2024-04-15T20:40:51.393 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T20:40:51.393 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306 --owner scheduled_teuthology@teuthology --verbose -- /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/orig.config.yaml 2024-04-15T20:40:51.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:40:51.523 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306 branch: main description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7657306' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 3f7db60e5ba4c4d053b594b7ec58703d2833c55b owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8042 sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 sleep_before_teardown: 0 subset: 25/64 suite: orch suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 3f7db60e5ba4c4d053b594b7ec58703d2833c55b targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6Hz/i97QUFumPxqikZ7dlk2dpRqoQgKvorGZQJHpuz47+p2nRTz500YphP2Rv4HQE3dZ6SgEHH+wMIL5OKrA4= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEkPXIFBn/nQd4yinAwGDZ8AxAGWxd9VHtmEqxVsJF5LOugu4wjMmSEpsvMR3IoHSExS97yv+iAX7F6gygp4+y8= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_main/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-15_20:08:15 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-15T20:40:51.523 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa; will attempt to use it 2024-04-15T20:40:51.524 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks 2024-04-15T20:40:51.524 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-15T20:40:51.525 INFO:teuthology.task.internal:Checking packages... 2024-04-15T20:40:51.549 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '87dbfb632e974cb2c28d17423071d2d833b53b29' 2024-04-15T20:40:51.549 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-15T20:40:51.549 INFO:teuthology.packaging:ref: None 2024-04-15T20:40:51.549 INFO:teuthology.packaging:tag: None 2024-04-15T20:40:51.549 INFO:teuthology.packaging:branch: main 2024-04-15T20:40:51.549 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:40:51.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-15T20:40:51.884 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3084.g87dbfb63 2024-04-15T20:40:51.885 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-15T20:40:51.893 INFO:teuthology.task.internal:no buildpackages task found 2024-04-15T20:40:51.893 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-15T20:40:51.937 INFO:teuthology.task.internal:Saving configuration 2024-04-15T20:40:51.956 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-15T20:40:51.961 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T20:40:51.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 20:35:08.029002', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6Hz/i97QUFumPxqikZ7dlk2dpRqoQgKvorGZQJHpuz47+p2nRTz500YphP2Rv4HQE3dZ6SgEHH+wMIL5OKrA4='} 2024-04-15T20:40:52.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 20:35:08.030578', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEkPXIFBn/nQd4yinAwGDZ8AxAGWxd9VHtmEqxVsJF5LOugu4wjMmSEpsvMR3IoHSExS97yv+iAX7F6gygp4+y8='} 2024-04-15T20:40:52.001 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-15T20:40:52.008 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-15T20:40:52.008 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-15T20:40:52.008 INFO:teuthology.run_tasks:Running task console_log... 2024-04-15T20:40:52.108 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae856970d0>, signals=[15]) 2024-04-15T20:40:52.108 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-15T20:40:52.114 INFO:teuthology.task.internal:Opening connections... 2024-04-15T20:40:52.115 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:40:52.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:40:52.222 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-04-15T20:40:52.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:40:52.311 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-15T20:40:52.318 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-15T20:40:52.336 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-15T20:40:52.336 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-15T20:40:52.392 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:40:52.393 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:40:52.394 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:40:52.394 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:40:52.394 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-15T20:40:52.410 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-04-15T20:40:52.426 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-04-15T20:40:52.426 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:40:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:40:52.483 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:40:52.483 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-04-15T20:40:52.510 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-15T20:40:52.520 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-15T20:40:52.546 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-15T20:40:52.546 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-15T20:40:52.548 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-04-15T20:40:52.562 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-15T20:40:52.570 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-15T20:40:52.570 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-15T20:40:52.605 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-04-15T20:40:52.697 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-15T20:40:52.742 INFO:teuthology.run_tasks:Running task kernel... 2024-04-15T20:40:52.757 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-15T20:40:52.757 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-15T20:40:52.757 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T20:40:52.758 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T20:40:52.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:40:52.773 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-04-15T20:40:52.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:40:52.774 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-15T20:40:52.828 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-361.el9.x86_64 2024-04-15T20:40:52.829 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-361.el9.x86_64 2024-04-15T20:40:52.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-04-15T20:40:52.830 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-361.el9.x86_64 2024-04-15T20:40:52.830 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.14.0-361.el9.x86_64 2024-04-15T20:40:52.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2024-04-15T20:40:54.843 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-04-15T20:40:55.920 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-15T20:40:56.452 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-04-15T20:40:57.323 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-04-15T20:40:57.559 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-15T20:40:59.602 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-15T20:41:00.481 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-04-15T20:41:03.761 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.2 MB 00:00 2024-04-15T20:41:05.462 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-15T20:41:09.623 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 21 MB 00:04 2024-04-15T20:41:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-04-15T20:41:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T20:41:16.969 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T20:41:17.056 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:41:17.064 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:41:17.065 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-04-15T20:41:17.065 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:41:17.065 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 77 M 2024-04-15T20:41:17.065 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 123 M 2024-04-15T20:41:17.065 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:41:17.222 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.7 MB/s | 277 kB 00:00 2024-04-15T20:41:17.713 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 23 MB/s | 15 MB 00:00 2024-04-15T20:41:18.364 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 24 MB/s | 28 MB 00:01 2024-04-15T20:41:18.664 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 21 MB/s | 34 MB 00:01 2024-04-15T20:41:18.667 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:41:18.668 INFO:teuthology.orchestra.run.smithi149.stdout:Total 48 MB/s | 77 MB 00:01 2024-04-15T20:41:18.668 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:41:18.932 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-04-15T20:41:19.054 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:41:19.055 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:41:19.918 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:41:19.918 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:41:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:41:22.823 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T20:41:22.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:41:23.629 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.2 MB 00:01 2024-04-15T20:41:25.204 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-04-15T20:41:25.683 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:41:25.831 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:41:27.126 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-15T20:41:30.537 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:41:30.591 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:41:32.132 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-15T20:41:34.583 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T20:41:34.584 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T20:41:34.685 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T20:41:34.700 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout:Install 4 Packages 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 77 M 2024-04-15T20:41:34.701 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 123 M 2024-04-15T20:41:34.702 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:41:35.020 INFO:teuthology.orchestra.run.smithi072.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 871 kB/s | 277 kB 00:00 2024-04-15T20:41:35.329 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:41:36.862 INFO:teuthology.orchestra.run.smithi072.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 7.0 MB/s | 15 MB 00:02 2024-04-15T20:41:38.337 INFO:teuthology.orchestra.run.smithi072.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 9.3 MB/s | 34 MB 00:03 2024-04-15T20:41:38.763 INFO:teuthology.orchestra.run.smithi072.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 7.4 MB/s | 28 MB 00:03 2024-04-15T20:41:38.766 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:41:38.766 INFO:teuthology.orchestra.run.smithi072.stdout:Total 19 MB/s | 77 MB 00:04 2024-04-15T20:41:38.766 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:41:39.169 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:41:39.170 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:41:40.005 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:41:40.005 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:41:42.297 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:41:42.955 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T20:41:43.060 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:41:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:41:45.970 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:41:50.669 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:41:50.716 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:41:55.410 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:04.613 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:04.613 INFO:teuthology.orchestra.run.smithi149.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T20:42:04.613 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:42:04.657 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T20:42:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:42:05.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:42:05.467 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:42:05.468 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:42:05.811 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T20:42:05.913 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T20:42:05.913 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T20:42:05.913 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T20:42:05.913 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T20:42:05.913 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-04-15T20:42:05.914 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T20:42:05.914 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T20:42:05.996 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:05.997 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T20:42:05.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-04-15T20:42:06.037 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 68.el9 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8264254 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-04-15T20:42:06.038 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:42:06.039 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T20:42:06.040 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T20:42:06.040 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-438.el9.x86_64 2024-04-15T20:42:06.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T20:42:06.616 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-04-15T20:42:08.044 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T20:42:08.079 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-04-15T20:42:08.087 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-04-15T20:42:08.104 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.2u1YKHz024 2024-04-15T20:42:08.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2u1YKHz024 2024-04-15T20:42:08.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.2u1YKHz024 2024-04-15T20:42:08.313 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.2u1YKHz024 is 6KB 2024-04-15T20:42:08.363 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.2u1YKHz024 2024-04-15T20:42:08.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T20:42:08.464 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T20:42:08.465 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T20:42:08.465 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T20:42:08.465 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T20:42:08.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T20:42:08.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-04-15T20:42:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:26.905 INFO:teuthology.orchestra.run.smithi072.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T20:42:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:42:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:27.378 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:27.378 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T20:42:27.378 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T20:42:27.378 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T20:42:27.801 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T20:42:27.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:42:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:42:27.802 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:42:28.259 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T20:42:28.364 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:28.364 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T20:42:28.364 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T20:42:28.364 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T20:42:28.364 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T20:42:28.364 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-04-15T20:42:28.364 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T20:42:28.365 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T20:42:28.443 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T20:42:28.444 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T20:42:28.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-04-15T20:42:28.476 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2024-04-15T20:42:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:42:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T20:42:28.482 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T20:42:28.482 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 5.14.0-438.el9.x86_64 2024-04-15T20:42:28.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T20:42:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-15T20:42:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T20:42:30.668 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-15T20:42:30.670 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-15T20:42:30.730 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.iayl1NarFD 2024-04-15T20:42:30.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iayl1NarFD 2024-04-15T20:42:30.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.iayl1NarFD 2024-04-15T20:42:30.949 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.iayl1NarFD is 6KB 2024-04-15T20:42:30.998 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.iayl1NarFD 2024-04-15T20:42:31.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T20:42:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T20:42:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T20:42:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T20:42:31.078 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T20:42:31.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T20:42:31.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-15T20:42:38.590 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-15T20:42:38.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:42:38.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:42:56.927 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-04-15T20:43:01.236 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-15T20:43:01.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:43:01.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:43:05.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:43:05.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:43:08.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-04-15T20:43:19.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-15T20:43:20.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:43:20.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:43:28.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:43:28.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:43:39.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-04-15T20:43:54.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:43:54.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:43:54.891 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-04-15T20:43:55.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:43:55.353 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-438.el9.x86_64"... 2024-04-15T20:43:55.353 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-04-15T20:43:55.368 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-438.el9.x86_64 2024-04-15T20:43:55.368 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T20:43:55.368 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T20:43:55.368 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T20:43:56.369 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-15T20:43:56.369 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T20:43:56.454 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-04-15T20:43:56.497 DEBUG:teuthology.parallel:result is None 2024-04-15T20:44:28.721 DEBUG:teuthology.orchestra.remote:timed out 2024-04-15T20:44:40.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:44:40.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:44:41.114 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-15T20:44:41.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:44:41.568 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-438.el9.x86_64"... 2024-04-15T20:44:41.568 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-15T20:44:41.584 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-438.el9.x86_64 2024-04-15T20:44:41.584 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T20:44:41.584 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T20:44:41.585 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T20:44:42.585 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-15T20:44:42.585 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T20:44:42.668 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-15T20:44:42.699 DEBUG:teuthology.parallel:result is None 2024-04-15T20:44:42.699 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-15T20:44:42.706 INFO:teuthology.task.internal:Creating test directory... 2024-04-15T20:44:42.706 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T20:44:42.709 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T20:44:42.729 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-15T20:44:42.745 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-15T20:44:42.778 INFO:teuthology.task.internal:Creating archive directory... 2024-04-15T20:44:42.778 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T20:44:42.781 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T20:44:42.846 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-15T20:44:42.853 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-15T20:44:42.853 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T20:44:42.855 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T20:44:42.889 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T20:44:42.899 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T20:44:42.904 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T20:44:42.914 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T20:44:42.916 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-15T20:44:42.922 INFO:teuthology.task.internal:Configuring sudo... 2024-04-15T20:44:42.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T20:44:42.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T20:44:42.980 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-15T20:44:42.995 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-15T20:44:42.996 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T20:44:43.018 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T20:44:43.036 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T20:44:43.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T20:44:43.167 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T20:44:43.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T20:44:43.293 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:44:43.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T20:44:43.360 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T20:44:43.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T20:44:43.458 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T20:44:43.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T20:44:43.586 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:44:43.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T20:44:43.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-15T20:44:43.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-04-15T20:44:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T20:44:43.794 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T20:44:44.229 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-15T20:44:44.237 INFO:teuthology.task.internal:Starting timer... 2024-04-15T20:44:44.237 INFO:teuthology.run_tasks:Running task pcp... 2024-04-15T20:44:44.291 INFO:teuthology.run_tasks:Running task selinux... 2024-04-15T20:44:44.322 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-15T20:44:44.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-04-15T20:44:44.389 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-04-15T20:44:44.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-04-15T20:44:44.452 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-04-15T20:44:44.453 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-15T20:44:44.454 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-04-15T20:44:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-04-15T20:44:44.475 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-04-15T20:44:44.511 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-04-15T20:44:44.511 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-04-15T20:44:44.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T20:44:44.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:44:44.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T20:44:44.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:44:44.581 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-15T20:44:44.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-04-15T20:44:44.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-04-15T20:44:44.654 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-15T20:44:44.663 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-15T20:44:44.669 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-15T20:44:44.811 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-15T20:44:44.826 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-15T20:44:44.827 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-15T20:49:00.273 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-04-15T20:49:00.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:49:00.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:49:00.368 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-15T20:49:00.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-15T20:49:00.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:49:00.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:49:00.535 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-04-15T20:49:00.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-04-15T20:49:00.613 INFO:teuthology.run_tasks:Running task clock... 2024-04-15T20:49:00.624 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-15T20:49:00.625 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T20:49:00.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T20:49:00.628 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T20:49:00.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T20:49:00.659 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T20:49:00.678 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T20:49:00.685 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T20:49:00.703 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T20:49:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-04-15T20:49:00.723 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-04-15T20:49:00.734 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-04-15T20:49:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T20:49:00.748 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-04-15T20:49:00.758 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T20:49:00.765 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T20:49:00.783 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T20:49:00.812 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.847 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-04-15T20:49:00.850 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T20:49:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-04-15T20:49:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T20:49:00.851 INFO:teuthology.run_tasks:Running task install... 2024-04-15T20:49:00.862 DEBUG:teuthology.task.install:project ceph 2024-04-15T20:49:00.862 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29'}} 2024-04-15T20:49:00.862 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29'} 2024-04-15T20:49:00.862 INFO:teuthology.task.install:Using flavor: default 2024-04-15T20:49:00.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-15T20:49:00.868 INFO:teuthology.task.install:extra packages: [] 2024-04-15T20:49:00.868 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-04-15T20:49:00.869 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:49:00.869 INFO:teuthology.packaging:ref: None 2024-04-15T20:49:00.869 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:49:00.869 INFO:teuthology.packaging:branch: None 2024-04-15T20:49:00.869 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:49:03.014 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-15T20:49:03.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-15T20:49:03.018 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-04-15T20:49:03.018 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:49:03.018 INFO:teuthology.packaging:ref: None 2024-04-15T20:49:03.018 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:49:03.018 INFO:teuthology.packaging:branch: None 2024-04-15T20:49:03.018 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:49:03.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-15T20:49:03.273 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-04-15T20:49:03.273 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-04-15T20:49:03.278 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-04-15T20:49:03.279 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-04-15T20:49:03.327 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T20:49:03.328 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:49:03.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T20:49:03.335 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T20:49:03.335 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:49:03.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T20:49:03.363 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-15T20:49:03.363 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:49:03.363 INFO:teuthology.packaging:ref: None 2024-04-15T20:49:03.363 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:49:03.363 INFO:teuthology.packaging:branch: None 2024-04-15T20:49:03.363 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:49:03.363 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T20:49:03.370 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-15T20:49:03.370 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:49:03.370 INFO:teuthology.packaging:ref: None 2024-04-15T20:49:03.370 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:49:03.370 INFO:teuthology.packaging:branch: None 2024-04-15T20:49:03.370 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:49:03.370 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T20:49:03.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T20:49:03.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T20:49:03.521 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T20:49:03.526 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T20:49:03.549 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-04-15T20:49:03.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-04-15T20:49:03.555 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-04-15T20:49:03.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-04-15T20:49:03.795 INFO:teuthology.orchestra.run.smithi072.stdout:74 files removed 2024-04-15T20:49:03.810 INFO:teuthology.orchestra.run.smithi149.stdout:74 files removed 2024-04-15T20:49:03.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw 2024-04-15T20:49:03.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2024-04-15T20:49:04.265 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 551 kB/s | 76 kB 00:00 2024-04-15T20:49:04.283 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 578 kB/s | 76 kB 00:00 2024-04-15T20:49:04.438 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 73 kB/s | 9.3 kB 00:00 2024-04-15T20:49:04.450 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 78 kB/s | 9.3 kB 00:00 2024-04-15T20:49:04.608 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 17 kB/s | 2.2 kB 00:00 2024-04-15T20:49:04.651 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-04-15T20:49:05.412 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.7 MB 00:00 2024-04-15T20:49:05.453 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.7 MB 00:00 2024-04-15T20:49:07.054 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-04-15T20:49:07.712 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 1.7 MB/s | 2.0 MB 00:01 2024-04-15T20:49:08.104 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-15T20:49:08.586 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-15T20:49:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-15T20:49:10.370 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-15T20:49:14.463 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-04-15T20:49:14.496 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-15T20:49:16.348 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-15T20:49:17.162 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-15T20:49:17.901 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-15T20:49:19.986 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-04-15T20:49:22.990 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-04-15T20:49:24.976 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-15T20:49:25.744 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-04-15T20:49:25.752 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T20:49:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:Install 28 Packages 2024-04-15T20:49:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-04-15T20:49:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:25.755 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 53 M 2024-04-15T20:49:25.755 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:49:26.108 INFO:teuthology.orchestra.run.smithi149.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 30 MB/s | 5.2 MB 00:00 2024-04-15T20:49:26.125 INFO:teuthology.orchestra.run.smithi149.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-04-15T20:49:26.167 INFO:teuthology.orchestra.run.smithi149.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-04-15T20:49:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-04-15T20:49:26.326 INFO:teuthology.orchestra.run.smithi149.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 20 MB/s | 7.6 MB 00:00 2024-04-15T20:49:26.342 INFO:teuthology.orchestra.run.smithi149.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 2.7 MB/s | 45 kB 00:00 2024-04-15T20:49:26.401 INFO:teuthology.orchestra.run.smithi149.stdout:(7/30): librgw2-18.2.0-0.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-15T20:49:26.426 INFO:teuthology.orchestra.run.smithi149.stdout:(8/30): python3-ceph-common-18.2.0-0.el9.x86_64 1.4 MB/s | 119 kB 00:00 2024-04-15T20:49:26.443 INFO:teuthology.orchestra.run.smithi149.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 3.6 MB/s | 155 kB 00:00 2024-04-15T20:49:26.477 INFO:teuthology.orchestra.run.smithi149.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-04-15T20:49:26.502 INFO:teuthology.orchestra.run.smithi149.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.0 MB/s | 297 kB 00:00 2024-04-15T20:49:26.528 INFO:teuthology.orchestra.run.smithi149.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-15T20:49:26.778 INFO:teuthology.orchestra.run.smithi149.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-04-15T20:49:26.811 INFO:teuthology.orchestra.run.smithi149.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 342 kB/s | 106 kB 00:00 2024-04-15T20:49:26.836 INFO:teuthology.orchestra.run.smithi149.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 44 kB 00:00 2024-04-15T20:49:26.870 INFO:teuthology.orchestra.run.smithi149.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 498 kB/s | 159 kB 00:00 2024-04-15T20:49:26.921 INFO:teuthology.orchestra.run.smithi149.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 661 kB 00:00 2024-04-15T20:49:26.946 INFO:teuthology.orchestra.run.smithi149.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2024-04-15T20:49:26.971 INFO:teuthology.orchestra.run.smithi149.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 411 kB/s | 41 kB 00:00 2024-04-15T20:49:27.404 INFO:teuthology.orchestra.run.smithi149.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 229 kB/s | 111 kB 00:00 2024-04-15T20:49:27.546 INFO:teuthology.orchestra.run.smithi149.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2024-04-15T20:49:27.572 INFO:teuthology.orchestra.run.smithi149.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 514 kB/s | 309 kB 00:00 2024-04-15T20:49:27.672 INFO:teuthology.orchestra.run.smithi149.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-04-15T20:49:27.697 INFO:teuthology.orchestra.run.smithi149.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-04-15T20:49:27.779 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:49:27.798 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:27.798 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:49:27.798 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:27.798 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:49:27.798 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T20:49:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T20:49:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Install 28 Packages 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 2 Packages 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 53 M 2024-04-15T20:49:27.801 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:49:27.922 INFO:teuthology.orchestra.run.smithi149.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 852 kB/s | 192 kB 00:00 2024-04-15T20:49:28.161 INFO:teuthology.orchestra.run.smithi072.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 24 MB/s | 5.2 MB 00:00 2024-04-15T20:49:28.187 INFO:teuthology.orchestra.run.smithi072.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 953 kB/s | 24 kB 00:00 2024-04-15T20:49:28.229 INFO:teuthology.orchestra.run.smithi072.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-04-15T20:49:28.271 INFO:teuthology.orchestra.run.smithi072.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-04-15T20:49:28.414 INFO:teuthology.orchestra.run.smithi149.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.1 MB/s | 838 kB 00:00 2024-04-15T20:49:28.430 INFO:teuthology.orchestra.run.smithi072.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 16 MB/s | 7.6 MB 00:00 2024-04-15T20:49:28.456 INFO:teuthology.orchestra.run.smithi072.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.7 MB/s | 45 kB 00:00 2024-04-15T20:49:28.474 INFO:teuthology.orchestra.run.smithi072.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 6.3 MB/s | 119 kB 00:00 2024-04-15T20:49:28.490 INFO:teuthology.orchestra.run.smithi149.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-04-15T20:49:28.500 INFO:teuthology.orchestra.run.smithi072.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.0 MB/s | 155 kB 00:00 2024-04-15T20:49:28.534 INFO:teuthology.orchestra.run.smithi072.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 9.3 MB/s | 321 kB 00:00 2024-04-15T20:49:28.557 INFO:teuthology.orchestra.run.smithi149.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-04-15T20:49:28.568 INFO:teuthology.orchestra.run.smithi072.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 8.7 MB/s | 297 kB 00:00 2024-04-15T20:49:28.593 INFO:teuthology.orchestra.run.smithi072.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-04-15T20:49:28.598 INFO:teuthology.orchestra.run.smithi149.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-04-15T20:49:28.685 INFO:teuthology.orchestra.run.smithi072.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-15T20:49:28.907 INFO:teuthology.orchestra.run.smithi149.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-04-15T20:49:28.911 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:49:28.911 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 53 MB 00:03 2024-04-15T20:49:28.912 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:49:28.947 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:49:28.947 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:49:29.053 INFO:teuthology.orchestra.run.smithi072.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 16 MB/s | 18 MB 00:01 2024-04-15T20:49:29.078 INFO:teuthology.orchestra.run.smithi072.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 218 kB/s | 106 kB 00:00 2024-04-15T20:49:29.104 INFO:teuthology.orchestra.run.smithi072.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-04-15T20:49:29.129 INFO:teuthology.orchestra.run.smithi072.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 379 kB/s | 159 kB 00:00 2024-04-15T20:49:29.171 INFO:teuthology.orchestra.run.smithi072.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 661 kB 00:00 2024-04-15T20:49:29.197 INFO:teuthology.orchestra.run.smithi072.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2024-04-15T20:49:29.222 INFO:teuthology.orchestra.run.smithi072.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 447 kB/s | 41 kB 00:00 2024-04-15T20:49:29.393 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:49:29.394 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:49:29.439 INFO:teuthology.orchestra.run.smithi072.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 415 kB/s | 111 kB 00:00 2024-04-15T20:49:29.490 INFO:teuthology.orchestra.run.smithi072.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 515 kB/s | 26 kB 00:00 2024-04-15T20:49:29.540 INFO:teuthology.orchestra.run.smithi072.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 972 kB/s | 309 kB 00:00 2024-04-15T20:49:29.568 INFO:teuthology.orchestra.run.smithi072.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 628 kB/s | 49 kB 00:00 2024-04-15T20:49:29.610 INFO:teuthology.orchestra.run.smithi072.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 977 kB/s | 67 kB 00:00 2024-04-15T20:49:29.702 INFO:teuthology.orchestra.run.smithi072.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-15T20:49:29.878 INFO:teuthology.orchestra.run.smithi072.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2024-04-15T20:49:29.979 INFO:teuthology.orchestra.run.smithi072.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 33 MB/s | 3.3 MB 00:00 2024-04-15T20:49:30.062 INFO:teuthology.orchestra.run.smithi072.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 36 MB/s | 3.0 MB 00:00 2024-04-15T20:49:30.312 INFO:teuthology.orchestra.run.smithi072.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-04-15T20:49:30.792 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:49:30.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-15T20:49:30.932 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-15T20:49:30.954 INFO:teuthology.orchestra.run.smithi072.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-04-15T20:49:30.962 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:49:30.962 INFO:teuthology.orchestra.run.smithi072.stdout:Total 17 MB/s | 53 MB 00:03 2024-04-15T20:49:30.962 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:49:30.988 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-15T20:49:30.998 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:49:30.998 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:49:31.296 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-15T20:49:31.344 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:31.419 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:31.435 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:49:31.485 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:49:31.500 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-04-15T20:49:31.537 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:31.583 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:31.612 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-15T20:49:31.658 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-04-15T20:49:31.729 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-04-15T20:49:31.756 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:31.805 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:31.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-15T20:49:31.955 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-15T20:49:31.996 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-15T20:49:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-15T20:49:32.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-15T20:49:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-15T20:49:32.132 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-15T20:49:32.431 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-15T20:49:32.462 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-04-15T20:49:32.535 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-04-15T20:49:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-04-15T20:49:32.612 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-15T20:49:32.924 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:49:33.006 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-15T20:49:33.018 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-15T20:49:33.030 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-04-15T20:49:33.053 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-15T20:49:33.085 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-04-15T20:49:33.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-15T20:49:33.169 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-04-15T20:49:33.200 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-04-15T20:49:33.431 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-15T20:49:33.564 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:33.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-04-15T20:49:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:33.829 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:33.867 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-15T20:49:33.916 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-04-15T20:49:33.978 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-04-15T20:49:34.006 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:34.078 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:34.187 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-15T20:49:34.223 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-15T20:49:34.263 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-15T20:49:34.289 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-15T20:49:34.318 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-15T20:49:34.346 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-15T20:49:34.379 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-15T20:49:34.678 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-15T20:49:34.711 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-04-15T20:49:34.801 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-04-15T20:49:34.833 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-04-15T20:49:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-15T20:49:35.264 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-15T20:49:35.292 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-04-15T20:49:35.324 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:35.367 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-04-15T20:49:35.440 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-04-15T20:49:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-04-15T20:49:35.934 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:35.974 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-04-15T20:49:36.063 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-04-15T20:49:36.063 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T20:49:36.063 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T20:49:36.063 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:36.101 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-04-15T20:49:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-04-15T20:49:38.350 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-04-15T20:49:38.351 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T20:49:38.351 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T20:49:38.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:38.386 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:45.834 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:45.834 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-04-15T20:49:45.834 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-04-15T20:49:45.835 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:46.587 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-04-15T20:49:46.614 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-04-15T20:49:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:49:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T20:49:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T20:49:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T20:49:46.615 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:46.617 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-15T20:49:46.690 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-15T20:49:46.690 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-04-15T20:49:47.756 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-15T20:49:47.757 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-15T20:49:47.758 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.790 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T20:49:48.791 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:48.792 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:49:49.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2024-04-15T20:49:49.407 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:49.407 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-04-15T20:49:49.407 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-04-15T20:49:49.407 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-04-15T20:49:49.408 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-04-15T20:49:49.408 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-04-15T20:49:49.408 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-04-15T20:49:49.408 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-04-15T20:49:49.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:49.655 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:27 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:49:49.819 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T20:49:49.820 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 40 M 2024-04-15T20:49:49.821 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 167 M 2024-04-15T20:49:49.822 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:49:50.060 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 161 kB 00:00 2024-04-15T20:49:50.145 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-04-15T20:49:50.152 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 974 kB/s | 217 kB 00:00 2024-04-15T20:49:50.170 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-04-15T20:49:50.170 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:49:50.171 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T20:49:50.171 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T20:49:50.171 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T20:49:50.171 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:50.172 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-15T20:49:50.177 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 300 kB 00:00 2024-04-15T20:49:50.211 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-04-15T20:49:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-15T20:49:50.257 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:50.628 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): ceph-test-18.2.0-0.el9.x86_64.rpm 57 MB/s | 40 MB 00:00 2024-04-15T20:49:50.762 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): jq-1.6-16.el9.x86_64.rpm 320 kB/s | 187 kB 00:00 2024-04-15T20:49:50.765 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:49:50.765 INFO:teuthology.orchestra.run.smithi149.stdout:Total 43 MB/s | 40 MB 00:00 2024-04-15T20:49:50.780 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:49:50.801 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:49:50.801 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:49:51.149 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:49:51.150 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:49:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-04-15T20:49:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-04-15T20:49:51.554 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-15T20:49:51.555 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-15T20:49:51.556 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-04-15T20:49:51.682 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:49:51.763 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-15T20:49:51.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-15T20:49:51.846 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T20:49:51.887 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-15T20:49:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-04-15T20:49:52.613 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T20:49:52.614 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T20:49:52.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:52.616 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:49:53.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-test 2024-04-15T20:49:53.602 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:29 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:49:53.760 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:49:53.760 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:53.760 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:49:53.760 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout:Install 6 Packages 2024-04-15T20:49:53.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:49:53.762 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 40 M 2024-04-15T20:49:53.762 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 167 M 2024-04-15T20:49:53.762 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:49:53.997 INFO:teuthology.orchestra.run.smithi072.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-04-15T20:49:54.064 INFO:teuthology.orchestra.run.smithi072.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-04-15T20:49:54.098 INFO:teuthology.orchestra.run.smithi072.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.9 MB/s | 300 kB 00:00 2024-04-15T20:49:54.124 INFO:teuthology.orchestra.run.smithi072.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-04-15T20:49:54.808 INFO:teuthology.orchestra.run.smithi072.stdout:(5/6): ceph-test-18.2.0-0.el9.x86_64.rpm 43 MB/s | 40 MB 00:00 2024-04-15T20:49:54.835 INFO:teuthology.orchestra.run.smithi072.stdout:(6/6): jq-1.6-16.el9.x86_64.rpm 255 kB/s | 187 kB 00:00 2024-04-15T20:49:54.836 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:49:54.837 INFO:teuthology.orchestra.run.smithi072.stdout:Total 38 MB/s | 40 MB 00:01 2024-04-15T20:49:54.851 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:49:54.871 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:49:54.871 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:49:55.202 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:49:55.202 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:49:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-04-15T20:49:55.722 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:49:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-04-15T20:49:55.810 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-15T20:49:55.859 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-15T20:49:55.894 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T20:49:55.937 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-15T20:49:55.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-15T20:49:57.797 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:58.169 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:49:58.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2024-04-15T20:49:59.037 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:37 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:49:59.196 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:49:59.198 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:59.198 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:49:59.198 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T20:49:59.199 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T20:49:59.200 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout:Install 33 Packages 2024-04-15T20:49:59.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:49:59.202 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 M 2024-04-15T20:49:59.202 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 109 M 2024-04-15T20:49:59.202 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:49:59.671 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-04-15T20:49:59.724 INFO:teuthology.orchestra.run.smithi149.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 63 kB/s | 6.4 kB 00:00 2024-04-15T20:49:59.771 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-04-15T20:49:59.782 INFO:teuthology.orchestra.run.smithi149.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-04-15T20:49:59.824 INFO:teuthology.orchestra.run.smithi149.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-04-15T20:49:59.849 INFO:teuthology.orchestra.run.smithi149.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-04-15T20:49:59.941 INFO:teuthology.orchestra.run.smithi149.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-15T20:50:00.067 INFO:teuthology.orchestra.run.smithi149.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 313 kB/s | 32 kB 00:00 2024-04-15T20:50:00.092 INFO:teuthology.orchestra.run.smithi149.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 595 kB/s | 144 kB 00:00 2024-04-15T20:50:00.142 INFO:teuthology.orchestra.run.smithi149.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 630 kB/s | 47 kB 00:00 2024-04-15T20:50:00.168 INFO:teuthology.orchestra.run.smithi149.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 514 kB/s | 39 kB 00:00 2024-04-15T20:50:00.355 INFO:teuthology.orchestra.run.smithi149.stdout:(10/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 31 MB/s | 18 MB 00:00 2024-04-15T20:50:00.376 INFO:teuthology.orchestra.run.smithi149.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 241 kB 00:00 2024-04-15T20:50:00.560 INFO:teuthology.orchestra.run.smithi149.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.1 MB 00:00 2024-04-15T20:50:00.577 INFO:teuthology.orchestra.run.smithi149.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 458 kB/s | 103 kB 00:00 2024-04-15T20:50:00.594 INFO:teuthology.orchestra.run.smithi149.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 570 kB/s | 124 kB 00:00 2024-04-15T20:50:00.636 INFO:teuthology.orchestra.run.smithi149.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-04-15T20:50:00.870 INFO:teuthology.orchestra.run.smithi149.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 428 kB/s | 125 kB 00:00 2024-04-15T20:50:00.903 INFO:teuthology.orchestra.run.smithi149.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 141 kB/s | 43 kB 00:00 2024-04-15T20:50:00.996 INFO:teuthology.orchestra.run.smithi149.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-04-15T20:50:01.054 INFO:teuthology.orchestra.run.smithi149.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 411 kB/s | 172 kB 00:00 2024-04-15T20:50:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-04-15T20:50:01.113 INFO:teuthology.orchestra.run.smithi149.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 394 kB/s | 23 kB 00:00 2024-04-15T20:50:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-04-15T20:50:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-04-15T20:50:01.205 INFO:teuthology.orchestra.run.smithi149.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 693 kB/s | 46 kB 00:00 2024-04-15T20:50:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-04-15T20:50:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 778 kB/s | 358 kB 00:00 2024-04-15T20:50:01.356 INFO:teuthology.orchestra.run.smithi149.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-04-15T20:50:01.448 INFO:teuthology.orchestra.run.smithi149.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-04-15T20:50:01.473 INFO:teuthology.orchestra.run.smithi149.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 632 kB/s | 90 kB 00:00 2024-04-15T20:50:01.490 INFO:teuthology.orchestra.run.smithi149.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 267 kB/s | 36 kB 00:00 2024-04-15T20:50:01.557 INFO:teuthology.orchestra.run.smithi149.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2024-04-15T20:50:01.632 INFO:teuthology.orchestra.run.smithi149.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-04-15T20:50:01.733 INFO:teuthology.orchestra.run.smithi149.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-04-15T20:50:01.739 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:01.739 INFO:teuthology.orchestra.run.smithi149.stdout:Total 12 MB/s | 30 MB 00:02 2024-04-15T20:50:01.754 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:01.794 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:01.794 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:02.166 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:02.168 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:03.056 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-04-15T20:50:03.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-04-15T20:50:03.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-04-15T20:50:03.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T20:50:03.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-15T20:50:03.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-15T20:50:03.382 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:03.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-15T20:50:03.459 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-15T20:50:03.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:03.459 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:03.460 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-04-15T20:50:03.460 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T20:50:03.460 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T20:50:03.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:03.460 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:03.467 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-15T20:50:03.500 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-15T20:50:03.591 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-15T20:50:03.670 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-15T20:50:03.719 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-15T20:50:03.799 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-15T20:50:03.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph 2024-04-15T20:50:03.853 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-04-15T20:50:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-04-15T20:50:03.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-04-15T20:50:04.014 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-04-15T20:50:04.202 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-04-15T20:50:04.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-04-15T20:50:04.285 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-04-15T20:50:04.320 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-04-15T20:50:04.358 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-15T20:50:04.404 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:40 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:04.433 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-04-15T20:50:04.468 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-15T20:50:04.502 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-04-15T20:50:04.533 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-04-15T20:50:04.563 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:04.565 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T20:50:04.566 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T20:50:04.567 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:04.568 INFO:teuthology.orchestra.run.smithi072.stdout:Install 33 Packages 2024-04-15T20:50:04.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:04.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-04-15T20:50:04.569 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 30 M 2024-04-15T20:50:04.570 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 109 M 2024-04-15T20:50:04.570 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:04.603 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-04-15T20:50:04.694 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-04-15T20:50:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-04-15T20:50:04.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-04-15T20:50:04.887 INFO:teuthology.orchestra.run.smithi072.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 67 kB/s | 6.4 kB 00:00 2024-04-15T20:50:04.938 INFO:teuthology.orchestra.run.smithi072.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 9.8 MB/s | 1.4 MB 00:00 2024-04-15T20:50:04.943 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-04-15T20:50:04.997 INFO:teuthology.orchestra.run.smithi072.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-04-15T20:50:05.030 INFO:teuthology.orchestra.run.smithi072.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.1 MB/s | 240 kB 00:00 2024-04-15T20:50:05.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-15T20:50:05.156 INFO:teuthology.orchestra.run.smithi072.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-15T20:50:05.232 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-04-15T20:50:05.232 INFO:teuthology.orchestra.run.smithi072.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 718 kB/s | 144 kB 00:00 2024-04-15T20:50:05.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-04-15T20:50:05.257 INFO:teuthology.orchestra.run.smithi072.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 317 kB/s | 32 kB 00:00 2024-04-15T20:50:05.283 INFO:teuthology.orchestra.run.smithi072.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 935 kB/s | 47 kB 00:00 2024-04-15T20:50:05.295 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-04-15T20:50:05.295 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:05.295 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T20:50:05.295 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T20:50:05.296 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T20:50:05.296 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:05.308 INFO:teuthology.orchestra.run.smithi072.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 762 kB/s | 39 kB 00:00 2024-04-15T20:50:05.334 INFO:teuthology.orchestra.run.smithi072.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.6 MB/s | 241 kB 00:00 2024-04-15T20:50:05.643 INFO:teuthology.orchestra.run.smithi072.stdout:(11/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 25 MB/s | 18 MB 00:00 2024-04-15T20:50:05.685 INFO:teuthology.orchestra.run.smithi072.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 3.0 MB/s | 1.1 MB 00:00 2024-04-15T20:50:05.704 INFO:teuthology.orchestra.run.smithi072.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 279 kB/s | 103 kB 00:00 2024-04-15T20:50:05.729 INFO:teuthology.orchestra.run.smithi072.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 1.4 MB/s | 124 kB 00:00 2024-04-15T20:50:05.755 INFO:teuthology.orchestra.run.smithi072.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-04-15T20:50:05.914 INFO:teuthology.orchestra.run.smithi072.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 597 kB/s | 125 kB 00:00 2024-04-15T20:50:06.006 INFO:teuthology.orchestra.run.smithi072.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 157 kB/s | 43 kB 00:00 2024-04-15T20:50:06.090 INFO:teuthology.orchestra.run.smithi072.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-04-15T20:50:06.132 INFO:teuthology.orchestra.run.smithi072.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 456 kB/s | 172 kB 00:00 2024-04-15T20:50:06.183 INFO:teuthology.orchestra.run.smithi072.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 191 kB/s | 18 kB 00:00 2024-04-15T20:50:06.216 INFO:teuthology.orchestra.run.smithi072.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 275 kB/s | 23 kB 00:00 2024-04-15T20:50:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-04-15T20:50:06.301 INFO:teuthology.orchestra.run.smithi072.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-04-15T20:50:06.343 INFO:teuthology.orchestra.run.smithi072.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 836 kB/s | 358 kB 00:00 2024-04-15T20:50:06.393 INFO:teuthology.orchestra.run.smithi072.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 393 kB/s | 46 kB 00:00 2024-04-15T20:50:06.419 INFO:teuthology.orchestra.run.smithi072.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 669 kB/s | 79 kB 00:00 2024-04-15T20:50:06.461 INFO:teuthology.orchestra.run.smithi072.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-15T20:50:06.487 INFO:teuthology.orchestra.run.smithi072.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 176 kB/s | 16 kB 00:00 2024-04-15T20:50:06.522 INFO:teuthology.orchestra.run.smithi072.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 875 kB/s | 90 kB 00:00 2024-04-15T20:50:06.548 INFO:teuthology.orchestra.run.smithi072.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 415 kB/s | 36 kB 00:00 2024-04-15T20:50:06.623 INFO:teuthology.orchestra.run.smithi072.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 266 kB/s | 20 kB 00:00 2024-04-15T20:50:06.698 INFO:teuthology.orchestra.run.smithi072.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-04-15T20:50:06.732 INFO:teuthology.orchestra.run.smithi072.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.0 MB/s | 427 kB 00:00 2024-04-15T20:50:06.735 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:06.736 INFO:teuthology.orchestra.run.smithi072.stdout:Total 14 MB/s | 30 MB 00:02 2024-04-15T20:50:06.751 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:06.792 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:06.792 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:06.866 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-04-15T20:50:06.897 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-04-15T20:50:06.898 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:06.898 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T20:50:06.898 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T20:50:06.898 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T20:50:06.898 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:07.161 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:07.161 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:07.342 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-04-15T20:50:07.366 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-04-15T20:50:07.366 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:07.366 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T20:50:07.367 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T20:50:07.367 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T20:50:07.367 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:07.575 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T20:50:07.600 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:07.665 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-04-15T20:50:08.433 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:08.494 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-15T20:50:08.526 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-15T20:50:08.568 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-15T20:50:08.660 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-15T20:50:08.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-15T20:50:08.791 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-15T20:50:08.872 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-15T20:50:08.926 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-04-15T20:50:08.973 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-04-15T20:50:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-04-15T20:50:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-04-15T20:50:09.296 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-04-15T20:50:09.350 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-04-15T20:50:09.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-04-15T20:50:09.424 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-04-15T20:50:09.454 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-15T20:50:09.455 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-15T20:50:09.456 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-15T20:50:09.456 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-15T20:50:09.457 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-15T20:50:09.534 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-04-15T20:50:09.576 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-15T20:50:09.610 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-04-15T20:50:09.651 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-04-15T20:50:09.695 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-04-15T20:50:09.730 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-04-15T20:50:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-04-15T20:50:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-04-15T20:50:09.945 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-04-15T20:50:10.090 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-04-15T20:50:10.218 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-15T20:50:10.369 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T20:50:10.370 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T20:50:10.371 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:10.372 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:10.383 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-04-15T20:50:10.417 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-04-15T20:50:10.443 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-04-15T20:50:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T20:50:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T20:50:10.444 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T20:50:10.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:10.746 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2024-04-15T20:50:11.348 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:49 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:11.448 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:11.501 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:11.502 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:11.502 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:11.569 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2024-04-15T20:50:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-04-15T20:50:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-04-15T20:50:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:12.044 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T20:50:12.044 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T20:50:12.044 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T20:50:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:12.159 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:50 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:12.312 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:12.313 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:12.314 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:12.314 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 209 k 2024-04-15T20:50:12.314 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 200 k 2024-04-15T20:50:12.314 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:12.391 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.6 MB/s | 209 kB 00:00 2024-04-15T20:50:12.392 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:12.392 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.6 MB/s | 209 kB 00:00 2024-04-15T20:50:12.392 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:12.397 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:12.397 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:12.400 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:12.400 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:12.472 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:12.491 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T20:50:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T20:50:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-04-15T20:50:12.919 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:12.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:13.661 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:13.661 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:13.661 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:13.661 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-04-15T20:50:13.661 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:13.662 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:13.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2024-04-15T20:50:14.483 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:52 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-04-15T20:50:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 142 k 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 399 k 2024-04-15T20:50:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:14.709 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-04-15T20:50:14.710 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:14.710 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-04-15T20:50:14.710 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:14.717 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:14.717 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:14.770 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:14.771 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:14.913 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:14.968 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:14.993 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:14.993 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:14.993 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T20:50:14.993 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:15.507 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-04-15T20:50:15.507 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-04-15T20:50:15.507 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-04-15T20:50:15.507 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-15T20:50:15.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-15T20:50:15.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-15T20:50:15.960 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:15.961 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:15.961 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:15.961 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:15.961 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:15.961 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:16.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2024-04-15T20:50:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T20:50:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T20:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:16.362 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:16.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-base 2024-04-15T20:50:16.820 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:54 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:16.932 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:16.988 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:16.989 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:16.989 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:17.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2024-04-15T20:50:17.333 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:53 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:17.432 INFO:teuthology.orchestra.run.smithi072.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:17.484 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:17.485 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:50:17.485 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:17.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install cephadm 2024-04-15T20:50:17.651 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:55 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:17.804 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:50:17.805 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout:Install 7 Packages 2024-04-15T20:50:17.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:17.807 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.0 M 2024-04-15T20:50:17.807 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 8.1 M 2024-04-15T20:50:17.807 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:18.128 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:54 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:18.278 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:18.279 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:18.279 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:18.279 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:18.279 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 209 k 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 200 k 2024-04-15T20:50:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:18.288 INFO:teuthology.orchestra.run.smithi149.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 188 kB/s | 23 kB 00:00 2024-04-15T20:50:18.314 INFO:teuthology.orchestra.run.smithi149.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 99 kB/s | 15 kB 00:00 2024-04-15T20:50:18.345 INFO:teuthology.orchestra.run.smithi072.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.1 MB/s | 209 kB 00:00 2024-04-15T20:50:18.346 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:18.346 INFO:teuthology.orchestra.run.smithi072.stdout:Total 3.1 MB/s | 209 kB 00:00 2024-04-15T20:50:18.346 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:18.351 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:18.352 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:18.354 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:18.354 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:18.364 INFO:teuthology.orchestra.run.smithi149.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.6 MB/s | 1.7 MB 00:00 2024-04-15T20:50:18.425 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:18.639 INFO:teuthology.orchestra.run.smithi149.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 26 kB/s | 9.0 kB 00:00 2024-04-15T20:50:18.698 INFO:teuthology.orchestra.run.smithi149.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 107 kB/s | 41 kB 00:00 2024-04-15T20:50:18.723 INFO:teuthology.orchestra.run.smithi149.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 98 kB/s | 31 kB 00:00 2024-04-15T20:50:18.815 INFO:teuthology.orchestra.run.smithi149.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.1 MB/s | 188 kB 00:00 2024-04-15T20:50:18.819 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:18.819 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-04-15T20:50:18.819 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:18.827 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:18.827 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:18.868 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:18.894 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:18.895 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:18.965 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:19.194 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:19.258 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-15T20:50:19.292 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-15T20:50:19.331 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:19.337 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-15T20:50:19.378 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-15T20:50:19.407 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:19.603 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:19.636 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-04-15T20:50:19.660 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-04-15T20:50:19.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-immutable-object-cache 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-15T20:50:20.240 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-15T20:50:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:56 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T20:50:20.535 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T20:50:20.536 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:20.536 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repo Size 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:20.569 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:50:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:20.569 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 142 k 2024-04-15T20:50:20.569 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 399 k 2024-04-15T20:50:20.569 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:20.638 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.0 MB/s | 142 kB 00:00 2024-04-15T20:50:20.638 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:20.639 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.0 MB/s | 142 kB 00:00 2024-04-15T20:50:20.639 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:20.646 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:20.646 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:20.698 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:20.698 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:20.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-15T20:50:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:20.898 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:20.923 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:20.923 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:20.923 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T20:50:20.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:21.343 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:59 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:21.496 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T20:50:21.498 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:21.499 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 37 M 2024-04-15T20:50:21.500 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 209 M 2024-04-15T20:50:21.500 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:21.869 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:21.869 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:21.972 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 216 kB/s | 32 kB 00:00 2024-04-15T20:50:22.072 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): ceph-mgr-diskprediction-local-18.2.0-0. 30 MB/s | 7.4 MB 00:00 2024-04-15T20:50:22.097 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 137 kB/s | 17 kB 00:00 2024-04-15T20:50:22.122 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2024-04-15T20:50:22.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr 2024-04-15T20:50:22.323 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2024-04-15T20:50:22.390 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2024-04-15T20:50:22.415 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-04-15T20:50:22.632 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.7 MB/s | 3.0 MB 00:00 2024-04-15T20:50:22.727 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:58 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:22.829 INFO:teuthology.orchestra.run.smithi072.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:22.832 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-15T20:50:22.881 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:22.882 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:50:22.882 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:22.925 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-04-15T20:50:22.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-dashboard 2024-04-15T20:50:23.016 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-04-15T20:50:23.041 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): libquadmath-11.4.1-3.el9.x86_64.rpm 480 kB/s | 195 kB 00:00 2024-04-15T20:50:23.043 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:23.044 INFO:teuthology.orchestra.run.smithi149.stdout:Total 24 MB/s | 37 MB 00:01 2024-04-15T20:50:23.086 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:23.110 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:23.524 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:59 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:23.546 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:23.546 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:23.676 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:23.676 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:23.676 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:50:23.676 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:23.677 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:23.678 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:23.678 INFO:teuthology.orchestra.run.smithi072.stdout:Install 7 Packages 2024-04-15T20:50:23.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:23.678 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 2.0 M 2024-04-15T20:50:23.678 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 8.1 M 2024-04-15T20:50:23.679 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:24.156 INFO:teuthology.orchestra.run.smithi072.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 209 kB/s | 23 kB 00:00 2024-04-15T20:50:24.182 INFO:teuthology.orchestra.run.smithi072.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 107 kB/s | 15 kB 00:00 2024-04-15T20:50:24.233 INFO:teuthology.orchestra.run.smithi072.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 9.0 MB/s | 1.7 MB 00:00 2024-04-15T20:50:24.244 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:24.305 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-15T20:50:24.317 INFO:teuthology.orchestra.run.smithi072.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 56 kB/s | 9.0 kB 00:00 2024-04-15T20:50:24.337 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-15T20:50:24.368 INFO:teuthology.orchestra.run.smithi072.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 229 kB/s | 31 kB 00:00 2024-04-15T20:50:24.394 INFO:teuthology.orchestra.run.smithi072.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 193 kB/s | 41 kB 00:00 2024-04-15T20:50:24.430 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-15T20:50:24.466 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-15T20:50:24.494 INFO:teuthology.orchestra.run.smithi072.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-04-15T20:50:24.495 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:24.496 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2024-04-15T20:50:24.496 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:24.503 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:24.503 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:24.566 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:24.566 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:24.644 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T20:50:24.672 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T20:50:24.749 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-15T20:50:24.852 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:24.912 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-15T20:50:24.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-15T20:50:25.001 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-15T20:50:25.043 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-15T20:50:25.080 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-04-15T20:50:25.308 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-04-15T20:50:25.344 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-04-15T20:50:25.427 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-15T20:50:25.544 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-15T20:50:26.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-15T20:50:26.318 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-15T20:50:26.318 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:26.318 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:26.318 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-04-15T20:50:26.318 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:26.319 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:26.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-15T20:50:26.787 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-15T20:50:27.148 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:03 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:27.301 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:27.302 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:50:27.302 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:27.302 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T20:50:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout:Install 12 Packages 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 37 M 2024-04-15T20:50:27.304 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 209 M 2024-04-15T20:50:27.305 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:27.617 INFO:teuthology.orchestra.run.smithi072.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 257 kB/s | 32 kB 00:00 2024-04-15T20:50:27.768 INFO:teuthology.orchestra.run.smithi072.stdout:(2/12): ceph-mgr-diskprediction-local-18.2.0-0. 27 MB/s | 7.4 MB 00:00 2024-04-15T20:50:27.795 INFO:teuthology.orchestra.run.smithi072.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 97 kB/s | 17 kB 00:00 2024-04-15T20:50:27.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-15T20:50:27.820 INFO:teuthology.orchestra.run.smithi072.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 659 kB/s | 34 kB 00:00 2024-04-15T20:50:27.839 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-04-15T20:50:28.037 INFO:teuthology.orchestra.run.smithi072.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-04-15T20:50:28.146 INFO:teuthology.orchestra.run.smithi072.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2024-04-15T20:50:28.180 INFO:teuthology.orchestra.run.smithi072.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 217 kB 00:00 2024-04-15T20:50:28.372 INFO:teuthology.orchestra.run.smithi072.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.4 MB/s | 3.0 MB 00:00 2024-04-15T20:50:29.040 INFO:teuthology.orchestra.run.smithi072.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-04-15T20:50:29.740 INFO:teuthology.orchestra.run.smithi072.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 516 kB/s | 803 kB 00:01 2024-04-15T20:50:30.358 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-04-15T20:50:30.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-15T20:50:30.359 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-15T20:50:30.440 INFO:teuthology.orchestra.run.smithi072.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 95 kB/s | 195 kB 00:02 2024-04-15T20:50:30.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T20:50:30.818 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:30.819 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:31.157 INFO:teuthology.orchestra.run.smithi072.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 116 kB/s | 245 kB 00:02 2024-04-15T20:50:31.160 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:31.161 INFO:teuthology.orchestra.run.smithi072.stdout:Total 9.6 MB/s | 37 MB 00:03 2024-04-15T20:50:31.206 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:31.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2024-04-15T20:50:31.231 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:31.231 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:31.682 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:31.683 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:31.822 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:09 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:31.979 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-04-15T20:50:31.980 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T20:50:31.981 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.0 M 2024-04-15T20:50:31.982 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2024-04-15T20:50:31.983 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:32.231 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 427 kB/s | 47 kB 00:00 2024-04-15T20:50:32.256 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 179 kB/s | 24 kB 00:00 2024-04-15T20:50:32.282 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 112 kB/s | 18 kB 00:00 2024-04-15T20:50:32.307 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-15T20:50:32.333 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T20:50:32.358 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 211 kB 00:00 2024-04-15T20:50:32.383 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 571 kB/s | 43 kB 00:00 2024-04-15T20:50:32.508 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 100 kB/s | 15 kB 00:00 2024-04-15T20:50:32.533 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 183 kB/s | 32 kB 00:00 2024-04-15T20:50:32.650 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 759 kB/s | 203 kB 00:00 2024-04-15T20:50:32.675 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 417 kB/s | 59 kB 00:00 2024-04-15T20:50:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 979 kB/s | 90 kB 00:00 2024-04-15T20:50:32.810 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.4 MB/s | 1.0 MB 00:00 2024-04-15T20:50:32.811 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:32.812 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.5 MB/s | 2.0 MB 00:00 2024-04-15T20:50:32.812 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:32.826 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:32.827 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:32.926 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:32.927 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:33.411 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:33.447 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-15T20:50:33.529 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-15T20:50:33.617 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-15T20:50:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-15T20:50:33.669 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-15T20:50:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-15T20:50:33.725 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-15T20:50:33.762 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-15T20:50:33.803 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-15T20:50:33.846 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T20:50:33.876 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T20:50:33.897 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-15T20:50:33.965 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-15T20:50:33.999 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-15T20:50:34.046 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-15T20:50:34.622 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-15T20:50:34.737 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-15T20:50:34.769 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-15T20:50:34.818 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-15T20:50:34.852 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-15T20:50:34.898 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-15T20:50:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-04-15T20:50:35.751 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-15T20:50:35.752 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-15T20:50:35.976 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-15T20:50:36.119 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-15T20:50:36.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:36.119 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T20:50:36.120 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:36.121 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:36.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2024-04-15T20:50:36.951 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:14 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-15T20:50:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-04-15T20:50:37.105 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T20:50:37.106 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:37.107 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 6.8 M 2024-04-15T20:50:37.108 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 33 M 2024-04-15T20:50:37.108 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:37.603 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.5 MB/s | 127 kB 00:00 2024-04-15T20:50:37.712 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.0 MB/s | 548 kB 00:00 2024-04-15T20:50:37.762 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.2 MB/s | 58 kB 00:00 2024-04-15T20:50:37.838 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-04-15T20:50:37.863 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 513 kB/s | 51 kB 00:00 2024-04-15T20:50:38.113 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 417 kB/s | 248 kB 00:00 2024-04-15T20:50:38.115 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:38.115 INFO:teuthology.orchestra.run.smithi149.stdout:Total 6.7 MB/s | 6.8 MB 00:01 2024-04-15T20:50:38.128 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:38.138 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:38.138 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:38.227 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:38.229 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:38.521 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:38.686 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-15T20:50:38.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-15T20:50:39.257 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-15T20:50:39.342 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-15T20:50:39.410 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-15T20:50:39.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-04-15T20:50:40.249 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-04-15T20:50:40.249 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-04-15T20:50:40.249 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-15T20:50:40.249 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-15T20:50:40.250 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-15T20:50:40.250 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-15T20:50:40.548 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-15T20:50:40.548 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:40.549 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:40.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2024-04-15T20:50:41.337 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-04-15T20:50:41.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-04-15T20:50:41.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-15T20:50:41.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-15T20:50:41.397 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:19 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-04-15T20:50:41.556 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 913 k 2024-04-15T20:50:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.7 M 2024-04-15T20:50:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 8.9 MB/s | 835 kB 00:00 2024-04-15T20:50:41.707 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 524 kB/s | 79 kB 00:00 2024-04-15T20:50:41.708 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:41.708 INFO:teuthology.orchestra.run.smithi149.stdout:Total 5.8 MB/s | 913 kB 00:00 2024-04-15T20:50:41.709 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:41.729 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:41.729 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T20:50:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:41.808 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:41.808 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:42.005 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:42.129 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-15T20:50:42.198 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-04-15T20:50:42.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-rook 2024-04-15T20:50:42.840 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:18 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-04-15T20:50:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-04-15T20:50:43.005 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-04-15T20:50:43.006 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:43.007 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Install 13 Packages 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 2.0 M 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 26 M 2024-04-15T20:50:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:43.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-15T20:50:43.273 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:43.273 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:43.273 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-15T20:50:43.273 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:43.273 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:43.280 INFO:teuthology.orchestra.run.smithi072.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 428 kB/s | 47 kB 00:00 2024-04-15T20:50:43.306 INFO:teuthology.orchestra.run.smithi072.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 179 kB/s | 24 kB 00:00 2024-04-15T20:50:43.333 INFO:teuthology.orchestra.run.smithi072.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 111 kB/s | 18 kB 00:00 2024-04-15T20:50:43.358 INFO:teuthology.orchestra.run.smithi072.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 174 kB 00:00 2024-04-15T20:50:43.384 INFO:teuthology.orchestra.run.smithi072.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T20:50:43.418 INFO:teuthology.orchestra.run.smithi072.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.4 MB/s | 211 kB 00:00 2024-04-15T20:50:43.443 INFO:teuthology.orchestra.run.smithi072.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 509 kB/s | 43 kB 00:00 2024-04-15T20:50:43.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2024-04-15T20:50:43.844 INFO:teuthology.orchestra.run.smithi072.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 35 kB/s | 15 kB 00:00 2024-04-15T20:50:43.869 INFO:teuthology.orchestra.run.smithi072.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 71 kB/s | 32 kB 00:00 2024-04-15T20:50:44.062 INFO:teuthology.orchestra.run.smithi072.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 308 kB/s | 59 kB 00:00 2024-04-15T20:50:44.095 INFO:teuthology.orchestra.run.smithi072.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 311 kB/s | 203 kB 00:00 2024-04-15T20:50:44.151 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:22 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:44.221 INFO:teuthology.orchestra.run.smithi072.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 564 kB/s | 90 kB 00:00 2024-04-15T20:50:44.303 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 126 k 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 456 k 2024-04-15T20:50:44.304 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:44.370 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-04-15T20:50:44.371 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:44.371 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.8 MB/s | 126 kB 00:00 2024-04-15T20:50:44.371 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:44.376 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:44.376 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-04-15T20:50:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2024-04-15T20:50:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:44.431 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:44.431 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:44.573 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:44.685 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:45.129 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:45.253 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-15T20:50:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-15T20:50:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-15T20:50:45.403 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:45.422 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:45.445 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-15T20:50:45.540 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-15T20:50:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-15T20:50:45.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2024-04-15T20:50:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-15T20:50:46.315 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:24 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:46.419 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:46.428 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-15T20:50:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:46.485 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-15T20:50:46.520 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-15T20:50:46.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2024-04-15T20:50:46.566 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-15T20:50:46.599 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-04-15T20:50:47.136 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:25 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:47.290 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:47.291 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 k 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 137 k 2024-04-15T20:50:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:47.366 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 411 kB/s | 30 kB 00:00 2024-04-15T20:50:47.367 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:47.367 INFO:teuthology.orchestra.run.smithi149.stdout:Total 404 kB/s | 30 kB 00:00 2024-04-15T20:50:47.367 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:47.371 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:47.371 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:47.398 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:47.400 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:47.482 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:47.588 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-04-15T20:50:47.588 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-04-15T20:50:47.588 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-15T20:50:47.588 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-15T20:50:47.589 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-15T20:50:47.590 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T20:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:47.944 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:48.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-cephadm 2024-04-15T20:50:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:48.264 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:48.265 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:48.265 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:48.265 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:48.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2024-04-15T20:50:48.828 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:24 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:48.980 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T20:50:48.981 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Install 6 Packages 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 6.8 M 2024-04-15T20:50:48.983 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 33 M 2024-04-15T20:50:48.983 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:49.043 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:27 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:49.144 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:49.197 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:49.198 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:49.199 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:49.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2024-04-15T20:50:49.624 INFO:teuthology.orchestra.run.smithi072.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.5 MB/s | 127 kB 00:00 2024-04-15T20:50:49.867 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:27 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:49.967 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:50.016 INFO:teuthology.orchestra.run.smithi072.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 5.8 MB 00:00 2024-04-15T20:50:50.020 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:50.022 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:50.022 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:50.050 INFO:teuthology.orchestra.run.smithi072.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 489 kB/s | 248 kB 00:00 2024-04-15T20:50:50.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2024-04-15T20:50:50.342 INFO:teuthology.orchestra.run.smithi072.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 764 kB/s | 548 kB 00:00 2024-04-15T20:50:50.367 INFO:teuthology.orchestra.run.smithi072.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 164 kB/s | 58 kB 00:00 2024-04-15T20:50:50.392 INFO:teuthology.orchestra.run.smithi072.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 149 kB/s | 51 kB 00:00 2024-04-15T20:50:50.395 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:50.395 INFO:teuthology.orchestra.run.smithi072.stdout:Total 4.8 MB/s | 6.8 MB 00:01 2024-04-15T20:50:50.408 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:50.418 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:50.418 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:50.506 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:50.506 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:50.701 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:28 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:50.799 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:50.802 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:50.856 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:50.857 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:50.857 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:50.931 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2024-04-15T20:50:50.965 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-15T20:50:51.020 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-15T20:50:51.529 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:29 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:51.534 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-15T20:50:51.626 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-15T20:50:51.631 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:51.684 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:51.685 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:51.685 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-15T20:50:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-04-15T20:50:51.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2024-04-15T20:50:52.346 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:30 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:52.446 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:52.499 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:52.500 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:52.501 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:52.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-15T20:50:52.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:53.065 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:53.164 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:53.265 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:53.317 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:53.319 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-04-15T20:50:53.319 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:53.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2024-04-15T20:50:53.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-fuse 2024-04-15T20:50:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:29 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:54.133 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:54.135 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi072.stdout:Install 2 Packages 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 913 k 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 2.7 M 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-04-15T20:50:54.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 86 k 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 230 k 2024-04-15T20:50:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-04-15T20:50:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.2 MB/s | 86 kB 00:00 2024-04-15T20:50:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:54.240 INFO:teuthology.orchestra.run.smithi072.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 7.8 MB/s | 835 kB 00:00 2024-04-15T20:50:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:54.266 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:54.298 INFO:teuthology.orchestra.run.smithi072.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 79 kB 00:00 2024-04-15T20:50:54.300 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:54.300 INFO:teuthology.orchestra.run.smithi072.stdout:Total 5.4 MB/s | 913 kB 00:00 2024-04-15T20:50:54.300 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:54.320 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:54.320 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:54.396 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:54.397 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:54.398 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:54.502 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:54.574 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:54.715 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-15T20:50:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-04-15T20:50:54.958 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:55.256 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:55.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2024-04-15T20:50:55.533 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-04-15T20:50:55.533 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:55.848 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:56.083 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:34 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:56.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librados-devel 2024-04-15T20:50:56.239 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:56.240 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.0 M 2024-04-15T20:50:56.241 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 12 M 2024-04-15T20:50:56.242 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:56.341 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-04-15T20:50:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:Total 29 MB/s | 3.0 MB 00:00 2024-04-15T20:50:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:56.351 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:56.351 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:56.426 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:56.426 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:56.796 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:32 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:56.834 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:56.884 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:56.909 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:56.909 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:50:56.909 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T20:50:56.909 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T20:50:56.910 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T20:50:56.910 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:56.954 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:56.954 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:50:56.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:56.956 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 126 k 2024-04-15T20:50:56.956 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 456 k 2024-04-15T20:50:56.956 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:57.020 INFO:teuthology.orchestra.run.smithi072.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-04-15T20:50:57.020 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:57.021 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-04-15T20:50:57.021 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:50:57.026 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:50:57.026 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:50:57.081 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:50:57.082 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:50:57.224 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:50:57.330 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:57.788 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:58.042 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:58.042 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:58.042 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:50:58.042 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:58.043 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:58.043 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:58.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2024-04-15T20:50:58.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install libcephfs2 2024-04-15T20:50:58.892 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:36 ago on Mon 15 Apr 2024 08:49:22 PM UTC. 2024-04-15T20:50:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:34 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:59.047 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:50:59.048 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 169 k 2024-04-15T20:50:59.049 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 490 k 2024-04-15T20:50:59.049 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-04-15T20:50:59.065 INFO:teuthology.orchestra.run.smithi072.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:50:59.103 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 169 kB 00:00 2024-04-15T20:50:59.104 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:59.104 INFO:teuthology.orchestra.run.smithi149.stdout:Total 3.0 MB/s | 169 kB 00:00 2024-04-15T20:50:59.104 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-04-15T20:50:59.112 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-04-15T20:50:59.112 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-04-15T20:50:59.120 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:59.121 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:50:59.121 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:50:59.167 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-04-15T20:50:59.167 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-04-15T20:50:59.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install libcephfs-devel 2024-04-15T20:50:59.325 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-04-15T20:50:59.426 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:59.782 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:35 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:50:59.852 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:50:59.935 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:50:59.936 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 30 k 2024-04-15T20:50:59.937 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 137 k 2024-04-15T20:50:59.937 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:50:59.998 INFO:teuthology.orchestra.run.smithi072.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 494 kB/s | 30 kB 00:00 2024-04-15T20:50:59.999 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:50:59.999 INFO:teuthology.orchestra.run.smithi072.stdout:Total 485 kB/s | 30 kB 00:00 2024-04-15T20:50:59.999 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:51:00.003 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:51:00.003 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:51:00.033 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:51:00.033 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:51:00.120 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:51:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:51:00.142 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-04-15T20:51:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-04-15T20:51:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:51:00.143 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-04-15T20:51:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:00.360 DEBUG:teuthology.parallel:result is None 2024-04-15T20:51:00.650 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:00.896 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:51:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-04-15T20:51:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:00.896 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:01.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librados2 2024-04-15T20:51:01.687 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:37 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:01.785 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:01.840 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:01.841 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:01.841 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:01.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librbd1 2024-04-15T20:51:02.500 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:38 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:02.599 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:02.652 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:02.653 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:02.653 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:02.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rados 2024-04-15T20:51:03.322 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:39 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:03.472 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:03.473 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:03.473 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:03.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rgw 2024-04-15T20:51:04.136 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:40 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:04.234 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:04.286 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:04.287 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:04.287 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:04.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-cephfs 2024-04-15T20:51:04.942 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:40 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:05.040 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:05.093 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:05.094 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:05.094 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:05.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rbd 2024-04-15T20:51:05.757 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:41 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:05.855 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-04-15T20:51:05.908 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-04-15T20:51:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:05.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-fuse 2024-04-15T20:51:06.563 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:42 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:06.714 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-04-15T20:51:06.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 86 k 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 230 k 2024-04-15T20:51:06.716 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:51:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-04-15T20:51:06.783 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:51:06.783 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.2 MB/s | 86 kB 00:00 2024-04-15T20:51:06.783 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:51:06.790 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:51:06.790 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:51:06.844 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:51:06.845 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:51:06.982 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:51:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:07.492 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:07.787 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:08.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-mirror 2024-04-15T20:51:08.631 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:44 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:08.788 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:08.789 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:08.789 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:51:08.789 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:08.789 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 3.0 M 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 12 M 2024-04-15T20:51:08.790 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:51:08.917 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 23 MB/s | 3.0 MB 00:00 2024-04-15T20:51:08.918 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:51:08.918 INFO:teuthology.orchestra.run.smithi072.stdout:Total 23 MB/s | 3.0 MB 00:00 2024-04-15T20:51:08.918 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:51:08.927 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:51:08.927 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:51:08.998 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:51:08.998 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:51:09.404 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:51:09.469 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:09.493 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T20:51:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T20:51:09.493 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T20:51:09.494 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T20:51:09.494 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:10.729 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:11.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-nbd 2024-04-15T20:51:11.615 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:47 ago on Mon 15 Apr 2024 08:49:24 PM UTC. 2024-04-15T20:51:11.767 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-15T20:51:11.768 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-15T20:51:11.769 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-04-15T20:51:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:11.769 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 169 k 2024-04-15T20:51:11.769 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 490 k 2024-04-15T20:51:11.769 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-15T20:51:11.837 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 169 kB 00:00 2024-04-15T20:51:11.837 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:51:11.838 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.4 MB/s | 169 kB 00:00 2024-04-15T20:51:11.838 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-15T20:51:11.846 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-15T20:51:11.846 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-15T20:51:11.900 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-15T20:51:11.900 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-15T20:51:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-15T20:51:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:12.612 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:51:12.889 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-15T20:51:13.167 DEBUG:teuthology.parallel:result is None 2024-04-15T20:51:13.167 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:51:13.168 INFO:teuthology.packaging:ref: None 2024-04-15T20:51:13.168 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:51:13.168 INFO:teuthology.packaging:branch: None 2024-04-15T20:51:13.168 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:51:13.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-15T20:51:13.395 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T20:51:13.418 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.0-0.el9 2024-04-15T20:51:13.418 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-04-15T20:51:13.418 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-04-15T20:51:13.420 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-15T20:51:13.420 INFO:teuthology.packaging:ref: None 2024-04-15T20:51:13.420 INFO:teuthology.packaging:tag: v18.2.0 2024-04-15T20:51:13.420 INFO:teuthology.packaging:branch: None 2024-04-15T20:51:13.420 INFO:teuthology.packaging:sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:51:13.421 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-15T20:51:13.637 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T20:51:13.663 INFO:teuthology.orchestra.run.smithi149.stdout:18.2.0-0.el9 2024-04-15T20:51:13.664 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-04-15T20:51:13.664 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-04-15T20:51:13.665 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-15T20:51:13.666 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:51:13.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T20:51:13.695 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:51:13.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T20:51:13.736 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-15T20:51:13.736 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:51:13.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T20:51:13.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T20:51:13.832 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:51:13.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T20:51:13.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T20:51:13.933 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-15T20:51:13.933 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:51:13.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T20:51:13.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T20:51:14.030 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:51:14.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T20:51:14.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T20:51:14.130 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-15T20:51:14.131 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:51:14.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T20:51:14.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T20:51:14.227 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:51:14.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T20:51:14.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T20:51:14.326 INFO:teuthology.run_tasks:Running task print... 2024-04-15T20:51:14.336 INFO:teuthology.task.print:**** done install task... 2024-04-15T20:51:14.336 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-15T20:51:14.463 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29'} 2024-04-15T20:51:14.463 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-04-15T20:51:14.464 INFO:tasks.cephadm:Cluster fsid is e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:51:14.464 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-15T20:51:14.464 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-15T20:51:14.464 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi072': '172.21.15.72', 'mon.smithi149': '172.21.15.149'} 2024-04-15T20:51:14.464 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-15T20:51:14.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname $(hostname -s) 2024-04-15T20:51:14.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-04-15T20:51:14.523 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-04-15T20:51:14.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T20:51:14.666 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/54897/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3084-g87dbfb63', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3084.g87dbfb63'}, 'url': 'https://3.chacra.ceph.com/r/ceph/main/87dbfb632e974cb2c28d17423071d2d833b53b29/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-14 16:30:23.821701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/main/87dbfb632e974cb2c28d17423071d2d833b53b29/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-15T20:51:14.883 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 f1f10a1c441d6255eaa3105af60f09fbca74c76c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-04-15T20:51:14.885 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/f1f10a1c441d6255eaa3105af60f09fbca74c76c/centos/9/x86_64/flavors/default/cephadm 2024-04-15T20:51:14.885 DEBUG:teuthology.orchestra.run.smithi072:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/f1f10a1c441d6255eaa3105af60f09fbca74c76c/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.252 INFO:teuthology.orchestra.run.smithi072.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 Apr 15 20:51 /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.253 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/f1f10a1c441d6255eaa3105af60f09fbca74c76c/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.614 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 Apr 15 20:51 /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.615 DEBUG:teuthology.orchestra.run.smithi072:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.635 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-15T20:51:15.662 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-04-15T20:51:15.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-04-15T20:51:15.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-04-15T20:51:16.488 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-15T20:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-04-15T20:51:41.012 INFO:teuthology.orchestra.run.smithi149.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-04-15T20:51:41.013 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-04-15T20:51:41.013 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "repo_digests": [ 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-04-15T20:51:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-15T20:51:41.289 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T20:51:41.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph 2024-04-15T20:51:41.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-04-15T20:51:41.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /etc/ceph 2024-04-15T20:51:41.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-04-15T20:51:41.464 INFO:tasks.cephadm:Writing seed config... 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-15T20:51:41.465 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-15T20:51:41.466 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-15T20:51:41.467 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-15T20:51:41.468 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-15T20:51:41.468 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-15T20:51:41.468 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-15T20:51:41.468 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-15T20:51:41.468 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-15T20:51:41.468 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:51:41.468 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-15T20:51:41.484 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e60a5b86-fb69-11ee-bc8f-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-15T20:51:41.484 DEBUG:teuthology.orchestra.run.smithi072:mon.smithi072> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service 2024-04-15T20:51:41.527 INFO:tasks.cephadm:Bootstrapping... 2024-04-15T20:51:41.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.72 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-15T20:51:41.684 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-15T20:51:41.684 INFO:teuthology.orchestra.run.smithi072.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'e60a5b86-fb69-11ee-bc8f-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.72', '--skip-admin-label'] 2024-04-15T20:51:41.709 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-15T20:51:41.709 INFO:teuthology.orchestra.run.smithi072.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-15T20:51:41.709 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying podman|docker is present... 2024-04-15T20:51:41.732 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-15T20:51:41.732 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying lvm2 is present... 2024-04-15T20:51:41.732 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying time synchronization is in place... 2024-04-15T20:51:41.739 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-15T20:51:41.739 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-15T20:51:41.745 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-15T20:51:41.746 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:51:41.752 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-04-15T20:51:41.758 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-04-15T20:51:41.758 INFO:teuthology.orchestra.run.smithi072.stdout:Unit chronyd.service is enabled and running 2024-04-15T20:51:41.758 INFO:teuthology.orchestra.run.smithi072.stdout:Repeating the final host check... 2024-04-15T20:51:41.781 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-15T20:51:41.781 INFO:teuthology.orchestra.run.smithi072.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-15T20:51:41.781 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl is present 2024-04-15T20:51:41.781 INFO:teuthology.orchestra.run.smithi072.stdout:lvcreate is present 2024-04-15T20:51:41.787 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-15T20:51:41.787 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-15T20:51:41.793 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-15T20:51:41.793 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:51:41.800 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Unit chronyd.service is enabled and running 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Host looks OK 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Cluster fsid: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Acquiring lock 139686931036864 on /run/cephadm/e60a5b86-fb69-11ee-bc8f-c7b262605968.lock 2024-04-15T20:51:41.807 INFO:teuthology.orchestra.run.smithi072.stdout:Lock 139686931036864 acquired on /run/cephadm/e60a5b86-fb69-11ee-bc8f-c7b262605968.lock 2024-04-15T20:51:41.808 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 3300 ... 2024-04-15T20:51:41.808 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 6789 ... 2024-04-15T20:51:41.808 INFO:teuthology.orchestra.run.smithi072.stdout:Base mon IP(s) is [172.21.15.72:3300, 172.21.15.72:6789], mon addrv is [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-04-15T20:51:41.811 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.72 metric 100 2024-04-15T20:51:41.811 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.72 metric 100 2024-04-15T20:51:41.814 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-15T20:51:41.814 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-15T20:51:41.814 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-04-15T20:51:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-15T20:51:41.818 INFO:teuthology.orchestra.run.smithi072.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-15T20:51:41.818 INFO:teuthology.orchestra.run.smithi072.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-15T20:51:42.604 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Getting image source signatures 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-04-15T20:51:42.605 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-15T20:51:43.499 INFO:teuthology.orchestra.run.smithi072.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-04-15T20:51:43.499 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-04-15T20:51:43.499 INFO:teuthology.orchestra.run.smithi072.stdout:Extracting ceph user uid/gid from container image... 2024-04-15T20:51:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:stat: stdout 167 167 2024-04-15T20:51:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial keys... 2024-04-15T20:51:45.375 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQBgkx1mN2cCMBAAxst4ou0FPoiGL/zjBz06yA== 2024-04-15T20:51:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQBhkx1mdG9gKxAAHUgkXIb9HfkoOwAPw1qOiQ== 2024-04-15T20:51:50.098 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQBikx1mVKerJhAAvzbSWzvRKLNgIrznuCMQvQ== 2024-04-15T20:51:50.099 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial monmap... 2024-04-15T20:52:03.100 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-15T20:52:03.100 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-04-15T20:52:03.100 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool for smithi072 [v2:172.21.15.72:3300,v1:172.21.15.72:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: set fsid to e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:52:03.101 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mon... 2024-04-15T20:52:05.849 INFO:teuthology.orchestra.run.smithi072.stdout:create mon.smithi072 on 2024-04-15T20:52:06.069 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-15T20:52:06.217 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-15T20:52:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target → /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target. 2024-04-15T20:52:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target → /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target. 2024-04-15T20:52:06.627 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072 2024-04-15T20:52:06.627 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Unit ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service not loaded. 2024-04-15T20:52:06.785 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target.wants/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service → /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@.service. 2024-04-15T20:52:07.109 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 podman[28686]: 2024-04-15 20:52:06.932349433 +0000 UTC m=+0.018361131 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-04-15T20:52:07.269 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-15T20:52:07.269 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-04-15T20:52:07.276 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-15T20:52:07.276 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:52:07.277 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-04-15T20:52:07.277 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-04-15T20:52:07.277 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon to start... 2024-04-15T20:52:07.277 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon... 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 podman[28686]: 2024-04-15 20:52:07.196054076 +0000 UTC m=+0.282065760 container init a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, RELEASE=HEAD) 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 podman[28686]: 2024-04-15 20:52:07.199145115 +0000 UTC m=+0.285156799 container start a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 ceph-mon[28705]: mkfs e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 ceph-mon[28705]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 bash[28686]: a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e 2024-04-15T20:52:07.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:07 smithi072 systemd[1]: Started Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: monmap e1: 1 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0]} removed_ranks: {} 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: fsmap 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: osdmap e1: 0 total, 0 up, 0 in 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: mgrmap e1: no daemons active 2024-04-15T20:52:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:08 smithi072 ceph-mon[28705]: from='client.? 172.21.15.72:0/1651664573' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-15T20:52:08.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout cluster: 2024-04-15T20:52:08.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout id: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:08.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-15T20:52:08.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:08.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout services: 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi072 (age 0.542924s) 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout data: 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pgs: 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.702+0000 7fbfc9c37700 1 Processor -- start 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.702+0000 7fbfc9c37700 1 -- start start 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.702+0000 7fbfc9c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:08.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.702+0000 7fbfc9c37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc407a830 con 0x7fbfc407bdf0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58438/0 (socket says 172.21.15.72:58438) 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc37fe700 1 -- 172.21.15.72:0/3604308576 learned_addr learned my addr 172.21.15.72:0/3604308576 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc37fe700 1 -- 172.21.15.72:0/3604308576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc407a970 con 0x7fbfc407bdf0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc37fe700 1 --2- 172.21.15.72:0/3604308576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009e80 tx=0x7fbfb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7ada354d303ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc27fc700 1 -- 172.21.15.72:0/3604308576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfb400e070 con 0x7fbfc407bdf0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc27fc700 1 -- 172.21.15.72:0/3604308576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4003a20 con 0x7fbfc407bdf0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.703+0000 7fbfc27fc700 1 -- 172.21.15.72:0/3604308576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfb4003bd0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 -- 172.21.15.72:0/3604308576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 msgr2=0x7fbfc407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 --2- 172.21.15.72:0/3604308576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009e80 tx=0x7fbfb400b330 comp rx=0 tx=0).stop 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 -- 172.21.15.72:0/3604308576 shutdown_connections 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 --2- 172.21.15.72:0/3604308576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc407a2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:08.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 -- 172.21.15.72:0/3604308576 >> 172.21.15.72:0/3604308576 conn(0x7fbfc4101180 msgr2=0x7fbfc4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 -- 172.21.15.72:0/3604308576 shutdown_connections 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 -- 172.21.15.72:0/3604308576 wait complete. 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.704+0000 7fbfc9c37700 1 Processor -- start 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc9c37700 1 -- start start 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc9c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc9c37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc419b7c0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58452/0 (socket says 172.21.15.72:58452) 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc37fe700 1 -- 172.21.15.72:0/1651664573 learned_addr learned my addr 172.21.15.72:0/1651664573 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc37fe700 1 -- 172.21.15.72:0/1651664573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4009b30 con 0x7fbfc407bdf0 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.705+0000 7fbfc37fe700 1 --2- 172.21.15.72:0/1651664573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4004000 tx=0x7fbfb4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfb4004240 con 0x7fbfc407bdf0 2024-04-15T20:52:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40043e0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc419b9c0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfb40046e0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc419bde0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbfb4019050 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.706+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbfb40257e0 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.707+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc4195040 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.709+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fbfb402a060 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.779+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbfc4062380 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.779+0000 7fbfc0ff9700 1 -- 172.21.15.72:0/1651664573 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fbfb4020030 con 0x7fbfc407bdf0 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 msgr2=0x7fbfc419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 --2- 172.21.15.72:0/1651664573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4004000 tx=0x7fbfb4004ad0 comp rx=0 tx=0).stop 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 shutdown_connections 2024-04-15T20:52:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 --2- 172.21.15.72:0/1651664573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc407bdf0 0x7fbfc419b280 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:08.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 >> 172.21.15.72:0/1651664573 conn(0x7fbfc4101180 msgr2=0x7fbfc4102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:08.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 shutdown_connections 2024-04-15T20:52:08.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:07.780+0000 7fbfc9c37700 1 -- 172.21.15.72:0/1651664573 wait complete. 2024-04-15T20:52:08.336 INFO:teuthology.orchestra.run.smithi072.stdout:mon is available 2024-04-15T20:52:08.336 INFO:teuthology.orchestra.run.smithi072.stdout:Assimilating anything we can from ceph.conf... 2024-04-15T20:52:10.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:10 smithi072 ceph-mon[28705]: from='client.? 172.21.15.72:0/2187677335' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-15T20:52:10.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:10 smithi072 ceph-mon[28705]: from='client.? 172.21.15.72:0/2187677335' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-15T20:52:13.762 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:13.762 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-04-15T20:52:13.762 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-15T20:52:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4c6ce700 1 Processor -- start 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4c6ce700 1 -- start start 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4c6ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4c6ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44106460 con 0x7f3d44105b10 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4a46a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4a46a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58456/0 (socket says 172.21.15.72:58456) 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.658+0000 7f3d4a46a700 1 -- 172.21.15.72:0/745661427 learned_addr learned my addr 172.21.15.72:0/745661427 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d4a46a700 1 -- 172.21.15.72:0/745661427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d441065a0 con 0x7f3d44105b10 2024-04-15T20:52:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d4a46a700 1 --2- 172.21.15.72:0/745661427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3d400098a0 tx=0x7f3d40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a223dc6e382cb54d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d49468700 1 -- 172.21.15.72:0/745661427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d40004180 con 0x7f3d44105b10 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d49468700 1 -- 172.21.15.72:0/745661427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400042e0 con 0x7f3d44105b10 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d49468700 1 -- 172.21.15.72:0/745661427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d400036a0 con 0x7f3d44105b10 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/745661427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 msgr2=0x7f3d44105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.659+0000 7f3d4c6ce700 1 --2- 172.21.15.72:0/745661427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3d400098a0 tx=0x7f3d40009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/745661427 shutdown_connections 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 --2- 172.21.15.72:0/745661427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d44105f20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/745661427 >> 172.21.15.72:0/745661427 conn(0x7f3d44101180 msgr2=0x7f3d44103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/745661427 shutdown_connections 2024-04-15T20:52:13.765 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/745661427 wait complete. 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 Processor -- start 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- start start 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4c6ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4407c180 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4a46a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4a46a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58470/0 (socket says 172.21.15.72:58470) 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.660+0000 7f3d4a46a700 1 -- 172.21.15.72:0/2187677335 learned_addr learned my addr 172.21.15.72:0/2187677335 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d4a46a700 1 -- 172.21.15.72:0/2187677335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009550 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d4a46a700 1 --2- 172.21.15.72:0/2187677335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3d44106840 tx=0x7f3d40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d40003ce0 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40020070 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4407a290 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d40011630 con 0x7f3d44105b10 2024-04-15T20:52:13.766 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4407a6b0 con 0x7f3d44105b10 2024-04-15T20:52:13.767 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3d40022030 con 0x7f3d44105b10 2024-04-15T20:52:13.769 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.661+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3d40025d00 con 0x7f3d44105b10 2024-04-15T20:52:13.769 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.662+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4407b0c0 con 0x7f3d44105b10 2024-04-15T20:52:13.769 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.664+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3d40025480 con 0x7f3d44105b10 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.731+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3d44192400 con 0x7f3d44105b10 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.735+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d40011c20 con 0x7f3d44105b10 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.735+0000 7f3d3b7fe700 1 -- 172.21.15.72:0/2187677335 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f3d4001c500 con 0x7f3d44105b10 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 msgr2=0x7f3d4407bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 --2- 172.21.15.72:0/2187677335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3d44106840 tx=0x7f3d40004750 comp rx=0 tx=0).stop 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 shutdown_connections 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 --2- 172.21.15.72:0/2187677335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d44105b10 0x7f3d4407bc40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 >> 172.21.15.72:0/2187677335 conn(0x7f3d44101180 msgr2=0x7f3d4418d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 shutdown_connections 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:10.736+0000 7f3d4c6ce700 1 -- 172.21.15.72:0/2187677335 wait complete. 2024-04-15T20:52:13.770 INFO:teuthology.orchestra.run.smithi072.stdout:Generating new minimal ceph.conf... 2024-04-15T20:52:14.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:14 smithi072 ceph-mon[28705]: from='client.? 172.21.15.72:0/1530333514' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:52:14.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e11db4700 1 Processor -- start 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e11db4700 1 -- start start 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e11db4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e11db4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c07a870 con 0x7f4e0c07be30 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49274/0 (socket says 172.21.15.72:49274) 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e0b7fe700 1 -- 172.21.15.72:0/269235735 learned_addr learned my addr 172.21.15.72:0/269235735 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e0b7fe700 1 -- 172.21.15.72:0/269235735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c07a9b0 con 0x7f4e0c07be30 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.171+0000 7f4e0b7fe700 1 --2- 172.21.15.72:0/269235735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098a0 tx=0x7f4dfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b175e52ca061a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e0a7fc700 1 -- 172.21.15.72:0/269235735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dfc004180 con 0x7f4e0c07be30 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e0a7fc700 1 -- 172.21.15.72:0/269235735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4dfc0042e0 con 0x7f4e0c07be30 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e0a7fc700 1 -- 172.21.15.72:0/269235735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dfc011a50 con 0x7f4e0c07be30 2024-04-15T20:52:14.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 -- 172.21.15.72:0/269235735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 msgr2=0x7f4e0c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 --2- 172.21.15.72:0/269235735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098a0 tx=0x7f4dfc009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 -- 172.21.15.72:0/269235735 shutdown_connections 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 --2- 172.21.15.72:0/269235735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c07a330 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 -- 172.21.15.72:0/269235735 >> 172.21.15.72:0/269235735 conn(0x7f4e0c101180 msgr2=0x7f4e0c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 -- 172.21.15.72:0/269235735 shutdown_connections 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.172+0000 7f4e11db4700 1 -- 172.21.15.72:0/269235735 wait complete. 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e11db4700 1 Processor -- start 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e11db4700 1 -- start start 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e11db4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e11db4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c19bfb0 con 0x7f4e0c07be30 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e0b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49290/0 (socket says 172.21.15.72:49290) 2024-04-15T20:52:14.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.173+0000 7f4e0b7fe700 1 -- 172.21.15.72:0/1530333514 learned_addr learned my addr 172.21.15.72:0/1530333514 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e0b7fe700 1 -- 172.21.15.72:0/1530333514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009550 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e0b7fe700 1 --2- 172.21.15.72:0/1530333514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dfc003b90 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4dfc0248b0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c19c1b0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dfc01a8e0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c19c5d0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4dfc02d3f0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.174+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4dfc019400 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.175+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c10bdd0 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.177+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4dfc024a20 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.246+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4e0c19f660 con 0x7f4e0c07be30 2024-04-15T20:52:14.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.246+0000 7f4e08ff9700 1 -- 172.21.15.72:0/1530333514 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f4dfc035090 con 0x7f4e0c07be30 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 msgr2=0x7f4e0c19ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 --2- 172.21.15.72:0/1530333514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 shutdown_connections 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 --2- 172.21.15.72:0/1530333514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0c07be30 0x7f4e0c19ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 >> 172.21.15.72:0/1530333514 conn(0x7f4e0c101180 msgr2=0x7f4e0c102850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 shutdown_connections 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:14.247+0000 7f4e11db4700 1 -- 172.21.15.72:0/1530333514 wait complete. 2024-04-15T20:52:14.804 INFO:teuthology.orchestra.run.smithi072.stdout:Restarting the monitor... 2024-04-15T20:52:15.064 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:14 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T20:52:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[28701]: 2024-04-15T20:52:15.070+0000 7effb2e34700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T20:52:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[28701]: 2024-04-15T20:52:15.070+0000 7effb2e34700 -1 mon.smithi072@0(leader) e1 *** Got Signal Terminated *** 2024-04-15T20:52:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 podman[28952]: 2024-04-15 20:52:15.203920172 +0000 UTC m=+0.230441180 container died a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-15T20:52:15.715 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 podman[28952]: 2024-04-15 20:52:15.547286507 +0000 UTC m=+0.573807517 container cleanup a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=HEAD, ceph=True) 2024-04-15T20:52:15.715 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 bash[28952]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072 2024-04-15T20:52:16.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 podman[28966]: 2024-04-15 20:52:15.721884665 +0000 UTC m=+0.516717758 container remove a74378e4fbc64d96e7384b53facea5ad9c45dfab18df67e846cc030b56d8213e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, ceph=True, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-15T20:52:16.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Deactivated successfully. 2024-04-15T20:52:16.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 systemd[1]: Stopped Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T20:52:16.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:15 smithi072 systemd[1]: Starting Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 podman[29061]: 2024-04-15 20:52:16.169284893 +0000 UTC m=+0.111082657 container create 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0) 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 podman[29061]: 2024-04-15 20:52:16.07597778 +0000 UTC m=+0.017775517 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 podman[29061]: 2024-04-15 20:52:16.381798433 +0000 UTC m=+0.323596154 container init 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 podman[29061]: 2024-04-15 20:52:16.384841872 +0000 UTC m=+0.326639588 container start 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: set uid:gid to 167:167 (ceph:ceph) 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: pidfile_write: ignore empty --pid-file 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: load: jerasure load: lrc 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: RocksDB version: 7.9.2 2024-04-15T20:52:16.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Git sha 0 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Compile date 2023-08-03 19:21:13 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: DB SUMMARY 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: DB Session ID: 2HHLJU9VQ778S490XS12 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: CURRENT file: CURRENT 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: IDENTITY file: IDENTITY 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi072/store.db dir, Total Num: 1, files: 000008.sst 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi072/store.db: 000009.log size: 98772 ; 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.error_if_exists: 0 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.create_if_missing: 0 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.paranoid_checks: 1 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-15T20:52:16.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.env: 0x55cf0a51e720 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.fs: PosixFileSystem 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.info_log: 0x55cf0d73d2c0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_file_opening_threads: 16 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.statistics: (nil) 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.use_fsync: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_log_file_size: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.keep_log_file_num: 1000 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.recycle_log_file_num: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_fallocate: 1 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_mmap_reads: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_mmap_writes: 0 2024-04-15T20:52:16.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.use_direct_reads: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.create_missing_column_families: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.db_log_dir: 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.wal_dir: 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.advise_random_on_open: 1 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.db_write_buffer_size: 0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.write_buffer_manager: 0x55cf0c9ae3c0 2024-04-15T20:52:16.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.rate_limiter: (nil) 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.wal_recovery_mode: 2 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enable_thread_tracking: 0 2024-04-15T20:52:16.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enable_pipelined_write: 0 2024-04-15T20:52:16.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.unordered_write: 0 2024-04-15T20:52:16.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-15T20:52:16.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-15T20:52:16.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.row_cache: None 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.wal_filter: None 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_ingest_behind: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.two_write_queues: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.manual_wal_flush: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.wal_compression: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.atomic_flush: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-15T20:52:16.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.log_readahead_size: 0 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.best_efforts_recovery: 0 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.allow_data_in_errors: 0 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.db_host_id: __hostname__ 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_background_jobs: 2 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_background_compactions: -1 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_subcompactions: 1 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-15T20:52:16.422 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_total_wal_size: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_open_files: -1 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bytes_per_sync: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_readahead_size: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_background_flushes: -1 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Compression algorithms supported: 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kZSTD supported: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kXpressCompression supported: 0 2024-04-15T20:52:16.423 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kLZ4HCCompression supported: 1 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kZlibCompression supported: 1 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kSnappyCompression supported: 1 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kLZ4Compression supported: 1 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: kBZip2Compression supported: 0 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000010 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.merge_operator: 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_filter: None 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_filter_factory: None 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.sst_partitioner_factory: None 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-15T20:52:16.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cf0d73d3c0) 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks: 1 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_top_level_index_and_filter: 1 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_type: 0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_index_type: 0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_shortening: 1 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: checksum: 4 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: no_block_cache: 0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache: 0x55cf0ca4f1f0 2024-04-15T20:52:16.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_name: BinnedLRUCache 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_options: 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: capacity : 536870912 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_shard_bits : 4 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: strict_capacity_limit : 0 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: high_pri_pool_ratio: 0.000 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_compressed: (nil) 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: persistent_cache: (nil) 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size: 4096 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size_deviation: 10 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_restart_interval: 16 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_block_restart_interval: 1 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_block_size: 4096 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: partition_filters: 0 2024-04-15T20:52:16.426 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: use_delta_encoding: 1 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: filter_policy: bloomfilter 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: whole_key_filtering: 1 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: verify_compression: 0 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: read_amp_bytes_per_bit: 0 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: format_version: 5 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_index_compression: 1 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_align: 0 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_auto_readahead_size: 262144 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: prepopulate_block_cache: 0 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: initial_auto_readahead_size: 8192 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_file_reads_for_auto_readahead: 2 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.write_buffer_size: 33554432 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_write_buffer_number: 2 2024-04-15T20:52:16.427 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression: NoCompression 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression: Disabled 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.prefix_extractor: nullptr 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.num_levels: 7 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-15T20:52:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.level: 32767 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.strategy: 0 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.enabled: false 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-15T20:52:16.429 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.target_file_size_base: 67108864 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-15T20:52:16.430 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.arena_block_size: 1048576 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.disable_auto_compactions: 0 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-15T20:52:16.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-15T20:52:16.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-15T20:52:16.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-15T20:52:16.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.table_properties_collectors: 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.inplace_update_support: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.bloom_locality: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.max_successive_merges: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.paranoid_file_checks: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.force_consistency_checks: 1 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.report_bg_io_stats: 0 2024-04-15T20:52:16.433 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.ttl: 2592000 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enable_blob_files: false 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.min_blob_size: 0 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_file_size: 268435456 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-15T20:52:16.434 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.blob_file_starting_level: 0 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a9a56ff-83a8-48b5-9778-6b7d54cc777a 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214336413643, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214336414694, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93772, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 323, "table_properties": {"data_size": 91794, "index_size": 260, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13592, "raw_average_key_size": 49, "raw_value_size": 84390, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 274, "num_filter_entries": 274, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713214336, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a9a56ff-83a8-48b5-9778-6b7d54cc777a", "db_session_id": "2HHLJU9VQ778S490XS12", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214336414774, "job": 1, "event": "recovery_finished"} 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi072/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cf0caec000 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: DB pointer 0x55cf0cad8000 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-15T20:52:16.435 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** DB Stats ** 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L0 2/0 93.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Sum 2/0 93.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-15T20:52:16.436 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-15T20:52:16.437 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative compaction: 0.00 GB write, 29.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval compaction: 0.00 GB write, 29.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache BinnedLRUCache@0x55cf0ca4f1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: starting mon.smithi072 rank 0 at public addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] at bind addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi072 fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???) e1 preinit fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).mds e1 new map 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).mds e1 print_map 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: e1 2024-04-15T20:52:16.438 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: legacy client fscid: -1 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: No filesystems configured 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expand map: {default=false} 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta from 'false' to 'false' 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expanded map: {default=false} 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expand map: {default=info} 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta from 'info' to 'info' 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expanded map: {default=info} 2024-04-15T20:52:16.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expand map: {default=daemon} 2024-04-15T20:52:16.440 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta from 'daemon' to 'daemon' 2024-04-15T20:52:16.440 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expanded map: {default=daemon} 2024-04-15T20:52:16.440 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expand map: {default=debug} 2024-04-15T20:52:16.440 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta from 'debug' to 'debug' 2024-04-15T20:52:16.440 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: expand_channel_meta expanded map: {default=debug} 2024-04-15T20:52:16.479 INFO:teuthology.orchestra.run.smithi072.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-15T20:52:16.832 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-04-15T20:52:16.832 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: monmap e1: 1 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0]} removed_ranks: {} 2024-04-15T20:52:16.832 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: fsmap 2024-04-15T20:52:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: osdmap e1: 0 total, 0 up, 0 in 2024-04-15T20:52:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 ceph-mon[29079]: mgrmap e1: no daemons active 2024-04-15T20:52:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 bash[29061]: 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd 2024-04-15T20:52:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:16 smithi072 systemd[1]: Started Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f258a3ee700 1 Processor -- start 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f258a3ee700 1 -- start start 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f258a3ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f258a3ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584106460 con 0x7f2584105b10 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f2583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f2583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49300/0 (socket says 172.21.15.72:49300) 2024-04-15T20:52:17.556 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.941+0000 7f2583fff700 1 -- 172.21.15.72:0/4124026163 learned_addr learned my addr 172.21.15.72:0/4124026163 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.942+0000 7f2583fff700 1 -- 172.21.15.72:0/4124026163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25841065a0 con 0x7f2584105b10 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.942+0000 7f2583fff700 1 --2- 172.21.15.72:0/4124026163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25740098a0 tx=0x7f2574009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59d39f99420c9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.942+0000 7f2582ffd700 1 -- 172.21.15.72:0/4124026163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2574004180 con 0x7f2584105b10 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.942+0000 7f2582ffd700 1 -- 172.21.15.72:0/4124026163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f25740042e0 con 0x7f2584105b10 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.942+0000 7f2582ffd700 1 -- 172.21.15.72:0/4124026163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2574011a50 con 0x7f2584105b10 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- 172.21.15.72:0/4124026163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 msgr2=0x7f2584105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 --2- 172.21.15.72:0/4124026163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25740098a0 tx=0x7f2574009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- 172.21.15.72:0/4124026163 shutdown_connections 2024-04-15T20:52:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 --2- 172.21.15.72:0/4124026163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584105f20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- 172.21.15.72:0/4124026163 >> 172.21.15.72:0/4124026163 conn(0x7f2584101180 msgr2=0x7f2584103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- 172.21.15.72:0/4124026163 shutdown_connections 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- 172.21.15.72:0/4124026163 wait complete. 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 Processor -- start 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.943+0000 7f258a3ee700 1 -- start start 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f258a3ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f258a3ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584199d90 con 0x7f2584105b10 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f2583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:17.558 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f2583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49302/0 (socket says 172.21.15.72:49302) 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f2583fff700 1 -- 172.21.15.72:0/644850235 learned_addr learned my addr 172.21.15.72:0/644850235 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f2583fff700 1 -- 172.21.15.72:0/644850235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009550 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f2583fff700 1 --2- 172.21.15.72:0/644850235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f25740119e0 tx=0x7f2574011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2574003b90 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f257401a8a0 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2574019930 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584199f90 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.944+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258419a3b0 con 0x7f2584105b10 2024-04-15T20:52:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.945+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f257402d440 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.945+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f25740248b0 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.945+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584062380 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:16.948+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f257401aa10 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.014+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f2584107980 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f25817fa700 1 -- 172.21.15.72:0/644850235 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f257401abb0 con 0x7f2584105b10 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 msgr2=0x7f2584199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 --2- 172.21.15.72:0/644850235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f25740119e0 tx=0x7f2574011ac0 comp rx=0 tx=0).stop 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 shutdown_connections 2024-04-15T20:52:17.560 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 --2- 172.21.15.72:0/644850235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2584105b10 0x7f2584199850 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:17.561 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 >> 172.21.15.72:0/644850235 conn(0x7f2584101180 msgr2=0x7f2584101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:17.561 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 shutdown_connections 2024-04-15T20:52:17.561 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:17.017+0000 7f258a3ee700 1 -- 172.21.15.72:0/644850235 wait complete. 2024-04-15T20:52:17.561 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-15T20:52:17.582 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-15T20:52:17.582 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mgr... 2024-04-15T20:52:17.583 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-15T20:52:17.583 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-15T20:52:17.583 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:8443 ... 2024-04-15T20:52:17.829 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mgr.smithi072.wfjmmp 2024-04-15T20:52:17.830 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mgr.smithi072.wfjmmp.service: Unit ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mgr.smithi072.wfjmmp.service not loaded. 2024-04-15T20:52:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968.target.wants/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mgr.smithi072.wfjmmp.service → /etc/systemd/system/ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@.service. 2024-04-15T20:52:18.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:18 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/644850235' entity='client.admin' 2024-04-15T20:52:18.482 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-15T20:52:18.482 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-04-15T20:52:18.489 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-15T20:52:18.489 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:52:18.489 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-04-15T20:52:18.489 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-04-15T20:52:18.497 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-15T20:52:18.498 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr to start... 2024-04-15T20:52:18.505 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr... 2024-04-15T20:52:19.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:19 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2500482210' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "e60a5b86-fb69-11ee-bc8f-c7b262605968", 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-15T20:52:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-15T20:52:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-04-15T20:52:07.240755+0000", 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1cb5b79700 1 Processor -- start 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1cb5b79700 1 -- start start 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1cb5b79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1cb5b79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0107a80 con 0x7f1cb0107130 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49316/0 (socket says 172.21.15.72:49316) 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.948+0000 7f1caf7fe700 1 -- 172.21.15.72:0/1538141680 learned_addr learned my addr 172.21.15.72:0/1538141680 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.949+0000 7f1caf7fe700 1 -- 172.21.15.72:0/1538141680 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0107bc0 con 0x7f1cb0107130 2024-04-15T20:52:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.949+0000 7f1caf7fe700 1 --2- 172.21.15.72:0/1538141680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00098a0 tx=0x7f1ca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba699dbb6e41571a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.949+0000 7f1cae7fc700 1 -- 172.21.15.72:0/1538141680 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca0004180 con 0x7f1cb0107130 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.949+0000 7f1cae7fc700 1 -- 172.21.15.72:0/1538141680 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca00042e0 con 0x7f1cb0107130 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.949+0000 7f1cae7fc700 1 -- 172.21.15.72:0/1538141680 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca0011a50 con 0x7f1cb0107130 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- 172.21.15.72:0/1538141680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 msgr2=0x7f1cb0107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 --2- 172.21.15.72:0/1538141680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00098a0 tx=0x7f1ca0009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- 172.21.15.72:0/1538141680 shutdown_connections 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 --2- 172.21.15.72:0/1538141680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0107540 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- 172.21.15.72:0/1538141680 >> 172.21.15.72:0/1538141680 conn(0x7f1cb00ff7e0 msgr2=0x7f1cb0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- 172.21.15.72:0/1538141680 shutdown_connections 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- 172.21.15.72:0/1538141680 wait complete. 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 Processor -- start 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.950+0000 7f1cb5b79700 1 -- start start 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cb5b79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cb5b79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0197b70 con 0x7f1cb0107130 2024-04-15T20:52:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49326/0 (socket says 172.21.15.72:49326) 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1caf7fe700 1 -- 172.21.15.72:0/2500482210 learned_addr learned my addr 172.21.15.72:0/2500482210 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1caf7fe700 1 -- 172.21.15.72:0/2500482210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0009550 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1caf7fe700 1 --2- 172.21.15.72:0/2500482210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca0003b90 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb0197d70 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca00248b0 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.951+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0198190 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.952+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca001a8e0 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.952+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1ca002d3f0 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.952+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1ca00194a0 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.952+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c005320 con 0x7f1cb0107130 2024-04-15T20:52:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:18.954+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1ca0024440 con 0x7f1cb0107130 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.027+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1c9c005cc0 con 0x7f1cb0107130 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.027+0000 7f1cacff9700 1 -- 172.21.15.72:0/2500482210 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f1ca0035090 con 0x7f1cb0107130 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 msgr2=0x7f1cb0197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 --2- 172.21.15.72:0/2500482210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 shutdown_connections 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 --2- 172.21.15.72:0/2500482210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cb0107130 0x7f1cb0197630 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 >> 172.21.15.72:0/2500482210 conn(0x7f1cb00ff7e0 msgr2=0x7f1cb0101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.028+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 shutdown_connections 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:19.029+0000 7f1cb5b79700 1 -- 172.21.15.72:0/2500482210 wait complete. 2024-04-15T20:52:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (1/15)... 2024-04-15T20:52:22.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:22 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3613142522' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "e60a5b86-fb69-11ee-bc8f-c7b262605968", 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:22.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-15T20:52:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-15T20:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-15T20:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-04-15T20:52:07.240755+0000", 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-15T20:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff7ad26700 1 Processor -- start 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff7ad26700 1 -- start start 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff7ad26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff7ad26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74104750 con 0x7eff74103e00 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff78ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff78ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58804/0 (socket says 172.21.15.72:58804) 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.112+0000 7eff78ac2700 1 -- 172.21.15.72:0/1928009420 learned_addr learned my addr 172.21.15.72:0/1928009420 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff78ac2700 1 -- 172.21.15.72:0/1928009420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74104890 con 0x7eff74103e00 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff78ac2700 1 --2- 172.21.15.72:0/1928009420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff680098a0 tx=0x7eff68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1c84e4ee430a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff737fe700 1 -- 172.21.15.72:0/1928009420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff68004180 con 0x7eff74103e00 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff737fe700 1 -- 172.21.15.72:0/1928009420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7eff680042e0 con 0x7eff74103e00 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff737fe700 1 -- 172.21.15.72:0/1928009420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff68011a50 con 0x7eff74103e00 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff7ad26700 1 -- 172.21.15.72:0/1928009420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 msgr2=0x7eff74104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.113+0000 7eff7ad26700 1 --2- 172.21.15.72:0/1928009420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff680098a0 tx=0x7eff68009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- 172.21.15.72:0/1928009420 shutdown_connections 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 --2- 172.21.15.72:0/1928009420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74104210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- 172.21.15.72:0/1928009420 >> 172.21.15.72:0/1928009420 conn(0x7eff740ff7e0 msgr2=0x7eff74101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- 172.21.15.72:0/1928009420 shutdown_connections 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- 172.21.15.72:0/1928009420 wait complete. 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 Processor -- start 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- start start 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.114+0000 7eff7ad26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff74199da0 con 0x7eff74103e00 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff78ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff78ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58806/0 (socket says 172.21.15.72:58806) 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff78ac2700 1 -- 172.21.15.72:0/3613142522 learned_addr learned my addr 172.21.15.72:0/3613142522 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff78ac2700 1 -- 172.21.15.72:0/3613142522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68009550 con 0x7eff74103e00 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff78ac2700 1 --2- 172.21.15.72:0/3613142522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c00 tx=0x7eff68011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff68003b90 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff74199fa0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7eff680248b0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff6801a8e0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.115+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7419a3c0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.116+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff6802d3f0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.116+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff68019490 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.116+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff741079c0 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.118+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7eff68024a20 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.191+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7eff7419d480 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.192+0000 7eff71ffb700 1 -- 172.21.15.72:0/3613142522 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7eff68035090 con 0x7eff74103e00 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 msgr2=0x7eff74199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 --2- 172.21.15.72:0/3613142522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c00 tx=0x7eff68011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 shutdown_connections 2024-04-15T20:52:22.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 --2- 172.21.15.72:0/3613142522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff74103e00 0x7eff74199860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:22.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 >> 172.21.15.72:0/3613142522 conn(0x7eff740ff7e0 msgr2=0x7eff741005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:22.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 shutdown_connections 2024-04-15T20:52:22.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:22.193+0000 7eff7ad26700 1 -- 172.21.15.72:0/3613142522 wait complete. 2024-04-15T20:52:22.836 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (2/15)... 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: Activating manager daemon smithi072.wfjmmp 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: mgrmap e2: smithi072.wfjmmp(active, starting, since 0.00303876s) 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T20:52:25.355 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:25.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:25 smithi072 ceph-mon[29079]: from='mgr.14100 172.21.15.72:0/1284337030' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "e60a5b86-fb69-11ee-bc8f-c7b262605968", 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-15T20:52:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-15T20:52:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-15T20:52:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-15T20:52:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-15T20:52:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-15T20:52:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-15T20:52:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-04-15T20:52:07.240755+0000", 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.284+0000 7ff9d8749700 1 Processor -- start 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d8749700 1 -- start start 2024-04-15T20:52:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d8749700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d8749700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0106460 con 0x7ff9d0105b10 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d64e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d64e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58876/0 (socket says 172.21.15.72:58876) 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d64e5700 1 -- 172.21.15.72:0/4286149298 learned_addr learned my addr 172.21.15.72:0/4286149298 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d64e5700 1 -- 172.21.15.72:0/4286149298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d01065a0 con 0x7ff9d0105b10 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.285+0000 7ff9d64e5700 1 --2- 172.21.15.72:0/4286149298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098a0 tx=0x7ff9cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621b12adb663db87 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d54e3700 1 -- 172.21.15.72:0/4286149298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc004180 con 0x7ff9d0105b10 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d54e3700 1 -- 172.21.15.72:0/4286149298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff9cc0042e0 con 0x7ff9d0105b10 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d54e3700 1 -- 172.21.15.72:0/4286149298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc011a50 con 0x7ff9d0105b10 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 -- 172.21.15.72:0/4286149298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 msgr2=0x7ff9d0105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 --2- 172.21.15.72:0/4286149298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098a0 tx=0x7ff9cc009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 -- 172.21.15.72:0/4286149298 shutdown_connections 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 --2- 172.21.15.72:0/4286149298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0105f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 -- 172.21.15.72:0/4286149298 >> 172.21.15.72:0/4286149298 conn(0x7ff9d0101180 msgr2=0x7ff9d0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 -- 172.21.15.72:0/4286149298 shutdown_connections 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.286+0000 7ff9d8749700 1 -- 172.21.15.72:0/4286149298 wait complete. 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d8749700 1 Processor -- start 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d8749700 1 -- start start 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d8749700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d8749700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0199d50 con 0x7ff9d0105b10 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d64e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d64e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58882/0 (socket says 172.21.15.72:58882) 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d64e5700 1 -- 172.21.15.72:0/2055626439 learned_addr learned my addr 172.21.15.72:0/2055626439 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.287+0000 7ff9d64e5700 1 -- 172.21.15.72:0/2055626439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009550 con 0x7ff9d0105b10 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9d64e5700 1 --2- 172.21.15.72:0/2055626439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0119e0 tx=0x7ff9cc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc003b90 con 0x7ff9d0105b10 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff9cc01a8a0 con 0x7ff9d0105b10 2024-04-15T20:52:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0199f50 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc019930 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.288+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d019a370 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.289+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7ff9cc01aa10 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.289+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff9cc04c210 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.289+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0062380 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.291+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff9cc018530 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.361+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff9d019d440 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.361+0000 7ff9c37fe700 1 -- 172.21.15.72:0/2055626439 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7ff9cc049020 con 0x7ff9d0105b10 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 msgr2=0x7ff9d0199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 --2- 172.21.15.72:0/2055626439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0119e0 tx=0x7ff9cc011ac0 comp rx=0 tx=0).stop 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 shutdown_connections 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 --2- 172.21.15.72:0/2055626439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d0105b10 0x7ff9d0199810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 >> 172.21.15.72:0/2055626439 conn(0x7ff9d0101180 msgr2=0x7ff9d0101f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 shutdown_connections 2024-04-15T20:52:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:25.362+0000 7ff9d8749700 1 -- 172.21.15.72:0/2055626439 wait complete. 2024-04-15T20:52:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (3/15)... 2024-04-15T20:52:26.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:26 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2055626439' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-15T20:52:26.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:26 smithi072 ceph-mon[29079]: mgrmap e3: smithi072.wfjmmp(active, since 1.00627s) 2024-04-15T20:52:28.643 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:28 smithi072 ceph-mon[29079]: mgrmap e4: smithi072.wfjmmp(active, since 2s) 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "e60a5b86-fb69-11ee-bc8f-c7b262605968", 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-15T20:52:29.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-15T20:52:29.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-15T20:52:29.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:29.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-15T20:52:29.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-15T20:52:29.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-15T20:52:29.263 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-15T20:52:29.264 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-04-15T20:52:29.265 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-04-15T20:52:07.240755+0000", 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f971e844700 1 Processor -- start 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f971e844700 1 -- start start 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f971e844700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f971e844700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718105360 con 0x7f9718104a10 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f9717fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:29.266 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f9717fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58894/0 (socket says 172.21.15.72:58894) 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.374+0000 7f9717fff700 1 -- 172.21.15.72:0/3974335408 learned_addr learned my addr 172.21.15.72:0/3974335408 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f9717fff700 1 -- 172.21.15.72:0/3974335408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97181054a0 con 0x7f9718104a10 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f9717fff700 1 --2- 172.21.15.72:0/3974335408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974487e6cb5ce47b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f9716ffd700 1 -- 172.21.15.72:0/3974335408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708004180 con 0x7f9718104a10 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f9716ffd700 1 -- 172.21.15.72:0/3974335408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f97080042e0 con 0x7f9718104a10 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f9716ffd700 1 -- 172.21.15.72:0/3974335408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708011a50 con 0x7f9718104a10 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f971e844700 1 -- 172.21.15.72:0/3974335408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 msgr2=0x7f9718104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.375+0000 7f971e844700 1 --2- 172.21.15.72:0/3974335408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 -- 172.21.15.72:0/3974335408 shutdown_connections 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 --2- 172.21.15.72:0/3974335408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718104e20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 -- 172.21.15.72:0/3974335408 >> 172.21.15.72:0/3974335408 conn(0x7f9718100060 msgr2=0x7f9718102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 -- 172.21.15.72:0/3974335408 shutdown_connections 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 -- 172.21.15.72:0/3974335408 wait complete. 2024-04-15T20:52:29.267 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 Processor -- start 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.376+0000 7f971e844700 1 -- start start 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f971e844700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f971e844700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971819c580 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f9717fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f9717fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58908/0 (socket says 172.21.15.72:58908) 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f9717fff700 1 -- 172.21.15.72:0/1049068933 learned_addr learned my addr 172.21.15.72:0/1049068933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f9717fff700 1 -- 172.21.15.72:0/1049068933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708009550 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f9717fff700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9708003b90 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f97080248b0 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971819c6c0 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.377+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f970801a8e0 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.378+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971819cae0 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.378+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f970801aba0 con 0x7f9718104a10 2024-04-15T20:52:29.268 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.378+0000 7f97157fa700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 0x7f970003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.378+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718062380 con 0x7f9718104a10 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.379+0000 7f97177fe700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 0x7f970003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.379+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f970804c2b0 con 0x7f9718104a10 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.379+0000 7f97177fe700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 0x7f970003a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.384+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f97080233a0 con 0x7f9718104a10 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.649+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9718106880 con 0x7f9718104a10 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.650+0000 7f97157fa700 1 -- 172.21.15.72:0/1049068933 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f970800a0d0 con 0x7f9718104a10 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 msgr2=0x7f970003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 0x7f970003a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:29.269 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 msgr2=0x7f9718079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 shutdown_connections 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f97000383a0 0x7f970003a850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 --2- 172.21.15.72:0/1049068933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9718104a10 0x7f9718079b20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 >> 172.21.15.72:0/1049068933 conn(0x7f9718100060 msgr2=0x7f9718100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 shutdown_connections 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:28.652+0000 7f971e844700 1 -- 172.21.15.72:0/1049068933 wait complete. 2024-04-15T20:52:29.270 INFO:teuthology.orchestra.run.smithi072.stdout:mgr is available 2024-04-15T20:52:29.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:29 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1049068933' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-15T20:52:30.519 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:30 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2489969846' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-04-15T20:52:30.528 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada6f6d700 1 Processor -- start 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada6f6d700 1 -- start start 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada6f6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada6f6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada0106940 con 0x7fada0105ff0 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada4d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada4d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58918/0 (socket says 172.21.15.72:58918) 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada4d09700 1 -- 172.21.15.72:0/3657306393 learned_addr learned my addr 172.21.15.72:0/3657306393 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.683+0000 7fada4d09700 1 -- 172.21.15.72:0/3657306393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0106a80 con 0x7fada0105ff0 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada4d09700 1 --2- 172.21.15.72:0/3657306393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad9400bb40 tx=0x7fad9400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c798a88ad06e7ef server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:30.529 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fad9f7fe700 1 -- 172.21.15.72:0/3657306393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad9400dc00 con 0x7fada0105ff0 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fad9f7fe700 1 -- 172.21.15.72:0/3657306393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fad940044a0 con 0x7fada0105ff0 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fad9f7fe700 1 -- 172.21.15.72:0/3657306393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad94010470 con 0x7fada0105ff0 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 -- 172.21.15.72:0/3657306393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 msgr2=0x7fada0106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 --2- 172.21.15.72:0/3657306393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad9400bb40 tx=0x7fad9400be50 comp rx=0 tx=0).stop 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 -- 172.21.15.72:0/3657306393 shutdown_connections 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 --2- 172.21.15.72:0/3657306393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada0106400 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 -- 172.21.15.72:0/3657306393 >> 172.21.15.72:0/3657306393 conn(0x7fada00ff7e0 msgr2=0x7fada0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 -- 172.21.15.72:0/3657306393 shutdown_connections 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.684+0000 7fada6f6d700 1 -- 172.21.15.72:0/3657306393 wait complete. 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada6f6d700 1 Processor -- start 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada6f6d700 1 -- start start 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada6f6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada6f6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada019bf60 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada4d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada4d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58930/0 (socket says 172.21.15.72:58930) 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada4d09700 1 -- 172.21.15.72:0/2489969846 learned_addr learned my addr 172.21.15.72:0/2489969846 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.685+0000 7fada4d09700 1 -- 172.21.15.72:0/2489969846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9400b7f0 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fada4d09700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad940046d0 tx=0x7fad94003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad940042a0 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada019c160 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fad94010b50 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad94021ae0 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.686+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada019c520 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.687+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fad940193f0 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.687+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada00623f0 con 0x7fada0105ff0 2024-04-15T20:52:30.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.687+0000 7fad9dffb700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 0x7fad9003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.687+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fad9404c260 con 0x7fada0105ff0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.687+0000 7fad9ffff700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 0x7fad9003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.688+0000 7fad9ffff700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 0x7fad9003a850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006fd0 tx=0x7fad8c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.692+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fada00623f0 con 0x7fada0105ff0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.879+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fada0191340 con 0x7fada0105ff0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.880+0000 7fad9dffb700 1 -- 172.21.15.72:0/2489969846 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fad9400e770 con 0x7fada0105ff0 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.882+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 msgr2=0x7fad9003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.882+0000 7fada6f6d700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 0x7fad9003a850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006fd0 tx=0x7fad8c006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 msgr2=0x7fada019ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad940046d0 tx=0x7fad94003d70 comp rx=0 tx=0).stop 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 shutdown_connections 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fad900383a0 0x7fad9003a850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 --2- 172.21.15.72:0/2489969846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada0105ff0 0x7fada019ba20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:30.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 >> 172.21.15.72:0/2489969846 conn(0x7fada00ff7e0 msgr2=0x7fada018e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:30.533 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 shutdown_connections 2024-04-15T20:52:30.533 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:29.883+0000 7fada6f6d700 1 -- 172.21.15.72:0/2489969846 wait complete. 2024-04-15T20:52:30.533 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling cephadm module... 2024-04-15T20:52:31.467 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:31 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2352407756' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-15T20:52:31.990 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.947+0000 7ff607ae2700 1 Processor -- start 2024-04-15T20:52:31.990 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff607ae2700 1 -- start start 2024-04-15T20:52:31.990 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff607ae2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:31.990 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff607ae2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600105860 con 0x7ff600104f10 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff60587e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff60587e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58942/0 (socket says 172.21.15.72:58942) 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff60587e700 1 -- 172.21.15.72:0/60106485 learned_addr learned my addr 172.21.15.72:0/60106485 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff60587e700 1 -- 172.21.15.72:0/60106485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6001059a0 con 0x7ff600104f10 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.948+0000 7ff60587e700 1 --2- 172.21.15.72:0/60106485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a023903080b860 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff60487c700 1 -- 172.21.15.72:0/60106485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5f4004180 con 0x7ff600104f10 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff60487c700 1 -- 172.21.15.72:0/60106485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff5f40042e0 con 0x7ff600104f10 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff60487c700 1 -- 172.21.15.72:0/60106485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5f4011a50 con 0x7ff600104f10 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 -- 172.21.15.72:0/60106485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 msgr2=0x7ff600105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 --2- 172.21.15.72:0/60106485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40098a0 tx=0x7ff5f4009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 -- 172.21.15.72:0/60106485 shutdown_connections 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 --2- 172.21.15.72:0/60106485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600105320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 -- 172.21.15.72:0/60106485 >> 172.21.15.72:0/60106485 conn(0x7ff6000ff7e0 msgr2=0x7ff600101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:31.991 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 -- 172.21.15.72:0/60106485 shutdown_connections 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.949+0000 7ff607ae2700 1 -- 172.21.15.72:0/60106485 wait complete. 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff607ae2700 1 Processor -- start 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff607ae2700 1 -- start start 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff607ae2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff607ae2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600199d80 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff60587e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff60587e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58954/0 (socket says 172.21.15.72:58954) 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff60587e700 1 -- 172.21.15.72:0/2352407756 learned_addr learned my addr 172.21.15.72:0/2352407756 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff60587e700 1 -- 172.21.15.72:0/2352407756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4009550 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.950+0000 7ff60587e700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006af0 tx=0x7ff5f4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5f4003b90 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff5f401a8a0 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff600199f80 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5f4019880 con 0x7ff600104f10 2024-04-15T20:52:31.992 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60019a3a0 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.951+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7ff5f401a430 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.952+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff600062380 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.952+0000 7ff5f2ffd700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 0x7ff5ec03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.952+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff5f404c680 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.952+0000 7ff60507d700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 0x7ff5ec03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.952+0000 7ff60507d700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 0x7ff5ec03a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:30.956+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff5f40187c0 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.202+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff600108ed0 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.427+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff5f402d960 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.428+0000 7ff5f2ffd700 1 -- 172.21.15.72:0/2352407756 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff5f404c0a0 con 0x7ff600104f10 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 msgr2=0x7ff5ec03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 0x7ff5ec03a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 msgr2=0x7ff600199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006af0 tx=0x7ff5f4011a90 comp rx=0 tx=0).stop 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 shutdown_connections 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7ff5ec0383b0 0x7ff5ec03a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 --2- 172.21.15.72:0/2352407756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff600104f10 0x7ff600199840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 >> 172.21.15.72:0/2352407756 conn(0x7ff6000ff7e0 msgr2=0x7ff600104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 shutdown_connections 2024-04-15T20:52:31.994 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:31.430+0000 7ff607ae2700 1 -- 172.21.15.72:0/2352407756 wait complete. 2024-04-15T20:52:32.618 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:32 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2352407756' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-15T20:52:32.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:32 smithi072 ceph-mon[29079]: mgrmap e5: smithi072.wfjmmp(active, since 6s) 2024-04-15T20:52:33.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:33.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-15T20:52:33.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "smithi072.wfjmmp", 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.419+0000 7fd3dfc38700 1 Processor -- start 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.419+0000 7fd3dfc38700 1 -- start start 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dfc38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dfc38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80744d0 con 0x7fd3d8104440 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dd9d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dd9d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52544/0 (socket says 172.21.15.72:52544) 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dd9d4700 1 -- 172.21.15.72:0/2177517111 learned_addr learned my addr 172.21.15.72:0/2177517111 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dd9d4700 1 -- 172.21.15.72:0/2177517111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d8074610 con 0x7fd3d8104440 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dd9d4700 1 --2- 172.21.15.72:0/2177517111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40098a0 tx=0x7fd3d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb482c5e1193ba77 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:33.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dc9d2700 1 -- 172.21.15.72:0/2177517111 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3d4004180 con 0x7fd3d8104440 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dc9d2700 1 -- 172.21.15.72:0/2177517111 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd3d40042e0 con 0x7fd3d8104440 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.420+0000 7fd3dc9d2700 1 -- 172.21.15.72:0/2177517111 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3d4011a50 con 0x7fd3d8104440 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 -- 172.21.15.72:0/2177517111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 msgr2=0x7fd3d8104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/2177517111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40098a0 tx=0x7fd3d4009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 -- 172.21.15.72:0/2177517111 shutdown_connections 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/2177517111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d8104850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 -- 172.21.15.72:0/2177517111 >> 172.21.15.72:0/2177517111 conn(0x7fd3d8100070 msgr2=0x7fd3d8102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 -- 172.21.15.72:0/2177517111 shutdown_connections 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.421+0000 7fd3dfc38700 1 -- 172.21.15.72:0/2177517111 wait complete. 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dfc38700 1 Processor -- start 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dfc38700 1 -- start start 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dfc38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dfc38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d819bef0 con 0x7fd3d8104440 2024-04-15T20:52:33.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dd9d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dd9d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52550/0 (socket says 172.21.15.72:52550) 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dd9d4700 1 -- 172.21.15.72:0/1950501641 learned_addr learned my addr 172.21.15.72:0/1950501641 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.422+0000 7fd3dd9d4700 1 -- 172.21.15.72:0/1950501641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009550 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3dd9d4700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000c00 tx=0x7fd3d4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3d4003b90 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd3d40248b0 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d819c150 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3d401a8e0 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.423+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d819c5d0 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd3d401ab50 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d8195220 con 0x7fd3d8104440 2024-04-15T20:52:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3ceffd700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 0x7fd3c403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd3d404bfd0 con 0x7fd3d8104440 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3dd1d3700 1 -- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 msgr2=0x7fd3c403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.424+0000 7fd3dd1d3700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 0x7fd3c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.429+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd3d40233a0 con 0x7fd3d8104440 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.625+0000 7fd3dd1d3700 1 -- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 msgr2=0x7fd3c403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.625+0000 7fd3dd1d3700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 0x7fd3c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.708+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd3d802cc30 con 0x7fd3d8104440 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.708+0000 7fd3ceffd700 1 -- 172.21.15.72:0/1950501641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd3d4018b00 con 0x7fd3d8104440 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 msgr2=0x7fd3c403a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 0x7fd3c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 msgr2=0x7fd3d819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000c00 tx=0x7fd3d4011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.277 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 shutdown_connections 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7fd3c4038440 0x7fd3c403a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 --2- 172.21.15.72:0/1950501641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3d8104440 0x7fd3d819b9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 >> 172.21.15.72:0/1950501641 conn(0x7fd3d8100070 msgr2=0x7fd3d8190000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 shutdown_connections 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:32.711+0000 7fd3dfc38700 1 -- 172.21.15.72:0/1950501641 wait complete. 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-04-15T20:52:33.278 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 5... 2024-04-15T20:52:33.517 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:33 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1950501641' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-15T20:52:38.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: Active manager daemon smithi072.wfjmmp restarted 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: Activating manager daemon smithi072.wfjmmp 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: osdmap e2: 0 total, 0 up, 0 in 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: mgrmap e6: smithi072.wfjmmp(active, starting, since 0.00324142s) 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:38.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:38.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T20:52:38.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:38 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T20:52:39.638 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:39 smithi072 ceph-mon[29079]: Found migration_current of "None". Setting to last migration. 2024-04-15T20:52:39.639 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:39 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:39.639 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:39 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:39.639 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:39 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:39.639 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:39 smithi072 ceph-mon[29079]: mgrmap e7: smithi072.wfjmmp(active, since 1.00523s) 2024-04-15T20:52:39.648 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d98aa2700 1 Processor -- start 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d98aa2700 1 -- start start 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d98aa2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d98aa2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d941064c0 con 0x7f7d94079cf0 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52554/0 (socket says 172.21.15.72:52554) 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.736+0000 7f7d9259c700 1 -- 172.21.15.72:0/2633958455 learned_addr learned my addr 172.21.15.72:0/2633958455 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.737+0000 7f7d9259c700 1 -- 172.21.15.72:0/2633958455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9410b010 con 0x7f7d94079cf0 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.737+0000 7f7d9259c700 1 --2- 172.21.15.72:0/2633958455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d840098a0 tx=0x7f7d84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a42d8cdcc467f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:39.649 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.737+0000 7f7d9159a700 1 -- 172.21.15.72:0/2633958455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d84004180 con 0x7f7d94079cf0 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.737+0000 7f7d9159a700 1 -- 172.21.15.72:0/2633958455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d840042e0 con 0x7f7d94079cf0 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.737+0000 7f7d9159a700 1 -- 172.21.15.72:0/2633958455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d84011a50 con 0x7f7d94079cf0 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 -- 172.21.15.72:0/2633958455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 msgr2=0x7f7d9410aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/2633958455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7d840098a0 tx=0x7f7d84009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 -- 172.21.15.72:0/2633958455 shutdown_connections 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/2633958455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d94079cf0 0x7f7d9410aad0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 -- 172.21.15.72:0/2633958455 >> 172.21.15.72:0/2633958455 conn(0x7f7d94100060 msgr2=0x7f7d941024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 -- 172.21.15.72:0/2633958455 shutdown_connections 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.738+0000 7f7d98aa2700 1 -- 172.21.15.72:0/2633958455 wait complete. 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d98aa2700 1 Processor -- start 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d98aa2700 1 -- start start 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d98aa2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:39.650 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d98aa2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9419c400 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52568/0 (socket says 172.21.15.72:52568) 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.739+0000 7f7d9259c700 1 -- 172.21.15.72:0/3708593425 learned_addr learned my addr 172.21.15.72:0/3708593425 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d9259c700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009550 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d9259c700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009520 tx=0x7f7d84011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d84003a80 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d84003be0 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9419c600 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d840197b0 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.740+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9419f260 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7d84019a20 con 0x7f7d9419bab0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d837fe700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d94079cf0 con 0x7f7d7c0383f0 2024-04-15T20:52:39.651 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d91d9b700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7d8404c630 con 0x7f7d9419bab0 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.741+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.942+0000 7f7d91d9b700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:33.942+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:34.343+0000 7f7d91d9b700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:34.343+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:35.144+0000 7f7d91d9b700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:35.144+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:36.745+0000 7f7d91d9b700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/4212675791 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:36.745+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:38.021+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7f7d84019d20 con 0x7f7d9419bab0 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:38.021+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 msgr2=0x7f7d7c03a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:52:39.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:38.021+0000 7f7d837fe700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.022+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f7d840172b0 con 0x7f7d9419bab0 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.022+0000 7f7d837fe700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 0x7f7d7c03def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.022+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d94079cf0 con 0x7f7d7c03bb10 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.022+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 0x7f7d7c03def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.023+0000 7f7d91d9b700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 0x7f7d7c03def0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7d88003a10 tx=0x7f7d880092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.023+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f7d94079cf0 con 0x7f7d7c03bb10 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7d9419ce30 con 0x7f7d7c03bb10 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d837fe700 1 -- 172.21.15.72:0/3708593425 <== mgr.14120 v2:172.21.15.72:6800/3853111144 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7d9419ce30 con 0x7f7d7c03bb10 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 msgr2=0x7f7d7c03def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 0x7f7d7c03def0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7d88003a10 tx=0x7f7d880092b0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 msgr2=0x7f7d9419bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009520 tx=0x7f7d84011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 shutdown_connections 2024-04-15T20:52:39.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f7d7c03bb10 0x7f7d7c03def0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9419bab0 0x7f7d9419bec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 --2- 172.21.15.72:0/3708593425 >> [v2:172.21.15.72:6800/4212675791,v1:172.21.15.72:6801/4212675791] conn(0x7f7d7c0383f0 0x7f7d7c03a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 >> 172.21.15.72:0/3708593425 conn(0x7f7d94100060 msgr2=0x7f7d941017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.030+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 shutdown_connections 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:39.031+0000 7f7d98aa2700 1 -- 172.21.15.72:0/3708593425 wait complete. 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 5 is available 2024-04-15T20:52:39.654 INFO:teuthology.orchestra.run.smithi072.stdout:Setting orchestrator backend to cephadm... 2024-04-15T20:52:40.583 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: [15/Apr/2024:20:52:38] ENGINE Bus STARTING 2024-04-15T20:52:40.583 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: [15/Apr/2024:20:52:38] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T20:52:40.583 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: [15/Apr/2024:20:52:38] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T20:52:40.584 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: [15/Apr/2024:20:52:38] ENGINE Bus STARTED 2024-04-15T20:52:40.584 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-15T20:52:40.584 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-15T20:52:40.584 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:40.584 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:40 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:40.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88f54b700 1 Processor -- start 2024-04-15T20:52:40.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88f54b700 1 -- start start 2024-04-15T20:52:40.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88f54b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:40.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88f54b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888079d70 con 0x7fc888106620 2024-04-15T20:52:40.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88d2e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:40.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88d2e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52640/0 (socket says 172.21.15.72:52640) 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.059+0000 7fc88d2e7700 1 -- 172.21.15.72:0/2099442784 learned_addr learned my addr 172.21.15.72:0/2099442784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc88d2e7700 1 -- 172.21.15.72:0/2099442784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888079eb0 con 0x7fc888106620 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc88d2e7700 1 --2- 172.21.15.72:0/2099442784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc8840098a0 tx=0x7fc884009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133681b9f2240320 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc87ffff700 1 -- 172.21.15.72:0/2099442784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc884004180 con 0x7fc888106620 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc87ffff700 1 -- 172.21.15.72:0/2099442784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc8840042e0 con 0x7fc888106620 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc87ffff700 1 -- 172.21.15.72:0/2099442784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc884011a50 con 0x7fc888106620 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc88f54b700 1 -- 172.21.15.72:0/2099442784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 msgr2=0x7fc888108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.060+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2099442784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc8840098a0 tx=0x7fc884009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- 172.21.15.72:0/2099442784 shutdown_connections 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2099442784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888108a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- 172.21.15.72:0/2099442784 >> 172.21.15.72:0/2099442784 conn(0x7fc888100060 msgr2=0x7fc888102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- 172.21.15.72:0/2099442784 shutdown_connections 2024-04-15T20:52:40.895 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- 172.21.15.72:0/2099442784 wait complete. 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 Processor -- start 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- start start 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88f54b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888199d80 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.061+0000 7fc88d2e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88d2e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52654/0 (socket says 172.21.15.72:52654) 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88d2e7700 1 -- 172.21.15.72:0/2077779741 learned_addr learned my addr 172.21.15.72:0/2077779741 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88d2e7700 1 -- 172.21.15.72:0/2077779741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884009550 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88d2e7700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc884000c00 tx=0x7fc884011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc884003b90 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc8840248b0 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc888199f80 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc88401a8e0 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.062+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88819a3a0 con 0x7fc888106620 2024-04-15T20:52:40.896 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.063+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fc884024440 con 0x7fc888106620 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.063+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888109b90 con 0x7fc888106620 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.063+0000 7fc87e7fc700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 0x7fc87403a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.063+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc88404c200 con 0x7fc888106620 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.063+0000 7fc88cae6700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 0x7fc87403a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.064+0000 7fc88cae6700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 0x7fc87403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc878006fd0 tx=0x7fc878006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.068+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc884018b40 con 0x7fc888106620 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.270+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fc88819d200 con 0x7fc874038320 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.276+0000 7fc87e7fc700 1 -- 172.21.15.72:0/2077779741 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc88819d200 con 0x7fc874038320 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 msgr2=0x7fc87403a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 0x7fc87403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc878006fd0 tx=0x7fc878006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 msgr2=0x7fc888199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:40.897 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc884000c00 tx=0x7fc884011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 shutdown_connections 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc874038320 0x7fc87403a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 --2- 172.21.15.72:0/2077779741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc888106620 0x7fc888199840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 >> 172.21.15.72:0/2077779741 conn(0x7fc888100060 msgr2=0x7fc8881017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 shutdown_connections 2024-04-15T20:52:40.898 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:40.278+0000 7fc88f54b700 1 -- 172.21.15.72:0/2077779741 wait complete. 2024-04-15T20:52:41.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:41 smithi072 ceph-mon[29079]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:41.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:41 smithi072 ceph-mon[29079]: mgrmap e8: smithi072.wfjmmp(active, since 2s) 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f59595a7700 1 Processor -- start 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f59595a7700 1 -- start start 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f59595a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f59595a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5954105350 con 0x7f5954104a00 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5952ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:42.126 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5952ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52656/0 (socket says 172.21.15.72:52656) 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5952ffd700 1 -- 172.21.15.72:0/2703378956 learned_addr learned my addr 172.21.15.72:0/2703378956 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5952ffd700 1 -- 172.21.15.72:0/2703378956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954105490 con 0x7f5954104a00 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5952ffd700 1 --2- 172.21.15.72:0/2703378956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59440098a0 tx=0x7f5944009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d572e214fce98481 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.302+0000 7f5951ffb700 1 -- 172.21.15.72:0/2703378956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5944004180 con 0x7f5954104a00 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f5951ffb700 1 -- 172.21.15.72:0/2703378956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59440042e0 con 0x7f5954104a00 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f5951ffb700 1 -- 172.21.15.72:0/2703378956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5944011a50 con 0x7f5954104a00 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 -- 172.21.15.72:0/2703378956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 msgr2=0x7f5954104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 --2- 172.21.15.72:0/2703378956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59440098a0 tx=0x7f5944009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 -- 172.21.15.72:0/2703378956 shutdown_connections 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 --2- 172.21.15.72:0/2703378956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954104e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 -- 172.21.15.72:0/2703378956 >> 172.21.15.72:0/2703378956 conn(0x7f5954100070 msgr2=0x7f5954102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:42.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 -- 172.21.15.72:0/2703378956 shutdown_connections 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.303+0000 7f59595a7700 1 -- 172.21.15.72:0/2703378956 wait complete. 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f59595a7700 1 Processor -- start 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f59595a7700 1 -- start start 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f59595a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f59595a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5954198c80 con 0x7f5954104a00 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f5952ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f5952ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52662/0 (socket says 172.21.15.72:52662) 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f5952ffd700 1 -- 172.21.15.72:0/40394118 learned_addr learned my addr 172.21.15.72:0/40394118 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.304+0000 7f5952ffd700 1 -- 172.21.15.72:0/40394118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009550 con 0x7f5954104a00 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f5952ffd700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5944000c00 tx=0x7f5944011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5944003b90 con 0x7f5954104a00 2024-04-15T20:52:42.128 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59440248b0 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f594401a8e0 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5954198e80 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.305+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59541992a0 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5944024440 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f593bfff700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 0x7f593c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5954062380 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f594404c3d0 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f59527fc700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 0x7f593c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.306+0000 7f59527fc700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 0x7f593c03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5948006fd0 tx=0x7f5948006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.311+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f59440189a0 con 0x7f5954104a00 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.502+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f5954101550 con 0x7f593c038440 2024-04-15T20:52:42.129 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.503+0000 7f593bfff700 1 -- 172.21.15.72:0/40394118 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f5954101550 con 0x7f593c038440 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 msgr2=0x7f593c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 0x7f593c03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5948006fd0 tx=0x7f5948006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 msgr2=0x7f5954198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5944000c00 tx=0x7f5944011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 shutdown_connections 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f593c038440 0x7f593c03a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 --2- 172.21.15.72:0/40394118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5954104a00 0x7f5954198740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 >> 172.21.15.72:0/40394118 conn(0x7f5954100070 msgr2=0x7f5954100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 shutdown_connections 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:41.505+0000 7f59595a7700 1 -- 172.21.15.72:0/40394118 wait complete. 2024-04-15T20:52:42.130 INFO:teuthology.orchestra.run.smithi072.stdout:Generating ssh key... 2024-04-15T20:52:42.721 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:42 smithi072 ceph-mon[29079]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:43.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c3149e700 1 Processor -- start 2024-04-15T20:52:43.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c3149e700 1 -- start start 2024-04-15T20:52:43.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c3149e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:43.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c3149e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c105340 con 0x7f3c2c1049f0 2024-04-15T20:52:43.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54540/0 (socket says 172.21.15.72:54540) 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c2affd700 1 -- 172.21.15.72:0/3312891079 learned_addr learned my addr 172.21.15.72:0/3312891079 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c2affd700 1 -- 172.21.15.72:0/3312891079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c105480 con 0x7f3c2c1049f0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.526+0000 7f3c2affd700 1 --2- 172.21.15.72:0/3312891079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0098a0 tx=0x7f3c1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f490001661d33dd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c29ffb700 1 -- 172.21.15.72:0/3312891079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c004180 con 0x7f3c2c1049f0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c29ffb700 1 -- 172.21.15.72:0/3312891079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0042e0 con 0x7f3c2c1049f0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c29ffb700 1 -- 172.21.15.72:0/3312891079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c011a50 con 0x7f3c2c1049f0 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 -- 172.21.15.72:0/3312891079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 msgr2=0x7f3c2c104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 --2- 172.21.15.72:0/3312891079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0098a0 tx=0x7f3c1c009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 -- 172.21.15.72:0/3312891079 shutdown_connections 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 --2- 172.21.15.72:0/3312891079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c104e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 -- 172.21.15.72:0/3312891079 >> 172.21.15.72:0/3312891079 conn(0x7f3c2c100080 msgr2=0x7f3c2c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:43.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 -- 172.21.15.72:0/3312891079 shutdown_connections 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.527+0000 7f3c3149e700 1 -- 172.21.15.72:0/3312891079 wait complete. 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c3149e700 1 Processor -- start 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c3149e700 1 -- start start 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c3149e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c3149e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c19c540 con 0x7f3c2c1049f0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54556/0 (socket says 172.21.15.72:54556) 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.528+0000 7f3c2affd700 1 -- 172.21.15.72:0/1360722171 learned_addr learned my addr 172.21.15.72:0/1360722171 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.529+0000 7f3c2affd700 1 -- 172.21.15.72:0/1360722171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009550 con 0x7f3c2c1049f0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.529+0000 7f3c2affd700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c000c00 tx=0x7f3c1c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.532+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c003b90 con 0x7f3c2c1049f0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.532+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3c1c0248b0 con 0x7f3c2c1049f0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.532+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c19c680 con 0x7f3c2c1049f0 2024-04-15T20:52:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.532+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c01a8e0 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.532+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c19caa0 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3c1c01aba0 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c062380 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c13fff700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 0x7f3c1403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3c1c04c540 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c2a7fc700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 0x7f3c1403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.533+0000 7f3c2a7fc700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 0x7f3c1403a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.538+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3c1c02dc90 con 0x7f3c2c1049f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.727+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c2c101500 con 0x7f3c140383f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.820+0000 7f3c13fff700 1 -- 172.21.15.72:0/1360722171 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3c2c101500 con 0x7f3c140383f0 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 msgr2=0x7f3c1403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 0x7f3c1403a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 msgr2=0x7f3c2c079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:43.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c000c00 tx=0x7f3c1c011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 shutdown_connections 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f3c140383f0 0x7f3c1403a8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 --2- 172.21.15.72:0/1360722171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c2c1049f0 0x7f3c2c079b20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.822+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 >> 172.21.15.72:0/1360722171 conn(0x7f3c2c100080 msgr2=0x7f3c2c100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.823+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 shutdown_connections 2024-04-15T20:52:43.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:42.823+0000 7f3c3149e700 1 -- 172.21.15.72:0/1360722171 wait complete. 2024-04-15T20:52:44.068 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:43 smithi072 ceph-mon[29079]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:44.068 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:43 smithi072 ceph-mon[29079]: Generating ssh key... 2024-04-15T20:52:44.068 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:43 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:44.068 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:43 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:44.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHbyzcqzGP/YrSrOFoPz4MIizbhi06Nr7WkbW8cKtuOEe47nfGNEgQivs28FVNx6SExQAhZPj6Vim8HWPoQNtyeB589YAMU7kZEviN/yQrjqfqz/30Wzz1wBcRE77BDXBl21gm8J8vybybgneBOFwhcjuvqq77HIoTYERCTU4v4J790QyOYRTxATbFF9JU9ZzFo3zuhbW9+YU9Gl3r66Hz5YO1vYd8o0R8DjpSOgV1tG6cVTslZywdPrZL+Fo1ecCSX4xjFVqnMYMaX9JZpUt3c+IFCqO5J8ZL2CidslZV8tcI7DrNbfARSfaYoRtnyQy+ICMr90t9gpnevGVF9JXPxs8VGary/xg1fTXkRqaj2557YdzNhg1VcyTF9QFxUQzJs914MMCaaWLtX1XvwcHb5wxytBkQvXzEEwC/FlRqs+w5OB/mquaDN8ZoI19ma3wUjm8pqI271MrVMPUcPFJhGCFGS923LMe719CukIxXJlWmOm2BohjL/CWl/trvgBE= ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f11268c0700 1 Processor -- start 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f11268c0700 1 -- start start 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f11268c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f11268c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120105350 con 0x7f1120104a00 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f111ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f111ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54568/0 (socket says 172.21.15.72:54568) 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.873+0000 7f111ffff700 1 -- 172.21.15.72:0/1896633727 learned_addr learned my addr 172.21.15.72:0/1896633727 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f111ffff700 1 -- 172.21.15.72:0/1896633727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120105490 con 0x7f1120104a00 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f111ffff700 1 --2- 172.21.15.72:0/1896633727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11100098a0 tx=0x7f1110009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708d236041e85717 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f111effd700 1 -- 172.21.15.72:0/1896633727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1110004180 con 0x7f1120104a00 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f111effd700 1 -- 172.21.15.72:0/1896633727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f11100042e0 con 0x7f1120104a00 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f111effd700 1 -- 172.21.15.72:0/1896633727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1110011a50 con 0x7f1120104a00 2024-04-15T20:52:44.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f11268c0700 1 -- 172.21.15.72:0/1896633727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 msgr2=0x7f1120104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f11268c0700 1 --2- 172.21.15.72:0/1896633727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11100098a0 tx=0x7f1110009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f11268c0700 1 -- 172.21.15.72:0/1896633727 shutdown_connections 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f11268c0700 1 --2- 172.21.15.72:0/1896633727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f1120104e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.874+0000 7f11268c0700 1 -- 172.21.15.72:0/1896633727 >> 172.21.15.72:0/1896633727 conn(0x7f1120100070 msgr2=0x7f1120102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 -- 172.21.15.72:0/1896633727 shutdown_connections 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 -- 172.21.15.72:0/1896633727 wait complete. 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 Processor -- start 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 -- start start 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.875+0000 7f11268c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112019c570 con 0x7f1120104a00 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54574/0 (socket says 172.21.15.72:54574) 2024-04-15T20:52:44.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111ffff700 1 -- 172.21.15.72:0/3907880081 learned_addr learned my addr 172.21.15.72:0/3907880081 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111ffff700 1 -- 172.21.15.72:0/3907880081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110009550 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111ffff700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1110003b90 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f11100248b0 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f111001a8e0 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112019c6b0 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.876+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112019cad0 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.877+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1110024440 con 0x7f1120104a00 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.877+0000 7f111d7fa700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 0x7f110803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.877+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f111004c3d0 con 0x7f1120104a00 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.877+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120062380 con 0x7f1120104a00 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.877+0000 7f111f7fe700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 0x7f110803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.878+0000 7f111f7fe700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 0x7f110803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1114006fd0 tx=0x7f1114006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:43.882+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f11100189a0 con 0x7f1120104a00 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.074+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1120106a00 con 0x7f1108038440 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.075+0000 7f111d7fa700 1 -- 172.21.15.72:0/3907880081 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1120106a00 con 0x7f1108038440 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 msgr2=0x7f110803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 0x7f110803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1114006fd0 tx=0x7f1114006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 msgr2=0x7f11200742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 shutdown_connections 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f1108038440 0x7f110803a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 --2- 172.21.15.72:0/3907880081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1120104a00 0x7f11200742e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 >> 172.21.15.72:0/3907880081 conn(0x7f1120100070 msgr2=0x7f1120100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:44.663 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 shutdown_connections 2024-04-15T20:52:44.663 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:44.077+0000 7f11268c0700 1 -- 172.21.15.72:0/3907880081 wait complete. 2024-04-15T20:52:44.663 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-15T20:52:44.663 INFO:teuthology.orchestra.run.smithi072.stdout:Adding key to root@localhost authorized_keys... 2024-04-15T20:52:44.663 INFO:teuthology.orchestra.run.smithi072.stdout:Adding host smithi072... 2024-04-15T20:52:44.902 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:44 smithi072 ceph-mon[29079]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:45.853 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:45 smithi072 ceph-mon[29079]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:47.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:47 smithi072 ceph-mon[29079]: Deploying cephadm binary to smithi072 2024-04-15T20:52:48.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Added host 'smithi072' with addr '172.21.15.72' 2024-04-15T20:52:48.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.107+0000 7fca7538f700 1 Processor -- start 2024-04-15T20:52:48.530 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.107+0000 7fca7538f700 1 -- start start 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.107+0000 7fca7538f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.107+0000 7fca7538f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70106480 con 0x7fca70079cf0 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54590/0 (socket says 172.21.15.72:54590) 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6effd700 1 -- 172.21.15.72:0/458428214 learned_addr learned my addr 172.21.15.72:0/458428214 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6effd700 1 -- 172.21.15.72:0/458428214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7010afd0 con 0x7fca70079cf0 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6effd700 1 --2- 172.21.15.72:0/458428214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca640098a0 tx=0x7fca64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f240a5279b36be8b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6dffb700 1 -- 172.21.15.72:0/458428214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca64004180 con 0x7fca70079cf0 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6dffb700 1 -- 172.21.15.72:0/458428214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca640042e0 con 0x7fca70079cf0 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.108+0000 7fca6dffb700 1 -- 172.21.15.72:0/458428214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca64011a50 con 0x7fca70079cf0 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 -- 172.21.15.72:0/458428214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 msgr2=0x7fca7010aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 --2- 172.21.15.72:0/458428214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca640098a0 tx=0x7fca64009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:48.533 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 -- 172.21.15.72:0/458428214 shutdown_connections 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 --2- 172.21.15.72:0/458428214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca70079cf0 0x7fca7010aa90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 -- 172.21.15.72:0/458428214 >> 172.21.15.72:0/458428214 conn(0x7fca70100080 msgr2=0x7fca70102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 -- 172.21.15.72:0/458428214 shutdown_connections 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 -- 172.21.15.72:0/458428214 wait complete. 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.109+0000 7fca7538f700 1 Processor -- start 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca7538f700 1 -- start start 2024-04-15T20:52:48.534 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca7538f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca7538f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7019c350 con 0x7fca7019ba00 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54598/0 (socket says 172.21.15.72:54598) 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca6effd700 1 -- 172.21.15.72:0/1212763549 learned_addr learned my addr 172.21.15.72:0/1212763549 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca6effd700 1 -- 172.21.15.72:0/1212763549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009550 con 0x7fca7019ba00 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.110+0000 7fca6effd700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca64000c00 tx=0x7fca64011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.111+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca64003b90 con 0x7fca7019ba00 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.111+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca640248b0 con 0x7fca7019ba00 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.111+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca6401a8e0 con 0x7fca7019ba00 2024-04-15T20:52:48.535 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.111+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7019c550 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.111+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7019f1b0 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70079cf0 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fca6401aba0 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca57fff700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 0x7fca5803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fca6404c610 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca6e7fc700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 0x7fca5803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.112+0000 7fca6e7fc700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 0x7fca5803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.120+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fca640233a0 con 0x7fca7019ba00 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:45.335+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}) v1 -- 0x7fca70102360 con 0x7fca580383f0 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.903+0000 7fca57fff700 1 -- 172.21.15.72:0/1212763549 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fca70102360 con 0x7fca580383f0 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.906+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 msgr2=0x7fca5803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.906+0000 7fca7538f700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 0x7fca5803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:48.536 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.906+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 msgr2=0x7fca7019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.906+0000 7fca7538f700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca64000c00 tx=0x7fca64011ab0 comp rx=0 tx=0).stop 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 shutdown_connections 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fca580383f0 0x7fca5803a8a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 --2- 172.21.15.72:0/1212763549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca7019ba00 0x7fca7019be10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 >> 172.21.15.72:0/1212763549 conn(0x7fca70100080 msgr2=0x7fca70101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 shutdown_connections 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:47.907+0000 7fca7538f700 1 -- 172.21.15.72:0/1212763549 wait complete. 2024-04-15T20:52:48.537 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying mon service with default placement... 2024-04-15T20:52:49.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:48 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:48 smithi072 ceph-mon[29079]: Added host smithi072 2024-04-15T20:52:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:48 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:52:49.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.953+0000 7f6ba3ed8700 1 Processor -- start 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba3ed8700 1 -- start start 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba3ed8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba3ed8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c079d30 con 0x7f6b9c106660 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba1c74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba1c74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54606/0 (socket says 172.21.15.72:54606) 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba1c74700 1 -- 172.21.15.72:0/3541686982 learned_addr learned my addr 172.21.15.72:0/3541686982 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba1c74700 1 -- 172.21.15.72:0/3541686982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c079e70 con 0x7f6b9c106660 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba1c74700 1 --2- 172.21.15.72:0/3541686982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098a0 tx=0x7f6b98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdee7c5ff098ea5b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.954+0000 7f6ba0c72700 1 -- 172.21.15.72:0/3541686982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b98004180 con 0x7f6b9c106660 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba0c72700 1 -- 172.21.15.72:0/3541686982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b980042e0 con 0x7f6b9c106660 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba0c72700 1 -- 172.21.15.72:0/3541686982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b98011a50 con 0x7f6b9c106660 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/3541686982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 msgr2=0x7f6b9c108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:49.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/3541686982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098a0 tx=0x7f6b98009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/3541686982 shutdown_connections 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/3541686982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c108a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/3541686982 >> 172.21.15.72:0/3541686982 conn(0x7f6b9c100060 msgr2=0x7f6b9c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/3541686982 shutdown_connections 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.955+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/3541686982 wait complete. 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba3ed8700 1 Processor -- start 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba3ed8700 1 -- start start 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba3ed8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba3ed8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c199d70 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba1c74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba1c74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54610/0 (socket says 172.21.15.72:54610) 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba1c74700 1 -- 172.21.15.72:0/1223185936 learned_addr learned my addr 172.21.15.72:0/1223185936 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba1c74700 1 -- 172.21.15.72:0/1223185936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009550 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.956+0000 7f6ba1c74700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006af0 tx=0x7f6b98011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b98003b90 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b9801a8a0 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c199fd0 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b98019880 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c19a450 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.957+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6b9801a430 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.958+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c0623f0 con 0x7f6b9c106660 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.958+0000 7f6b8effd700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 0x7f6b8803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:49.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.958+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6b9804c840 con 0x7f6b9c106660 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.958+0000 7f6ba1473700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 0x7f6b8803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.958+0000 7f6ba1473700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 0x7f6b8803a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:48.963+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6b9c0623f0 con 0x7f6b9c106660 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.182+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b9c062380 con 0x7f6b880383b0 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.187+0000 7f6b8effd700 1 -- 172.21.15.72:0/1223185936 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6b9c062380 con 0x7f6b880383b0 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 msgr2=0x7f6b8803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 0x7f6b8803a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 msgr2=0x7f6b9c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006af0 tx=0x7f6b98011a90 comp rx=0 tx=0).stop 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 shutdown_connections 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f6b880383b0 0x7f6b8803a860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 --2- 172.21.15.72:0/1223185936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b9c106660 0x7f6b9c199830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 >> 172.21.15.72:0/1223185936 conn(0x7f6b9c100060 msgr2=0x7f6b9c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:49.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 shutdown_connections 2024-04-15T20:52:49.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:49.189+0000 7f6ba3ed8700 1 -- 172.21.15.72:0/1223185936 wait complete. 2024-04-15T20:52:49.868 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying mgr service with default placement... 2024-04-15T20:52:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:50 smithi072 ceph-mon[29079]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:50 smithi072 ceph-mon[29079]: Saving service mon spec with placement count:5 2024-04-15T20:52:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:50 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.266+0000 7fdb411e5700 1 Processor -- start 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.266+0000 7fdb411e5700 1 -- start start 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb411e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb411e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c105360 con 0x7fdb3c104a10 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54624/0 (socket says 172.21.15.72:54624) 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb3ad9d700 1 -- 172.21.15.72:0/2750169532 learned_addr learned my addr 172.21.15.72:0/2750169532 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb3ad9d700 1 -- 172.21.15.72:0/2750169532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c1054a0 con 0x7fdb3c104a10 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb3ad9d700 1 --2- 172.21.15.72:0/2750169532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0098a0 tx=0x7fdb2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a898b396e364e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:51.307 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb39d9b700 1 -- 172.21.15.72:0/2750169532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2c004180 con 0x7fdb3c104a10 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb39d9b700 1 -- 172.21.15.72:0/2750169532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdb2c0042e0 con 0x7fdb3c104a10 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.267+0000 7fdb39d9b700 1 -- 172.21.15.72:0/2750169532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2c011a50 con 0x7fdb3c104a10 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 -- 172.21.15.72:0/2750169532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 msgr2=0x7fdb3c104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2750169532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0098a0 tx=0x7fdb2c009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 -- 172.21.15.72:0/2750169532 shutdown_connections 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2750169532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c104e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 -- 172.21.15.72:0/2750169532 >> 172.21.15.72:0/2750169532 conn(0x7fdb3c100060 msgr2=0x7fdb3c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 -- 172.21.15.72:0/2750169532 shutdown_connections 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.268+0000 7fdb411e5700 1 -- 172.21.15.72:0/2750169532 wait complete. 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb411e5700 1 Processor -- start 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb411e5700 1 -- start start 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb411e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:51.308 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb411e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c198c70 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54630/0 (socket says 172.21.15.72:54630) 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb3ad9d700 1 -- 172.21.15.72:0/2112573962 learned_addr learned my addr 172.21.15.72:0/2112573962 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb3ad9d700 1 -- 172.21.15.72:0/2112573962 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009550 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.269+0000 7fdb3ad9d700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0119e0 tx=0x7fdb2c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.270+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2c003b90 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.270+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdb2c01a8a0 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.270+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c198e70 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.270+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2c019930 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.270+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c199290 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fdb2c019bf0 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c062380 con 0x7fdb3c104a10 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb23fff700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 0x7fdb2403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:51.309 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdb2c04c730 con 0x7fdb3c104a10 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb3a59c700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 0x7fdb2403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.271+0000 7fdb3a59c700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 0x7fdb2403a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006fd0 tx=0x7fdb30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.275+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdb2c02b700 con 0x7fdb3c104a10 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.480+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb3c101520 con 0x7fdb240383b0 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.485+0000 7fdb23fff700 1 -- 172.21.15.72:0/2112573962 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdb3c101520 con 0x7fdb240383b0 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 msgr2=0x7fdb2403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 0x7fdb2403a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006fd0 tx=0x7fdb30006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 msgr2=0x7fdb3c198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0119e0 tx=0x7fdb2c011ac0 comp rx=0 tx=0).stop 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 shutdown_connections 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fdb240383b0 0x7fdb2403a860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 --2- 172.21.15.72:0/2112573962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb3c104a10 0x7fdb3c198730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:51.310 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 >> 172.21.15.72:0/2112573962 conn(0x7fdb3c100060 msgr2=0x7fdb3c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:51.311 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 shutdown_connections 2024-04-15T20:52:51.311 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:50.487+0000 7fdb411e5700 1 -- 172.21.15.72:0/2112573962 wait complete. 2024-04-15T20:52:51.311 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying crash service with default placement... 2024-04-15T20:52:51.731 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:51 smithi072 ceph-mon[29079]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:51.731 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:51 smithi072 ceph-mon[29079]: Saving service mgr spec with placement count:2 2024-04-15T20:52:51.731 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:51 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481fd3b700 1 Processor -- start 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481fd3b700 1 -- start start 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481fd3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481fd3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818079d70 con 0x7f4818106620 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481dad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481dad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40174/0 (socket says 172.21.15.72:40174) 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.751+0000 7f481dad7700 1 -- 172.21.15.72:0/576073485 learned_addr learned my addr 172.21.15.72:0/576073485 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.752+0000 7f481dad7700 1 -- 172.21.15.72:0/576073485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818079eb0 con 0x7f4818106620 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.752+0000 7f481dad7700 1 --2- 172.21.15.72:0/576073485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48140098a0 tx=0x7f4814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52381b4b7a30e142 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.752+0000 7f481cad5700 1 -- 172.21.15.72:0/576073485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4814004180 con 0x7f4818106620 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.752+0000 7f481cad5700 1 -- 172.21.15.72:0/576073485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f48140042e0 con 0x7f4818106620 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.752+0000 7f481cad5700 1 -- 172.21.15.72:0/576073485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4814011a50 con 0x7f4818106620 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- 172.21.15.72:0/576073485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 msgr2=0x7f4818108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 --2- 172.21.15.72:0/576073485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48140098a0 tx=0x7f4814009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- 172.21.15.72:0/576073485 shutdown_connections 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 --2- 172.21.15.72:0/576073485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818108a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- 172.21.15.72:0/576073485 >> 172.21.15.72:0/576073485 conn(0x7f4818100060 msgr2=0x7f4818102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- 172.21.15.72:0/576073485 shutdown_connections 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- 172.21.15.72:0/576073485 wait complete. 2024-04-15T20:52:52.771 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 Processor -- start 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- start start 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.753+0000 7f481fd3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818199db0 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481dad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481dad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40184/0 (socket says 172.21.15.72:40184) 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481dad7700 1 -- 172.21.15.72:0/3715640637 learned_addr learned my addr 172.21.15.72:0/3715640637 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481dad7700 1 -- 172.21.15.72:0/3715640637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4814009550 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481dad7700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4814006af0 tx=0x7f4814011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4814003b90 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f481401a8a0 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4814019880 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4818199fb0 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.754+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481819a3d0 con 0x7f4818106620 2024-04-15T20:52:52.772 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.755+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f481401a430 con 0x7f4818106620 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.755+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4818062380 con 0x7f4818106620 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.755+0000 7f480effd700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 0x7f480403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.755+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f481404c7c0 con 0x7f4818106620 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.755+0000 7f481d2d6700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 0x7f480403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.756+0000 7f481d2d6700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 0x7f480403a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4808006fd0 tx=0x7f4808006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.760+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4814019d20 con 0x7f4818106620 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.963+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f4818102380 con 0x7f48040383b0 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.967+0000 7f480effd700 1 -- 172.21.15.72:0/3715640637 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f4818102380 con 0x7f48040383b0 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 msgr2=0x7f480403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 0x7f480403a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4808006fd0 tx=0x7f4808006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 msgr2=0x7f4818199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4814006af0 tx=0x7f4814011a90 comp rx=0 tx=0).stop 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 shutdown_connections 2024-04-15T20:52:52.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f48040383b0 0x7f480403a860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:52.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 --2- 172.21.15.72:0/3715640637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4818106620 0x7f4818199870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:52.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 >> 172.21.15.72:0/3715640637 conn(0x7f4818100060 msgr2=0x7f4818101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:52.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 shutdown_connections 2024-04-15T20:52:52.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:51.969+0000 7f481fd3b700 1 -- 172.21.15.72:0/3715640637 wait complete. 2024-04-15T20:52:52.774 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying ceph-exporter service with default placement... 2024-04-15T20:52:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:52 smithi072 ceph-mon[29079]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:52 smithi072 ceph-mon[29079]: Saving service crash spec with placement * 2024-04-15T20:52:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:52 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:52 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.183+0000 7fa1407ab700 1 Processor -- start 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.183+0000 7fa1407ab700 1 -- start start 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.183+0000 7fa1407ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.183+0000 7fa1407ab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138105380 con 0x7fa138104a30 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13e547700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13e547700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40186/0 (socket says 172.21.15.72:40186) 2024-04-15T20:52:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13e547700 1 -- 172.21.15.72:0/959320347 learned_addr learned my addr 172.21.15.72:0/959320347 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13e547700 1 -- 172.21.15.72:0/959320347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1381054c0 con 0x7fa138104a30 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13e547700 1 --2- 172.21.15.72:0/959320347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa134009e80 tx=0x7fa13400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9a06ef6217bba server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13d545700 1 -- 172.21.15.72:0/959320347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13400e070 con 0x7fa138104a30 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13d545700 1 -- 172.21.15.72:0/959320347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa13400b8c0 con 0x7fa138104a30 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.184+0000 7fa13d545700 1 -- 172.21.15.72:0/959320347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1340044d0 con 0x7fa138104a30 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- 172.21.15.72:0/959320347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 msgr2=0x7fa138104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 --2- 172.21.15.72:0/959320347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa134009e80 tx=0x7fa13400b330 comp rx=0 tx=0).stop 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- 172.21.15.72:0/959320347 shutdown_connections 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 --2- 172.21.15.72:0/959320347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa138104e40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- 172.21.15.72:0/959320347 >> 172.21.15.72:0/959320347 conn(0x7fa138100060 msgr2=0x7fa1381024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- 172.21.15.72:0/959320347 shutdown_connections 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- 172.21.15.72:0/959320347 wait complete. 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 Processor -- start 2024-04-15T20:52:54.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.185+0000 7fa1407ab700 1 -- start start 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa1407ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa1407ab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138199de0 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa13e547700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa13e547700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40200/0 (socket says 172.21.15.72:40200) 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa13e547700 1 -- 172.21.15.72:0/225828247 learned_addr learned my addr 172.21.15.72:0/225828247 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa13e547700 1 -- 172.21.15.72:0/225828247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134009b30 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa13e547700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa134000f80 tx=0x7fa1340049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13400e040 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa138199fe0 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa13400bd00 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa134012770 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.186+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13819a460 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.187+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138062380 con 0x7fa138104a30 2024-04-15T20:52:54.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.187+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa134019040 con 0x7fa138104a30 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.187+0000 7fa12f7fe700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 0x7fa12403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.187+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa13404bd40 con 0x7fa138104a30 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.188+0000 7fa13dd46700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 0x7fa12403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.188+0000 7fa13dd46700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 0x7fa12403a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.192+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa1340129f0 con 0x7fa138104a30 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.409+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fa138102240 con 0x7fa1240383f0 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.414+0000 7fa12f7fe700 1 -- 172.21.15.72:0/225828247 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fa138102240 con 0x7fa1240383f0 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 msgr2=0x7fa12403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 0x7fa12403a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 msgr2=0x7fa1381998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa134000f80 tx=0x7fa1340049f0 comp rx=0 tx=0).stop 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 shutdown_connections 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fa1240383f0 0x7fa12403a8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 --2- 172.21.15.72:0/225828247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa138104a30 0x7fa1381998a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:54.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 >> 172.21.15.72:0/225828247 conn(0x7fa138100060 msgr2=0x7fa138079870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:54.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 shutdown_connections 2024-04-15T20:52:54.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:53.416+0000 7fa1407ab700 1 -- 172.21.15.72:0/225828247 wait complete. 2024-04-15T20:52:54.029 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying prometheus service with default placement... 2024-04-15T20:52:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:54 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:54 smithi072 ceph-mon[29079]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:54 smithi072 ceph-mon[29079]: Saving service ceph-exporter spec with placement * 2024-04-15T20:52:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:54 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.447+0000 7f41edefd700 1 Processor -- start 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.447+0000 7f41edefd700 1 -- start start 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.447+0000 7f41edefd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.447+0000 7f41edefd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81064a0 con 0x7f41e8079cf0 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.447+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40214/0 (socket says 172.21.15.72:40214) 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e77fe700 1 -- 172.21.15.72:0/3972200363 learned_addr learned my addr 172.21.15.72:0/3972200363 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e77fe700 1 -- 172.21.15.72:0/3972200363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e810aff0 con 0x7f41e8079cf0 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e77fe700 1 --2- 172.21.15.72:0/3972200363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41d80098a0 tx=0x7f41d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d8073efa2812e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e6ffd700 1 -- 172.21.15.72:0/3972200363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d8004180 con 0x7f41e8079cf0 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e6ffd700 1 -- 172.21.15.72:0/3972200363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41d80042e0 con 0x7f41e8079cf0 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.448+0000 7f41e6ffd700 1 -- 172.21.15.72:0/3972200363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d8011af0 con 0x7f41e8079cf0 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 -- 172.21.15.72:0/3972200363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 msgr2=0x7f41e810aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 --2- 172.21.15.72:0/3972200363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41d80098a0 tx=0x7f41d8009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 -- 172.21.15.72:0/3972200363 shutdown_connections 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 --2- 172.21.15.72:0/3972200363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e8079cf0 0x7f41e810aab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 -- 172.21.15.72:0/3972200363 >> 172.21.15.72:0/3972200363 conn(0x7f41e8100060 msgr2=0x7f41e8102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 -- 172.21.15.72:0/3972200363 shutdown_connections 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.449+0000 7f41edefd700 1 -- 172.21.15.72:0/3972200363 wait complete. 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41edefd700 1 Processor -- start 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41edefd700 1 -- start start 2024-04-15T20:52:55.512 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41edefd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41edefd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e819c3e0 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40222/0 (socket says 172.21.15.72:40222) 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.450+0000 7f41e77fe700 1 -- 172.21.15.72:0/3809127285 learned_addr learned my addr 172.21.15.72:0/3809127285 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41e77fe700 1 -- 172.21.15.72:0/3809127285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009550 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41e77fe700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41d8000c00 tx=0x7f41d8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d8003a70 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e819c5e0 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41d8003bd0 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d80238c0 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.451+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e819f240 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.452+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f41d8023b80 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.452+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8079cf0 con 0x7f41e819ba90 2024-04-15T20:52:55.513 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.452+0000 7f41e57fa700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 0x7f41d403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.452+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f41d804c260 con 0x7f41e819ba90 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.452+0000 7f41dffff700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 0x7f41d403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.453+0000 7f41dffff700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 0x7f41d403a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.457+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f41d802b300 con 0x7f41e819ba90 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.671+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f41e81023d0 con 0x7f41d40383f0 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.677+0000 7f41e57fa700 1 -- 172.21.15.72:0/3809127285 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f41e81023d0 con 0x7f41d40383f0 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.679+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 msgr2=0x7f41d403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.679+0000 7f41edefd700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 0x7f41d403a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.679+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 msgr2=0x7f41e819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.679+0000 7f41edefd700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41d8000c00 tx=0x7f41d8011b50 comp rx=0 tx=0).stop 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 shutdown_connections 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f41d40383f0 0x7f41d403a8a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 --2- 172.21.15.72:0/3809127285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e819ba90 0x7f41e819bea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 >> 172.21.15.72:0/3809127285 conn(0x7f41e8100060 msgr2=0x7f41e81017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 shutdown_connections 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:54.680+0000 7f41edefd700 1 -- 172.21.15.72:0/3809127285 wait complete. 2024-04-15T20:52:55.515 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying grafana service with default placement... 2024-04-15T20:52:55.756 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:55 smithi072 ceph-mon[29079]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:55.757 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:55 smithi072 ceph-mon[29079]: Saving service prometheus spec with placement count:1 2024-04-15T20:52:55.757 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:55 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.316+0000 7fb3779e9700 1 Processor -- start 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.316+0000 7fb3779e9700 1 -- start start 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb3779e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb3779e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370079d30 con 0x7fb370106680 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb375785700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb375785700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40226/0 (socket says 172.21.15.72:40226) 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb375785700 1 -- 172.21.15.72:0/91174447 learned_addr learned my addr 172.21.15.72:0/91174447 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb375785700 1 -- 172.21.15.72:0/91174447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370079e70 con 0x7fb370106680 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb375785700 1 --2- 172.21.15.72:0/91174447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0098a0 tx=0x7fb36c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6195ad17cd02ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb367fff700 1 -- 172.21.15.72:0/91174447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb36c004180 con 0x7fb370106680 2024-04-15T20:52:57.131 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb367fff700 1 -- 172.21.15.72:0/91174447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb36c0042e0 con 0x7fb370106680 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.317+0000 7fb367fff700 1 -- 172.21.15.72:0/91174447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb36c011af0 con 0x7fb370106680 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 -- 172.21.15.72:0/91174447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 msgr2=0x7fb370108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 --2- 172.21.15.72:0/91174447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0098a0 tx=0x7fb36c009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 -- 172.21.15.72:0/91174447 shutdown_connections 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 --2- 172.21.15.72:0/91174447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb370108a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 -- 172.21.15.72:0/91174447 >> 172.21.15.72:0/91174447 conn(0x7fb370100060 msgr2=0x7fb3701024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 -- 172.21.15.72:0/91174447 shutdown_connections 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.318+0000 7fb3779e9700 1 -- 172.21.15.72:0/91174447 wait complete. 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb3779e9700 1 Processor -- start 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb3779e9700 1 -- start start 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb3779e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb3779e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370199de0 con 0x7fb370106680 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb375785700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb375785700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40230/0 (socket says 172.21.15.72:40230) 2024-04-15T20:52:57.132 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb375785700 1 -- 172.21.15.72:0/697498729 learned_addr learned my addr 172.21.15.72:0/697498729 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb375785700 1 -- 172.21.15.72:0/697498729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009550 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.319+0000 7fb375785700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb36c011670 tx=0x7fb36c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.320+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb36c0039f0 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.320+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb36c003b50 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.320+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37019a040 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.320+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb36c0247c0 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.320+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37019a4c0 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb36c01a430 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb3667fc700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 0x7fb35c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370109ba0 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb36c04c300 con 0x7fb370106680 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb374f84700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 0x7fb35c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.321+0000 7fb374f84700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 0x7fb35c03a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb360006fd0 tx=0x7fb360006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:57.133 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.326+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb36c018b40 con 0x7fb370106680 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.538+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3701023c0 con 0x7fb35c038440 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.544+0000 7fb3667fc700 1 -- 172.21.15.72:0/697498729 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb3701023c0 con 0x7fb35c038440 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 msgr2=0x7fb35c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 0x7fb35c03a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb360006fd0 tx=0x7fb360006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 msgr2=0x7fb3701998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb36c011670 tx=0x7fb36c011b50 comp rx=0 tx=0).stop 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 shutdown_connections 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fb35c038440 0x7fb35c03a8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 --2- 172.21.15.72:0/697498729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb370106680 0x7fb3701998a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 >> 172.21.15.72:0/697498729 conn(0x7fb370100060 msgr2=0x7fb3701017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:57.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 shutdown_connections 2024-04-15T20:52:57.135 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:56.547+0000 7fb3779e9700 1 -- 172.21.15.72:0/697498729 wait complete. 2024-04-15T20:52:57.135 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying node-exporter service with default placement... 2024-04-15T20:52:57.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:57 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:57.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:57 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:58.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:58 smithi072 ceph-mon[29079]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:58.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:58 smithi072 ceph-mon[29079]: Saving service grafana spec with placement count:1 2024-04-15T20:52:58.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:58 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:58.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:58 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:52:58.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-15T20:52:58.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc9652700 1 Processor -- start 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc9652700 1 -- start start 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc9652700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc9652700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4105350 con 0x7f2bc4104a00 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40232/0 (socket says 172.21.15.72:40232) 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.563+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/2177646392 learned_addr learned my addr 172.21.15.72:0/2177646392 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/2177646392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4105490 con 0x7f2bc4104a00 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc2ffd700 1 --2- 172.21.15.72:0/2177646392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40098a0 tx=0x7f2bb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83349b6058b95be0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc1ffb700 1 -- 172.21.15.72:0/2177646392 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bb4004180 con 0x7f2bc4104a00 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc1ffb700 1 -- 172.21.15.72:0/2177646392 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2bb40042e0 con 0x7f2bc4104a00 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc1ffb700 1 -- 172.21.15.72:0/2177646392 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bb4011af0 con 0x7f2bc4104a00 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc9652700 1 -- 172.21.15.72:0/2177646392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 msgr2=0x7f2bc4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.564+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2177646392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40098a0 tx=0x7f2bb4009bb0 comp rx=0 tx=0).stop 2024-04-15T20:52:58.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- 172.21.15.72:0/2177646392 shutdown_connections 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2177646392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4104e10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- 172.21.15.72:0/2177646392 >> 172.21.15.72:0/2177646392 conn(0x7f2bc4100070 msgr2=0x7f2bc4102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- 172.21.15.72:0/2177646392 shutdown_connections 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- 172.21.15.72:0/2177646392 wait complete. 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 Processor -- start 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- start start 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.565+0000 7f2bc9652700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4199db0 con 0x7f2bc4104a00 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40246/0 (socket says 172.21.15.72:40246) 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/2834531958 learned_addr learned my addr 172.21.15.72:0/2834531958 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc2ffd700 1 -- 172.21.15.72:0/2834531958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4009550 con 0x7f2bc4104a00 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc2ffd700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4006ba0 tx=0x7f2bb4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:58.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bb4003b00 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2bb401a8e0 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4199fb0 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bb40199c0 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.566+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc419a3d0 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.567+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2bb4019c80 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.567+0000 7f2babfff700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 0x7f2bac03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.567+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2bb404c860 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.567+0000 7f2bc27fc700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 0x7f2bac03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.567+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4062380 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.568+0000 7f2bc27fc700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 0x7f2bac03a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8006fd0 tx=0x7f2bb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.572+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2bb402b930 con 0x7f2bc4104a00 2024-04-15T20:52:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.795+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bc4102210 con 0x7f2bac0383a0 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.801+0000 7f2babfff700 1 -- 172.21.15.72:0/2834531958 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2bc4102210 con 0x7f2bac0383a0 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.803+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 msgr2=0x7f2bac03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.803+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 0x7f2bac03a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8006fd0 tx=0x7f2bb8006e40 comp rx=0 tx=0).stop 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.803+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 msgr2=0x7f2bc4199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.803+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4006ba0 tx=0x7f2bb4011b50 comp rx=0 tx=0).stop 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 shutdown_connections 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2bac0383a0 0x7f2bac03a850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 --2- 172.21.15.72:0/2834531958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bc4104a00 0x7f2bc4199870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 >> 172.21.15.72:0/2834531958 conn(0x7f2bc4100070 msgr2=0x7f2bc4074070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 shutdown_connections 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:57.804+0000 7f2bc9652700 1 -- 172.21.15.72:0/2834531958 wait complete. 2024-04-15T20:52:58.402 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying alertmanager service with default placement... 2024-04-15T20:52:59.404 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:59 smithi072 ceph-mon[29079]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:52:59.404 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:59 smithi072 ceph-mon[29079]: Saving service node-exporter spec with placement * 2024-04-15T20:52:59.404 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:59 smithi072 ceph-mon[29079]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:52:59.404 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:52:59 smithi072 ceph-mon[29079]: from='mgr.14120 172.21.15.72:0/3339887649' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-15T20:53:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f663971f700 1 Processor -- start 2024-04-15T20:53:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f663971f700 1 -- start start 2024-04-15T20:53:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f663971f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f663971f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634105350 con 0x7f6634104a00 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40248/0 (socket says 172.21.15.72:40248) 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f6632ffd700 1 -- 172.21.15.72:0/472934222 learned_addr learned my addr 172.21.15.72:0/472934222 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.826+0000 7f6632ffd700 1 -- 172.21.15.72:0/472934222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634105490 con 0x7f6634104a00 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f6632ffd700 1 --2- 172.21.15.72:0/472934222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef2bd9e29334cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f6631ffb700 1 -- 172.21.15.72:0/472934222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6624004180 con 0x7f6634104a00 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f6631ffb700 1 -- 172.21.15.72:0/472934222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66240042e0 con 0x7f6634104a00 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f6631ffb700 1 -- 172.21.15.72:0/472934222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6624011af0 con 0x7f6634104a00 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 -- 172.21.15.72:0/472934222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 msgr2=0x7f6634104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 --2- 172.21.15.72:0/472934222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 -- 172.21.15.72:0/472934222 shutdown_connections 2024-04-15T20:53:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 --2- 172.21.15.72:0/472934222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634104e10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 -- 172.21.15.72:0/472934222 >> 172.21.15.72:0/472934222 conn(0x7f6634100070 msgr2=0x7f6634102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 -- 172.21.15.72:0/472934222 shutdown_connections 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.827+0000 7f663971f700 1 -- 172.21.15.72:0/472934222 wait complete. 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f663971f700 1 Processor -- start 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f663971f700 1 -- start start 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f663971f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f663971f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634199dc0 con 0x7f6634104a00 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f6632ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40252/0 (socket says 172.21.15.72:40252) 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.828+0000 7f6632ffd700 1 -- 172.21.15.72:0/3318474354 learned_addr learned my addr 172.21.15.72:0/3318474354 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f6632ffd700 1 -- 172.21.15.72:0/3318474354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009550 con 0x7f6634104a00 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f6632ffd700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6624006ba0 tx=0x7f6624011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6624003b00 con 0x7f6634104a00 2024-04-15T20:53:00.139 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f662401a8e0 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6634199fc0 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66240199c0 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.829+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663419a3e0 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.830+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6624019c80 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.830+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634062380 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.830+0000 7f661bfff700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 0x7f661c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.830+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f662404c5f0 con 0x7f6634104a00 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.830+0000 7f66327fc700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 0x7f661c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.831+0000 7f66327fc700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 0x7f661c03a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6628006fd0 tx=0x7f6628006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:58.835+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f662402b700 con 0x7f6634104a00 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.044+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f66341021f0 con 0x7f661c0383a0 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.048+0000 7f661bfff700 1 -- 172.21.15.72:0/3318474354 <== mgr.14120 v2:172.21.15.72:6800/3853111144 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f66341021f0 con 0x7f661c0383a0 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 msgr2=0x7f661c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 0x7f661c03a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6628006fd0 tx=0x7f6628006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 msgr2=0x7f6634199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6624006ba0 tx=0x7f6624011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 shutdown_connections 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f661c0383a0 0x7f661c03a850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 --2- 172.21.15.72:0/3318474354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6634104a00 0x7f6634199880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 >> 172.21.15.72:0/3318474354 conn(0x7f6634100070 msgr2=0x7f66340740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 shutdown_connections 2024-04-15T20:53:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:52:59.051+0000 7f663971f700 1 -- 172.21.15.72:0/3318474354 wait complete. 2024-04-15T20:53:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:00 smithi072 ceph-mon[29079]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:00 smithi072 ceph-mon[29079]: Saving service alertmanager spec with placement count:1 2024-04-15T20:53:01.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:01 smithi072 ceph-mon[29079]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc509bb1700 1 Processor -- start 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc509bb1700 1 -- start start 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc509bb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc509bb1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504105360 con 0x7fc504104a10 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40256/0 (socket says 172.21.15.72:40256) 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.996+0000 7fc5037fe700 1 -- 172.21.15.72:0/1581030682 learned_addr learned my addr 172.21.15.72:0/1581030682 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.997+0000 7fc5037fe700 1 -- 172.21.15.72:0/1581030682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5041054a0 con 0x7fc504104a10 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.997+0000 7fc5037fe700 1 --2- 172.21.15.72:0/1581030682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098a0 tx=0x7fc4f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c993f464faf1585 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.997+0000 7fc5027fc700 1 -- 172.21.15.72:0/1581030682 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f4004180 con 0x7fc504104a10 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.997+0000 7fc5027fc700 1 -- 172.21.15.72:0/1581030682 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4f40042e0 con 0x7fc504104a10 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.997+0000 7fc5027fc700 1 -- 172.21.15.72:0/1581030682 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f4011af0 con 0x7fc504104a10 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- 172.21.15.72:0/1581030682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 msgr2=0x7fc504104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 --2- 172.21.15.72:0/1581030682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098a0 tx=0x7fc4f4009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- 172.21.15.72:0/1581030682 shutdown_connections 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 --2- 172.21.15.72:0/1581030682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc504104e20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- 172.21.15.72:0/1581030682 >> 172.21.15.72:0/1581030682 conn(0x7fc504100060 msgr2=0x7fc504102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- 172.21.15.72:0/1581030682 shutdown_connections 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- 172.21.15.72:0/1581030682 wait complete. 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 Processor -- start 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.998+0000 7fc509bb1700 1 -- start start 2024-04-15T20:53:01.807 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc509bb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc509bb1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504198ce0 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40272/0 (socket says 172.21.15.72:40272) 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc5037fe700 1 -- 172.21.15.72:0/2393834614 learned_addr learned my addr 172.21.15.72:0/2393834614 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc5037fe700 1 -- 172.21.15.72:0/2393834614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4009550 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc5037fe700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4006ba0 tx=0x7fc4f4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f4003b00 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4f401a8e0 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f40199c0 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc504198ee0 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:00.999+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc504199300 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.000+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc4f4019c80 con 0x7fc504104a10 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.000+0000 7fc500ff9700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 0x7fc4ec03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:01.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.001+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504062380 con 0x7fc504104a10 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.001+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc4f404c6a0 con 0x7fc504104a10 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.001+0000 7fc502ffd700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 0x7fc4ec03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.001+0000 7fc502ffd700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 0x7fc4ec03a850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8006fd0 tx=0x7fc4f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.005+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc4f4018940 con 0x7fc504104a10 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.197+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc50419c160 con 0x7fc504104a10 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.200+0000 7fc500ff9700 1 -- 172.21.15.72:0/2393834614 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc4f4018350 con 0x7fc504104a10 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 msgr2=0x7fc4ec03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 0x7fc4ec03a850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8006fd0 tx=0x7fc4f8006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 msgr2=0x7fc5041987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4006ba0 tx=0x7fc4f4011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 shutdown_connections 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fc4ec0383a0 0x7fc4ec03a850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 --2- 172.21.15.72:0/2393834614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504104a10 0x7fc5041987a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:01.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 >> 172.21.15.72:0/2393834614 conn(0x7fc504100060 msgr2=0x7fc504101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:01.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 shutdown_connections 2024-04-15T20:53:01.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:01.202+0000 7fc509bb1700 1 -- 172.21.15.72:0/2393834614 wait complete. 2024-04-15T20:53:02.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:02 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2393834614' entity='client.admin' 2024-04-15T20:53:03.038 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.243+0000 7f6695f70700 1 Processor -- start 2024-04-15T20:53:03.038 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f6695f70700 1 -- start start 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f6695f70700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f6695f70700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690079d30 con 0x7f6690106680 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f668f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f668f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39156/0 (socket says 172.21.15.72:39156) 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f668f7fe700 1 -- 172.21.15.72:0/3505301466 learned_addr learned my addr 172.21.15.72:0/3505301466 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f668f7fe700 1 -- 172.21.15.72:0/3505301466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690079e70 con 0x7f6690106680 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.244+0000 7f668f7fe700 1 --2- 172.21.15.72:0/3505301466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66780098a0 tx=0x7f6678009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0aa95bbbc2165 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f668e7fc700 1 -- 172.21.15.72:0/3505301466 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6678004180 con 0x7f6690106680 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f668e7fc700 1 -- 172.21.15.72:0/3505301466 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66780042e0 con 0x7f6690106680 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f668e7fc700 1 -- 172.21.15.72:0/3505301466 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6678011af0 con 0x7f6690106680 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 -- 172.21.15.72:0/3505301466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 msgr2=0x7f6690108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 --2- 172.21.15.72:0/3505301466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66780098a0 tx=0x7f6678009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 -- 172.21.15.72:0/3505301466 shutdown_connections 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 --2- 172.21.15.72:0/3505301466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f6690108a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:03.039 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 -- 172.21.15.72:0/3505301466 >> 172.21.15.72:0/3505301466 conn(0x7f6690100060 msgr2=0x7f66901024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 -- 172.21.15.72:0/3505301466 shutdown_connections 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.245+0000 7f6695f70700 1 -- 172.21.15.72:0/3505301466 wait complete. 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f6695f70700 1 Processor -- start 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f6695f70700 1 -- start start 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f6695f70700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f6695f70700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690199de0 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f668f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f668f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39168/0 (socket says 172.21.15.72:39168) 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.246+0000 7f668f7fe700 1 -- 172.21.15.72:0/3453746750 learned_addr learned my addr 172.21.15.72:0/3453746750 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f668f7fe700 1 -- 172.21.15.72:0/3453746750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009550 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f668f7fe700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6678011670 tx=0x7f6678011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66780039c0 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6678003b20 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669019a040 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66780247f0 con 0x7f6690106680 2024-04-15T20:53:03.040 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.247+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669019a4c0 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.248+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6678024ab0 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.248+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6690109ba0 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.248+0000 7f668cff9700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 0x7f667c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.248+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f667804c490 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.248+0000 7f668effd700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 0x7f667c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.249+0000 7f668effd700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 0x7f667c03a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6680006fd0 tx=0x7f6680006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.253+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6678022310 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.441+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f669019d260 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.443+0000 7f668cff9700 1 -- 172.21.15.72:0/3453746750 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6678018b00 con 0x7f6690106680 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 msgr2=0x7f667c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 0x7f667c03a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6680006fd0 tx=0x7f6680006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:03.041 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 msgr2=0x7f66901998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6678011670 tx=0x7f6678011aa0 comp rx=0 tx=0).stop 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 shutdown_connections 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f667c0383b0 0x7f667c03a860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 --2- 172.21.15.72:0/3453746750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6690106680 0x7f66901998a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 >> 172.21.15.72:0/3453746750 conn(0x7f6690100060 msgr2=0x7f66901017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 shutdown_connections 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:02.446+0000 7f6695f70700 1 -- 172.21.15.72:0/3453746750 wait complete. 2024-04-15T20:53:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling the dashboard module... 2024-04-15T20:53:03.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:03 smithi072 ceph-mon[29079]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:03.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:03 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3453746750' entity='client.admin' 2024-04-15T20:53:04.784 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:04 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3943944917' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-15T20:53:05.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f0248f0f700 1 Processor -- start 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f0248f0f700 1 -- start start 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f0248f0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f0248f0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244079d10 con 0x7f0244104470 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f024259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f024259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39172/0 (socket says 172.21.15.72:39172) 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.484+0000 7f024259c700 1 -- 172.21.15.72:0/1070411233 learned_addr learned my addr 172.21.15.72:0/1070411233 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f024259c700 1 -- 172.21.15.72:0/1070411233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0244079e50 con 0x7f0244104470 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f024259c700 1 --2- 172.21.15.72:0/1070411233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02340098a0 tx=0x7f0234009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10d687a4a5a49d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f024159a700 1 -- 172.21.15.72:0/1070411233 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0234004180 con 0x7f0244104470 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f024159a700 1 -- 172.21.15.72:0/1070411233 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f02340042e0 con 0x7f0244104470 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f024159a700 1 -- 172.21.15.72:0/1070411233 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0234011af0 con 0x7f0244104470 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f0248f0f700 1 -- 172.21.15.72:0/1070411233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 msgr2=0x7f0244104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.485+0000 7f0248f0f700 1 --2- 172.21.15.72:0/1070411233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02340098a0 tx=0x7f0234009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- 172.21.15.72:0/1070411233 shutdown_connections 2024-04-15T20:53:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 --2- 172.21.15.72:0/1070411233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f0244104880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- 172.21.15.72:0/1070411233 >> 172.21.15.72:0/1070411233 conn(0x7f0244100060 msgr2=0x7f0244102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- 172.21.15.72:0/1070411233 shutdown_connections 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- 172.21.15.72:0/1070411233 wait complete. 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 Processor -- start 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- start start 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.486+0000 7f0248f0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024419bfd0 con 0x7f0244104470 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f024259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f024259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39180/0 (socket says 172.21.15.72:39180) 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f024259c700 1 -- 172.21.15.72:0/3943944917 learned_addr learned my addr 172.21.15.72:0/3943944917 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f024259c700 1 -- 172.21.15.72:0/3943944917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0234009550 con 0x7f0244104470 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f024259c700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0234003a70 con 0x7f0244104470 2024-04-15T20:53:05.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0234003bd0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02340238c0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024419c1d0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.487+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024419c5f0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.488+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0234023b30 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.488+0000 7f02337fe700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 0x7f022c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.488+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f023404c1c0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.488+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02441952d0 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.488+0000 7f0241d9b700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 0x7f022c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.489+0000 7f0241d9b700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 0x7f022c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0238006fd0 tx=0x7f0238006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.493+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0234023e30 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:03.734+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0244062380 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.447+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f0234019930 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.449+0000 7f02337fe700 1 -- 172.21.15.72:0/3943944917 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f0234017e30 con 0x7f0244104470 2024-04-15T20:53:05.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 msgr2=0x7f022c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 0x7f022c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0238006fd0 tx=0x7f0238006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 msgr2=0x7f024419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 shutdown_connections 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f022c038440 0x7f022c03a8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 --2- 172.21.15.72:0/3943944917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0244104470 0x7f024419ba90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 >> 172.21.15.72:0/3943944917 conn(0x7f0244100060 msgr2=0x7f0244190030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 shutdown_connections 2024-04-15T20:53:05.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:04.453+0000 7f0248f0f700 1 -- 172.21.15.72:0/3943944917 wait complete. 2024-04-15T20:53:05.731 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:05 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3943944917' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-15T20:53:05.732 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:05 smithi072 ceph-mon[29079]: mgrmap e9: smithi072.wfjmmp(active, since 26s) 2024-04-15T20:53:06.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "smithi072.wfjmmp", 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1c1dfd700 1 Processor -- start 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1c1dfd700 1 -- start start 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1c1dfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1c1dfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc104750 con 0x7fe1bc103e00 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:06.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39196/0 (socket says 172.21.15.72:39196) 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1bb7fe700 1 -- 172.21.15.72:0/1791849409 learned_addr learned my addr 172.21.15.72:0/1791849409 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.533+0000 7fe1bb7fe700 1 -- 172.21.15.72:0/1791849409 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc104890 con 0x7fe1bc103e00 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1bb7fe700 1 --2- 172.21.15.72:0/1791849409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6543fb5f0f7e889 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1ba7fc700 1 -- 172.21.15.72:0/1791849409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1ac004180 con 0x7fe1bc103e00 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1ba7fc700 1 -- 172.21.15.72:0/1791849409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1ac0042e0 con 0x7fe1bc103e00 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1ba7fc700 1 -- 172.21.15.72:0/1791849409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1ac011af0 con 0x7fe1bc103e00 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/1791849409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 msgr2=0x7fe1bc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/1791849409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/1791849409 shutdown_connections 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/1791849409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc104210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/1791849409 >> 172.21.15.72:0/1791849409 conn(0x7fe1bc0ff7e0 msgr2=0x7fe1bc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/1791849409 shutdown_connections 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.534+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/1791849409 wait complete. 2024-04-15T20:53:06.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.535+0000 7fe1c1dfd700 1 Processor -- start 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.535+0000 7fe1c1dfd700 1 -- start start 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.535+0000 7fe1c1dfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.535+0000 7fe1c1dfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc199de0 con 0x7fe1bc103e00 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1bb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39208/0 (socket says 172.21.15.72:39208) 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1bb7fe700 1 -- 172.21.15.72:0/633410359 learned_addr learned my addr 172.21.15.72:0/633410359 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1bb7fe700 1 -- 172.21.15.72:0/633410359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009550 con 0x7fe1bc103e00 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1bb7fe700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac006ba0 tx=0x7fe1ac011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1ac003b00 con 0x7fe1bc103e00 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc199fe0 con 0x7fe1bc103e00 2024-04-15T20:53:06.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1ac01a8e0 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1ac019990 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.536+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc19a400 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe1ac019c50 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc062380 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1b8ff9700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 0x7fe1a403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1baffd700 1 -- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 msgr2=0x7fe1a403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe1ac04c600 con 0x7fe1bc103e00 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.537+0000 7fe1baffd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 0x7fe1a403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:53:06.407 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.546+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe1ac02d440 con 0x7fe1bc103e00 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.738+0000 7fe1baffd700 1 -- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 msgr2=0x7fe1a403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.738+0000 7fe1baffd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 0x7fe1a403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.792+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe1bc19d260 con 0x7fe1bc103e00 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.793+0000 7fe1b8ff9700 1 -- 172.21.15.72:0/633410359 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe1ac02b340 con 0x7fe1bc103e00 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 msgr2=0x7fe1a403a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 0x7fe1a403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 msgr2=0x7fe1bc1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac006ba0 tx=0x7fe1ac011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 shutdown_connections 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7fe1a40383f0 0x7fe1a403a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:06.408 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 --2- 172.21.15.72:0/633410359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc103e00 0x7fe1bc1998a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 >> 172.21.15.72:0/633410359 conn(0x7fe1bc0ff7e0 msgr2=0x7fe1bc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 shutdown_connections 2024-04-15T20:53:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:05.795+0000 7fe1c1dfd700 1 -- 172.21.15.72:0/633410359 wait complete. 2024-04-15T20:53:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-04-15T20:53:06.409 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 9... 2024-04-15T20:53:06.652 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:06 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/633410359' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-15T20:53:11.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: Active manager daemon smithi072.wfjmmp restarted 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: Activating manager daemon smithi072.wfjmmp 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: osdmap e3: 0 total, 0 up, 0 in 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: mgrmap e10: smithi072.wfjmmp(active, starting, since 0.00375753s) 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T20:53:11.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.859+0000 7f215c0df700 1 Processor -- start 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f215c0df700 1 -- start start 2024-04-15T20:53:12.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f215c0df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f215c0df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154107a80 con 0x7f2154107130 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f2159e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f2159e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39212/0 (socket says 172.21.15.72:39212) 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f2159e7b700 1 -- 172.21.15.72:0/1198506373 learned_addr learned my addr 172.21.15.72:0/1198506373 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f2159e7b700 1 -- 172.21.15.72:0/1198506373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154107bc0 con 0x7f2154107130 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.860+0000 7f2159e7b700 1 --2- 172.21.15.72:0/1198506373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21500098a0 tx=0x7f2150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65af93843d7c2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f2158e79700 1 -- 172.21.15.72:0/1198506373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2150004180 con 0x7f2154107130 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f2158e79700 1 -- 172.21.15.72:0/1198506373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21500042e0 con 0x7f2154107130 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f2158e79700 1 -- 172.21.15.72:0/1198506373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2150011af0 con 0x7f2154107130 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f215c0df700 1 -- 172.21.15.72:0/1198506373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 msgr2=0x7f2154107540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f215c0df700 1 --2- 172.21.15.72:0/1198506373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21500098a0 tx=0x7f2150009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f215c0df700 1 -- 172.21.15.72:0/1198506373 shutdown_connections 2024-04-15T20:53:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f215c0df700 1 --2- 172.21.15.72:0/1198506373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154107540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.861+0000 7f215c0df700 1 -- 172.21.15.72:0/1198506373 >> 172.21.15.72:0/1198506373 conn(0x7f21540ff7e0 msgr2=0x7f2154101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 -- 172.21.15.72:0/1198506373 shutdown_connections 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 -- 172.21.15.72:0/1198506373 wait complete. 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 Processor -- start 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 -- start start 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f215c0df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154106d70 con 0x7f2154107130 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.862+0000 7f2159e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f2159e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39222/0 (socket says 172.21.15.72:39222) 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f2159e7b700 1 -- 172.21.15.72:0/359672202 learned_addr learned my addr 172.21.15.72:0/359672202 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f2159e7b700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150009550 con 0x7f2154107130 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f2159e7b700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2150011ad0 tx=0x7f2150011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:12.863 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2150003ab0 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2150003c10 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2154104e80 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21500198e0 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.863+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21541052a0 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f2150019ba0 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f214affd700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f214003b000 con 0x7f2140038440 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f215004c280 con 0x7f2154107130 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f215967a700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:06.864+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:07.065+0000 7f215967a700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:07.065+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:53:12.864 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:07.466+0000 7f215967a700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:07.466+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:08.267+0000 7f215967a700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:08.267+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:09.868+0000 7f215967a700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3853111144 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:09.868+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:11.114+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f215000b3e0 con 0x7f2154107130 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:11.114+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 msgr2=0x7f214003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:11.114+0000 7f214affd700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.115+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f215004dc50 con 0x7f2154107130 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.115+0000 7f214affd700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 0x7f214003e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.115+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f214003b000 con 0x7f214003bea0 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.115+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 0x7f214003e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.116+0000 7f215967a700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 0x7f214003e280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2144003a10 tx=0x7f21440092b0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:12.865 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.116+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f214003b000 con 0x7f214003bea0 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f21541063d0 con 0x7f214003bea0 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f214affd700 1 -- 172.21.15.72:0/359672202 <== mgr.14164 v2:172.21.15.72:6800/3608699399 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f21541063d0 con 0x7f214003bea0 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 msgr2=0x7f214003e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 0x7f214003e280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2144003a10 tx=0x7f21440092b0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 msgr2=0x7f2154106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2150011ad0 tx=0x7f2150011bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 shutdown_connections 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f214003bea0 0x7f214003e280 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154107130 0x7f2154106830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.123+0000 7f215c0df700 1 --2- 172.21.15.72:0/359672202 >> [v2:172.21.15.72:6800/3853111144,v1:172.21.15.72:6801/3853111144] conn(0x7f2140038440 0x7f214003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.124+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 >> 172.21.15.72:0/359672202 conn(0x7f21540ff7e0 msgr2=0x7f21541005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.124+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 shutdown_connections 2024-04-15T20:53:12.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:12.124+0000 7f215c0df700 1 -- 172.21.15.72:0/359672202 wait complete. 2024-04-15T20:53:12.867 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 9 is available 2024-04-15T20:53:12.867 INFO:teuthology.orchestra.run.smithi072.stdout:Generating a dashboard self-signed certificate... 2024-04-15T20:53:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: [15/Apr/2024:20:53:11] ENGINE Bus STARTING 2024-04-15T20:53:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: [15/Apr/2024:20:53:11] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T20:53:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: [15/Apr/2024:20:53:11] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T20:53:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: [15/Apr/2024:20:53:11] ENGINE Bus STARTED 2024-04-15T20:53:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-15T20:53:13.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: mgrmap e11: smithi072.wfjmmp(active, since 1.00582s) 2024-04-15T20:53:13.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:13 smithi072 ceph-mon[29079]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-15T20:53:14.226 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:14 smithi072 ceph-mon[29079]: mgrmap e12: smithi072.wfjmmp(active, since 2s) 2024-04-15T20:53:14.226 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:14 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:14.226 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:14 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:14.226 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:14 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:14.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-15T20:53:14.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.319+0000 7f6d7d81c700 1 Processor -- start 2024-04-15T20:53:14.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.319+0000 7f6d7d81c700 1 -- start start 2024-04-15T20:53:14.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d7d81c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d7d81c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78105340 con 0x7f6d781049f0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41094/0 (socket says 172.21.15.72:41094) 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d76ffd700 1 -- 172.21.15.72:0/2962589716 learned_addr learned my addr 172.21.15.72:0/2962589716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d76ffd700 1 -- 172.21.15.72:0/2962589716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78105480 con 0x7f6d781049f0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d76ffd700 1 --2- 172.21.15.72:0/2962589716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d680098a0 tx=0x7f6d68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee48790df6ec441 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d75ffb700 1 -- 172.21.15.72:0/2962589716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d68004180 con 0x7f6d781049f0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d75ffb700 1 -- 172.21.15.72:0/2962589716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d680042e0 con 0x7f6d781049f0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.320+0000 7f6d75ffb700 1 -- 172.21.15.72:0/2962589716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d68011af0 con 0x7f6d781049f0 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 -- 172.21.15.72:0/2962589716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 msgr2=0x7f6d78104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/2962589716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d680098a0 tx=0x7f6d68009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 -- 172.21.15.72:0/2962589716 shutdown_connections 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/2962589716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d78104e00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 -- 172.21.15.72:0/2962589716 >> 172.21.15.72:0/2962589716 conn(0x7f6d78100080 msgr2=0x7f6d78102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 -- 172.21.15.72:0/2962589716 shutdown_connections 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.321+0000 7f6d7d81c700 1 -- 172.21.15.72:0/2962589716 wait complete. 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d7d81c700 1 Processor -- start 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d7d81c700 1 -- start start 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d7d81c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d7d81c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78190110 con 0x7f6d781049f0 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41110/0 (socket says 172.21.15.72:41110) 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d76ffd700 1 -- 172.21.15.72:0/3389187558 learned_addr learned my addr 172.21.15.72:0/3389187558 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.322+0000 7f6d76ffd700 1 -- 172.21.15.72:0/3389187558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68009550 con 0x7f6d781049f0 2024-04-15T20:53:14.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d76ffd700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d68011ad0 tx=0x7f6d68011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d68003ab0 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d68003c10 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7818e220 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d680198e0 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.323+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7818e640 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f6d68019b50 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78062380 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d7c81a700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 0x7f6d6003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d6804c480 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d767fc700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 0x7f6d6003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.324+0000 7f6d767fc700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 0x7f6d6003a940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c006fd0 tx=0x7f6d6c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.329+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6d6801a430 con 0x7f6d781049f0 2024-04-15T20:53:14.237 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.540+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d781021e0 con 0x7f6d60038490 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.605+0000 7f6d7c81a700 1 -- 172.21.15.72:0/3389187558 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6d781021e0 con 0x7f6d60038490 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 msgr2=0x7f6d6003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 0x7f6d6003a940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c006fd0 tx=0x7f6d6c006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 msgr2=0x7f6d7818fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d68011ad0 tx=0x7f6d68011bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 shutdown_connections 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6d60038490 0x7f6d6003a940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 --2- 172.21.15.72:0/3389187558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d781049f0 0x7f6d7818fbd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.607+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 >> 172.21.15.72:0/3389187558 conn(0x7f6d78100080 msgr2=0x7f6d78079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.608+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 shutdown_connections 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:13.608+0000 7f6d7d81c700 1 -- 172.21.15.72:0/3389187558 wait complete. 2024-04-15T20:53:14.238 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial admin user... 2024-04-15T20:53:15.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:15 smithi072 ceph-mon[29079]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:15.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:15 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:15.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:15 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:15.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Itk8uIUg70WN2yPzg4nDFOFsM7QfTqZVGrW65tyCUzwOEHMORJarO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713214395, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.706+0000 7f67891c3700 1 Processor -- start 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.706+0000 7f67891c3700 1 -- start start 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.706+0000 7f67891c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.706+0000 7f67891c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784105380 con 0x7f6784104a30 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6782d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6782d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41112/0 (socket says 172.21.15.72:41112) 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6782d9d700 1 -- 172.21.15.72:0/2017272143 learned_addr learned my addr 172.21.15.72:0/2017272143 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6782d9d700 1 -- 172.21.15.72:0/2017272143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67841054c0 con 0x7f6784104a30 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6782d9d700 1 --2- 172.21.15.72:0/2017272143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f677400bb40 tx=0x7f677400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b097f93ed09633b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6781d9b700 1 -- 172.21.15.72:0/2017272143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f677400dc00 con 0x7f6784104a30 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6781d9b700 1 -- 172.21.15.72:0/2017272143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f67740044e0 con 0x7f6784104a30 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.707+0000 7f6781d9b700 1 -- 172.21.15.72:0/2017272143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6774010470 con 0x7f6784104a30 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 -- 172.21.15.72:0/2017272143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 msgr2=0x7f6784104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:15.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 --2- 172.21.15.72:0/2017272143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f677400bb40 tx=0x7f677400be50 comp rx=0 tx=0).stop 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 -- 172.21.15.72:0/2017272143 shutdown_connections 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 --2- 172.21.15.72:0/2017272143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f6784104e40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 -- 172.21.15.72:0/2017272143 >> 172.21.15.72:0/2017272143 conn(0x7f6784100060 msgr2=0x7f67841024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 -- 172.21.15.72:0/2017272143 shutdown_connections 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.708+0000 7f67891c3700 1 -- 172.21.15.72:0/2017272143 wait complete. 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f67891c3700 1 Processor -- start 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f67891c3700 1 -- start start 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f67891c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f67891c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678419c030 con 0x7f6784104a30 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f6782d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f6782d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41116/0 (socket says 172.21.15.72:41116) 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f6782d9d700 1 -- 172.21.15.72:0/2121940696 learned_addr learned my addr 172.21.15.72:0/2121940696 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f6782d9d700 1 -- 172.21.15.72:0/2121940696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677400b7f0 con 0x7f6784104a30 2024-04-15T20:53:15.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.709+0000 7f6782d9d700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6774003ff0 tx=0x7f67740040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.710+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f677400de20 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.710+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f67740042e0 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.710+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678419c230 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.710+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6774021c70 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.710+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678419c5f0 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f67740193f0 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f676bfff700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 0x7f676c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f677404c8f0 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f678259c700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 0x7f676c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6784191360 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.711+0000 7f678259c700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 0x7f676c03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6778006fd0 tx=0x7f6778006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.716+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f677400e360 con 0x7f6784104a30 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:14.971+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6784078fc0 con 0x7f676c038440 2024-04-15T20:53:15.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.199+0000 7f676bfff700 1 -- 172.21.15.72:0/2121940696 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f6778009e20 con 0x7f676c038440 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 msgr2=0x7f676c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 0x7f676c03a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6778006fd0 tx=0x7f6778006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 msgr2=0x7f678419baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6774003ff0 tx=0x7f67740040d0 comp rx=0 tx=0).stop 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 shutdown_connections 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f676c038440 0x7f676c03a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 --2- 172.21.15.72:0/2121940696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6784104a30 0x7f678419baf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 >> 172.21.15.72:0/2121940696 conn(0x7f6784100060 msgr2=0x7f678418e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.202+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 shutdown_connections 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:15.203+0000 7f67891c3700 1 -- 172.21.15.72:0/2121940696 wait complete. 2024-04-15T20:53:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:Fetching dashboard port number... 2024-04-15T20:53:16.613 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:16 smithi072 ceph-mon[29079]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:17.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:17 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/4084755357' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 8443 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.817+0000 7f5b1ed62700 1 Processor -- start 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.817+0000 7f5b1ed62700 1 -- start start 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.817+0000 7f5b1ed62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.817+0000 7f5b1ed62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18074510 con 0x7f5b18106610 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b1cafe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b1cafe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41128/0 (socket says 172.21.15.72:41128) 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b1cafe700 1 -- 172.21.15.72:0/2128231840 learned_addr learned my addr 172.21.15.72:0/2128231840 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b1cafe700 1 -- 172.21.15.72:0/2128231840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18074650 con 0x7f5b18106610 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b1cafe700 1 --2- 172.21.15.72:0/2128231840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009e80 tx=0x7f5b1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cf0d12238cc1ce server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b0f7fe700 1 -- 172.21.15.72:0/2128231840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400e070 con 0x7f5b18106610 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b0f7fe700 1 -- 172.21.15.72:0/2128231840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b1400b8c0 con 0x7f5b18106610 2024-04-15T20:53:17.652 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.818+0000 7f5b0f7fe700 1 -- 172.21.15.72:0/2128231840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b140044d0 con 0x7f5b18106610 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- 172.21.15.72:0/2128231840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 msgr2=0x7f5b181089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/2128231840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009e80 tx=0x7f5b1400b330 comp rx=0 tx=0).stop 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- 172.21.15.72:0/2128231840 shutdown_connections 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/2128231840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b181089f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- 172.21.15.72:0/2128231840 >> 172.21.15.72:0/2128231840 conn(0x7f5b18100070 msgr2=0x7f5b18102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- 172.21.15.72:0/2128231840 shutdown_connections 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- 172.21.15.72:0/2128231840 wait complete. 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 Processor -- start 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.819+0000 7f5b1ed62700 1 -- start start 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1ed62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1ed62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18199d40 con 0x7f5b18106610 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1cafe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1cafe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41136/0 (socket says 172.21.15.72:41136) 2024-04-15T20:53:17.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1cafe700 1 -- 172.21.15.72:0/4084755357 learned_addr learned my addr 172.21.15.72:0/4084755357 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1cafe700 1 -- 172.21.15.72:0/4084755357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009b30 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1cafe700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b140072a0 tx=0x7f5b140049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b1400e040 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b1400bd80 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b140126c0 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18199f40 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.820+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1819a3c0 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.821+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f5b14019040 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.821+0000 7f5b0dffb700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 0x7f5b0003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.821+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18062380 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.821+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5b1404bee0 con 0x7f5b18106610 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.822+0000 7f5b0ffff700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 0x7f5b0003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.822+0000 7f5b0ffff700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 0x7f5b0003a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b08006fd0 tx=0x7f5b08006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:17.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:16.826+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b1401f020 con 0x7f5b18106610 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.017+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5b1819cda0 con 0x7f5b18106610 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.017+0000 7f5b0dffb700 1 -- 172.21.15.72:0/4084755357 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5b1401a390 con 0x7f5b18106610 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 msgr2=0x7f5b0003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 0x7f5b0003a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b08006fd0 tx=0x7f5b08006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 msgr2=0x7f5b18199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b140072a0 tx=0x7f5b140049f0 comp rx=0 tx=0).stop 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 shutdown_connections 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5b00038400 0x7f5b0003a8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 --2- 172.21.15.72:0/4084755357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b18106610 0x7f5b18199800 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 >> 172.21.15.72:0/4084755357 conn(0x7f5b18100070 msgr2=0x7f5b18100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.019+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 shutdown_connections 2024-04-15T20:53:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:17.020+0000 7f5b1ed62700 1 -- 172.21.15.72:0/4084755357 wait complete. 2024-04-15T20:53:17.660 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-15T20:53:17.660 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-04-15T20:53:17.667 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-15T20:53:17.667 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-04-15T20:53:17.667 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-04-15T20:53:17.667 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph Dashboard is now available at: 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: URL: https://smithi072.front.sepia.ceph.com:8443/ 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: User: admin 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: Password: bjdb6it4pu 2024-04-15T20:53:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:17.670 INFO:teuthology.orchestra.run.smithi072.stdout:Saving cluster configuration to /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config directory 2024-04-15T20:53:17.670 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling autotune for osd_memory_target 2024-04-15T20:53:18.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:18 smithi072 ceph-mon[29079]: mgrmap e13: smithi072.wfjmmp(active, since 6s) 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75f0fa700 1 Processor -- start 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75f0fa700 1 -- start start 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75f0fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75f0fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758104750 con 0x7fa758103e00 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75ce96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75ce96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41146/0 (socket says 172.21.15.72:41146) 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75ce96700 1 -- 172.21.15.72:0/1755687470 learned_addr learned my addr 172.21.15.72:0/1755687470 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.102+0000 7fa75ce96700 1 -- 172.21.15.72:0/1755687470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758104890 con 0x7fa758103e00 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75ce96700 1 --2- 172.21.15.72:0/1755687470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0098a0 tx=0x7fa74c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fd049ed483185b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa7577fe700 1 -- 172.21.15.72:0/1755687470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74c004180 con 0x7fa758103e00 2024-04-15T20:53:18.951 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa7577fe700 1 -- 172.21.15.72:0/1755687470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa74c0042e0 con 0x7fa758103e00 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa7577fe700 1 -- 172.21.15.72:0/1755687470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74c011af0 con 0x7fa758103e00 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1755687470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 msgr2=0x7fa758104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1755687470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0098a0 tx=0x7fa74c009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1755687470 shutdown_connections 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1755687470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa758104210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1755687470 >> 172.21.15.72:0/1755687470 conn(0x7fa7580ff7e0 msgr2=0x7fa758101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1755687470 shutdown_connections 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.103+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1755687470 wait complete. 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75f0fa700 1 Processor -- start 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75f0fa700 1 -- start start 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75f0fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75f0fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758199e00 con 0x7fa758103e00 2024-04-15T20:53:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75ce96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75ce96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41154/0 (socket says 172.21.15.72:41154) 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75ce96700 1 -- 172.21.15.72:0/1953138098 learned_addr learned my addr 172.21.15.72:0/1953138098 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.104+0000 7fa75ce96700 1 -- 172.21.15.72:0/1953138098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009550 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa75ce96700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa74c006ba0 tx=0x7fa74c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74c003b00 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa74c01a8e0 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75819a000 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74c019990 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.105+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75819a420 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa74c019c00 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758062380 con 0x7fa758103e00 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa755ffb700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 0x7fa74803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:18.953 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa74c04ca60 con 0x7fa758103e00 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa757fff700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 0x7fa74803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.106+0000 7fa757fff700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 0x7fa74803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa744006fd0 tx=0x7fa744006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.111+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa74c02d440 con 0x7fa758103e00 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.300+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fa75819d2f0 con 0x7fa758103e00 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.301+0000 7fa755ffb700 1 -- 172.21.15.72:0/1953138098 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa74c02b340 con 0x7fa758103e00 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 msgr2=0x7fa74803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 0x7fa74803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa744006fd0 tx=0x7fa744006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 msgr2=0x7fa7581998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa74c006ba0 tx=0x7fa74c011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 shutdown_connections 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fa7480384e0 0x7fa74803a990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 --2- 172.21.15.72:0/1953138098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa758103e00 0x7fa7581998c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:18.954 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 >> 172.21.15.72:0/1953138098 conn(0x7fa7580ff7e0 msgr2=0x7fa758100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:18.955 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 shutdown_connections 2024-04-15T20:53:18.955 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:18.303+0000 7fa75f0fa700 1 -- 172.21.15.72:0/1953138098 wait complete. 2024-04-15T20:53:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.407+0000 7f659b58f700 1 Processor -- start 2024-04-15T20:53:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659b58f700 1 -- start start 2024-04-15T20:53:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659b58f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659b58f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659407a850 con 0x7f659407be10 2024-04-15T20:53:20.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659932b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659932b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41156/0 (socket says 172.21.15.72:41156) 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659932b700 1 -- 172.21.15.72:0/147135535 learned_addr learned my addr 172.21.15.72:0/147135535 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659932b700 1 -- 172.21.15.72:0/147135535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659407a990 con 0x7f659407be10 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.408+0000 7f659932b700 1 --2- 172.21.15.72:0/147135535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65900098a0 tx=0x7f6590009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9754cc9ca339e328 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f6587fff700 1 -- 172.21.15.72:0/147135535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6590004180 con 0x7f659407be10 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f6587fff700 1 -- 172.21.15.72:0/147135535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65900042e0 con 0x7f659407be10 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f6587fff700 1 -- 172.21.15.72:0/147135535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6590011af0 con 0x7f659407be10 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 -- 172.21.15.72:0/147135535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 msgr2=0x7f659407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 --2- 172.21.15.72:0/147135535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65900098a0 tx=0x7f6590009bb0 comp rx=0 tx=0).stop 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 -- 172.21.15.72:0/147135535 shutdown_connections 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 --2- 172.21.15.72:0/147135535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659407a310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 -- 172.21.15.72:0/147135535 >> 172.21.15.72:0/147135535 conn(0x7f6594101180 msgr2=0x7f6594103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 -- 172.21.15.72:0/147135535 shutdown_connections 2024-04-15T20:53:20.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.409+0000 7f659b58f700 1 -- 172.21.15.72:0/147135535 wait complete. 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659b58f700 1 Processor -- start 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659b58f700 1 -- start start 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659b58f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659b58f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659419bfe0 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659932b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659932b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41160/0 (socket says 172.21.15.72:41160) 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.410+0000 7f659932b700 1 -- 172.21.15.72:0/1185383022 learned_addr learned my addr 172.21.15.72:0/1185383022 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f659932b700 1 -- 172.21.15.72:0/1185383022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590009550 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f659932b700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6590000c00 tx=0x7f6590011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6590003a70 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6590003bd0 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659419c1e0 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65900238c0 con 0x7f659407be10 2024-04-15T20:53:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.411+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659419c600 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f6590023b30 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659410be20 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f65867fc700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 0x7f658003a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f659004c410 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f6598b2a700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 0x7f658003a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.412+0000 7f6598b2a700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 0x7f658003a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fd0 tx=0x7f6588006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.417+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6590010970 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.712+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f659410c010 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.715+0000 7f65867fc700 1 -- 172.21.15.72:0/1185383022 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f659002c350 con 0x7f659407be10 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 msgr2=0x7f658003a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 0x7f658003a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fd0 tx=0x7f6588006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 msgr2=0x7f659419baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6590000c00 tx=0x7f6590011b50 comp rx=0 tx=0).stop 2024-04-15T20:53:20.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 shutdown_connections 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6580038530 0x7f658003a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 --2- 172.21.15.72:0/1185383022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f659407be10 0x7f659419baa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 >> 172.21.15.72:0/1185383022 conn(0x7f6594101180 msgr2=0x7f6594102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 shutdown_connections 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-04-15T20:53:19.717+0000 7f659b58f700 1 -- 172.21.15.72:0/1185383022 wait complete. 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout:Or, if you are only running a single cluster on this host: 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: ceph telemetry on 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout:For more information see: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:20.287 INFO:teuthology.orchestra.run.smithi072.stdout:Bootstrap complete. 2024-04-15T20:53:20.314 INFO:tasks.cephadm:Fetching config... 2024-04-15T20:53:20.315 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:53:20.315 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-15T20:53:20.331 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-15T20:53:20.331 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:53:20.331 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-15T20:53:20.387 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-15T20:53:20.387 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:53:20.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/keyring of=/dev/stdout 2024-04-15T20:53:20.456 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-15T20:53:20.456 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:53:20.456 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-15T20:53:20.512 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-15T20:53:20.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHbyzcqzGP/YrSrOFoPz4MIizbhi06Nr7WkbW8cKtuOEe47nfGNEgQivs28FVNx6SExQAhZPj6Vim8HWPoQNtyeB589YAMU7kZEviN/yQrjqfqz/30Wzz1wBcRE77BDXBl21gm8J8vybybgneBOFwhcjuvqq77HIoTYERCTU4v4J790QyOYRTxATbFF9JU9ZzFo3zuhbW9+YU9Gl3r66Hz5YO1vYd8o0R8DjpSOgV1tG6cVTslZywdPrZL+Fo1ecCSX4xjFVqnMYMaX9JZpUt3c+IFCqO5J8ZL2CidslZV8tcI7DrNbfARSfaYoRtnyQy+ICMr90t9gpnevGVF9JXPxs8VGary/xg1fTXkRqaj2557YdzNhg1VcyTF9QFxUQzJs914MMCaaWLtX1XvwcHb5wxytBkQvXzEEwC/FlRqs+w5OB/mquaDN8ZoI19ma3wUjm8pqI271MrVMPUcPFJhGCFGS923LMe719CukIxXJlWmOm2BohjL/CWl/trvgBE= ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-15T20:53:20.595 INFO:teuthology.orchestra.run.smithi072.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHbyzcqzGP/YrSrOFoPz4MIizbhi06Nr7WkbW8cKtuOEe47nfGNEgQivs28FVNx6SExQAhZPj6Vim8HWPoQNtyeB589YAMU7kZEviN/yQrjqfqz/30Wzz1wBcRE77BDXBl21gm8J8vybybgneBOFwhcjuvqq77HIoTYERCTU4v4J790QyOYRTxATbFF9JU9ZzFo3zuhbW9+YU9Gl3r66Hz5YO1vYd8o0R8DjpSOgV1tG6cVTslZywdPrZL+Fo1ecCSX4xjFVqnMYMaX9JZpUt3c+IFCqO5J8ZL2CidslZV8tcI7DrNbfARSfaYoRtnyQy+ICMr90t9gpnevGVF9JXPxs8VGary/xg1fTXkRqaj2557YdzNhg1VcyTF9QFxUQzJs914MMCaaWLtX1XvwcHb5wxytBkQvXzEEwC/FlRqs+w5OB/mquaDN8ZoI19ma3wUjm8pqI271MrVMPUcPFJhGCFGS923LMe719CukIxXJlWmOm2BohjL/CWl/trvgBE= ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:53:20.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHbyzcqzGP/YrSrOFoPz4MIizbhi06Nr7WkbW8cKtuOEe47nfGNEgQivs28FVNx6SExQAhZPj6Vim8HWPoQNtyeB589YAMU7kZEviN/yQrjqfqz/30Wzz1wBcRE77BDXBl21gm8J8vybybgneBOFwhcjuvqq77HIoTYERCTU4v4J790QyOYRTxATbFF9JU9ZzFo3zuhbW9+YU9Gl3r66Hz5YO1vYd8o0R8DjpSOgV1tG6cVTslZywdPrZL+Fo1ecCSX4xjFVqnMYMaX9JZpUt3c+IFCqO5J8ZL2CidslZV8tcI7DrNbfARSfaYoRtnyQy+ICMr90t9gpnevGVF9JXPxs8VGary/xg1fTXkRqaj2557YdzNhg1VcyTF9QFxUQzJs914MMCaaWLtX1XvwcHb5wxytBkQvXzEEwC/FlRqs+w5OB/mquaDN8ZoI19ma3wUjm8pqI271MrVMPUcPFJhGCFGS923LMe719CukIxXJlWmOm2BohjL/CWl/trvgBE= ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-15T20:53:20.659 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHbyzcqzGP/YrSrOFoPz4MIizbhi06Nr7WkbW8cKtuOEe47nfGNEgQivs28FVNx6SExQAhZPj6Vim8HWPoQNtyeB589YAMU7kZEviN/yQrjqfqz/30Wzz1wBcRE77BDXBl21gm8J8vybybgneBOFwhcjuvqq77HIoTYERCTU4v4J790QyOYRTxATbFF9JU9ZzFo3zuhbW9+YU9Gl3r66Hz5YO1vYd8o0R8DjpSOgV1tG6cVTslZywdPrZL+Fo1ecCSX4xjFVqnMYMaX9JZpUt3c+IFCqO5J8ZL2CidslZV8tcI7DrNbfARSfaYoRtnyQy+ICMr90t9gpnevGVF9JXPxs8VGary/xg1fTXkRqaj2557YdzNhg1VcyTF9QFxUQzJs914MMCaaWLtX1XvwcHb5wxytBkQvXzEEwC/FlRqs+w5OB/mquaDN8ZoI19ma3wUjm8pqI271MrVMPUcPFJhGCFGS923LMe719CukIxXJlWmOm2BohjL/CWl/trvgBE= ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:53:20.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-15T20:53:20.881 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:53:21.001 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:20 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1185383022' entity='client.admin' 2024-04-15T20:53:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 -- 172.21.15.72:0/806267891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 msgr2=0x7fdb34100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 --2- 172.21.15.72:0/806267891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34100230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009910 tx=0x7fdb24009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 -- 172.21.15.72:0/806267891 shutdown_connections 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 --2- 172.21.15.72:0/806267891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34100230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 -- 172.21.15.72:0/806267891 >> 172.21.15.72:0/806267891 conn(0x7fdb340fb3d0 msgr2=0x7fdb340fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 -- 172.21.15.72:0/806267891 shutdown_connections 2024-04-15T20:53:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 -- 172.21.15.72:0/806267891 wait complete. 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.116+0000 7fdb397b6700 1 Processor -- start 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb397b6700 1 -- start start 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb397b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb397b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34075030 con 0x7fdb340ffe20 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb32ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56910/0 (socket says 172.21.15.72:56910) 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb32ffd700 1 -- 172.21.15.72:0/2620971796 learned_addr learned my addr 172.21.15.72:0/2620971796 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb32ffd700 1 -- 172.21.15.72:0/2620971796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240095f0 con 0x7fdb340ffe20 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb32ffd700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005b40 tx=0x7fdb24004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2401d070 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb34073140 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb2400be10 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.117+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb2400f460 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.118+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb340735e0 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.118+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fdb2400f6d0 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.118+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb34062380 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.119+0000 7fdb1bfff700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 0x7fdb1c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.119+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdb2404c260 con 0x7fdb340ffe20 2024-04-15T20:53:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.119+0000 7fdb327fc700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 0x7fdb1c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:23.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.119+0000 7fdb327fc700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 0x7fdb1c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:23.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.123+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdb24020730 con 0x7fdb340ffe20 2024-04-15T20:53:23.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.319+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fdb3418e8b0 con 0x7fdb340ffe20 2024-04-15T20:53:23.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.322+0000 7fdb1bfff700 1 -- 172.21.15.72:0/2620971796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdb24027020 con 0x7fdb340ffe20 2024-04-15T20:53:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 msgr2=0x7fdb1c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 0x7fdb1c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 msgr2=0x7fdb34074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005b40 tx=0x7fdb24004740 comp rx=0 tx=0).stop 2024-04-15T20:53:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 shutdown_connections 2024-04-15T20:53:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fdb1c038490 0x7fdb1c03a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 --2- 172.21.15.72:0/2620971796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb340ffe20 0x7fdb34074af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.324+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 >> 172.21.15.72:0/2620971796 conn(0x7fdb340fb3d0 msgr2=0x7fdb340fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.325+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 shutdown_connections 2024-04-15T20:53:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:23.325+0000 7fdb397b6700 1 -- 172.21.15.72:0/2620971796 wait complete. 2024-04-15T20:53:24.633 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:24 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2620971796' entity='client.admin' 2024-04-15T20:53:24.850 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-15T20:53:24.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-15T20:53:25.061 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:53:25.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:25.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:53:25.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:25 smithi072 ceph-mon[29079]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-04-15T20:53:27.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 -- 172.21.15.72:0/3114278893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 msgr2=0x7f6a94100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 --2- 172.21.15.72:0/3114278893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94100240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009910 tx=0x7f6a84009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 -- 172.21.15.72:0/3114278893 shutdown_connections 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 --2- 172.21.15.72:0/3114278893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94100240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 -- 172.21.15.72:0/3114278893 >> 172.21.15.72:0/3114278893 conn(0x7f6a940fb3c0 msgr2=0x7f6a940fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 -- 172.21.15.72:0/3114278893 shutdown_connections 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.809+0000 7f6a98f61700 1 -- 172.21.15.72:0/3114278893 wait complete. 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a98f61700 1 Processor -- start 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a98f61700 1 -- start start 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a98f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a98f61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941954c0 con 0x7f6a940ffe30 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:27.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56926/0 (socket says 172.21.15.72:56926) 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.810+0000 7f6a9259c700 1 -- 172.21.15.72:0/2278950789 learned_addr learned my addr 172.21.15.72:0/2278950789 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.811+0000 7f6a9259c700 1 -- 172.21.15.72:0/2278950789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840095f0 con 0x7f6a940ffe30 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.811+0000 7f6a9259c700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a840092e0 tx=0x7f6a84009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.811+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a8401d070 con 0x7f6a940ffe30 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.811+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a941956c0 con 0x7f6a940ffe30 2024-04-15T20:53:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.811+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a8400be10 con 0x7f6a940ffe30 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.812+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a8400f460 con 0x7f6a940ffe30 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.812+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a94195b60 con 0x7f6a940ffe30 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.812+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f6a8400f5c0 con 0x7f6a940ffe30 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.813+0000 7f6a837fe700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 0x7f6a7c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.813+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a8404c2c0 con 0x7f6a940ffe30 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.813+0000 7f6a91d9b700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 0x7f6a7c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.813+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a941008c0 con 0x7f6a940ffe30 2024-04-15T20:53:27.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.813+0000 7f6a91d9b700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 0x7f6a7c03a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:27.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:27.818+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6a941008c0 con 0x7f6a940ffe30 2024-04-15T20:53:28.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.026+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a9402d030 con 0x7f6a7c0384e0 2024-04-15T20:53:28.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.029+0000 7f6a837fe700 1 -- 172.21.15.72:0/2278950789 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6a9402d030 con 0x7f6a7c0384e0 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 msgr2=0x7f6a7c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 0x7f6a7c03a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 msgr2=0x7f6a94194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a840092e0 tx=0x7f6a84009e60 comp rx=0 tx=0).stop 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 shutdown_connections 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f6a7c0384e0 0x7f6a7c03a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:28.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 --2- 172.21.15.72:0/2278950789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a940ffe30 0x7f6a94194f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:28.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 >> 172.21.15.72:0/2278950789 conn(0x7f6a940fb3c0 msgr2=0x7f6a940fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:28.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 shutdown_connections 2024-04-15T20:53:28.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:28.031+0000 7f6a98f61700 1 -- 172.21.15.72:0/2278950789 wait complete. 2024-04-15T20:53:28.740 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-04-15T20:53:28.740 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:53:28.740 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-04-15T20:53:28.759 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:53:28.759 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-15T20:53:28.817 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-04-15T20:53:28.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch host add smithi149 2024-04-15T20:53:29.029 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:53:29.152 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:29 smithi072 ceph-mon[29079]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:29.152 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:29 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:29.152 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:29 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:29.152 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:29 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:29.152 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:29 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:30.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:30 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:30.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:30 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:53:30.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:30 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-15T20:53:30.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:30 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:53:30.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:30 smithi072 ceph-mon[29079]: Deploying daemon crash.smithi072 on smithi072 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 -- 172.21.15.72:0/1656662506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 msgr2=0x7f8604100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 --2- 172.21.15.72:0/1656662506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604100230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009910 tx=0x7f85f4009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 -- 172.21.15.72:0/1656662506 shutdown_connections 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 --2- 172.21.15.72:0/1656662506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604100230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 -- 172.21.15.72:0/1656662506 >> 172.21.15.72:0/1656662506 conn(0x7f86040fb3d0 msgr2=0x7f86040fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 -- 172.21.15.72:0/1656662506 shutdown_connections 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.871+0000 7f860a5c5700 1 -- 172.21.15.72:0/1656662506 wait complete. 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f860a5c5700 1 Processor -- start 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f860a5c5700 1 -- start start 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f860a5c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f860a5c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041954a0 con 0x7f86040ffe20 2024-04-15T20:53:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f8603fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f8603fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56940/0 (socket says 172.21.15.72:56940) 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.872+0000 7f8603fff700 1 -- 172.21.15.72:0/2749812739 learned_addr learned my addr 172.21.15.72:0/2749812739 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f8603fff700 1 -- 172.21.15.72:0/2749812739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40095f0 con 0x7f86040ffe20 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f8603fff700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85f4005b40 tx=0x7f85f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85f401d070 con 0x7f86040ffe20 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f85f400be10 con 0x7f86040ffe20 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86041956a0 con 0x7f86040ffe20 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85f400f460 con 0x7f86040ffe20 2024-04-15T20:53:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.873+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8604195b40 con 0x7f86040ffe20 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.874+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f85f400f6d0 con 0x7f86040ffe20 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.874+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860418ea80 con 0x7f86040ffe20 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.874+0000 7f86017fa700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 0x7f85ec03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.874+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f85f404c440 con 0x7f86040ffe20 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.875+0000 7f86037fe700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 0x7f85ec03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.875+0000 7f86037fe700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 0x7f85ec03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006fd0 tx=0x7f85f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:30.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:30.879+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f85f4020730 con 0x7f86040ffe20 2024-04-15T20:53:31.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:31.084+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}) v1 -- 0x7f86041008b0 con 0x7f85ec038490 2024-04-15T20:53:32.320 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:32 smithi072 ceph-mon[29079]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:32.320 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:32 smithi072 ceph-mon[29079]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:32.320 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:32 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:33.402 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:33 smithi072 ceph-mon[29079]: Deploying cephadm binary to smithi149 2024-04-15T20:53:33.402 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:33 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:33.402 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:33 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:33.402 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:33 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:33.402 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:33 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:33.588 INFO:teuthology.orchestra.run.smithi072.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-04-15T20:53:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.593+0000 7f86017fa700 1 -- 172.21.15.72:0/2749812739 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f86041008b0 con 0x7f85ec038490 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.595+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 msgr2=0x7f85ec03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.595+0000 7f860a5c5700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 0x7f85ec03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006fd0 tx=0x7f85f8006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.595+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 msgr2=0x7f8604194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.595+0000 7f860a5c5700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f85f4005b40 tx=0x7f85f4004740 comp rx=0 tx=0).stop 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 shutdown_connections 2024-04-15T20:53:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f85ec038490 0x7f85ec03a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 --2- 172.21.15.72:0/2749812739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86040ffe20 0x7f8604194f60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 >> 172.21.15.72:0/2749812739 conn(0x7f86040fb3d0 msgr2=0x7f86040fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 shutdown_connections 2024-04-15T20:53:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:33.596+0000 7f860a5c5700 1 -- 172.21.15.72:0/2749812739 wait complete. 2024-04-15T20:53:34.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch host ls --format=json 2024-04-15T20:53:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:34 smithi072 ceph-mon[29079]: Deploying daemon node-exporter.smithi072 on smithi072 2024-04-15T20:53:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:34 smithi072 ceph-mon[29079]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:34 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:34.487 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:53:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:35 smithi072 ceph-mon[29079]: Added host smithi149 2024-04-15T20:53:36.290 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:36 smithi072 ceph-mon[29079]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:36.290 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:36 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:36.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 -- 172.21.15.72:0/505923828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 msgr2=0x7fe3100ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:36.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 --2- 172.21.15.72:0/505923828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe3100ff140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe300009910 tx=0x7fe300009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:36.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 -- 172.21.15.72:0/505923828 shutdown_connections 2024-04-15T20:53:36.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 --2- 172.21.15.72:0/505923828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe3100ff140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:36.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 -- 172.21.15.72:0/505923828 >> 172.21.15.72:0/505923828 conn(0x7fe3100fa2c0 msgr2=0x7fe3100fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:36.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 -- 172.21.15.72:0/505923828 shutdown_connections 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.398+0000 7fe3161a1700 1 -- 172.21.15.72:0/505923828 wait complete. 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe3161a1700 1 Processor -- start 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe3161a1700 1 -- start start 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe3161a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe3161a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe310194410 con 0x7fe3100fed30 2024-04-15T20:53:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35468/0 (socket says 172.21.15.72:35468) 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30f7fe700 1 -- 172.21.15.72:0/2805642834 learned_addr learned my addr 172.21.15.72:0/2805642834 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30f7fe700 1 -- 172.21.15.72:0/2805642834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000095f0 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30f7fe700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe300005b40 tx=0x7fe300004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.399+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe30001d070 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe30000be10 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe310194610 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe30000f460 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe310194ab0 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fe30000b960 con 0x7fe3100fed30 2024-04-15T20:53:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.400+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31018da10 con 0x7fe3100fed30 2024-04-15T20:53:36.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.401+0000 7fe30d7fa700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 0x7fe2fc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:36.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.401+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe30004c3f0 con 0x7fe3100fed30 2024-04-15T20:53:36.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.401+0000 7fe307fff700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 0x7fe2fc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:36.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.401+0000 7fe307fff700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 0x7fe2fc03a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:36.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.405+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe30002a360 con 0x7fe3100fed30 2024-04-15T20:53:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.609+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe310061190 con 0x7fe2fc038490 2024-04-15T20:53:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.610+0000 7fe30d7fa700 1 -- 172.21.15.72:0/2805642834 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fe310061190 con 0x7fe2fc038490 2024-04-15T20:53:36.604 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:53:36.604 INFO:teuthology.orchestra.run.smithi072.stdout:[{"addr": "172.21.15.72", "hostname": "smithi072", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-04-15T20:53:36.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 msgr2=0x7fe2fc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:36.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 0x7fe2fc03a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 msgr2=0x7fe310193ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe300005b40 tx=0x7fe300004740 comp rx=0 tx=0).stop 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 shutdown_connections 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fe2fc038490 0x7fe2fc03a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 --2- 172.21.15.72:0/2805642834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3100fed30 0x7fe310193ed0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 >> 172.21.15.72:0/2805642834 conn(0x7fe3100fa2c0 msgr2=0x7fe3100faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 shutdown_connections 2024-04-15T20:53:36.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:36.613+0000 7fe3161a1700 1 -- 172.21.15.72:0/2805642834 wait complete. 2024-04-15T20:53:37.939 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-15T20:53:37.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd crush tunables default 2024-04-15T20:53:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:53:38.608 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:38 smithi072 ceph-mon[29079]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-15T20:53:38.608 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:38 smithi072 ceph-mon[29079]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:39.570 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:39 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:39.570 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:39 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:39.571 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:39 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:39.571 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:39 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:39.571 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:39 smithi072 ceph-mon[29079]: Deploying daemon alertmanager.smithi072 on smithi072 2024-04-15T20:53:40.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 -- 172.21.15.72:0/2386903317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 msgr2=0x7f54400fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:40.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 --2- 172.21.15.72:0/2386903317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f54400fe510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5430009910 tx=0x7f5430009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 -- 172.21.15.72:0/2386903317 shutdown_connections 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 --2- 172.21.15.72:0/2386903317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f54400fe510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 -- 172.21.15.72:0/2386903317 >> 172.21.15.72:0/2386903317 conn(0x7f54400f9a50 msgr2=0x7f54400fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 -- 172.21.15.72:0/2386903317 shutdown_connections 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.079+0000 7f5445a12700 1 -- 172.21.15.72:0/2386903317 wait complete. 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f5445a12700 1 Processor -- start 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f5445a12700 1 -- start start 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f5445a12700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f5445a12700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401954f0 con 0x7f54400fe100 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f543effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f543effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35474/0 (socket says 172.21.15.72:35474) 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f543effd700 1 -- 172.21.15.72:0/3486144564 learned_addr learned my addr 172.21.15.72:0/3486144564 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f543effd700 1 -- 172.21.15.72:0/3486144564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300095f0 con 0x7f54400fe100 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.080+0000 7f543effd700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5430005b40 tx=0x7f5430004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543001d070 con 0x7f54400fe100 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54401956f0 con 0x7f54400fe100 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f543000be10 con 0x7f54400fe100 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543000f460 con 0x7f54400fe100 2024-04-15T20:53:40.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440195b90 con 0x7f54400fe100 2024-04-15T20:53:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.081+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f543000f6d0 con 0x7f54400fe100 2024-04-15T20:53:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.082+0000 7f5444a10700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 0x7f542c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.082+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f54300227e0 con 0x7f54400fe100 2024-04-15T20:53:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.082+0000 7f54367fc700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 0x7f542c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.082+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544018eb10 con 0x7f54400fe100 2024-04-15T20:53:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.082+0000 7f54367fc700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 0x7f542c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5428006fd0 tx=0x7f5428006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:40.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.088+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5430027030 con 0x7f54400fe100 2024-04-15T20:53:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.305+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5440062380 con 0x7f54400fe100 2024-04-15T20:53:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.482+0000 7f5444a10700 1 -- 172.21.15.72:0/3486144564 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5430027070 con 0x7f54400fe100 2024-04-15T20:53:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.484+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 msgr2=0x7f542c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.484+0000 7f5445a12700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 0x7f542c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5428006fd0 tx=0x7f5428006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.484+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 msgr2=0x7f5440194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.484+0000 7f5445a12700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5430005b40 tx=0x7f5430004740 comp rx=0 tx=0).stop 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 shutdown_connections 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f542c038490 0x7f542c03a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 --2- 172.21.15.72:0/3486144564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54400fe100 0x7f5440194fb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 >> 172.21.15.72:0/3486144564 conn(0x7f54400f9a50 msgr2=0x7f54400fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 shutdown_connections 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:53:40.485+0000 7f5445a12700 1 -- 172.21.15.72:0/3486144564 wait complete. 2024-04-15T20:53:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-04-15T20:53:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:40 smithi072 ceph-mon[29079]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:40 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3486144564' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-15T20:53:41.235 INFO:tasks.cephadm:Adding mon.smithi072 on smithi072 2024-04-15T20:53:41.235 INFO:tasks.cephadm:Adding mon.smithi149 on smithi149 2024-04-15T20:53:41.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch apply mon '2;smithi072:172.21.15.72=smithi072;smithi149:172.21.15.149=smithi149' 2024-04-15T20:53:41.443 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:41.491 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:41.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:41 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3486144564' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-15T20:53:41.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:41 smithi072 ceph-mon[29079]: osdmap e4: 0 total, 0 up, 0 in 2024-04-15T20:53:41.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:41 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:42 smithi072 ceph-mon[29079]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 -- 172.21.15.149:0/716160079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 msgr2=0x7f97040fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 --2- 172.21.15.149:0/716160079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f97040fe8b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9700009910 tx=0x7f9700009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 -- 172.21.15.149:0/716160079 shutdown_connections 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 --2- 172.21.15.149:0/716160079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f97040fe8b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 -- 172.21.15.149:0/716160079 >> 172.21.15.149:0/716160079 conn(0x7f97040f9a50 msgr2=0x7f97040fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 -- 172.21.15.149:0/716160079 shutdown_connections 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 -- 172.21.15.149:0/716160079 wait complete. 2024-04-15T20:53:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.092+0000 7f970b2aa700 1 Processor -- start 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f970b2aa700 1 -- start start 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f970b2aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f970b2aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704193320 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f9709046700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f9709046700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45110/0 (socket says 172.21.15.149:45110) 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f9709046700 1 -- 172.21.15.149:0/1649646245 learned_addr learned my addr 172.21.15.149:0/1649646245 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f9709046700 1 -- 172.21.15.149:0/1649646245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000095f0 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f9709046700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9700005b40 tx=0x7f9700004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f970001d070 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f970000be10 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.093+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9704193520 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.094+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f970000f460 con 0x7f97040fe4a0 2024-04-15T20:53:43.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.094+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97041939c0 con 0x7f97040fe4a0 2024-04-15T20:53:43.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.094+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f970000b960 con 0x7f97040fe4a0 2024-04-15T20:53:43.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.094+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970418c900 con 0x7f97040fe4a0 2024-04-15T20:53:43.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.095+0000 7f96fa7fc700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 0x7f96f003ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:43.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.095+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f970004c4a0 con 0x7f97040fe4a0 2024-04-15T20:53:43.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.095+0000 7f9708845700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 0x7f96f003ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:43.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.095+0000 7f9708845700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 0x7f96f003ba50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006fd0 tx=0x7f96f4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:43.093 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.099+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f970002a360 con 0x7f97040fe4a0 2024-04-15T20:53:43.294 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.300+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 --> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi072:172.21.15.72=smithi072;smithi149:172.21.15.149=smithi149", "target": ["mon-mgr", ""]}) v1 -- 0x7f9704061300 con 0x7f96f00395a0 2024-04-15T20:53:43.300 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.306+0000 7f96fa7fc700 1 -- 172.21.15.149:0/1649646245 <== mgr.14164 v2:172.21.15.72:6800/3608699399 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9704061300 con 0x7f96f00395a0 2024-04-15T20:53:43.300 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mon update... 2024-04-15T20:53:43.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 msgr2=0x7f96f003ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:43.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 0x7f96f003ba50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006fd0 tx=0x7f96f4006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:43.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 msgr2=0x7f9704192de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:43.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9700005b40 tx=0x7f9700004740 comp rx=0 tx=0).stop 2024-04-15T20:53:43.302 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 shutdown_connections 2024-04-15T20:53:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f96f00395a0 0x7f96f003ba50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 --2- 172.21.15.149:0/1649646245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040fe4a0 0x7f9704192de0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 >> 172.21.15.149:0/1649646245 conn(0x7f97040f9a50 msgr2=0x7f97040fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 shutdown_connections 2024-04-15T20:53:43.303 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:43.309+0000 7f970b2aa700 1 -- 172.21.15.149:0/1649646245 wait complete. 2024-04-15T20:53:43.901 DEBUG:teuthology.orchestra.run.smithi149:mon.smithi149> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi149.service 2024-04-15T20:53:43.904 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:53:43.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:53:44.134 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:44.181 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:44.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:44 smithi072 ceph-mon[29079]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:44.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:44 smithi072 ceph-mon[29079]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi072:172.21.15.72=smithi072;smithi149:172.21.15.149=smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:53:44.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:44 smithi072 ceph-mon[29079]: Saving service mon spec with placement smithi072:172.21.15.72=smithi072;smithi149:172.21.15.149=smithi149;count:2 2024-04-15T20:53:44.439 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:44 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:45.626 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 -- 172.21.15.149:0/4092197229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 msgr2=0x7f21840fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 --2- 172.21.15.149:0/4092197229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f21840fe4f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2180009910 tx=0x7f2180009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 -- 172.21.15.149:0/4092197229 shutdown_connections 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 --2- 172.21.15.149:0/4092197229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f21840fe4f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 -- 172.21.15.149:0/4092197229 >> 172.21.15.149:0/4092197229 conn(0x7f21840f9af0 msgr2=0x7f21840fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 -- 172.21.15.149:0/4092197229 shutdown_connections 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.631+0000 7f218bea1700 1 -- 172.21.15.149:0/4092197229 wait complete. 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f218bea1700 1 Processor -- start 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f218bea1700 1 -- start start 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f218bea1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f218bea1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841954d0 con 0x7f21840fe0e0 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f2189c3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:45.627 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f2189c3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:55546/0 (socket says 172.21.15.149:55546) 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.632+0000 7f2189c3d700 1 -- 172.21.15.149:0/530121738 learned_addr learned my addr 172.21.15.149:0/530121738 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f2189c3d700 1 -- 172.21.15.149:0/530121738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800095f0 con 0x7f21840fe0e0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f2189c3d700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21800092e0 tx=0x7f2180009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f218001d070 con 0x7f21840fe0e0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f218000be10 con 0x7f21840fe0e0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21841956d0 con 0x7f21840fe0e0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f218000f460 con 0x7f21840fe0e0 2024-04-15T20:53:45.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.633+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2184195b70 con 0x7f21840fe0e0 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.634+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2180022470 con 0x7f21840fe0e0 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.634+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218418ea80 con 0x7f21840fe0e0 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.634+0000 7f217affd700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 0x7f217003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.634+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f218004c560 con 0x7f21840fe0e0 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.634+0000 7f218943c700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 0x7f217003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:45.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.635+0000 7f218943c700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 0x7f217003a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2174006fd0 tx=0x7f2174006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:45.632 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.639+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f218000b960 con 0x7f21840fe0e0 2024-04-15T20:53:45.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.907+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f218402cc30 con 0x7f21840fe0e0 2024-04-15T20:53:45.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.907+0000 7f217affd700 1 -- 172.21.15.149:0/530121738 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2180027070 con 0x7f21840fe0e0 2024-04-15T20:53:45.901 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:53:45.902 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 msgr2=0x7f217003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 0x7f217003a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2174006fd0 tx=0x7f2174006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 msgr2=0x7f2184194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21800092e0 tx=0x7f2180009e60 comp rx=0 tx=0).stop 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 shutdown_connections 2024-04-15T20:53:45.904 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f2170038490 0x7f217003a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:45.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 --2- 172.21.15.149:0/530121738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21840fe0e0 0x7f2184194f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:45.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 >> 172.21.15.149:0/530121738 conn(0x7f21840f9af0 msgr2=0x7f21840fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:45.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 shutdown_connections 2024-04-15T20:53:45.905 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:45.909+0000 7f218bea1700 1 -- 172.21.15.149:0/530121738 wait complete. 2024-04-15T20:53:45.905 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:53:46.530 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:46 smithi072 ceph-mon[29079]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:46.530 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:46 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/530121738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:53:47.446 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:53:47.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:53:47.664 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:47.712 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:48.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:48 smithi072 ceph-mon[29079]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:49.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 -- 172.21.15.149:0/3287080043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 msgr2=0x7faed80ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:49.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 --2- 172.21.15.149:0/3287080043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed80ff130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faec8009910 tx=0x7faec8009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:49.201 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 -- 172.21.15.149:0/3287080043 shutdown_connections 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 --2- 172.21.15.149:0/3287080043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed80ff130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 -- 172.21.15.149:0/3287080043 >> 172.21.15.149:0/3287080043 conn(0x7faed80fa2b0 msgr2=0x7faed80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 -- 172.21.15.149:0/3287080043 shutdown_connections 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.207+0000 7faedf388700 1 -- 172.21.15.149:0/3287080043 wait complete. 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedf388700 1 Processor -- start 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedf388700 1 -- start start 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedf388700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:49.202 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedf388700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81976e0 con 0x7faed80fed20 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedd124700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedd124700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:55572/0 (socket says 172.21.15.149:55572) 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.208+0000 7faedd124700 1 -- 172.21.15.149:0/1465961295 learned_addr learned my addr 172.21.15.149:0/1465961295 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faedd124700 1 -- 172.21.15.149:0/1465961295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec80095f0 con 0x7faed80fed20 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faedd124700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faec8005b40 tx=0x7faec8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faec801d070 con 0x7faed80fed20 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faec800be10 con 0x7faed80fed20 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed81978e0 con 0x7faed80fed20 2024-04-15T20:53:49.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faec800f460 con 0x7faed80fed20 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.209+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8197d80 con 0x7faed80fed20 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.210+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7faec800b960 con 0x7faed80fed20 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.210+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8190e10 con 0x7faed80fed20 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.210+0000 7faece7fc700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 0x7faec403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.210+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faec804c340 con 0x7faed80fed20 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.210+0000 7faedc923700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 0x7faec403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:49.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.211+0000 7faedc923700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 0x7faec403a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:49.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.215+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faec802bb60 con 0x7faed80fed20 2024-04-15T20:53:49.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.484+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faed802cc30 con 0x7faed80fed20 2024-04-15T20:53:49.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.485+0000 7faece7fc700 1 -- 172.21.15.149:0/1465961295 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7faec8027030 con 0x7faed80fed20 2024-04-15T20:53:49.479 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:53:49.479 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:53:49.480 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 msgr2=0x7faec403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 0x7faec403a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed4006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 msgr2=0x7faed81971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faec8005b40 tx=0x7faec8004740 comp rx=0 tx=0).stop 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 shutdown_connections 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7faec40384e0 0x7faec403a990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 --2- 172.21.15.149:0/1465961295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed80fed20 0x7faed81971a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 >> 172.21.15.149:0/1465961295 conn(0x7faed80fa2b0 msgr2=0x7faed80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 shutdown_connections 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:49.487+0000 7faedf388700 1 -- 172.21.15.149:0/1465961295 wait complete. 2024-04-15T20:53:49.481 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:49.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:49 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1465961295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:53:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:50 smithi072 ceph-mon[29079]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-15T20:53:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-15T20:53:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:50 smithi072 ceph-mon[29079]: Deploying daemon grafana.smithi072 on smithi072 2024-04-15T20:53:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:50 smithi072 ceph-mon[29079]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:51.155 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:53:51.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:53:51.363 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:51.414 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:52.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:52 smithi072 ceph-mon[29079]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:52.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:52 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 -- 172.21.15.149:0/2425928887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 msgr2=0x7febac102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 --2- 172.21.15.149:0/2425928887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac102d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feba8009910 tx=0x7feba8009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 -- 172.21.15.149:0/2425928887 shutdown_connections 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 --2- 172.21.15.149:0/2425928887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac102d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 -- 172.21.15.149:0/2425928887 >> 172.21.15.149:0/2425928887 conn(0x7febac0fa2b0 msgr2=0x7febac0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 -- 172.21.15.149:0/2425928887 shutdown_connections 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.964+0000 7febb42e5700 1 -- 172.21.15.149:0/2425928887 wait complete. 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb42e5700 1 Processor -- start 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb42e5700 1 -- start start 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb42e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:52.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb42e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1007f0 con 0x7febac100950 2024-04-15T20:53:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb2081700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb2081700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:55598/0 (socket says 172.21.15.149:55598) 2024-04-15T20:53:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb2081700 1 -- 172.21.15.149:0/3806764184 learned_addr learned my addr 172.21.15.149:0/3806764184 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:53:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.965+0000 7febb2081700 1 -- 172.21.15.149:0/3806764184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80095f0 con 0x7febac100950 2024-04-15T20:53:52.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7febb2081700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feba8005b40 tx=0x7feba8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba801d070 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feba800be10 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba800f460 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0fe900 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.966+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0feda0 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.967+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7feba800b960 con 0x7febac100950 2024-04-15T20:53:52.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.967+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac062380 con 0x7febac100950 2024-04-15T20:53:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.967+0000 7feba37fe700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 0x7feb9803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.967+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feba804c470 con 0x7febac100950 2024-04-15T20:53:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.967+0000 7febb1880700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 0x7feb9803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:52.962 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.968+0000 7febb1880700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 0x7feb9803a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb9c006fd0 tx=0x7feb9c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:52.965 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:52.972+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feba802bb60 con 0x7febac100950 2024-04-15T20:53:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.237+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7febac18e4e0 con 0x7febac100950 2024-04-15T20:53:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.238+0000 7feba37fe700 1 -- 172.21.15.149:0/3806764184 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7feba8027070 con 0x7febac100950 2024-04-15T20:53:53.231 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:53:53.231 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:53:53.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 msgr2=0x7feb9803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:53.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 0x7feb9803a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb9c006fd0 tx=0x7feb9c006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:53.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 msgr2=0x7febac1002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feba8005b40 tx=0x7feba8004740 comp rx=0 tx=0).stop 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 shutdown_connections 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feb980384e0 0x7feb9803a990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 --2- 172.21.15.149:0/3806764184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febac100950 0x7febac1002b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 >> 172.21.15.149:0/3806764184 conn(0x7febac0fa2b0 msgr2=0x7febac0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 shutdown_connections 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:53.240+0000 7febb42e5700 1 -- 172.21.15.149:0/3806764184 wait complete. 2024-04-15T20:53:53.234 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:53:54.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:54 smithi072 ceph-mon[29079]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:54.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:54 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/3806764184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:53:54.781 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:53:54.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:53:54.990 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:55.037 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:56.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:56 smithi072 ceph-mon[29079]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:53:56.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 -- 172.21.15.149:0/2950818542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 msgr2=0x7f50a80ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:56.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 --2- 172.21.15.149:0/2950818542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a80ff130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f509c009910 tx=0x7f509c009c20 comp rx=0 tx=0).stop 2024-04-15T20:53:56.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 -- 172.21.15.149:0/2950818542 shutdown_connections 2024-04-15T20:53:56.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 --2- 172.21.15.149:0/2950818542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a80ff130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:56.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 -- 172.21.15.149:0/2950818542 >> 172.21.15.149:0/2950818542 conn(0x7f50a80fa2b0 msgr2=0x7f50a80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 -- 172.21.15.149:0/2950818542 shutdown_connections 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.442+0000 7f50af051700 1 -- 172.21.15.149:0/2950818542 wait complete. 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50af051700 1 Processor -- start 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50af051700 1 -- start start 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50af051700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50af051700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81954f0 con 0x7f50a80fed20 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50acded700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50acded700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45688/0 (socket says 172.21.15.149:45688) 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50acded700 1 -- 172.21.15.149:0/2457938703 learned_addr learned my addr 172.21.15.149:0/2457938703 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.443+0000 7f50acded700 1 -- 172.21.15.149:0/2457938703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0095f0 con 0x7f50a80fed20 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50acded700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f509c005b40 tx=0x7f509c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f509c01d070 con 0x7f50a80fed20 2024-04-15T20:53:56.438 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f509c00be10 con 0x7f50a80fed20 2024-04-15T20:53:56.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a81956f0 con 0x7f50a80fed20 2024-04-15T20:53:56.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f509c00f460 con 0x7f50a80fed20 2024-04-15T20:53:56.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.444+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a8195b90 con 0x7f50a80fed20 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.445+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f509c00f6d0 con 0x7f50a80fed20 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.445+0000 7f50a5ffb700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 0x7f509803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.445+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f509c04c4a0 con 0x7f50a80fed20 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.445+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a818ea10 con 0x7f50a80fed20 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.445+0000 7f50a7fff700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 0x7f509803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:53:56.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.446+0000 7f50a7fff700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 0x7f509803a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:53:56.444 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.451+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f509c027030 con 0x7f50a80fed20 2024-04-15T20:53:56.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.715+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f50a802cc30 con 0x7f50a80fed20 2024-04-15T20:53:56.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.716+0000 7f50a5ffb700 1 -- 172.21.15.149:0/2457938703 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f509c02c440 con 0x7f50a80fed20 2024-04-15T20:53:56.709 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:53:56.709 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:53:56.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 msgr2=0x7f509803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:56.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 0x7f509803a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5094006fd0 tx=0x7f5094006e40 comp rx=0 tx=0).stop 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 msgr2=0x7f50a8194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f509c005b40 tx=0x7f509c004740 comp rx=0 tx=0).stop 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 shutdown_connections 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f5098038490 0x7f509803a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 --2- 172.21.15.149:0/2457938703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a80fed20 0x7f50a8194fb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 >> 172.21.15.149:0/2457938703 conn(0x7f50a80fa2b0 msgr2=0x7f50a80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 shutdown_connections 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:53:56.718+0000 7f50af051700 1 -- 172.21.15.149:0/2457938703 wait complete. 2024-04-15T20:53:56.712 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:53:57.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:57 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2457938703' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:53:58.336 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:53:58.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:53:58.543 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:58.589 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:53:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:53:58 smithi072 ceph-mon[29079]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/3103647082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 msgr2=0x7f4e580ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/3103647082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e580ff140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009910 tx=0x7f4e54009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/3103647082 shutdown_connections 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/3103647082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e580ff140 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/3103647082 >> 172.21.15.149:0/3103647082 conn(0x7f4e580fa2c0 msgr2=0x7f4e580fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/3103647082 shutdown_connections 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.156+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/3103647082 wait complete. 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5fc6b700 1 Processor -- start 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5fc6b700 1 -- start start 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5fc6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:00.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5fc6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58197d20 con 0x7f4e580fed30 2024-04-15T20:54:00.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5da07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:00.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5da07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45708/0 (socket says 172.21.15.149:45708) 2024-04-15T20:54:00.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5da07700 1 -- 172.21.15.149:0/86339327 learned_addr learned my addr 172.21.15.149:0/86339327 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:00.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.157+0000 7f4e5da07700 1 -- 172.21.15.149:0/86339327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540095f0 con 0x7f4e580fed30 2024-04-15T20:54:00.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e5da07700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e54005b40 tx=0x7f4e54004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:00.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e5401d070 con 0x7f4e580fed30 2024-04-15T20:54:00.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58197e60 con 0x7f4e580fed30 2024-04-15T20:54:00.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e5400be10 con 0x7f4e580fed30 2024-04-15T20:54:00.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e5400f460 con 0x7f4e580fed30 2024-04-15T20:54:00.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.158+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581982a0 con 0x7f4e580fed30 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.159+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4e5400b960 con 0x7f4e580fed30 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.159+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5818da10 con 0x7f4e580fed30 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.159+0000 7f4e4effd700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 0x7f4e4403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.159+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4e5404c4b0 con 0x7f4e580fed30 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.159+0000 7f4e5d206700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 0x7f4e4403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:00.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.160+0000 7f4e5d206700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 0x7f4e4403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e48006fd0 tx=0x7f4e48006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:00.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.164+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e5402a360 con 0x7f4e580fed30 2024-04-15T20:54:00.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.425+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4e5802cc30 con 0x7f4e580fed30 2024-04-15T20:54:00.419 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.425+0000 7f4e4effd700 1 -- 172.21.15.149:0/86339327 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4e54027030 con 0x7f4e580fed30 2024-04-15T20:54:00.420 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:00.420 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.427+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 msgr2=0x7f4e4403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.427+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 0x7f4e4403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e48006fd0 tx=0x7f4e48006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.427+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 msgr2=0x7f4e58069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.427+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e54005b40 tx=0x7f4e54004740 comp rx=0 tx=0).stop 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 shutdown_connections 2024-04-15T20:54:00.422 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f4e44038490 0x7f4e4403a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:00.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 --2- 172.21.15.149:0/86339327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e580fed30 0x7f4e58069340 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:00.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 >> 172.21.15.149:0/86339327 conn(0x7f4e580fa2c0 msgr2=0x7f4e580faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:00.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 shutdown_connections 2024-04-15T20:54:00.423 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:00.428+0000 7f4e5fc6b700 1 -- 172.21.15.149:0/86339327 wait complete. 2024-04-15T20:54:00.423 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:00 smithi072 ceph-mon[29079]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:00 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/86339327' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:01.997 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:01.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:02.197 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:02.245 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:02.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:02 smithi072 ceph-mon[29079]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:03.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 -- 172.21.15.149:0/1597767864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 msgr2=0x7fbc90100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 --2- 172.21.15.149:0/1597767864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90100230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009910 tx=0x7fbc84009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 -- 172.21.15.149:0/1597767864 shutdown_connections 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 --2- 172.21.15.149:0/1597767864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90100230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 -- 172.21.15.149:0/1597767864 >> 172.21.15.149:0/1597767864 conn(0x7fbc900fb3d0 msgr2=0x7fbc900fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 -- 172.21.15.149:0/1597767864 shutdown_connections 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.598+0000 7fbc96971700 1 -- 172.21.15.149:0/1597767864 wait complete. 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc96971700 1 Processor -- start 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc96971700 1 -- start start 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc96971700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:03.594 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc96971700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90075030 con 0x7fbc900ffe20 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc8ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45732/0 (socket says 172.21.15.149:45732) 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.599+0000 7fbc8ffff700 1 -- 172.21.15.149:0/2870133796 learned_addr learned my addr 172.21.15.149:0/2870133796 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc8ffff700 1 -- 172.21.15.149:0/2870133796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840095f0 con 0x7fbc900ffe20 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc8ffff700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005b40 tx=0x7fbc84004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:03.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc8401d070 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc90073140 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc8400be10 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc8400f460 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.600+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc900735e0 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.601+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fbc8400f6d0 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.601+0000 7fbc8d7fa700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 0x7fbc7803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.601+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc90062380 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.601+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbc8404c310 con 0x7fbc900ffe20 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.601+0000 7fbc8f7fe700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 0x7fbc7803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:03.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.602+0000 7fbc8f7fe700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 0x7fbc7803a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbc80006fd0 tx=0x7fbc80006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:03.600 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.607+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbc84027030 con 0x7fbc900ffe20 2024-04-15T20:54:03.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.870+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbc901008b0 con 0x7fbc900ffe20 2024-04-15T20:54:03.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.871+0000 7fbc8d7fa700 1 -- 172.21.15.149:0/2870133796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbc901008b0 con 0x7fbc900ffe20 2024-04-15T20:54:03.865 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:03.866 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 msgr2=0x7fbc7803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 0x7fbc7803a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbc80006fd0 tx=0x7fbc80006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 msgr2=0x7fbc90074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005b40 tx=0x7fbc84004740 comp rx=0 tx=0).stop 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 shutdown_connections 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fbc78038490 0x7fbc7803a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 --2- 172.21.15.149:0/2870133796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc900ffe20 0x7fbc90074af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 >> 172.21.15.149:0/2870133796 conn(0x7fbc900fb3d0 msgr2=0x7fbc900fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 shutdown_connections 2024-04-15T20:54:03.868 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:03.873+0000 7fbc96971700 1 -- 172.21.15.149:0/2870133796 wait complete. 2024-04-15T20:54:03.869 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:04.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:04 smithi072 ceph-mon[29079]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:04.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:04 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2870133796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:05.482 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:05.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:05.683 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:05.731 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:06.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:06 smithi072 ceph-mon[29079]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:07.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.134+0000 7f1f93840700 1 -- 172.21.15.149:0/3061474335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 msgr2=0x7f1f8c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.134+0000 7f1f93840700 1 --2- 172.21.15.149:0/3061474335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c0ff130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b0a0 tx=0x7f1f8800b3b0 comp rx=0 tx=0).stop 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- 172.21.15.149:0/3061474335 shutdown_connections 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 --2- 172.21.15.149:0/3061474335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c0ff130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- 172.21.15.149:0/3061474335 >> 172.21.15.149:0/3061474335 conn(0x7f1f8c0fa2b0 msgr2=0x7f1f8c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- 172.21.15.149:0/3061474335 shutdown_connections 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- 172.21.15.149:0/3061474335 wait complete. 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 Processor -- start 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- start start 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.135+0000 7f1f93840700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c195500 con 0x7f1f8c0fed20 2024-04-15T20:54:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f915dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f915dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45450/0 (socket says 172.21.15.149:45450) 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f915dc700 1 -- 172.21.15.149:0/1671363866 learned_addr learned my addr 172.21.15.149:0/1671363866 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f915dc700 1 -- 172.21.15.149:0/1671363866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009d00 con 0x7f1f8c0fed20 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f915dc700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009fd0 tx=0x7f1f8800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f8800e040 con 0x7f1f8c0fed20 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f8800bdc0 con 0x7f1f8c0fed20 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c195700 con 0x7f1f8c0fed20 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f8801da40 con 0x7f1f8c0fed20 2024-04-15T20:54:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.136+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c195b20 con 0x7f1f8c0fed20 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.137+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c18ea10 con 0x7f1f8c0fed20 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.138+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f1f8801d480 con 0x7f1f8c0fed20 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.139+0000 7f1f827fc700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 0x7f1f7803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.139+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1f8804d730 con 0x7f1f8c0fed20 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.139+0000 7f1f90ddb700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 0x7f1f7803a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.139+0000 7f1f90ddb700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 0x7f1f7803a9e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c006fd0 tx=0x7f1f7c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:07.137 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.144+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1f8802f970 con 0x7f1f8c0fed20 2024-04-15T20:54:07.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.409+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1f8c062380 con 0x7f1f8c0fed20 2024-04-15T20:54:07.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.410+0000 7f1f827fc700 1 -- 172.21.15.149:0/1671363866 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1f8802f380 con 0x7f1f8c0fed20 2024-04-15T20:54:07.404 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:07.404 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:07.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 msgr2=0x7f1f7803a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:07.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 0x7f1f7803a9e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c006fd0 tx=0x7f1f7c006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 msgr2=0x7f1f8c194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009fd0 tx=0x7f1f8800bb10 comp rx=0 tx=0).stop 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 shutdown_connections 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f1f78038530 0x7f1f7803a9e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 --2- 172.21.15.149:0/1671363866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f8c0fed20 0x7f1f8c194fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 >> 172.21.15.149:0/1671363866 conn(0x7f1f8c0fa2b0 msgr2=0x7f1f8c0687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 shutdown_connections 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:07.412+0000 7f1f93840700 1 -- 172.21.15.149:0/1671363866 wait complete. 2024-04-15T20:54:07.406 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: Deploying daemon prometheus.smithi072 on smithi072 2024-04-15T20:54:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:08 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1671363866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:08.954 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:08.954 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:09.160 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:09.207 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:10.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 -- 172.21.15.149:0/2334488639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 msgr2=0x7fd7840fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:10.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 --2- 172.21.15.149:0/2334488639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7840fe4f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd780009910 tx=0x7fd780009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:10.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 -- 172.21.15.149:0/2334488639 shutdown_connections 2024-04-15T20:54:10.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 --2- 172.21.15.149:0/2334488639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7840fe4f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:10.616 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 -- 172.21.15.149:0/2334488639 >> 172.21.15.149:0/2334488639 conn(0x7fd7840f9a50 msgr2=0x7fd7840fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 -- 172.21.15.149:0/2334488639 shutdown_connections 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.622+0000 7fd78b646700 1 -- 172.21.15.149:0/2334488639 wait complete. 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd78b646700 1 Processor -- start 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd78b646700 1 -- start start 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd78b646700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd78b646700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7841976f0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd7893e2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd7893e2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45480/0 (socket says 172.21.15.149:45480) 2024-04-15T20:54:10.617 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd7893e2700 1 -- 172.21.15.149:0/1976932798 learned_addr learned my addr 172.21.15.149:0/1976932798 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd7893e2700 1 -- 172.21.15.149:0/1976932798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800095f0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.623+0000 7fd7893e2700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd780005b40 tx=0x7fd780004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.624+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd78001d070 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.624+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd78000be10 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.624+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7841978f0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.624+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd78000f460 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.624+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd784197d90 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.625+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd784191620 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.625+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd7800227e0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.625+0000 7fd77a7fc700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 0x7fd77003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:10.619 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.625+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd78004c4a0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.625+0000 7fd788be1700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 0x7fd77003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:10.620 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.626+0000 7fd788be1700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 0x7fd77003a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd774006fd0 tx=0x7fd774006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:10.624 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.631+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd78002bba0 con 0x7fd7840fe0e0 2024-04-15T20:54:10.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:10 smithi072 ceph-mon[29079]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:10.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.895+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd78402cc30 con 0x7fd7840fe0e0 2024-04-15T20:54:10.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.896+0000 7fd77a7fc700 1 -- 172.21.15.149:0/1976932798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd780027070 con 0x7fd7840fe0e0 2024-04-15T20:54:10.889 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:10.890 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 msgr2=0x7fd77003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 0x7fd77003a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd774006fd0 tx=0x7fd774006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 msgr2=0x7fd7841971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd780005b40 tx=0x7fd780004740 comp rx=0 tx=0).stop 2024-04-15T20:54:10.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 shutdown_connections 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fd770038490 0x7fd77003a940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 --2- 172.21.15.149:0/1976932798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7840fe0e0 0x7fd7841971b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 >> 172.21.15.149:0/1976932798 conn(0x7fd7840f9a50 msgr2=0x7fd7840fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 shutdown_connections 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:10.898+0000 7fd78b646700 1 -- 172.21.15.149:0/1976932798 wait complete. 2024-04-15T20:54:10.892 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:11.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:11 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1976932798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:11.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:11 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:12.448 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:12.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:12.702 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:12.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:12 smithi072 ceph-mon[29079]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:14.126 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.132+0000 7fb86834b700 1 -- 172.21.15.149:0/1358349422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 msgr2=0x7fb8601006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.132+0000 7fb86834b700 1 --2- 172.21.15.149:0/1358349422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb8601006e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb850009910 tx=0x7fb850009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 -- 172.21.15.149:0/1358349422 shutdown_connections 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 --2- 172.21.15.149:0/1358349422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb8601006e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 -- 172.21.15.149:0/1358349422 >> 172.21.15.149:0/1358349422 conn(0x7fb8600f9af0 msgr2=0x7fb8600fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 -- 172.21.15.149:0/1358349422 shutdown_connections 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 -- 172.21.15.149:0/1358349422 wait complete. 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 Processor -- start 2024-04-15T20:54:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.133+0000 7fb86834b700 1 -- start start 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb86834b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb86834b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860194400 con 0x7fb8601002d0 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb8660e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb8660e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:45508/0 (socket says 172.21.15.149:45508) 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb8660e7700 1 -- 172.21.15.149:0/4152851905 learned_addr learned my addr 172.21.15.149:0/4152851905 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb8660e7700 1 -- 172.21.15.149:0/4152851905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500095f0 con 0x7fb8601002d0 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.134+0000 7fb8660e7700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb850005b40 tx=0x7fb850004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.135+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb85001d070 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.135+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb85000be10 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.135+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb860194600 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.135+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb85000f460 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.135+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860194a20 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860104ac0 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb8500227e0 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb8577fe700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 0x7fb84c03cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb85004c4b0 con 0x7fb8601002d0 2024-04-15T20:54:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb8658e6700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 0x7fb84c03cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:14.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.136+0000 7fb8658e6700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 0x7fb84c03cb50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:14.134 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.141+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb85002bba0 con 0x7fb8601002d0 2024-04-15T20:54:14.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.402+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb860104cb0 con 0x7fb8601002d0 2024-04-15T20:54:14.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.403+0000 7fb8577fe700 1 -- 172.21.15.149:0/4152851905 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb850027070 con 0x7fb8601002d0 2024-04-15T20:54:14.397 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:14.397 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:14.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 msgr2=0x7fb84c03cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 0x7fb84c03cb50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 msgr2=0x7fb860193ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb850005b40 tx=0x7fb850004740 comp rx=0 tx=0).stop 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 shutdown_connections 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb84c03a6a0 0x7fb84c03cb50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 --2- 172.21.15.149:0/4152851905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8601002d0 0x7fb860193ec0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 >> 172.21.15.149:0/4152851905 conn(0x7fb8600f9af0 msgr2=0x7fb8600fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 shutdown_connections 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:14.405+0000 7fb86834b700 1 -- 172.21.15.149:0/4152851905 wait complete. 2024-04-15T20:54:14.399 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:14 smithi072 ceph-mon[29079]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:14 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/4152851905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:15.960 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:15.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:16.166 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:16.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:16 smithi072 ceph-mon[29079]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 -- 172.21.15.149:0/2468143990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 msgr2=0x7f04140fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 --2- 172.21.15.149:0/2468143990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f04140fe4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f041000b0a0 tx=0x7f041000b3b0 comp rx=0 tx=0).stop 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 -- 172.21.15.149:0/2468143990 shutdown_connections 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 --2- 172.21.15.149:0/2468143990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f04140fe4f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 -- 172.21.15.149:0/2468143990 >> 172.21.15.149:0/2468143990 conn(0x7f04140f9af0 msgr2=0x7f04140fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 -- 172.21.15.149:0/2468143990 shutdown_connections 2024-04-15T20:54:17.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.688+0000 7f041b341700 1 -- 172.21.15.149:0/2468143990 wait complete. 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.689+0000 7f041b341700 1 Processor -- start 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.689+0000 7f041b341700 1 -- start start 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.689+0000 7f041b341700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.689+0000 7f041b341700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04141954d0 con 0x7f04140fe0e0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.689+0000 7f04190dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f04190dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:33052/0 (socket says 172.21.15.149:33052) 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f04190dd700 1 -- 172.21.15.149:0/449275830 learned_addr learned my addr 172.21.15.149:0/449275830 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f04190dd700 1 -- 172.21.15.149:0/449275830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410009d00 con 0x7f04140fe0e0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f04190dd700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f041000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f041000e040 con 0x7f04140fe0e0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04141956d0 con 0x7f04140fe0e0 2024-04-15T20:54:17.684 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f041001d930 con 0x7f04140fe0e0 2024-04-15T20:54:17.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04100129d0 con 0x7f04140fe0e0 2024-04-15T20:54:17.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.690+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0414195af0 con 0x7f04140fe0e0 2024-04-15T20:54:17.685 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.691+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f0410012c90 con 0x7f04140fe0e0 2024-04-15T20:54:17.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.691+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041418ea80 con 0x7f04140fe0e0 2024-04-15T20:54:17.686 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.691+0000 7f040a7fc700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 0x7f040003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:17.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.692+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f041004cab0 con 0x7f04140fe0e0 2024-04-15T20:54:17.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.692+0000 7f04188dc700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 0x7f040003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:17.687 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.692+0000 7f04188dc700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 0x7f040003a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0404006fd0 tx=0x7f0404006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:17.690 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.697+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f041001aba0 con 0x7f04140fe0e0 2024-04-15T20:54:17.955 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.962+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0414062380 con 0x7f04140fe0e0 2024-04-15T20:54:17.956 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.963+0000 7f040a7fc700 1 -- 172.21.15.149:0/449275830 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f041001aba0 con 0x7f04140fe0e0 2024-04-15T20:54:17.956 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:17.956 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 msgr2=0x7f040003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 0x7f040003a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0404006fd0 tx=0x7f0404006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 msgr2=0x7f0414194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f041000bb10 comp rx=0 tx=0).stop 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 shutdown_connections 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f0400038490 0x7f040003a940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 --2- 172.21.15.149:0/449275830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04140fe0e0 0x7f0414194f90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:17.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 >> 172.21.15.149:0/449275830 conn(0x7f04140f9af0 msgr2=0x7f04140fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:17.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 shutdown_connections 2024-04-15T20:54:17.959 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:17.965+0000 7f041b341700 1 -- 172.21.15.149:0/449275830 wait complete. 2024-04-15T20:54:17.959 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:18 smithi072 ceph-mon[29079]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:18 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/449275830' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:19.557 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:19.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:19.762 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:19.811 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:20 smithi072 ceph-mon[29079]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.239+0000 7fb5d3516700 1 -- 172.21.15.149:0/979135281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 msgr2=0x7fb5cc0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.239+0000 7fb5d3516700 1 --2- 172.21.15.149:0/979135281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0ff130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b0a0 tx=0x7fb5bc00b3b0 comp rx=0 tx=0).stop 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.239+0000 7fb5d3516700 1 -- 172.21.15.149:0/979135281 shutdown_connections 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.239+0000 7fb5d3516700 1 --2- 172.21.15.149:0/979135281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0ff130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.239+0000 7fb5d3516700 1 -- 172.21.15.149:0/979135281 >> 172.21.15.149:0/979135281 conn(0x7fb5cc0fa2b0 msgr2=0x7fb5cc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 -- 172.21.15.149:0/979135281 shutdown_connections 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 -- 172.21.15.149:0/979135281 wait complete. 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 Processor -- start 2024-04-15T20:54:21.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 -- start start 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d3516700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0fc7a0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.240+0000 7fb5d12b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d12b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:33072/0 (socket says 172.21.15.149:33072) 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d12b2700 1 -- 172.21.15.149:0/542060743 learned_addr learned my addr 172.21.15.149:0/542060743 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:21.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d12b2700 1 -- 172.21.15.149:0/542060743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009d00 con 0x7fb5cc0fed20 2024-04-15T20:54:21.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d12b2700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b830 tx=0x7fb5bc00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:21.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5bc00e040 con 0x7fb5cc0fed20 2024-04-15T20:54:21.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5bc012af0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc0fa8b0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5bc01d9f0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.241+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc0facd0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.242+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0fb6e0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.242+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb5bc012c60 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.242+0000 7fb5ca7fc700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 0x7fb5b403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.242+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb5bc04c8d0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.243+0000 7fb5d0ab1700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 0x7fb5b403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:21.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.243+0000 7fb5d0ab1700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 0x7fb5b403a940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006fd0 tx=0x7fb5c0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:21.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.247+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb5bc01c5c0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.514+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb5cc18e3f0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.515+0000 7fb5ca7fc700 1 -- 172.21.15.149:0/542060743 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb5bc01c3e0 con 0x7fb5cc0fed20 2024-04-15T20:54:21.509 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:21.509 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:21.510 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 msgr2=0x7fb5b403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 0x7fb5b403a940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006fd0 tx=0x7fb5c0006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 msgr2=0x7fb5cc0fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b830 tx=0x7fb5bc00bd40 comp rx=0 tx=0).stop 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 shutdown_connections 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7fb5b4038490 0x7fb5b403a940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 --2- 172.21.15.149:0/542060743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5cc0fed20 0x7fb5cc0fc260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 >> 172.21.15.149:0/542060743 conn(0x7fb5cc0fa2b0 msgr2=0x7fb5cc0687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 shutdown_connections 2024-04-15T20:54:21.511 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:21.517+0000 7fb5d3516700 1 -- 172.21.15.149:0/542060743 wait complete. 2024-04-15T20:54:21.512 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:22 smithi072 ceph-mon[29079]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:22 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/542060743' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:23.033 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:23.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:23.232 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:23.283 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:24.659 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:24 smithi072 ceph-mon[29079]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- 172.21.15.149:0/2064786820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 msgr2=0x7fedbc100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 --2- 172.21.15.149:0/2064786820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc100230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009910 tx=0x7fedb8009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- 172.21.15.149:0/2064786820 shutdown_connections 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 --2- 172.21.15.149:0/2064786820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc100230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- 172.21.15.149:0/2064786820 >> 172.21.15.149:0/2064786820 conn(0x7fedbc0fb3d0 msgr2=0x7fedbc0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:24.731 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- 172.21.15.149:0/2064786820 shutdown_connections 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- 172.21.15.149:0/2064786820 wait complete. 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 Processor -- start 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- start start 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.736+0000 7fedc3806700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc1954a0 con 0x7fedbc0ffe20 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc15a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc15a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:33090/0 (socket says 172.21.15.149:33090) 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc15a2700 1 -- 172.21.15.149:0/726184927 learned_addr learned my addr 172.21.15.149:0/726184927 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc15a2700 1 -- 172.21.15.149:0/726184927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80095f0 con 0x7fedbc0ffe20 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc15a2700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005b40 tx=0x7fedb8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedb801d070 con 0x7fedbc0ffe20 2024-04-15T20:54:24.732 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc1956a0 con 0x7fedbc0ffe20 2024-04-15T20:54:24.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fedb800be10 con 0x7fedbc0ffe20 2024-04-15T20:54:24.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedb800f460 con 0x7fedbc0ffe20 2024-04-15T20:54:24.733 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.737+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc195b40 con 0x7fedbc0ffe20 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.738+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fedb80227e0 con 0x7fedbc0ffe20 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.738+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc18ea80 con 0x7fedbc0ffe20 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.738+0000 7fedb27fc700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 0x7feda803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.738+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fedb804c360 con 0x7fedbc0ffe20 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.739+0000 7fedc0da1700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 0x7feda803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:24.734 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.739+0000 7fedc0da1700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 0x7feda803a940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedac006fd0 tx=0x7fedac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:24.737 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:24.744+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fedb802b590 con 0x7fedbc0ffe20 2024-04-15T20:54:25.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.012+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fedbc02cc30 con 0x7fedbc0ffe20 2024-04-15T20:54:25.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.012+0000 7fedb27fc700 1 -- 172.21.15.149:0/726184927 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fedb8027070 con 0x7fedbc0ffe20 2024-04-15T20:54:25.006 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:25.006 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:25.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 msgr2=0x7feda803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:25.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 0x7feda803a940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fedac006fd0 tx=0x7fedac006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:25.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 msgr2=0x7fedbc194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:25.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005b40 tx=0x7fedb8004740 comp rx=0 tx=0).stop 2024-04-15T20:54:25.008 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 shutdown_connections 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7feda8038490 0x7feda803a940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 --2- 172.21.15.149:0/726184927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedbc0ffe20 0x7fedbc194f60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 >> 172.21.15.149:0/726184927 conn(0x7fedbc0fb3d0 msgr2=0x7fedbc0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 shutdown_connections 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:25.015+0000 7fedc3806700 1 -- 172.21.15.149:0/726184927 wait complete. 2024-04-15T20:54:25.009 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:25.477 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:25 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/726184927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:26.596 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:26.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:26.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:26 smithi072 ceph-mon[29079]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:26.803 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:26.849 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:27 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:27 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:27 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:27 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 -- 172.21.15.149:0/856903407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 msgr2=0x7ff6380fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 --2- 172.21.15.149:0/856903407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380fe8b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff634009910 tx=0x7ff634009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 -- 172.21.15.149:0/856903407 shutdown_connections 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 --2- 172.21.15.149:0/856903407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380fe8b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 -- 172.21.15.149:0/856903407 >> 172.21.15.149:0/856903407 conn(0x7ff6380f9af0 msgr2=0x7ff6380fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 -- 172.21.15.149:0/856903407 shutdown_connections 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.266+0000 7ff63fd39700 1 -- 172.21.15.149:0/856903407 wait complete. 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63fd39700 1 Processor -- start 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63fd39700 1 -- start start 2024-04-15T20:54:28.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63fd39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:28.261 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63fd39700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638197cb0 con 0x7ff6380fe4a0 2024-04-15T20:54:28.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63dad5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:28.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63dad5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:58546/0 (socket says 172.21.15.149:58546) 2024-04-15T20:54:28.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63dad5700 1 -- 172.21.15.149:0/3607476700 learned_addr learned my addr 172.21.15.149:0/3607476700 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:28.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63dad5700 1 -- 172.21.15.149:0/3607476700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340095f0 con 0x7ff6380fe4a0 2024-04-15T20:54:28.262 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.267+0000 7ff63dad5700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff634005b40 tx=0x7ff634004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff63401d070 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff63400be10 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff638197df0 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff63400f460 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff638198290 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7ff63400b960 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.268+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff638104250 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.269+0000 7ff62effd700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 0x7ff62403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.269+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff63404c540 con 0x7ff6380fe4a0 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.269+0000 7ff63d2d4700 1 -- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 msgr2=0x7ff62403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3608699399 2024-04-15T20:54:28.263 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.269+0000 7ff63d2d4700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 0x7ff62403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:54:28.266 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.273+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff63402a360 con 0x7ff6380fe4a0 2024-04-15T20:54:28.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.470+0000 7ff63d2d4700 1 -- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 msgr2=0x7ff62403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3608699399 2024-04-15T20:54:28.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.470+0000 7ff63d2d4700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 0x7ff62403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:54:28.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.544+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff638104440 con 0x7ff6380fe4a0 2024-04-15T20:54:28.537 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.544+0000 7ff62effd700 1 -- 172.21.15.149:0/3607476700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff634027030 con 0x7ff6380fe4a0 2024-04-15T20:54:28.538 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:28.538 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 msgr2=0x7ff62403a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 0x7ff62403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 msgr2=0x7ff6380faa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff634005b40 tx=0x7ff634004740 comp rx=0 tx=0).stop 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 shutdown_connections 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7ff6240384e0 0x7ff62403a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 --2- 172.21.15.149:0/3607476700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6380fe4a0 0x7ff6380faa90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 >> 172.21.15.149:0/3607476700 conn(0x7ff6380f9af0 msgr2=0x7ff6380fb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 shutdown_connections 2024-04-15T20:54:28.540 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:28.546+0000 7ff63fd39700 1 -- 172.21.15.149:0/3607476700 wait complete. 2024-04-15T20:54:28.541 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:28.751 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:28 smithi072 ceph-mon[29079]: from='mgr.14164 172.21.15.72:0/4108658838' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-15T20:54:28.751 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:28 smithi072 ceph-mon[29079]: mgrmap e14: smithi072.wfjmmp(active, since 76s) 2024-04-15T20:54:29.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:29 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/3607476700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:30.102 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:30.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:30.309 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:30.356 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3774357505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 msgr2=0x7f8cf40ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3774357505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40ff130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009910 tx=0x7f8ce8009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3774357505 shutdown_connections 2024-04-15T20:54:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3774357505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40ff130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:31.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3774357505 >> 172.21.15.149:0/3774357505 conn(0x7f8cf40fa2b0 msgr2=0x7f8cf40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3774357505 shutdown_connections 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.952+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3774357505 wait complete. 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cfa6da700 1 Processor -- start 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cfa6da700 1 -- start start 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cfa6da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cfa6da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40fc7a0 con 0x7f8cf40fed20 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cf3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cf3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:58572/0 (socket says 172.21.15.149:58572) 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.953+0000 7f8cf3fff700 1 -- 172.21.15.149:0/3894823947 learned_addr learned my addr 172.21.15.149:0/3894823947 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cf3fff700 1 -- 172.21.15.149:0/3894823947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80095f0 con 0x7f8cf40fed20 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cf3fff700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8005b40 tx=0x7f8ce8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ce801d070 con 0x7f8cf40fed20 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ce800be10 con 0x7f8cf40fed20 2024-04-15T20:54:31.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ce800f460 con 0x7f8cf40fed20 2024-04-15T20:54:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf40fa8b0 con 0x7f8cf40fed20 2024-04-15T20:54:31.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.954+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf40fad50 con 0x7f8cf40fed20 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f8ce800f6d0 con 0x7f8cf40fed20 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cf17fa700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 0x7f8cdc03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4062380 con 0x7f8cf40fed20 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8ce804c590 con 0x7f8cf40fed20 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cf37fe700 1 -- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 msgr2=0x7f8cdc03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3608699399 2024-04-15T20:54:31.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.955+0000 7f8cf37fe700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 0x7f8cdc03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:54:31.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:31.960+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8ce8027020 con 0x7f8cf40fed20 2024-04-15T20:54:32.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.156+0000 7f8cf37fe700 1 -- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 msgr2=0x7f8cdc03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3608699399 2024-04-15T20:54:32.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.156+0000 7f8cf37fe700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 0x7f8cdc03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T20:54:32.216 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.223+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8cf418e3f0 con 0x7f8cf40fed20 2024-04-15T20:54:32.217 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.224+0000 7f8cf17fa700 1 -- 172.21.15.149:0/3894823947 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8ce802c440 con 0x7f8cf40fed20 2024-04-15T20:54:32.217 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:32.217 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:32.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 msgr2=0x7f8cdc03a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:54:32.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 0x7f8cdc03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:32.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 msgr2=0x7f8cf40fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:32.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8005b40 tx=0x7f8ce8004740 comp rx=0 tx=0).stop 2024-04-15T20:54:32.219 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 shutdown_connections 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:6800/3608699399,v1:172.21.15.72:6801/3608699399] conn(0x7f8cdc0384e0 0x7f8cdc03a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 --2- 172.21.15.149:0/3894823947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cf40fed20 0x7f8cf40fc260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 >> 172.21.15.149:0/3894823947 conn(0x7f8cf40fa2b0 msgr2=0x7f8cf40687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 shutdown_connections 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:32.226+0000 7f8cfa6da700 1 -- 172.21.15.149:0/3894823947 wait complete. 2024-04-15T20:54:32.220 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:32.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:32 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/3894823947' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:33.819 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:33.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:34.012 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:34.060 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: Active manager daemon smithi072.wfjmmp restarted 2024-04-15T20:54:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: Activating manager daemon smithi072.wfjmmp 2024-04-15T20:54:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: osdmap e5: 0 total, 0 up, 0 in 2024-04-15T20:54:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: mgrmap e15: smithi072.wfjmmp(active, starting, since 0.00569366s) 2024-04-15T20:54:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:34.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:54:35.292 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:35 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T20:54:35.293 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:35 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T20:54:35.293 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:35 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:35.293 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:35 smithi072 ceph-mon[29079]: mgrmap e16: smithi072.wfjmmp(active, since 1.00589s) 2024-04-15T20:54:35.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 -- 172.21.15.149:0/2716003136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 msgr2=0x7fc298102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:35.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 --2- 172.21.15.149:0/2716003136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298102c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc288009910 tx=0x7fc288009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:35.488 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 -- 172.21.15.149:0/2716003136 shutdown_connections 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 --2- 172.21.15.149:0/2716003136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298102c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 -- 172.21.15.149:0/2716003136 >> 172.21.15.149:0/2716003136 conn(0x7fc2980fa2b0 msgr2=0x7fc2980fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 -- 172.21.15.149:0/2716003136 shutdown_connections 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.494+0000 7fc29db54700 1 -- 172.21.15.149:0/2716003136 wait complete. 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.495+0000 7fc29db54700 1 Processor -- start 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.495+0000 7fc29db54700 1 -- start start 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.495+0000 7fc29db54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:35.489 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.495+0000 7fc29db54700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981954e0 con 0x7fc2981008b0 2024-04-15T20:54:35.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.495+0000 7fc2977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc2977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:34106/0 (socket says 172.21.15.149:34106) 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc2977fe700 1 -- 172.21.15.149:0/699909624 learned_addr learned my addr 172.21.15.149:0/699909624 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc2977fe700 1 -- 172.21.15.149:0/699909624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880095f0 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc2977fe700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc288005b40 tx=0x7fc288004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc28801d070 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc28800be10 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2981956e0 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc28800f460 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.496+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc298195b80 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.497+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7fc28800f5c0 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.497+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29818eb00 con 0x7fc2981008b0 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.497+0000 7fc294ff9700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 0x7fc28003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:35.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.497+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc28804c2f0 con 0x7fc2981008b0 2024-04-15T20:54:35.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.498+0000 7fc296ffd700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 0x7fc28003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:35.492 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.498+0000 7fc296ffd700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 0x7fc28003a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:35.497 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.504+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc28802a360 con 0x7fc2981008b0 2024-04-15T20:54:35.777 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.783+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc29802cc30 con 0x7fc2981008b0 2024-04-15T20:54:35.778 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.784+0000 7fc294ff9700 1 -- 172.21.15.149:0/699909624 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc288027020 con 0x7fc2981008b0 2024-04-15T20:54:35.778 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:35.778 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 msgr2=0x7fc28003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 0x7fc28003a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 msgr2=0x7fc298194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc288005b40 tx=0x7fc288004740 comp rx=0 tx=0).stop 2024-04-15T20:54:35.780 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 shutdown_connections 2024-04-15T20:54:35.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc280038380 0x7fc28003a830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:35.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 --2- 172.21.15.149:0/699909624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2981008b0 0x7fc298194fa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:35.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.786+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 >> 172.21.15.149:0/699909624 conn(0x7fc2980fa2b0 msgr2=0x7fc2980faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:35.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.787+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 shutdown_connections 2024-04-15T20:54:35.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:35.787+0000 7fc29db54700 1 -- 172.21.15.149:0/699909624 wait complete. 2024-04-15T20:54:35.782 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:36.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: [15/Apr/2024:20:54:35] ENGINE Bus STARTING 2024-04-15T20:54:36.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: [15/Apr/2024:20:54:35] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T20:54:36.564 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: [15/Apr/2024:20:54:35] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T20:54:36.564 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: [15/Apr/2024:20:54:35] ENGINE Bus STARTED 2024-04-15T20:54:36.564 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:36.564 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:36 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/699909624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:37.392 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:37.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:37.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:37.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:37 smithi072 ceph-mon[29079]: mgrmap e17: smithi072.wfjmmp(active, since 2s) 2024-04-15T20:54:37.781 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:38.220 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-15T20:54:39.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 -- 172.21.15.149:0/1683406893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 msgr2=0x7fa018100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:39.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 --2- 172.21.15.149:0/1683406893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018100230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa014009910 tx=0x7fa014009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:39.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 -- 172.21.15.149:0/1683406893 shutdown_connections 2024-04-15T20:54:39.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 --2- 172.21.15.149:0/1683406893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018100230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:39.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 -- 172.21.15.149:0/1683406893 >> 172.21.15.149:0/1683406893 conn(0x7fa0180fb3d0 msgr2=0x7fa0180fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 -- 172.21.15.149:0/1683406893 shutdown_connections 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.644+0000 7fa02053f700 1 -- 172.21.15.149:0/1683406893 wait complete. 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa02053f700 1 Processor -- start 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa02053f700 1 -- start start 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa02053f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa02053f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018075030 con 0x7fa0180ffe20 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa01e2db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa01e2db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:34128/0 (socket says 172.21.15.149:34128) 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa01e2db700 1 -- 172.21.15.149:0/3084913932 learned_addr learned my addr 172.21.15.149:0/3084913932 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.645+0000 7fa01e2db700 1 -- 172.21.15.149:0/3084913932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140095f0 con 0x7fa0180ffe20 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa01e2db700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa014005b40 tx=0x7fa014004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa01401d070 con 0x7fa0180ffe20 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018073140 con 0x7fa0180ffe20 2024-04-15T20:54:39.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa01400be10 con 0x7fa0180ffe20 2024-04-15T20:54:39.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa01400f460 con 0x7fa0180ffe20 2024-04-15T20:54:39.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.646+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180735e0 con 0x7fa0180ffe20 2024-04-15T20:54:39.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.647+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018062380 con 0x7fa0180ffe20 2024-04-15T20:54:39.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.647+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fa01400b960 con 0x7fa0180ffe20 2024-04-15T20:54:39.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.647+0000 7fa00f7fe700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 0x7fa00403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:39.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.647+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa01404c4f0 con 0x7fa0180ffe20 2024-04-15T20:54:39.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.647+0000 7fa01dada700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 0x7fa00403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:39.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.648+0000 7fa01dada700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 0x7fa00403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa008006fd0 tx=0x7fa008006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:39.645 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.652+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa01402bba0 con 0x7fa0180ffe20 2024-04-15T20:54:39.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:39.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:39.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:39.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:39.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:54:39.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.921+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa01818e460 con 0x7fa0180ffe20 2024-04-15T20:54:39.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.921+0000 7fa00f7fe700 1 -- 172.21.15.149:0/3084913932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa014027020 con 0x7fa0180ffe20 2024-04-15T20:54:39.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:39.915 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 msgr2=0x7fa00403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 0x7fa00403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa008006fd0 tx=0x7fa008006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 msgr2=0x7fa018074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa014005b40 tx=0x7fa014004740 comp rx=0 tx=0).stop 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 shutdown_connections 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fa004038580 0x7fa00403aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 --2- 172.21.15.149:0/3084913932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0180ffe20 0x7fa018074af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 >> 172.21.15.149:0/3084913932 conn(0x7fa0180fb3d0 msgr2=0x7fa0180fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.923+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 shutdown_connections 2024-04-15T20:54:39.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:39.924+0000 7fa02053f700 1 -- 172.21.15.149:0/3084913932 wait complete. 2024-04-15T20:54:39.918 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/3084913932' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:54:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:41.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T20:54:41.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:54:41.951 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:41.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:42.663 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:42 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T20:54:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:42 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T20:54:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:42 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T20:54:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:42 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T20:54:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:42 smithi072 ceph-mon[29079]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 -- 172.21.15.149:0/3460336848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 msgr2=0x7f2f90101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 --2- 172.21.15.149:0/3460336848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f90101300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009910 tx=0x7f2f80009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 -- 172.21.15.149:0/3460336848 shutdown_connections 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 --2- 172.21.15.149:0/3460336848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f90101300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 -- 172.21.15.149:0/3460336848 >> 172.21.15.149:0/3460336848 conn(0x7f2f90074af0 msgr2=0x7f2f90074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 -- 172.21.15.149:0/3460336848 shutdown_connections 2024-04-15T20:54:44.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.371+0000 7f2f98630700 1 -- 172.21.15.149:0/3460336848 wait complete. 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f98630700 1 Processor -- start 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f98630700 1 -- start start 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f98630700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f98630700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90100ce0 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f963cc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f963cc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:34142/0 (socket says 172.21.15.149:34142) 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f963cc700 1 -- 172.21.15.149:0/1866424968 learned_addr learned my addr 172.21.15.149:0/1866424968 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.372+0000 7f2f963cc700 1 -- 172.21.15.149:0/1866424968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800095f0 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f963cc700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005b40 tx=0x7f2f80004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f8001d070 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f800044d0 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f80003930 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900ff2a0 con 0x7f2f90100f30 2024-04-15T20:54:44.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.373+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900ff720 con 0x7f2f90100f30 2024-04-15T20:54:44.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.374+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90107610 con 0x7f2f90100f30 2024-04-15T20:54:44.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.374+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f2f8000b960 con 0x7f2f90100f30 2024-04-15T20:54:44.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.374+0000 7f2f877fe700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 0x7f2f7c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:44.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.374+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2f8004c4b0 con 0x7f2f90100f30 2024-04-15T20:54:44.369 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.374+0000 7f2f95bcb700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 0x7f2f7c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:44.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.375+0000 7f2f95bcb700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 0x7f2f7c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c006fd0 tx=0x7f2f8c006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:44.372 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.379+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f8002a540 con 0x7f2f90100f30 2024-04-15T20:54:44.669 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.675+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2f900ff9c0 con 0x7f2f90100f30 2024-04-15T20:54:44.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.676+0000 7f2f877fe700 1 -- 172.21.15.149:0/1866424968 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2f8002a360 con 0x7f2f90100f30 2024-04-15T20:54:44.670 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:44.670 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:44.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 msgr2=0x7f2f7c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:44.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 0x7f2f7c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c006fd0 tx=0x7f2f8c006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:44.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 msgr2=0x7f2f900fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005b40 tx=0x7f2f80004c80 comp rx=0 tx=0).stop 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 shutdown_connections 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2f7c038580 0x7f2f7c03aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 --2- 172.21.15.149:0/1866424968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f90100f30 0x7f2f900fed60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 >> 172.21.15.149:0/1866424968 conn(0x7f2f90074af0 msgr2=0x7f2f90104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 shutdown_connections 2024-04-15T20:54:44.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:44.678+0000 7f2f98630700 1 -- 172.21.15.149:0/1866424968 wait complete. 2024-04-15T20:54:44.674 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:45.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:44 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1866424968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:46.255 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:46.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:46.459 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-15T20:54:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:54:46.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:46 smithi072 ceph-mon[29079]: Deploying daemon crash.smithi149 on smithi149 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.668+0000 7f1563d9d700 1 -- 172.21.15.149:0/3221173333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 msgr2=0x7f155c0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.668+0000 7f1563d9d700 1 --2- 172.21.15.149:0/3221173333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c0ff380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f154c009910 tx=0x7f154c009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 -- 172.21.15.149:0/3221173333 shutdown_connections 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 --2- 172.21.15.149:0/3221173333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c0ff380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 -- 172.21.15.149:0/3221173333 >> 172.21.15.149:0/3221173333 conn(0x7f155c0fa890 msgr2=0x7f155c0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 -- 172.21.15.149:0/3221173333 shutdown_connections 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 -- 172.21.15.149:0/3221173333 wait complete. 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 Processor -- start 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.669+0000 7f1563d9d700 1 -- start start 2024-04-15T20:54:48.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1563d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1563d9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1966f0 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1561b39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1561b39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:49822/0 (socket says 172.21.15.149:49822) 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1561b39700 1 -- 172.21.15.149:0/1703887026 learned_addr learned my addr 172.21.15.149:0/1703887026 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1561b39700 1 -- 172.21.15.149:0/1703887026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0095f0 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1561b39700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b5c0 tx=0x7f154c004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.670+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f154c01d070 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.671+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f154c00be10 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.671+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c1968f0 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.671+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f154c022df0 con 0x7f155c0fefb0 2024-04-15T20:54:48.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.671+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c196d10 con 0x7f155c0fefb0 2024-04-15T20:54:48.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.671+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c197010 con 0x7f155c0fefb0 2024-04-15T20:54:48.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.672+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f154c00b960 con 0x7f155c0fefb0 2024-04-15T20:54:48.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.672+0000 7f1552ffd700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 0x7f154803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:48.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.672+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f154c04c660 con 0x7f155c0fefb0 2024-04-15T20:54:48.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.672+0000 7f1561338700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 0x7f154803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:48.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.672+0000 7f1561338700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 0x7f154803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1558006fd0 tx=0x7f1558006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:48.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.677+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f154c02a360 con 0x7f155c0fefb0 2024-04-15T20:54:48.957 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.964+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f155c068f00 con 0x7f155c0fefb0 2024-04-15T20:54:48.958 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.965+0000 7f1552ffd700 1 -- 172.21.15.149:0/1703887026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f154c027070 con 0x7f155c0fefb0 2024-04-15T20:54:48.958 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:48.958 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:48.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 msgr2=0x7f154803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:48.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 0x7f154803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1558006fd0 tx=0x7f1558006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:48.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 msgr2=0x7f155c1961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:48.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f154c00b5c0 tx=0x7f154c004cb0 comp rx=0 tx=0).stop 2024-04-15T20:54:48.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 shutdown_connections 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1548038580 0x7f154803aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 --2- 172.21.15.149:0/1703887026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f155c0fefb0 0x7f155c1961b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 >> 172.21.15.149:0/1703887026 conn(0x7f155c0fa890 msgr2=0x7f155c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 shutdown_connections 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:48.967+0000 7f1563d9d700 1 -- 172.21.15.149:0/1703887026 wait complete. 2024-04-15T20:54:48.961 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:50.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:50.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:50.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:50.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:50.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: Deploying daemon node-exporter.smithi149 on smithi149 2024-04-15T20:54:50.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1703887026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:50.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:50.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:54:50.528 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:50.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:50.738 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 -- 172.21.15.149:0/2181023196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 msgr2=0x7fd11c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 --2- 172.21.15.149:0/2181023196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c100170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd110009910 tx=0x7fd110009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 -- 172.21.15.149:0/2181023196 shutdown_connections 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 --2- 172.21.15.149:0/2181023196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c100170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 -- 172.21.15.149:0/2181023196 >> 172.21.15.149:0/2181023196 conn(0x7fd11c075750 msgr2=0x7fd11c075b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:53.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 -- 172.21.15.149:0/2181023196 shutdown_connections 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.643+0000 7fd122d35700 1 -- 172.21.15.149:0/2181023196 wait complete. 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd122d35700 1 Processor -- start 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd122d35700 1 -- start start 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd122d35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd122d35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c0fdc40 con 0x7fd11c0ffda0 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd120ad1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd120ad1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:49844/0 (socket says 172.21.15.149:49844) 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd120ad1700 1 -- 172.21.15.149:0/466455912 learned_addr learned my addr 172.21.15.149:0/466455912 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.644+0000 7fd120ad1700 1 -- 172.21.15.149:0/466455912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100095f0 con 0x7fd11c0ffda0 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd120ad1700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd110005b40 tx=0x7fd110004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd11001d070 con 0x7fd11c0ffda0 2024-04-15T20:54:53.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c0fde40 con 0x7fd11c0ffda0 2024-04-15T20:54:53.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c0fc630 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd11000be10 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.645+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd110022d60 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.646+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c062380 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.646+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fd11000b960 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.647+0000 7fd119ffb700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 0x7fd10c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.647+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd11004c580 con 0x7fd11c0ffda0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.647+0000 7fd11bfff700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 0x7fd10c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:53.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.647+0000 7fd11bfff700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 0x7fd10c03aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd108006fd0 tx=0x7fd108006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:53.646 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.652+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd1100213d0 con 0x7fd11c0ffda0 2024-04-15T20:54:53.937 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.943+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd11c0fc920 con 0x7fd11c0ffda0 2024-04-15T20:54:53.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.944+0000 7fd119ffb700 1 -- 172.21.15.149:0/466455912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd1100213d0 con 0x7fd11c0ffda0 2024-04-15T20:54:53.938 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:53.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 msgr2=0x7fd10c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:53.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 0x7fd10c03aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd108006fd0 tx=0x7fd108006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:53.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 msgr2=0x7fd11c0fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd110005b40 tx=0x7fd110004c80 comp rx=0 tx=0).stop 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 shutdown_connections 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd10c038580 0x7fd10c03aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 --2- 172.21.15.149:0/466455912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd11c0ffda0 0x7fd11c0fbf20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 >> 172.21.15.149:0/466455912 conn(0x7fd11c075750 msgr2=0x7fd11c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 shutdown_connections 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:53.946+0000 7fd122d35700 1 -- 172.21.15.149:0/466455912 wait complete. 2024-04-15T20:54:53.941 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:54:54.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-15T20:54:54.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:54:54.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:54:54.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T20:54:54.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/466455912' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:54.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:55.640 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:54:55.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:54:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:55 smithi072 ceph-mon[29079]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:56.207 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:54:57.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 -- 172.21.15.149:0/3969558003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 msgr2=0x7f41300ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:57.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 --2- 172.21.15.149:0/3969558003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f41300ff390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4120009910 tx=0x7f4120009c20 comp rx=0 tx=0).stop 2024-04-15T20:54:57.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 -- 172.21.15.149:0/3969558003 shutdown_connections 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 --2- 172.21.15.149:0/3969558003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f41300ff390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 -- 172.21.15.149:0/3969558003 >> 172.21.15.149:0/3969558003 conn(0x7f4130074af0 msgr2=0x7f4130074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 -- 172.21.15.149:0/3969558003 shutdown_connections 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.598+0000 7f4134e15700 1 -- 172.21.15.149:0/3969558003 wait complete. 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f4134e15700 1 Processor -- start 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f4134e15700 1 -- start start 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f4134e15700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:57.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f4134e15700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130194890 con 0x7f41300fefc0 2024-04-15T20:54:57.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f412e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:57.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f412e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:47776/0 (socket says 172.21.15.149:47776) 2024-04-15T20:54:57.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.599+0000 7f412e59c700 1 -- 172.21.15.149:0/1206610317 learned_addr learned my addr 172.21.15.149:0/1206610317 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:54:57.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.600+0000 7f412e59c700 1 -- 172.21.15.149:0/1206610317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200095f0 con 0x7f41300fefc0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.600+0000 7f412e59c700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4120005b40 tx=0x7f4120004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.600+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f412001d070 con 0x7f41300fefc0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.600+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4130194a90 con 0x7f41300fefc0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.600+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41200044d0 con 0x7f41300fefc0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.601+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4120003930 con 0x7f41300fefc0 2024-04-15T20:54:57.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.601+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4130194e50 con 0x7f41300fefc0 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.601+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f4120003c70 con 0x7f41300fefc0 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.601+0000 7f411f7fe700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 0x7f411803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.601+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f412004c390 con 0x7f41300fefc0 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.602+0000 7f412dd9b700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 0x7f411803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.602+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130062380 con 0x7f41300fefc0 2024-04-15T20:54:57.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.602+0000 7f412dd9b700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 0x7f411803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4124006fd0 tx=0x7f4124006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:54:57.600 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.607+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f41200219c0 con 0x7f41300fefc0 2024-04-15T20:54:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:54:57.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:54:57.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:54:57.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:57 smithi072 ceph-mon[29079]: Deploying daemon mon.smithi149 on smithi149 2024-04-15T20:54:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.893+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4130109100 con 0x7f41300fefc0 2024-04-15T20:54:57.886 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.893+0000 7f411f7fe700 1 -- 172.21.15.149:0/1206610317 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f41200213d0 con 0x7f41300fefc0 2024-04-15T20:54:57.887 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:54:57.887 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 msgr2=0x7f411803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 0x7f411803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4124006fd0 tx=0x7f4124006e40 comp rx=0 tx=0).stop 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 msgr2=0x7f4130194350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4120005b40 tx=0x7f4120004c80 comp rx=0 tx=0).stop 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 shutdown_connections 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4118038580 0x7f411803aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:57.889 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 --2- 172.21.15.149:0/1206610317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41300fefc0 0x7f4130194350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:54:57.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 >> 172.21.15.149:0/1206610317 conn(0x7f4130074af0 msgr2=0x7f41301031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:54:57.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 shutdown_connections 2024-04-15T20:54:57.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:54:57.895+0000 7f4134e15700 1 -- 172.21.15.149:0/1206610317 wait complete. 2024-04-15T20:54:57.890 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:54:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:58 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1206610317' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:54:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:59 smithi072 ceph-mon[29079]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:54:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:54:59 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:00.162 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:55:00.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:55:00.525 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:55:01.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:01 smithi072 ceph-mon[29079]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 -- 172.21.15.149:0/2839776865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 msgr2=0x7f72ec0ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2839776865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec0ff480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009910 tx=0x7f72e0009c20 comp rx=0 tx=0).stop 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 -- 172.21.15.149:0/2839776865 shutdown_connections 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2839776865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec0ff480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 -- 172.21.15.149:0/2839776865 >> 172.21.15.149:0/2839776865 conn(0x7f72ec0fa970 msgr2=0x7f72ec0fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 -- 172.21.15.149:0/2839776865 shutdown_connections 2024-04-15T20:55:02.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.325+0000 7f72f1b71700 1 -- 172.21.15.149:0/2839776865 wait complete. 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.326+0000 7f72f1b71700 1 Processor -- start 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.326+0000 7f72f1b71700 1 -- start start 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72f1b71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72f1b71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1967b0 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.149:47786/0 (socket says 172.21.15.149:47786) 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72eb7fe700 1 -- 172.21.15.149:0/2666169805 learned_addr learned my addr 172.21.15.149:0/2666169805 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72eb7fe700 1 -- 172.21.15.149:0/2666169805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00095f0 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.327+0000 7f72eb7fe700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72e0005b40 tx=0x7f72e0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.328+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72e001d070 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.328+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec1969b0 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.328+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec196d70 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.328+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72e000be10 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.328+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72e0022b60 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.329+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d8005320 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.329+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f72e0022cc0 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.329+0000 7f72e8ff9700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 0x7f72d403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:02.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.329+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f72e004c340 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.329+0000 7f72eaffd700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 0x7f72d403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:02.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.330+0000 7f72eaffd700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 0x7f72d403aa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72dc006fd0 tx=0x7f72dc006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:02.328 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.334+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f72e0015350 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.618+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f72d8005190 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.619+0000 7f72e8ff9700 1 -- 172.21.15.149:0/2666169805 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f72e0021bc0 con 0x7f72ec0ff0b0 2024-04-15T20:55:02.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:55:02.613 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:51:54.748398Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.621+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 msgr2=0x7f72d403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.621+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 0x7f72d403aa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72dc006fd0 tx=0x7f72dc006e40 comp rx=0 tx=0).stop 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.621+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 msgr2=0x7f72ec196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.621+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72e0005b40 tx=0x7f72e0004c80 comp rx=0 tx=0).stop 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 shutdown_connections 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f72d4038580 0x7f72d403aa30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 --2- 172.21.15.149:0/2666169805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ec0ff0b0 0x7f72ec196270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 >> 172.21.15.149:0/2666169805 conn(0x7f72ec0fa970 msgr2=0x7f72ec103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 shutdown_connections 2024-04-15T20:55:02.615 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:02.622+0000 7f72f1b71700 1 -- 172.21.15.149:0/2666169805 wait complete. 2024-04-15T20:55:02.616 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-04-15T20:55:02.659 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: load: jerasure load: lrc 2024-04-15T20:55:02.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: RocksDB version: 7.9.2 2024-04-15T20:55:02.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Git sha 0 2024-04-15T20:55:02.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Compile date 2023-08-03 19:21:13 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: DB SUMMARY 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: DB Session ID: IP163PFE7IHL80ZD4F90 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: CURRENT file: CURRENT 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: IDENTITY file: IDENTITY 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi149/store.db dir, Total Num: 0, files: 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi149/store.db: 000004.log size: 511 ; 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.error_if_exists: 0 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.create_if_missing: 0 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.paranoid_checks: 1 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-15T20:55:02.918 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.env: 0x55fb28ecd720 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.fs: PosixFileSystem 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.info_log: 0x55fb2b6b92c0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_file_opening_threads: 16 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.statistics: (nil) 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.use_fsync: 0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_log_file_size: 0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.keep_log_file_num: 1000 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.recycle_log_file_num: 0 2024-04-15T20:55:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_fallocate: 1 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_mmap_reads: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_mmap_writes: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.use_direct_reads: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.create_missing_column_families: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.db_log_dir: 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.wal_dir: 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-15T20:55:02.920 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.advise_random_on_open: 1 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.db_write_buffer_size: 0 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.write_buffer_manager: 0x55fb2a92a3c0 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-15T20:55:02.922 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.rate_limiter: (nil) 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.wal_recovery_mode: 2 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enable_thread_tracking: 0 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enable_pipelined_write: 0 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.unordered_write: 0 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.row_cache: None 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.wal_filter: None 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-15T20:55:02.923 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_ingest_behind: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.two_write_queues: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.manual_wal_flush: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.wal_compression: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.atomic_flush: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.log_readahead_size: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.best_efforts_recovery: 0 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-15T20:55:02.924 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.allow_data_in_errors: 0 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.db_host_id: __hostname__ 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_background_jobs: 2 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_background_compactions: -1 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_subcompactions: 1 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_total_wal_size: 0 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-15T20:55:02.925 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_open_files: -1 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bytes_per_sync: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_readahead_size: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_background_flushes: -1 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Compression algorithms supported: 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kZSTD supported: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kXpressCompression supported: 0 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kLZ4HCCompression supported: 1 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kZlibCompression supported: 1 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kSnappyCompression supported: 1 2024-04-15T20:55:02.926 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kLZ4Compression supported: 1 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: kBZip2Compression supported: 0 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000005 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.merge_operator: 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_filter: None 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_filter_factory: None 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.sst_partitioner_factory: None 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fb2b6b93c0) 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-04-15T20:55:02.927 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_type: 0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_index_type: 0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_shortening: 1 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: checksum: 4 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: no_block_cache: 0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache: 0x55fb2a9cb1f0 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_options: 2024-04-15T20:55:02.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: capacity : 536870912 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_shard_bits : 4 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: strict_capacity_limit : 0 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_compressed: (nil) 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: persistent_cache: (nil) 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size: 4096 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size_deviation: 10 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_restart_interval: 16 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_block_restart_interval: 1 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_block_size: 4096 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: partition_filters: 0 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: use_delta_encoding: 1 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: filter_policy: bloomfilter 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: whole_key_filtering: 1 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: verify_compression: 0 2024-04-15T20:55:02.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: format_version: 5 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_index_compression: 1 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_align: 0 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_auto_readahead_size: 262144 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: prepopulate_block_cache: 0 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: initial_auto_readahead_size: 8192 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.write_buffer_size: 33554432 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_write_buffer_number: 2 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression: NoCompression 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression: Disabled 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.prefix_extractor: nullptr 2024-04-15T20:55:02.930 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.num_levels: 7 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-15T20:55:02.931 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.level: 32767 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.strategy: 0 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.enabled: false 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.target_file_size_base: 67108864 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-15T20:55:02.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.arena_block_size: 1048576 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-15T20:55:02.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.disable_auto_compactions: 0 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.table_properties_collectors: 2024-04-15T20:55:02.934 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.inplace_update_support: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.bloom_locality: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.max_successive_merges: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.paranoid_file_checks: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.force_consistency_checks: 1 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.report_bg_io_stats: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.ttl: 2592000 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-15T20:55:02.935 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enable_blob_files: false 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.min_blob_size: 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_file_size: 268435456 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.blob_file_starting_level: 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 62ed047f-0528-4563-80e4-60ae6ab25e1b 2024-04-15T20:55:02.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214502669445, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214502669960, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713214502, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "62ed047f-0528-4563-80e4-60ae6ab25e1b", "db_session_id": "IP163PFE7IHL80ZD4F90", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713214502670043, "job": 1, "event": "recovery_finished"} 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi149/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fb2aa68000 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: DB pointer 0x55fb2aa54000 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** DB Stats ** 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T20:55:02.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T20:55:02.938 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache BinnedLRUCache@0x55fb2a9cb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-15T20:55:02.939 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149 does not exist in monmap, will attempt to join an existing cluster 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: using public_addr v2:172.21.15.149:0/0 -> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: starting mon.smithi149 rank -1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi149 fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(???) e0 preinit fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).mds e1 new map 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).mds e1 print_map 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: e1 2024-04-15T20:55:02.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: legacy client fscid: -1 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: No filesystems configured 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-15T20:55:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/1866424968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: Deploying daemon crash.smithi149 on smithi149 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: Deploying daemon node-exporter.smithi149 on smithi149 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/1703887026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/466455912' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: Deploying daemon mon.smithi149 on smithi149 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/1206610317' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expand map: {default=false} 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta from 'false' to 'false' 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expanded map: {default=false} 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expand map: {default=info} 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta from 'info' to 'info' 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expanded map: {default=info} 2024-04-15T20:55:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expand map: {default=daemon} 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta from 'daemon' to 'daemon' 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expanded map: {default=daemon} 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expand map: {default=debug} 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta from 'debug' to 'debug' 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: expand_channel_meta expanded map: {default=debug} 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 ceph-mon[36029]: mon.smithi149@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 bash[35975]: 2dad6840485a51dafca5469baee3169abbefc71441c0b79f594b3f0d9af775b7 2024-04-15T20:55:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:02 smithi149 systemd[1]: Started Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T20:55:04.342 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-15T20:55:04.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mon dump -f json 2024-04-15T20:55:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:55:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:55:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: mon.smithi072 calling monitor election 2024-04-15T20:55:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: mon.smithi149 calling monitor election 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} 2024-04-15T20:55:08.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: fsmap 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: osdmap e5: 0 total, 0 up, 0 in 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: mgrmap e17: smithi072.wfjmmp(active, since 33s) 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: overall HEALTH_OK 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: mon.smithi072 calling monitor election 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: mon.smithi149 calling monitor election 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T20:55:08.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: fsmap 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: osdmap e5: 0 total, 0 up, 0 in 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: mgrmap e17: smithi072.wfjmmp(active, since 33s) 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: overall HEALTH_OK 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/1436272526' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 -- 172.21.15.149:0/2119886171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200035c0 msgr2=0x7f6520005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 --2- 172.21.15.149:0/2119886171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200035c0 0x7f6520005a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65340ffe80 tx=0x7f652400feb0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 -- 172.21.15.149:0/2119886171 shutdown_connections 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 --2- 172.21.15.149:0/2119886171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200035c0 0x7f6520005a40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 -- 172.21.15.149:0/2119886171 >> 172.21.15.149:0/2119886171 conn(0x7f65340fba50 msgr2=0x7f65340fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:09.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 -- 172.21.15.149:0/2119886171 shutdown_connections 2024-04-15T20:55:09.057 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.062+0000 7f653a812700 1 -- 172.21.15.149:0/2119886171 wait complete. 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: mgrmap e18: smithi072.wfjmmp(active, since 33s), standbys: smithi149.qgbaiy 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:09.057 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:09.059 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 Processor -- start 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 -- start start 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 0x7f6534199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534196060 con 0x7f6534195a50 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f653a812700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65341961d0 con 0x7f65200035c0 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36236/0 (socket says 172.21.15.149:36236) 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 -- 172.21.15.149:0/2074497230 learned_addr learned my addr 172.21.15.149:0/2074497230 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 -- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 msgr2=0x7f6534195510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 -- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 msgr2=0x7f6534195510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-15T20:55:09.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.063+0000 7f6533fff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f652bfff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 0x7f6534199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f652bfff700 1 -- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 msgr2=0x7f6534195510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f652bfff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f652bfff700 1 -- 172.21.15.149:0/2074497230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652400f900 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f652bfff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 0x7f6534199ec0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b500 tx=0x7f651c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651c011800 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653419a4c0 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f651c011e10 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651c00f2e0 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.064+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653419aa10 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.065+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653419ad40 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.066+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f651c010380 con 0x7f6534195a50 2024-04-15T20:55:09.061 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.066+0000 7f6531ffb700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 0x7f651406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.066+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f651c089dc0 con 0x7f6534195a50 2024-04-15T20:55:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.067+0000 7f6533fff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 0x7f651406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:09.062 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.067+0000 7f6533fff700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 0x7f651406ebb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6524005ed0 tx=0x7f6524005e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:09.064 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.071+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f651c055520 con 0x7f6534195a50 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: mgrmap e18: smithi072.wfjmmp(active, since 33s), standbys: smithi149.qgbaiy 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:09.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:55:09.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.348+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f65341a0160 con 0x7f6534195a50 2024-04-15T20:55:09.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.350+0000 7f6531ffb700 1 -- 172.21.15.149:0/2074497230 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f651c058b40 con 0x7f6534195a50 2024-04-15T20:55:09.343 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-04-15T20:55:09.343 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","modified":"2024-04-15T20:55:02.697678Z","created":"2024-04-15T20:51:54.748398Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi149","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 msgr2=0x7f651406ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 0x7f651406ebb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6524005ed0 tx=0x7f6524005e60 comp rx=0 tx=0).stop 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 msgr2=0x7f6534199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 0x7f6534199ec0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b500 tx=0x7f651c00b8c0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 shutdown_connections 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f651406c700 0x7f651406ebb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65200035c0 0x7f6534195510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 --2- 172.21.15.149:0/2074497230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6534195a50 0x7f6534199ec0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b500 tx=0x7f651c00b8c0 comp rx=0 tx=0).stop 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 >> 172.21.15.149:0/2074497230 conn(0x7f65340fba50 msgr2=0x7f6534103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 shutdown_connections 2024-04-15T20:55:09.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:55:09.352+0000 7f653a812700 1 -- 172.21.15.149:0/2074497230 wait complete. 2024-04-15T20:55:09.347 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-04-15T20:55:10.060 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-15T20:55:10.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph config generate-minimal-conf 2024-04-15T20:55:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:55:10.355 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:10 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:10.355 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:10 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/2074497230' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:10 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:10 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2074497230' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-15T20:55:11.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:55:11.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T20:55:11.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T20:55:11.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:12.640 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:12 smithi072 ceph-mon[29079]: Reconfiguring mon.smithi072 (unknown last config time)... 2024-04-15T20:55:12.640 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:12 smithi072 ceph-mon[29079]: Reconfiguring daemon mon.smithi072 on smithi072 2024-04-15T20:55:12.640 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:12 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2990759206' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 -- 172.21.15.72:0/4225497141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 msgr2=0x7fd5440ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 --2- 172.21.15.72:0/4225497141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd5440ff360 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd534009910 tx=0x7fd534009c20 comp rx=0 tx=0).stop 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 -- 172.21.15.72:0/4225497141 shutdown_connections 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 --2- 172.21.15.72:0/4225497141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd5440ff360 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 -- 172.21.15.72:0/4225497141 >> 172.21.15.72:0/4225497141 conn(0x7fd5440fa850 msgr2=0x7fd5440fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 -- 172.21.15.72:0/4225497141 shutdown_connections 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.910+0000 7fd54b26e700 1 -- 172.21.15.72:0/4225497141 wait complete. 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 Processor -- start 2024-04-15T20:55:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 -- start start 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd544196840 0x7fd544196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54419f400 con 0x7fd5440fef90 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54b26e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54419f540 con 0x7fd544196840 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40650/0 (socket says 172.21.15.72:40650) 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 -- 172.21.15.72:0/2990759206 learned_addr learned my addr 172.21.15.72:0/2990759206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 -- 172.21.15.72:0/2990759206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd544196840 msgr2=0x7fd544196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd544196840 0x7fd544196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.911+0000 7fd54900a700 1 -- 172.21.15.72:0/2990759206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340095f0 con 0x7fd5440fef90 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd54900a700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd534006010 tx=0x7fd53400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53401d070 con 0x7fd5440fef90 2024-04-15T20:55:12.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd534005140 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd534017440 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54419f740 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.912+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54419fc00 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.913+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd544062380 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.913+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fd53400f460 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.914+0000 7fd53a7fc700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 0x7fd53006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.914+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd53408ba10 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.914+0000 7fd548809700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 0x7fd53006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.914+0000 7fd548809700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 0x7fd53006ec10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5400098e0 tx=0x7fd540006dd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:11.918+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd534057250 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.114+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd544068e30 con 0x7fd5440fef90 2024-04-15T20:55:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.114+0000 7fd53a7fc700 1 -- 172.21.15.72:0/2990759206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fd534026090 con 0x7fd5440fef90 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stdout:# minimal ceph.conf for e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: mon_host = [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 msgr2=0x7fd53006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 0x7fd53006ec10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5400098e0 tx=0x7fd540006dd0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 msgr2=0x7fd544196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd534006010 tx=0x7fd53400bda0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 shutdown_connections 2024-04-15T20:55:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd53006c760 0x7fd53006ec10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5440fef90 0x7fd544196300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 --2- 172.21.15.72:0/2990759206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd544196840 0x7fd544196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.116+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 >> 172.21.15.72:0/2990759206 conn(0x7fd5440fa850 msgr2=0x7fd544104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.117+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 shutdown_connections 2024-04-15T20:55:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:12.117+0000 7fd54b26e700 1 -- 172.21.15.72:0/2990759206 wait complete. 2024-04-15T20:55:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:12 smithi149 ceph-mon[36029]: Reconfiguring mon.smithi072 (unknown last config time)... 2024-04-15T20:55:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:12 smithi149 ceph-mon[36029]: Reconfiguring daemon mon.smithi072 on smithi072 2024-04-15T20:55:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:12 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2990759206' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:55:13.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:13.684 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-15T20:55:13.684 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:55:13.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.conf 2024-04-15T20:55:13.716 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:55:13.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-15T20:55:13.785 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:55:13.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-04-15T20:55:13.816 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:13.816 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:13.816 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:13.816 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:55:13.816 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:55:13.817 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:13.822 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:55:13.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-15T20:55:13.894 INFO:tasks.cephadm:Deploying OSDs... 2024-04-15T20:55:13.894 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:55:13.894 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T20:55:13.910 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T20:55:13.910 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-15T20:55:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-15 20:54:25.812076428 +0000 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-15 20:48:38.482167490 +0000 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-15 20:48:38.482167490 +0000 2024-04-15T20:55:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-15 20:48:38.482167490 +0000 2024-04-15T20:55:13.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T20:55:14.036 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-15T20:55:14.036 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-15T20:55:14.036 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000245177 s, 2.1 MB/s 2024-04-15T20:55:14.037 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T20:55:14.094 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-15T20:55:14.149 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-15 20:54:25.813076407 +0000 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-15 20:48:38.829159839 +0000 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-15 20:48:38.829159839 +0000 2024-04-15T20:55:14.150 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-15 20:48:38.829159839 +0000 2024-04-15T20:55:14.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T20:55:14.217 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-15T20:55:14.218 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-15T20:55:14.218 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000231688 s, 2.2 MB/s 2024-04-15T20:55:14.219 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T20:55:14.275 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-15 20:54:25.813076407 +0000 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-15 20:48:39.159152563 +0000 2024-04-15T20:55:14.331 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-15 20:48:39.159152563 +0000 2024-04-15T20:55:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-15 20:48:39.159152563 +0000 2024-04-15T20:55:14.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T20:55:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-15T20:55:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-15T20:55:14.398 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000178239 s, 2.9 MB/s 2024-04-15T20:55:14.399 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T20:55:14.457 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-15T20:55:14.513 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-15 20:54:25.813076407 +0000 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-15 20:48:39.510144823 +0000 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-15 20:48:39.510144823 +0000 2024-04-15T20:55:14.514 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-04-15 20:48:39.510144823 +0000 2024-04-15T20:55:14.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T20:55:14.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:14 smithi072 ceph-mon[29079]: Reconfiguring mgr.smithi072.wfjmmp (unknown last config time)... 2024-04-15T20:55:14.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:14 smithi072 ceph-mon[29079]: Reconfiguring daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T20:55:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-15T20:55:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-15T20:55:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000185663 s, 2.8 MB/s 2024-04-15T20:55:14.582 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T20:55:14.639 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:55:14.639 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T20:55:14.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T20:55:14.659 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-04-15 20:55:00.489794954 +0000 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-04-15 20:48:33.606047491 +0000 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-04-15 20:48:33.606047491 +0000 2024-04-15T20:55:14.718 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-04-15 20:48:33.606047491 +0000 2024-04-15T20:55:14.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T20:55:14.787 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:14 smithi149 ceph-mon[36029]: Reconfiguring mgr.smithi072.wfjmmp (unknown last config time)... 2024-04-15T20:55:14.787 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:14 smithi149 ceph-mon[36029]: Reconfiguring daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T20:55:14.789 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-04-15T20:55:14.790 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-04-15T20:55:14.790 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00021681 s, 2.4 MB/s 2024-04-15T20:55:14.791 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T20:55:14.851 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-04-15 20:55:00.490794934 +0000 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-04-15 20:48:33.946040549 +0000 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-04-15 20:48:33.946040549 +0000 2024-04-15T20:55:14.910 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-04-15 20:48:33.946040549 +0000 2024-04-15T20:55:14.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T20:55:14.980 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-04-15T20:55:14.980 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-04-15T20:55:14.980 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000194482 s, 2.6 MB/s 2024-04-15T20:55:14.981 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T20:55:15.040 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-04-15 20:55:00.490794934 +0000 2024-04-15T20:55:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-04-15 20:48:34.301033301 +0000 2024-04-15T20:55:15.100 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-04-15 20:48:34.301033301 +0000 2024-04-15T20:55:15.100 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-04-15 20:48:34.301033301 +0000 2024-04-15T20:55:15.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T20:55:15.167 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-04-15T20:55:15.167 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-04-15T20:55:15.167 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000251899 s, 2.0 MB/s 2024-04-15T20:55:15.169 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T20:55:15.226 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-04-15T20:55:15.283 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T20:55:15.283 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T20:55:15.283 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-15T20:55:15.283 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T20:55:15.283 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T20:55:15.284 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-04-15 20:55:00.491794915 +0000 2024-04-15T20:55:15.284 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-04-15 20:48:34.646026257 +0000 2024-04-15T20:55:15.284 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-04-15 20:48:34.646026257 +0000 2024-04-15T20:55:15.284 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-04-15 20:48:34.646026257 +0000 2024-04-15T20:55:15.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T20:55:15.351 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-04-15T20:55:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-04-15T20:55:15.352 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000186346 s, 2.7 MB/s 2024-04-15T20:55:15.353 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T20:55:15.410 INFO:tasks.cephadm:Deploying osd.0 on smithi072 with /dev/vg_nvme/lv_4... 2024-04-15T20:55:15.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-15T20:55:15.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:15 smithi072 ceph-mon[29079]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:15.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:15 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:15.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:15 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:15.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:15 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:55:15.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:15 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:15.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:15 smithi149 ceph-mon[36029]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:15.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:15 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:15.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:15 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:15.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:15 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:55:15.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:15 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:16.353 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:55:16.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:16 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:55:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:16 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:17.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:17 smithi072 ceph-mon[29079]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:17.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:17 smithi072 ceph-mon[29079]: Reconfiguring crash.smithi072 (monmap changed)... 2024-04-15T20:55:17.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:17 smithi072 ceph-mon[29079]: Reconfiguring daemon crash.smithi072 on smithi072 2024-04-15T20:55:17.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:17 smithi149 ceph-mon[36029]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:17.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:17 smithi149 ceph-mon[36029]: Reconfiguring crash.smithi072 (monmap changed)... 2024-04-15T20:55:17.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:17 smithi149 ceph-mon[36029]: Reconfiguring daemon crash.smithi072 on smithi072 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126715 s, 828 MB/s 2024-04-15T20:55:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-04-15T20:55:19.660 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:19 smithi072 ceph-mon[29079]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:19.660 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:19.660 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:19.660 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:19.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_4 2024-04-15T20:55:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:19 smithi149 ceph-mon[36029]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:20.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:20 smithi072 ceph-mon[29079]: Reconfiguring alertmanager.smithi072 (dependencies changed)... 2024-04-15T20:55:20.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:20 smithi072 ceph-mon[29079]: Reconfiguring daemon alertmanager.smithi072 on smithi072 2024-04-15T20:55:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:20 smithi149 ceph-mon[36029]: Reconfiguring alertmanager.smithi072 (dependencies changed)... 2024-04-15T20:55:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:20 smithi149 ceph-mon[36029]: Reconfiguring daemon alertmanager.smithi072 on smithi072 2024-04-15T20:55:21.561 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:21 smithi072 ceph-mon[29079]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:55:21.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:21 smithi149 ceph-mon[36029]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:23.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:23 smithi072 ceph-mon[29079]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:23 smithi149 ceph-mon[36029]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- 172.21.15.72:0/889632249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fe500 msgr2=0x7fce340fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 --2- 172.21.15.72:0/889632249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fe500 0x7fce340fe910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce24009910 tx=0x7fce24009c20 comp rx=0 tx=0).stop 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- 172.21.15.72:0/889632249 shutdown_connections 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 --2- 172.21.15.72:0/889632249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fee50 0x7fce34101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 --2- 172.21.15.72:0/889632249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fe500 0x7fce340fe910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- 172.21.15.72:0/889632249 >> 172.21.15.72:0/889632249 conn(0x7fce340f9f10 msgr2=0x7fce340fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- 172.21.15.72:0/889632249 shutdown_connections 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- 172.21.15.72:0/889632249 wait complete. 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 Processor -- start 2024-04-15T20:55:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.088+0000 7fce39b94700 1 -- start start 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fe500 0x7fce34195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce341966c0 con 0x7fce340fee50 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34196800 con 0x7fce340fe500 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50766/0 (socket says 172.21.15.72:50766) 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 -- 172.21.15.72:0/1828581837 learned_addr learned my addr 172.21.15.72:0/1828581837 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce337fe700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fe500 0x7fce34195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 -- 172.21.15.72:0/1828581837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fe500 msgr2=0x7fce34195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fe500 0x7fce34195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 -- 172.21.15.72:0/1828581837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce240095f0 con 0x7fce340fee50 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce32ffd700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce2800b4d0 tx=0x7fce2800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce28011800 con 0x7fce340fee50 2024-04-15T20:55:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce28011e10 con 0x7fce340fee50 2024-04-15T20:55:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3419b2b0 con 0x7fce340fee50 2024-04-15T20:55:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2800f2e0 con 0x7fce340fee50 2024-04-15T20:55:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.089+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3419b800 con 0x7fce340fee50 2024-04-15T20:55:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.090+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34108db0 con 0x7fce340fee50 2024-04-15T20:55:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.091+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fce28010380 con 0x7fce340fee50 2024-04-15T20:55:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.092+0000 7fce30ff9700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 0x7fce1c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:55:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.092+0000 7fce337fe700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 0x7fce1c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:55:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.092+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fce2808a1f0 con 0x7fce340fee50 2024-04-15T20:55:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.092+0000 7fce337fe700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 0x7fce1c06eab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce2400b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:55:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.096+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fce280594c0 con 0x7fce340fee50 2024-04-15T20:55:24.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:24.301+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fce3419bef0 con 0x7fce1c06c600 2024-04-15T20:55:24.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:55:24.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:55:24.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:55:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:55:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:25.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:25 smithi149 ceph-mon[36029]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:25.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:25 smithi149 ceph-mon[36029]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:55:25.791 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:25 smithi072 ceph-mon[29079]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:25.791 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:25 smithi072 ceph-mon[29079]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:55:27.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:27 smithi072 ceph-mon[29079]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:27.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:27 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:27.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:27 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:27.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:27 smithi072 ceph-mon[29079]: Reconfiguring grafana.smithi072 (dependencies changed)... 2024-04-15T20:55:27.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:27 smithi072 ceph-mon[29079]: Reconfiguring daemon grafana.smithi072 on smithi072 2024-04-15T20:55:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:27 smithi149 ceph-mon[36029]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:27 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:27 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:27 smithi149 ceph-mon[36029]: Reconfiguring grafana.smithi072 (dependencies changed)... 2024-04-15T20:55:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:27 smithi149 ceph-mon[36029]: Reconfiguring daemon grafana.smithi072 on smithi072 2024-04-15T20:55:28.463 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:28 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1274158402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39a59c56-c54d-403d-8359-88c2416aab70"}]: dispatch 2024-04-15T20:55:28.463 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:28 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1274158402' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39a59c56-c54d-403d-8359-88c2416aab70"}]': finished 2024-04-15T20:55:28.463 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:28 smithi072 ceph-mon[29079]: osdmap e6: 1 total, 0 up, 1 in 2024-04-15T20:55:28.463 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:28 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:28.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:28 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1274158402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39a59c56-c54d-403d-8359-88c2416aab70"}]: dispatch 2024-04-15T20:55:28.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:28 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1274158402' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39a59c56-c54d-403d-8359-88c2416aab70"}]': finished 2024-04-15T20:55:28.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:28 smithi149 ceph-mon[36029]: osdmap e6: 1 total, 0 up, 1 in 2024-04-15T20:55:28.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:28 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:29.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:29 smithi072 ceph-mon[29079]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:29.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:29 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1972869083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:55:29.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:29 smithi149 ceph-mon[36029]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:29.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:29 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1972869083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:55:31.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:31 smithi072 ceph-mon[29079]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:31.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:31 smithi149 ceph-mon[36029]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:33.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:33 smithi072 ceph-mon[29079]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:33.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:33 smithi149 ceph-mon[36029]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:34.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:34.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:35.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:35 smithi149 ceph-mon[36029]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:35.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:35 smithi072 ceph-mon[29079]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:37.633 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:37 smithi072 ceph-mon[29079]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:37 smithi149 ceph-mon[36029]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:38.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:38.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:38.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:38 smithi072 ceph-mon[29079]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T20:55:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:38 smithi149 ceph-mon[36029]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T20:55:39.591 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:39 smithi072 ceph-mon[29079]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T20:55:39.591 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:39 smithi072 ceph-mon[29079]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:39.592 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T20:55:39.592 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:39.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:39 smithi149 ceph-mon[36029]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T20:55:39.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:39 smithi149 ceph-mon[36029]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:39.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T20:55:39.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:40.570 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:40 smithi072 ceph-mon[29079]: Deploying daemon osd.0 on smithi072 2024-04-15T20:55:40.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:40 smithi149 ceph-mon[36029]: Deploying daemon osd.0 on smithi072 2024-04-15T20:55:41.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:41 smithi072 ceph-mon[29079]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:41.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:41 smithi149 ceph-mon[36029]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:43.746 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:43 smithi149 ceph-mon[36029]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:43.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:43 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:43.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:43 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:43.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:43 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:55:43.747 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:43 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:43 smithi072 ceph-mon[29079]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:43 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:43 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:43 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T20:55:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:43 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:44.722 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:44 smithi072 ceph-mon[29079]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-04-15T20:55:44.722 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:44 smithi072 ceph-mon[29079]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-04-15T20:55:44.722 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:44.722 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:44.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:44 smithi149 ceph-mon[36029]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-04-15T20:55:44.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:44 smithi149 ceph-mon[36029]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-04-15T20:55:44.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:44.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:45.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:45 smithi149 ceph-mon[36029]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:45.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:45 smithi149 ceph-mon[36029]: Reconfiguring crash.smithi149 (monmap changed)... 2024-04-15T20:55:45.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:45 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:55:45.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:45 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:45.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:45 smithi149 ceph-mon[36029]: Reconfiguring daemon crash.smithi149 on smithi149 2024-04-15T20:55:45.786 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:45 smithi072 ceph-mon[29079]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:45.787 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:45 smithi072 ceph-mon[29079]: Reconfiguring crash.smithi149 (monmap changed)... 2024-04-15T20:55:45.787 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:45 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T20:55:45.787 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:45 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:45.787 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:45 smithi072 ceph-mon[29079]: Reconfiguring daemon crash.smithi149 on smithi149 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: Reconfiguring mgr.smithi149.qgbaiy (monmap changed)... 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: Reconfiguring daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T20:55:47.040 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:46 smithi149 ceph-mon[36029]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:47.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:47.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: Reconfiguring mgr.smithi149.qgbaiy (monmap changed)... 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: Reconfiguring daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T20:55:47.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:46 smithi072 ceph-mon[29079]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: Reconfiguring mon.smithi149 (monmap changed)... 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: Reconfiguring daemon mon.smithi149 on smithi149 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:48 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: Reconfiguring mon.smithi149 (monmap changed)... 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: Reconfiguring daemon mon.smithi149 on smithi149 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:48.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:48 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.643 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:55:49.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:55:49.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:55:50.637 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T20:55:50.637 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-04-15T20:55:50.638 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T20:55:50.638 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-04-15T20:55:50.638 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T20:55:50.638 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:50 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T20:55:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:50 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-04-15T20:55:51.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:51 smithi072 ceph-mon[29079]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:51.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:51 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:51.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:51 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:51 smithi149 ceph-mon[36029]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:51 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:51 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.777+0000 7fce30ff9700 1 -- 172.21.15.72:0/1828581837 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fce3419bef0 con 0x7fce1c06c600 2024-04-15T20:55:51.771 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 0 on host 'smithi072' 2024-04-15T20:55:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 msgr2=0x7fce1c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 0x7fce1c06eab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce2400b540 comp rx=0 tx=0).stop 2024-04-15T20:55:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 msgr2=0x7fce341960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce2800b4d0 tx=0x7fce2800b7e0 comp rx=0 tx=0).stop 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 shutdown_connections 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce1c06c600 0x7fce1c06eab0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce340fe500 0x7fce34195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 --2- 172.21.15.72:0/1828581837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce340fee50 0x7fce341960a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 >> 172.21.15.72:0/1828581837 conn(0x7fce340f9f10 msgr2=0x7fce341047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 shutdown_connections 2024-04-15T20:55:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:55:51.779+0000 7fce39b94700 1 -- 172.21.15.72:0/1828581837 wait complete. 2024-04-15T20:55:52.462 DEBUG:teuthology.orchestra.run.smithi072:osd.0> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.0.service 2024-04-15T20:55:52.464 INFO:tasks.cephadm:Deploying osd.1 on smithi072 with /dev/vg_nvme/lv_3... 2024-04-15T20:55:52.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-15T20:55:52.992 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:52 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:52.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:52 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:52.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:52 smithi072 ceph-mon[29079]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:52.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:52 smithi072 ceph-mon[29079]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-15T20:55:53.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:52 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:53.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:52 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:53.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:52 smithi149 ceph-mon[36029]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:53.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:52 smithi149 ceph-mon[36029]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-15T20:55:53.269 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:55:54.021 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-mon[29079]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-15T20:55:54.021 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-mon[29079]: osdmap e7: 1 total, 0 up, 1 in 2024-04-15T20:55:54.021 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:54.021 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-mon[29079]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:55:54.022 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[44046]: 2024-04-15T20:55:53.765+0000 7f536970b700 -1 osd.0 0 waiting for initial osdmap 2024-04-15T20:55:54.022 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:55:53 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[44046]: 2024-04-15T20:55:53.768+0000 7f5363cfd700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:55:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:53 smithi149 ceph-mon[36029]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-15T20:55:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:53 smithi149 ceph-mon[36029]: osdmap e7: 1 total, 0 up, 1 in 2024-04-15T20:55:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:53 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:53 smithi149 ceph-mon[36029]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:55:55.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:54 smithi072 ceph-mon[29079]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:55:55.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:54 smithi072 ceph-mon[29079]: osdmap e8: 1 total, 0 up, 1 in 2024-04-15T20:55:55.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:55.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:55.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:54 smithi072 ceph-mon[29079]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:54 smithi149 ceph-mon[36029]: from='osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:55:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:54 smithi149 ceph-mon[36029]: osdmap e8: 1 total, 0 up, 1 in 2024-04-15T20:55:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:54 smithi149 ceph-mon[36029]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] boot 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: osdmap e9: 1 total, 1 up, 1 in 2024-04-15T20:55:55.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:55 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: osd.0 [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] boot 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: osdmap e9: 1 total, 1 up, 1 in 2024-04-15T20:55:56.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:55 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T20:55:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:56 smithi072 ceph-mon[29079]: osdmap e10: 1 total, 1 up, 1 in 2024-04-15T20:55:56.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:56 smithi072 ceph-mon[29079]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129415 s, 810 MB/s 2024-04-15T20:55:57.073 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-04-15T20:55:57.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:56 smithi149 ceph-mon[36029]: osdmap e10: 1 total, 1 up, 1 in 2024-04-15T20:55:57.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:56 smithi149 ceph-mon[36029]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:55:57.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_3 2024-04-15T20:55:57.966 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:57.966 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:58.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:58.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:55:58.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:55:58 smithi072 ceph-mon[29079]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:55:59.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:55:58 smithi149 ceph-mon[36029]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:55:59.384 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.348 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:01.349 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:01.349 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.349 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:01.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:01.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:01.479 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 -- 172.21.15.72:0/2857557388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 msgr2=0x7effd81059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 --2- 172.21.15.72:0/2857557388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd81059e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effc0009910 tx=0x7effc0009c20 comp rx=0 tx=0).stop 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 -- 172.21.15.72:0/2857557388 shutdown_connections 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 --2- 172.21.15.72:0/2857557388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd81059e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 --2- 172.21.15.72:0/2857557388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd81030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 -- 172.21.15.72:0/2857557388 >> 172.21.15.72:0/2857557388 conn(0x7effd80fa700 msgr2=0x7effd80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 -- 172.21.15.72:0/2857557388 shutdown_connections 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.696+0000 7effdd7dc700 1 -- 172.21.15.72:0/2857557388 wait complete. 2024-04-15T20:56:01.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 Processor -- start 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 -- start start 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd8195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8196690 con 0x7effd8103600 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effdd7dc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81967d0 con 0x7effd8100ce0 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55554/0 (socket says 172.21.15.72:55554) 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 -- 172.21.15.72:0/3401016260 learned_addr learned my addr 172.21.15.72:0/3401016260 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd6ffd700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd8195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 -- 172.21.15.72:0/3401016260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 msgr2=0x7effd8195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd8195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd67fc700 1 -- 172.21.15.72:0/3401016260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00095f0 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.697+0000 7effd6ffd700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd8195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effd67fc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7effc0006010 tx=0x7effc000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc001d070 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7effc000f460 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd819b220 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc0021640 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.698+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd819b710 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.699+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd818fcf0 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.699+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7effc000fab0 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.700+0000 7effcffff700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 0x7effc406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.700+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7effc008beb0 con 0x7effd8103600 2024-04-15T20:56:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.700+0000 7effd6ffd700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 0x7effc406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.700+0000 7effd6ffd700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 0x7effc406eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fa0 tx=0x7effc8009570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:01.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.704+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7effc005aea0 con 0x7effd8103600 2024-04-15T20:56:01.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:01.921+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7effd8061190 con 0x7effc406c600 2024-04-15T20:56:02.649 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:02 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi072 2024-04-15T20:56:02.649 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:02 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi072 to 11840M 2024-04-15T20:56:02.649 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:02.649 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:02.649 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:02 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi072 2024-04-15T20:56:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:02 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi072 to 11840M 2024-04-15T20:56:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:02.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:03.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:03 smithi072 ceph-mon[29079]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:03.844 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:03 smithi072 ceph-mon[29079]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:03.844 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:03 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:03.844 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:03 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:03.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:03 smithi149 ceph-mon[36029]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:03.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:03 smithi149 ceph-mon[36029]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:03.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:03 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:03.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:03 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:04.771 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:04.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:05.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:05 smithi149 ceph-mon[36029]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:05.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:05 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3924763075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8f40340-9769-4140-bfb2-eb4deb6efb5b"}]: dispatch 2024-04-15T20:56:05.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:05 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3924763075' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8f40340-9769-4140-bfb2-eb4deb6efb5b"}]': finished 2024-04-15T20:56:05.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:05 smithi149 ceph-mon[36029]: osdmap e11: 2 total, 1 up, 2 in 2024-04-15T20:56:05.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:05 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:05.718 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:05 smithi072 ceph-mon[29079]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:05.718 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:05 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3924763075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8f40340-9769-4140-bfb2-eb4deb6efb5b"}]: dispatch 2024-04-15T20:56:05.719 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:05 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3924763075' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8f40340-9769-4140-bfb2-eb4deb6efb5b"}]': finished 2024-04-15T20:56:05.719 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:05 smithi072 ceph-mon[29079]: osdmap e11: 2 total, 1 up, 2 in 2024-04-15T20:56:05.719 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:05 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:06.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:06 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/490762987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:56:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:06 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/490762987' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:07.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:07.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:09.537 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:09 smithi072 ceph-mon[29079]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:09.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:09 smithi149 ceph-mon[36029]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:11.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:11 smithi072 ceph-mon[29079]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:11.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:11 smithi149 ceph-mon[36029]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:12.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T20:56:12.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T20:56:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:13.850 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:13 smithi072 ceph-mon[29079]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:13.850 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:13 smithi072 ceph-mon[29079]: Deploying daemon osd.1 on smithi072 2024-04-15T20:56:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:13 smithi149 ceph-mon[36029]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:13 smithi149 ceph-mon[36029]: Deploying daemon osd.1 on smithi072 2024-04-15T20:56:15.606 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:15 smithi072 ceph-mon[29079]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:15.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:15 smithi149 ceph-mon[36029]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:17 smithi072 ceph-mon[29079]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:17 smithi149 ceph-mon[36029]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:18 smithi149 ceph-mon[36029]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:19.133 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:19.133 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:19.133 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:19.133 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:18 smithi072 ceph-mon[29079]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:19.932 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:19.932 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:19.933 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.631+0000 7effcffff700 1 -- 172.21.15.72:0/3401016260 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7effd8061190 con 0x7effc406c600 2024-04-15T20:56:20.624 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 1 on host 'smithi072' 2024-04-15T20:56:20.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 msgr2=0x7effc406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:20.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 0x7effc406eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fa0 tx=0x7effc8009570 comp rx=0 tx=0).stop 2024-04-15T20:56:20.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 msgr2=0x7effd8196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:20.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7effc0006010 tx=0x7effc000be20 comp rx=0 tx=0).stop 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 shutdown_connections 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7effc406c600 0x7effc406eab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effd8100ce0 0x7effd8195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 --2- 172.21.15.72:0/3401016260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effd8103600 0x7effd8196070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 >> 172.21.15.72:0/3401016260 conn(0x7effd80fa700 msgr2=0x7effd80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 shutdown_connections 2024-04-15T20:56:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:20.633+0000 7effdd7dc700 1 -- 172.21.15.72:0/3401016260 wait complete. 2024-04-15T20:56:20.843 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:20 smithi149 ceph-mon[36029]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:20.843 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:20 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:20.843 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:20 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:20 smithi072 ceph-mon[29079]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:20 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:20 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:21.679 DEBUG:teuthology.orchestra.run.smithi072:osd.1> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.1.service 2024-04-15T20:56:21.681 INFO:tasks.cephadm:Deploying osd.2 on smithi072 with /dev/vg_nvme/lv_2... 2024-04-15T20:56:21.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-15T20:56:22.583 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:56:22.718 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:22 smithi072 ceph-mon[29079]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-15T20:56:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:22 smithi149 ceph-mon[36029]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-15T20:56:23.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-mon[29079]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:23.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-mon[29079]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-15T20:56:23.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-mon[29079]: osdmap e12: 2 total, 1 up, 2 in 2024-04-15T20:56:23.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:23.843 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-mon[29079]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:56:23.843 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[49671]: 2024-04-15T20:56:23.480+0000 7f8a8910b700 -1 osd.1 0 waiting for initial osdmap 2024-04-15T20:56:23.844 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:56:23 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[49671]: 2024-04-15T20:56:23.489+0000 7f8a826fb700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:56:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:23 smithi149 ceph-mon[36029]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:23 smithi149 ceph-mon[36029]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-15T20:56:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:23 smithi149 ceph-mon[36029]: osdmap e12: 2 total, 1 up, 2 in 2024-04-15T20:56:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:23 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:23 smithi149 ceph-mon[36029]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013197 s, 795 MB/s 2024-04-15T20:56:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-04-15T20:56:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:24 smithi072 ceph-mon[29079]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:56:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:24 smithi072 ceph-mon[29079]: osdmap e13: 2 total, 1 up, 2 in 2024-04-15T20:56:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:24 smithi149 ceph-mon[36029]: from='osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:56:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:24 smithi149 ceph-mon[36029]: osdmap e13: 2 total, 1 up, 2 in 2024-04-15T20:56:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:25.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi072:vg_nvme/lv_2 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] boot 2024-04-15T20:56:25.735 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: osdmap e14: 2 total, 2 up, 2 in 2024-04-15T20:56:25.736 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: osd.1 [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] boot 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: osdmap e14: 2 total, 2 up, 2 in 2024-04-15T20:56:25.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T20:56:26.802 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:26 smithi072 ceph-mon[29079]: osdmap e15: 2 total, 2 up, 2 in 2024-04-15T20:56:26.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:26 smithi149 ceph-mon[36029]: osdmap e15: 2 total, 2 up, 2 in 2024-04-15T20:56:27.024 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:56:27.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:27 smithi072 ceph-mon[29079]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:27.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:27 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:27.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:27 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:27 smithi149 ceph-mon[36029]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:27 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:27 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 -- 172.21.15.72:0/1293981117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 msgr2=0x7f163c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 --2- 172.21.15.72:0/1293981117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0ff540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1630009910 tx=0x7f1630009c20 comp rx=0 tx=0).stop 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 -- 172.21.15.72:0/1293981117 shutdown_connections 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 --2- 172.21.15.72:0/1293981117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 --2- 172.21.15.72:0/1293981117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0ff540 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 -- 172.21.15.72:0/1293981117 >> 172.21.15.72:0/1293981117 conn(0x7f163c0fa780 msgr2=0x7f163c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 -- 172.21.15.72:0/1293981117 shutdown_connections 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.623+0000 7f1642df0700 1 -- 172.21.15.72:0/1293981117 wait complete. 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 Processor -- start 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 -- start start 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c19ae30 con 0x7f163c0ff130 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1642df0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c19af70 con 0x7f163c1003d0 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52922/0 (socket says 172.21.15.72:52922) 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 -- 172.21.15.72:0/2027155501 learned_addr learned my addr 172.21.15.72:0/2027155501 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f163bfff700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 -- 172.21.15.72:0/2027155501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 msgr2=0x7f163c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f1640b8c700 1 -- 172.21.15.72:0/2027155501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300095f0 con 0x7f163c0ff130 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.624+0000 7f163bfff700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1640b8c700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1630006010 tx=0x7f163000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163001d070 con 0x7f163c0ff130 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f163000f460 con 0x7f163c0ff130 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c19b1f0 con 0x7f163c0ff130 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1630021640 con 0x7f163c0ff130 2024-04-15T20:56:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.625+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c19b6e0 con 0x7f163c0ff130 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c107c90 con 0x7f163c0ff130 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.626+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f1630004b20 con 0x7f163c0ff130 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.627+0000 7f1639ffb700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 0x7f162c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.627+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f163008c020 con 0x7f163c0ff130 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.627+0000 7f163bfff700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 0x7f162c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.627+0000 7f163bfff700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 0x7f162c06eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f163c069620 tx=0x7f1628008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:28.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.631+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f163005ae60 con 0x7f163c0ff130 2024-04-15T20:56:28.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:28.837+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f163c104d20 con 0x7f162c06c600 2024-04-15T20:56:29.848 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:29 smithi072 ceph-mon[29079]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:29.848 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:29 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:29.848 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:29 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:29.848 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:29 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:29.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:29 smithi149 ceph-mon[36029]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:29.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:29 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:29.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:29 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:29.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:29 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:30.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:30 smithi072 ceph-mon[29079]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:30.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:30 smithi149 ceph-mon[36029]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:31.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:31 smithi072 ceph-mon[29079]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:31.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:31 smithi149 ceph-mon[36029]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:33.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:33 smithi072 ceph-mon[29079]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:33 smithi149 ceph-mon[36029]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:34.771 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:34.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:35.791 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:35 smithi072 ceph-mon[29079]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:35.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:35 smithi149 ceph-mon[36029]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:36.609 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi072 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi072 to 5920M 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.610 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi072 2024-04-15T20:56:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi072 to 5920M 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/297653444' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5817373-e470-4ead-b9ef-2fa3c589decf"}]: dispatch 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/297653444' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5817373-e470-4ead-b9ef-2fa3c589decf"}]': finished 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: osdmap e16: 3 total, 2 up, 3 in 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:37.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:37 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1365125055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/297653444' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5817373-e470-4ead-b9ef-2fa3c589decf"}]: dispatch 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/297653444' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5817373-e470-4ead-b9ef-2fa3c589decf"}]': finished 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: osdmap e16: 3 total, 2 up, 3 in 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:37.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:37 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1365125055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:56:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:38.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:38 smithi149 ceph-mon[36029]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:38.951 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:38.951 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:38.951 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:38 smithi072 ceph-mon[29079]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:41 smithi072 ceph-mon[29079]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:41.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:41 smithi149 ceph-mon[36029]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:43 smithi072 ceph-mon[29079]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:43.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:43 smithi149 ceph-mon[36029]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:44.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T20:56:44.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:44.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T20:56:44.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:45.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:45 smithi072 ceph-mon[29079]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:45.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:45 smithi072 ceph-mon[29079]: Deploying daemon osd.2 on smithi072 2024-04-15T20:56:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:45 smithi149 ceph-mon[36029]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:45 smithi149 ceph-mon[36029]: Deploying daemon osd.2 on smithi072 2024-04-15T20:56:47.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:47 smithi072 ceph-mon[29079]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:47.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:47 smithi149 ceph-mon[36029]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:49 smithi072 ceph-mon[29079]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:49 smithi149 ceph-mon[36029]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:49.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:56:51.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:50 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:51.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:50 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:51.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:50 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:51.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:50 smithi072 ceph-mon[29079]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:51.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:50 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:51.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:50 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:51.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:50 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:56:51.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:50 smithi149 ceph-mon[36029]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:52.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.623+0000 7f1639ffb700 1 -- 172.21.15.72:0/2027155501 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f163c104d20 con 0x7f162c06c600 2024-04-15T20:56:52.618 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 2 on host 'smithi072' 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.625+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 msgr2=0x7f162c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 0x7f162c06eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f163c069620 tx=0x7f1628008040 comp rx=0 tx=0).stop 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 msgr2=0x7f163c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1630006010 tx=0x7f163000be20 comp rx=0 tx=0).stop 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 shutdown_connections 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f162c06c600 0x7f162c06eab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:52.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f163c0ff130 0x7f163c0690a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 --2- 172.21.15.72:0/2027155501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f163c1003d0 0x7f163c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 >> 172.21.15.72:0/2027155501 conn(0x7f163c0fa780 msgr2=0x7f163c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:56:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 shutdown_connections 2024-04-15T20:56:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:56:52.626+0000 7f1642df0700 1 -- 172.21.15.72:0/2027155501 wait complete. 2024-04-15T20:56:53.591 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:53 smithi072 ceph-mon[29079]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:53.592 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:53 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:53.592 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:53 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:53.593 DEBUG:teuthology.orchestra.run.smithi072:osd.2> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.2.service 2024-04-15T20:56:53.595 INFO:tasks.cephadm:Deploying osd.3 on smithi149 with /dev/vg_nvme/lv_4... 2024-04-15T20:56:53.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-15T20:56:53.806 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:56:53.914 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:56:53 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T20:56:53.757+0000 7f0359f1a640 -1 osd.2 0 log_to_monitors true 2024-04-15T20:56:53.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:53 smithi149 ceph-mon[36029]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:53.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:53 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:53.929 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:53 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:54.659 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:54 smithi072 ceph-mon[29079]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-15T20:56:54.807 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:54 smithi149 ceph-mon[36029]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-15T20:56:55.577 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128042 s, 819 MB/s 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 2024-04-15T20:56:55.578 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-04-15T20:56:55.635 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T20:56:55.485+0000 7f034ed90700 -1 osd.2 0 waiting for initial osdmap 2024-04-15T20:56:55.635 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T20:56:55.489+0000 7f034737e700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:56:55.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-mon[29079]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:55.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-mon[29079]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-15T20:56:55.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-mon[29079]: osdmap e17: 3 total, 2 up, 3 in 2024-04-15T20:56:55.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:55.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:55 smithi072 ceph-mon[29079]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:56:55.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:55 smithi149 ceph-mon[36029]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:55.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:55 smithi149 ceph-mon[36029]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-15T20:56:55.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:55 smithi149 ceph-mon[36029]: osdmap e17: 3 total, 2 up, 3 in 2024-04-15T20:56:55.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:55 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:55.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:55 smithi149 ceph-mon[36029]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T20:56:56.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-04-15T20:56:56.378 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:56:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:56 smithi072 ceph-mon[29079]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:56:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:56 smithi072 ceph-mon[29079]: osdmap e18: 3 total, 2 up, 3 in 2024-04-15T20:56:56.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:56.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:56.775 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:56 smithi149 ceph-mon[36029]: from='osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-04-15T20:56:56.775 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:56 smithi149 ceph-mon[36029]: osdmap e18: 3 total, 2 up, 3 in 2024-04-15T20:56:56.775 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:56.775 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:57.545 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] boot 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: osdmap e19: 3 total, 3 up, 3 in 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:57.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:57 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:57.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:56:57.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:56:57.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-15T20:56:57.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:57.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: osd.2 [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] boot 2024-04-15T20:56:57.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: osdmap e19: 3 total, 3 up, 3 in 2024-04-15T20:56:57.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T20:56:57.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:57.673 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:57 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 -- 172.21.15.149:0/3627758117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80ffb60 msgr2=0x7fb3c80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 --2- 172.21.15.149:0/3627758117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80ffb60 0x7fb3c80fffd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009910 tx=0x7fb3c4009c20 comp rx=0 tx=0).stop 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 -- 172.21.15.149:0/3627758117 shutdown_connections 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 --2- 172.21.15.149:0/3627758117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80ffb60 0x7fb3c80fffd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 --2- 172.21.15.149:0/3627758117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c80fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 -- 172.21.15.149:0/3627758117 >> 172.21.15.149:0/3627758117 conn(0x7fb3c80f9f10 msgr2=0x7fb3c80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 -- 172.21.15.149:0/3627758117 shutdown_connections 2024-04-15T20:56:57.870 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.875+0000 7fb3cf998700 1 -- 172.21.15.149:0/3627758117 wait complete. 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 Processor -- start 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 -- start start 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 0x7fb3c8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8196610 con 0x7fb3c80ffb60 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cf998700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8196750 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:42866/0 (socket says 172.21.15.149:42866) 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 -- 172.21.15.149:0/1089530585 learned_addr learned my addr 172.21.15.149:0/1089530585 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3ccf33700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 0x7fb3c8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 -- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 msgr2=0x7fb3c8195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 0x7fb3c8195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:56:57.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3cd734700 1 -- 172.21.15.149:0/1089530585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40095f0 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.876+0000 7fb3ccf33700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 0x7fb3c8195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3cd734700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00d900 tx=0x7fb3bc00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc0041f0 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb3bc004ce0 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c819b200 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc00b750 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.872 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.877+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c819b750 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.878+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c8107c20 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.878+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fb3bc004350 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.879+0000 7fb3ba7fc700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 0x7fb3b406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.879+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2846+0+0 (secure 0 0 0) 0x7fb3bc08ae80 con 0x7fb3c80fe8c0 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.879+0000 7fb3ccf33700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 0x7fb3b406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:56:57.873 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.880+0000 7fb3ccf33700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 0x7fb3b406eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4006010 tx=0x7fb3c400b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:56:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:57.883+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb3bc059b10 con 0x7fb3c80fe8c0 2024-04-15T20:56:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:56:58.082+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3c81056b0 con 0x7fb3b406c610 2024-04-15T20:56:58.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:58 smithi072 ceph-mon[29079]: osdmap e20: 3 total, 3 up, 3 in 2024-04-15T20:56:58.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:58 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:58.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:58 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:58.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:58 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:58.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:58 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-15T20:56:58.750 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:58 smithi149 ceph-mon[36029]: osdmap e20: 3 total, 3 up, 3 in 2024-04-15T20:56:58.750 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:58 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:56:58.750 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:58 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:56:58.750 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:58 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:56:58.751 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:58 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-15T20:56:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:59 smithi072 ceph-mon[29079]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:59 smithi072 ceph-mon[29079]: pgmap v80: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:56:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:59 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-15T20:56:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:59 smithi072 ceph-mon[29079]: osdmap e21: 3 total, 3 up, 3 in 2024-04-15T20:56:59.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:56:59 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-15T20:56:59.727 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:59 smithi149 ceph-mon[36029]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:56:59.727 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:59 smithi149 ceph-mon[36029]: pgmap v80: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:56:59.728 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:59 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-15T20:56:59.728 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:59 smithi149 ceph-mon[36029]: osdmap e21: 3 total, 3 up, 3 in 2024-04-15T20:56:59.728 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:56:59 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-15T20:57:00.710 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57600]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-15T20:57:00.710 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57600]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:00.710 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57600]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:00.710 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57600]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: osdmap e22: 3 total, 3 up, 3 in 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:00 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:00.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:00.787+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb3bc004e50 con 0x7fb3c80fe8c0 2024-04-15T20:57:00.781 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-15T20:57:00.781 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: osdmap e22: 3 total, 3 up, 3 in 2024-04-15T20:57:00.781 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.781 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.781 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:00.782 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:00 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:00.985 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57621]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-15T20:57:00.986 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57621]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:00.986 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57621]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:00.986 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57621]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:01.274 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57626]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-15T20:57:01.275 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57626]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:01.275 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:00 smithi072 sudo[57626]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:01.275 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57626]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:01.530 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57729]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-15T20:57:01.531 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:01.531 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57729]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:01.531 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57729]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:01.792 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57753]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-15T20:57:01.793 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57753]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:01.793 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57753]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:01.793 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57753]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi072 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi072 to 3946M 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2699033301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]: dispatch 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]: dispatch 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]': finished 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: osdmap e23: 4 total, 3 up, 4 in 2024-04-15T20:57:01.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:01.794 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:01.794 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: mgrmap e19: smithi072.wfjmmp(active, since 2m), standbys: smithi149.qgbaiy 2024-04-15T20:57:01.794 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:01 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2766772929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi072 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi072 to 3946M 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/2699033301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]: dispatch 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]: dispatch 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8352909c-79a0-4f91-b710-9d1faf18fb03"}]': finished 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: osdmap e23: 4 total, 3 up, 4 in 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: mgrmap e19: smithi072.wfjmmp(active, since 2m), standbys: smithi149.qgbaiy 2024-04-15T20:57:01.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:01 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/2766772929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:02.047 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57759]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-15T20:57:02.047 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57759]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:02.047 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57759]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:02.047 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 20:57:01 smithi072 sudo[57759]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:02.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57806]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-15T20:57:02.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57806]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:02.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57806]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:02.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57806]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57837]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-15T20:57:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57837]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:02.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57837]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:02.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 sudo[57837]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:02.823 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40440]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-15T20:57:02.823 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:02.823 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40440]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:02.824 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40440]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:03.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-15T20:57:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-15T20:57:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:57:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:57:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:57:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:02 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40628]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40628]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 sudo[40628]: pam_unix(sudo:session): session closed for user root 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T20:57:03.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:02 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T20:57:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:03 smithi072 ceph-mon[29079]: pgmap v85: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:03.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:03 smithi072 ceph-mon[29079]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-15T20:57:03.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:03 smithi072 ceph-mon[29079]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-15T20:57:03.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:03 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:04.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:03 smithi149 ceph-mon[36029]: pgmap v85: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:04.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:03 smithi149 ceph-mon[36029]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-15T20:57:04.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:03 smithi149 ceph-mon[36029]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-15T20:57:04.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:03 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:05.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:07.675 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:07 smithi149 ceph-mon[36029]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 232 KiB/s wr, 15 op/s 2024-04-15T20:57:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:07 smithi072 ceph-mon[29079]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 232 KiB/s wr, 15 op/s 2024-04-15T20:57:08.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T20:57:08.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:08.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T20:57:08.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:09.589 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:09 smithi149 ceph-mon[36029]: Deploying daemon osd.3 on smithi149 2024-04-15T20:57:09.589 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:09 smithi149 ceph-mon[36029]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-04-15T20:57:09.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:09 smithi072 ceph-mon[29079]: Deploying daemon osd.3 on smithi149 2024-04-15T20:57:09.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:09 smithi072 ceph-mon[29079]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-04-15T20:57:11.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:11 smithi149 ceph-mon[36029]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 136 KiB/s wr, 9 op/s 2024-04-15T20:57:11.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:11 smithi072 ceph-mon[29079]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 136 KiB/s wr, 9 op/s 2024-04-15T20:57:13.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:13 smithi149 ceph-mon[36029]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-04-15T20:57:13.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:13.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:13.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:13.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:13 smithi072 ceph-mon[29079]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-04-15T20:57:13.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:13.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:13.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:15.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:15 smithi149 ceph-mon[36029]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-04-15T20:57:15.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:15 smithi072 ceph-mon[29079]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-04-15T20:57:16.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.093+0000 7fb3ba7fc700 1 -- 172.21.15.149:0/1089530585 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb3c81056b0 con 0x7fb3b406c610 2024-04-15T20:57:16.086 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 3 on host 'smithi149' 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 msgr2=0x7fb3b406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 0x7fb3b406eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4006010 tx=0x7fb3c400b540 comp rx=0 tx=0).stop 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 msgr2=0x7fb3c8195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00d900 tx=0x7fb3bc00dcc0 comp rx=0 tx=0).stop 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 shutdown_connections 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb3b406c610 0x7fb3b406eac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:16.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c80fe8c0 0x7fb3c8195ab0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 --2- 172.21.15.149:0/1089530585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3c80ffb60 0x7fb3c8195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 >> 172.21.15.149:0/1089530585 conn(0x7fb3c80f9f10 msgr2=0x7fb3c8104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:57:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 shutdown_connections 2024-04-15T20:57:16.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:16.095+0000 7fb3cf998700 1 -- 172.21.15.149:0/1089530585 wait complete. 2024-04-15T20:57:16.900 DEBUG:teuthology.orchestra.run.smithi149:osd.3> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.3.service 2024-04-15T20:57:16.903 INFO:tasks.cephadm:Deploying osd.4 on smithi149 with /dev/vg_nvme/lv_3... 2024-04-15T20:57:16.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-15T20:57:17.157 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:57:17.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-04-15T20:57:17.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T20:57:17.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T20:57:17.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:17.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:18.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-mon[36029]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-15T20:57:18.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-mon[36029]: osdmap e24: 4 total, 3 up, 4 in 2024-04-15T20:57:18.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:18.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-mon[36029]: from='osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:18.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-mon[36029]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:18.656 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[42076]: 2024-04-15T20:57:18.486+0000 7f66cc1df700 -1 osd.3 0 waiting for initial osdmap 2024-04-15T20:57:18.656 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 20:57:18 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[42076]: 2024-04-15T20:57:18.492+0000 7f66c87d5700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:57:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:18 smithi072 ceph-mon[29079]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-15T20:57:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:18 smithi072 ceph-mon[29079]: osdmap e24: 4 total, 3 up, 4 in 2024-04-15T20:57:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:18 smithi072 ceph-mon[29079]: from='osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:18 smithi072 ceph-mon[29079]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:19.555 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:19.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:57:19.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: osdmap e25: 4 total, 3 up, 4 in 2024-04-15T20:57:19.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:19.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:19.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124198 s, 844 MB/s 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 2024-04-15T20:57:19.589 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-04-15T20:57:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:19.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:57:19.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: osdmap e25: 4 total, 3 up, 4 in 2024-04-15T20:57:19.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:19.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:19.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:20.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] boot 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: osdmap e26: 4 total, 4 up, 4 in 2024-04-15T20:57:20.656 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:20 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:20.742 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: osd.3 [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] boot 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: osdmap e26: 4 total, 4 up, 4 in 2024-04-15T20:57:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:20 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T20:57:21.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:21 smithi149 ceph-mon[36029]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:21.556 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:21 smithi149 ceph-mon[36029]: osdmap e27: 4 total, 4 up, 4 in 2024-04-15T20:57:21.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:21 smithi072 ceph-mon[29079]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-15T20:57:21.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:21 smithi072 ceph-mon[29079]: osdmap e27: 4 total, 4 up, 4 in 2024-04-15T20:57:22.801 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: osdmap e28: 4 total, 4 up, 4 in 2024-04-15T20:57:22.801 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.801 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.801 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:22.801 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:22.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:22 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/2394361818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b0102210 msgr2=0x7fe9b00fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/2394361818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b0102210 0x7fe9b00fe340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe998009910 tx=0x7fe998009c20 comp rx=0 tx=0).stop 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/2394361818 shutdown_connections 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/2394361818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b0102210 0x7fe9b00fe340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/2394361818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b01018c0 0x7fe9b0101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/2394361818 >> 172.21.15.149:0/2394361818 conn(0x7fe9b00f9f10 msgr2=0x7fe9b00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/2394361818 shutdown_connections 2024-04-15T20:57:22.815 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.821+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/2394361818 wait complete. 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 Processor -- start 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 -- start start 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b0102210 0x7fe9b00ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00ffb50 con 0x7fe9b0102210 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9b6a0e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00ffc90 con 0x7fe9b01018c0 2024-04-15T20:57:22.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45706/0 (socket says 172.21.15.149:45706) 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 -- 172.21.15.149:0/779323961 learned_addr learned my addr 172.21.15.149:0/779323961 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9a7fff700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b0102210 0x7fe9b00ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 -- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b0102210 msgr2=0x7fe9b00ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b0102210 0x7fe9b00ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.822+0000 7fe9affff700 1 -- 172.21.15.149:0/779323961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980095f0 con 0x7fe9b01018c0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9affff700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c8a0 tx=0x7fe9a000cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a00078e0 con 0x7fe9b01018c0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00fff70 con 0x7fe9b01018c0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9a000f450 con 0x7fe9b01018c0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a000e5e0 con 0x7fe9b01018c0 2024-04-15T20:57:22.818 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.823+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b019db60 con 0x7fe9b01018c0 2024-04-15T20:57:22.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.824+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0108d30 con 0x7fe9b01018c0 2024-04-15T20:57:22.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.825+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe9a000f5c0 con 0x7fe9b01018c0 2024-04-15T20:57:22.819 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.825+0000 7fe9adffb700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 0x7fe99c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:22.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.825+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7fe9a008b1e0 con 0x7fe9b01018c0 2024-04-15T20:57:22.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.825+0000 7fe9a7fff700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 0x7fe99c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:57:22.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.826+0000 7fe9a7fff700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 0x7fe99c06eb30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe998006010 tx=0x7fe99800b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:57:22.823 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:22.830+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe9a00599f0 con 0x7fe9b01018c0 2024-04-15T20:57:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: osdmap e28: 4 total, 4 up, 4 in 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:22.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:22 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:23.023 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:23.029+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b019e110 con 0x7fe99c06c680 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi149 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi149 to 3640M 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: osdmap e29: 4 total, 4 up, 4 in 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:57:23.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:23 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi149 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi149 to 3640M 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: osdmap e29: 4 total, 4 up, 4 in 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:57:23.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:23 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:24.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:24 smithi072 ceph-mon[29079]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:57:24.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:24 smithi072 ceph-mon[29079]: osdmap e30: 4 total, 4 up, 4 in 2024-04-15T20:57:24.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:24 smithi149 ceph-mon[36029]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:57:24.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:24 smithi149 ceph-mon[36029]: osdmap e30: 4 total, 4 up, 4 in 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/959384216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]: dispatch 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]: dispatch 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]': finished 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: osdmap e31: 5 total, 4 up, 5 in 2024-04-15T20:57:25.859 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:25.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:25.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/959384216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]: dispatch 2024-04-15T20:57:25.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]: dispatch 2024-04-15T20:57:25.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4544ec9f-b3e9-4b15-9f82-b8b8f99089b3"}]': finished 2024-04-15T20:57:25.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: osdmap e31: 5 total, 4 up, 5 in 2024-04-15T20:57:25.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:26.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:26 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1504223059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:26.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:26 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/1504223059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:27 smithi072 ceph-mon[29079]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-15T20:57:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:27 smithi149 ceph-mon[36029]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-15T20:57:29.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:29 smithi149 ceph-mon[36029]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-15T20:57:29.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:29 smithi072 ceph-mon[29079]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-15T20:57:31.759 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:31 smithi149 ceph-mon[36029]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-15T20:57:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:31 smithi072 ceph-mon[29079]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-15T20:57:33.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:33 smithi072 ceph-mon[29079]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-15T20:57:33.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T20:57:33.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:33 smithi149 ceph-mon[36029]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-15T20:57:33.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T20:57:33.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:34.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:34 smithi149 ceph-mon[36029]: Deploying daemon osd.4 on smithi149 2024-04-15T20:57:34.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:34 smithi072 ceph-mon[29079]: Deploying daemon osd.4 on smithi149 2024-04-15T20:57:34.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:35.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:35 smithi072 ceph-mon[29079]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-15T20:57:35.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:35 smithi149 ceph-mon[36029]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-15T20:57:37.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:37 smithi072 ceph-mon[29079]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-15T20:57:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:37 smithi149 ceph-mon[36029]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-04-15T20:57:39.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:39.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:39.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:39.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:38 smithi072 ceph-mon[29079]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:38 smithi149 ceph-mon[36029]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:41.564 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:41 smithi149 ceph-mon[36029]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:41.636 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.643+0000 7fe9adffb700 1 -- 172.21.15.149:0/779323961 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe9b019e110 con 0x7fe99c06c680 2024-04-15T20:57:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 4 on host 'smithi149' 2024-04-15T20:57:41.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.645+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 msgr2=0x7fe99c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:41.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 0x7fe99c06eb30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe998006010 tx=0x7fe99800b540 comp rx=0 tx=0).stop 2024-04-15T20:57:41.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 msgr2=0x7fe9b0100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:41.638 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c8a0 tx=0x7fe9a000cbb0 comp rx=0 tx=0).stop 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 shutdown_connections 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe99c06c680 0x7fe99c06eb30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b01018c0 0x7fe9b0100fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 --2- 172.21.15.149:0/779323961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9b0102210 0x7fe9b00ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 >> 172.21.15.149:0/779323961 conn(0x7fe9b00f9f10 msgr2=0x7fe9b0104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 shutdown_connections 2024-04-15T20:57:41.639 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:41.646+0000 7fe9b6a0e700 1 -- 172.21.15.149:0/779323961 wait complete. 2024-04-15T20:57:41.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:41 smithi072 ceph-mon[29079]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:42.244 DEBUG:teuthology.orchestra.run.smithi149:osd.4> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.4.service 2024-04-15T20:57:42.246 INFO:tasks.cephadm:Deploying osd.5 on smithi149 with /dev/vg_nvme/lv_2... 2024-04-15T20:57:42.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:42 smithi072 ceph-mon[29079]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:42.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:42 smithi149 ceph-mon[36029]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:43.894 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-mon[36029]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-15T20:57:43.895 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-mon[36029]: osdmap e32: 5 total, 4 up, 5 in 2024-04-15T20:57:43.895 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:43.895 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-mon[36029]: from='osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:43.895 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-mon[36029]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:43.895 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[46769]: 2024-04-15T20:57:43.635+0000 7fc67a061700 -1 osd.4 0 waiting for initial osdmap 2024-04-15T20:57:43.895 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 20:57:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[46769]: 2024-04-15T20:57:43.641+0000 7fc674e54700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:57:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:43 smithi072 ceph-mon[29079]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-15T20:57:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:43 smithi072 ceph-mon[29079]: osdmap e32: 5 total, 4 up, 5 in 2024-04-15T20:57:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:43 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:43 smithi072 ceph-mon[29079]: from='osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:43 smithi072 ceph-mon[29079]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:57:44.032 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:57:44.863 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:44 smithi149 ceph-mon[36029]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:57:44.863 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:44 smithi149 ceph-mon[36029]: osdmap e33: 5 total, 4 up, 5 in 2024-04-15T20:57:44.863 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:44.863 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:44 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:44.863 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:44 smithi149 ceph-mon[36029]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:44.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:44 smithi072 ceph-mon[29079]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:57:44.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:44 smithi072 ceph-mon[29079]: osdmap e33: 5 total, 4 up, 5 in 2024-04-15T20:57:44.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:44.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:44 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:44.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:44 smithi072 ceph-mon[29079]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-15T20:57:45.889 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:45 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:57:45.890 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:45 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:57:45.890 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:45 smithi072 ceph-mon[29079]: osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] boot 2024-04-15T20:57:45.890 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:45 smithi072 ceph-mon[29079]: osdmap e34: 5 total, 5 up, 5 in 2024-04-15T20:57:45.890 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:45 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:45 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:57:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:45 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:57:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:45 smithi149 ceph-mon[36029]: osd.4 [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] boot 2024-04-15T20:57:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:45 smithi149 ceph-mon[36029]: osdmap e34: 5 total, 5 up, 5 in 2024-04-15T20:57:45.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:45 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T20:57:46.394 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-15T20:57:46.394 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-15T20:57:46.394 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-04-15T20:57:46.395 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-04-15T20:57:46.395 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0143412 s, 731 MB/s 2024-04-15T20:57:46.395 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: osdmap e35: 5 total, 5 up, 5 in 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi149 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi149 to 1820M 2024-04-15T20:57:46.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:46 smithi149 ceph-mon[36029]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: osdmap e35: 5 total, 5 up, 5 in 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi149 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi149 to 1820M 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:46.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:57:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:57:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:57:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:46 smithi072 ceph-mon[29079]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:47.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-04-15T20:57:47.272 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 -- 172.21.15.149:0/1217204725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 msgr2=0x7f31640ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 --2- 172.21.15.149:0/1217204725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f31640ff540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3160009910 tx=0x7f3160009c20 comp rx=0 tx=0).stop 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 -- 172.21.15.149:0/1217204725 shutdown_connections 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 --2- 172.21.15.149:0/1217204725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31641003d0 0x7f3164100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 --2- 172.21.15.149:0/1217204725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f31640ff540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 -- 172.21.15.149:0/1217204725 >> 172.21.15.149:0/1217204725 conn(0x7f31640fa780 msgr2=0x7f31640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 -- 172.21.15.149:0/1217204725 shutdown_connections 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.790+0000 7f316bf84700 1 -- 172.21.15.149:0/1217204725 wait complete. 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 Processor -- start 2024-04-15T20:57:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 -- start start 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31641003d0 0x7f3164196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164196660 con 0x7f31641003d0 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f316bf84700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641967a0 con 0x7f31640ff130 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:59632/0 (socket says 172.21.15.149:59632) 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 -- 172.21.15.149:0/213209208 learned_addr learned my addr 172.21.15.149:0/213209208 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 -- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31641003d0 msgr2=0x7f3164196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31641003d0 0x7f3164196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 -- 172.21.15.149:0/213209208 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600095f0 con 0x7f31640ff130 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.791+0000 7f3169d20700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3160006010 tx=0x7f316000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.792+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f316001d070 con 0x7f31640ff130 2024-04-15T20:57:48.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.792+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316419b1f0 con 0x7f31640ff130 2024-04-15T20:57:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.792+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f316000f460 con 0x7f31640ff130 2024-04-15T20:57:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.792+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3160021640 con 0x7f31640ff130 2024-04-15T20:57:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.792+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316419b6e0 con 0x7f31640ff130 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.793+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164107c90 con 0x7f31640ff130 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.793+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f316000fab0 con 0x7f31640ff130 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.794+0000 7f315affd700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 0x7f315006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.794+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f316008c870 con 0x7f31640ff130 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.794+0000 7f316951f700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 0x7f315006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:57:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.794+0000 7f316951f700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 0x7f315006eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31540097b0 tx=0x7f3154006d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:57:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.798+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f316005aed0 con 0x7f31640ff130 2024-04-15T20:57:48.989 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:57:48.996+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3164068c50 con 0x7f315006c680 2024-04-15T20:57:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:49 smithi149 ceph-mon[36029]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:49.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:57:49.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:57:49.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:49.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:49 smithi072 ceph-mon[29079]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-15T20:57:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-15T20:57:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:49.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:57:50.590 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:50 smithi149 ceph-mon[36029]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:57:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:50 smithi072 ceph-mon[29079]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:57:51.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:51 smithi072 ceph-mon[29079]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:51.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:51 smithi149 ceph-mon[36029]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:52.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/4075241695' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]: dispatch 2024-04-15T20:57:52.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]: dispatch 2024-04-15T20:57:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]': finished 2024-04-15T20:57:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: osdmap e36: 6 total, 5 up, 6 in 2024-04-15T20:57:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:57:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:52 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/2776838123' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:52.916 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/4075241695' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]: dispatch 2024-04-15T20:57:52.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]: dispatch 2024-04-15T20:57:52.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "618aadbb-c524-42e5-9e80-62a254a5f1d5"}]': finished 2024-04-15T20:57:52.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: osdmap e36: 6 total, 5 up, 6 in 2024-04-15T20:57:52.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:57:52.917 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:52 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/2776838123' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-15T20:57:53.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:53 smithi072 ceph-mon[29079]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:53.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:53 smithi149 ceph-mon[36029]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:55.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:55 smithi149 ceph-mon[36029]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:55.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:55 smithi072 ceph-mon[29079]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:57.814 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:57 smithi149 ceph-mon[36029]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:57.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:57 smithi072 ceph-mon[29079]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:59.849 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:59 smithi072 ceph-mon[29079]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:59.849 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:59 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T20:57:59.849 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:57:59 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:57:59.887 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:59 smithi149 ceph-mon[36029]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:57:59.887 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:59 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T20:57:59.887 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:57:59 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:58:00.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:00 smithi149 ceph-mon[36029]: Deploying daemon osd.5 on smithi149 2024-04-15T20:58:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:00 smithi072 ceph-mon[29079]: Deploying daemon osd.5 on smithi149 2024-04-15T20:58:01.742 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:01 smithi149 ceph-mon[36029]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:01.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:01 smithi072 ceph-mon[29079]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:03.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:03 smithi149 ceph-mon[36029]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:03 smithi072 ceph-mon[29079]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:58:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:04 smithi072 ceph-mon[29079]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:58:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:04 smithi149 ceph-mon[36029]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:07 smithi149 ceph-mon[36029]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:07 smithi072 ceph-mon[29079]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:08.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.011+0000 7f315affd700 1 -- 172.21.15.149:0/213209208 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3164068c50 con 0x7f315006c680 2024-04-15T20:58:08.004 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 5 on host 'smithi149' 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 msgr2=0x7f315006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 0x7f315006eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31540097b0 tx=0x7f3154006d20 comp rx=0 tx=0).stop 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 msgr2=0x7f3164195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3160006010 tx=0x7f316000be20 comp rx=0 tx=0).stop 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 shutdown_connections 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f315006c680 0x7f315006eb30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31640ff130 0x7f3164195b00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 --2- 172.21.15.149:0/213209208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31641003d0 0x7f3164196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 >> 172.21.15.149:0/213209208 conn(0x7f31640fa780 msgr2=0x7f3164068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:08.006 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 shutdown_connections 2024-04-15T20:58:08.007 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:08.013+0000 7f316bf84700 1 -- 172.21.15.149:0/213209208 wait complete. 2024-04-15T20:58:08.567 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:08 smithi149 ceph-mon[36029]: from='osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T20:58:08.568 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:08 smithi149 ceph-mon[36029]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T20:58:08.568 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:08.568 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:08 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:08.589 DEBUG:teuthology.orchestra.run.smithi149:osd.5> sudo journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.5.service 2024-04-15T20:58:08.591 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-15T20:58:08.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd stat -f json 2024-04-15T20:58:08.814 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:08.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:08 smithi072 ceph-mon[29079]: from='osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T20:58:08.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:08 smithi072 ceph-mon[29079]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T20:58:08.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:08.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:08 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:09.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: osdmap e37: 6 total, 5 up, 6 in 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:09.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:09 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: osdmap e37: 6 total, 5 up, 6 in 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:09.813 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:09.814 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[51434]: 2024-04-15T20:58:09.500+0000 7f0e3178a700 -1 osd.5 0 waiting for initial osdmap 2024-04-15T20:58:09.814 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 20:58:09 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[51434]: 2024-04-15T20:58:09.511+0000 7f0e2d57f700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T20:58:10.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 -- 172.21.15.72:0/827141333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24100d60 msgr2=0x7fee24103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:10.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 --2- 172.21.15.72:0/827141333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24100d60 0x7fee24103140 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fee14009910 tx=0x7fee14009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:10.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 -- 172.21.15.72:0/827141333 shutdown_connections 2024-04-15T20:58:10.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 --2- 172.21.15.72:0/827141333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24103680 0x7fee24105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 --2- 172.21.15.72:0/827141333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24100d60 0x7fee24103140 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 -- 172.21.15.72:0/827141333 >> 172.21.15.72:0/827141333 conn(0x7fee240fa780 msgr2=0x7fee240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 -- 172.21.15.72:0/827141333 shutdown_connections 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.453+0000 7fee29d85700 1 -- 172.21.15.72:0/827141333 wait complete. 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 Processor -- start 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 -- start start 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 0x7fee24195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24196580 con 0x7fee24103680 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee29d85700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241966c0 con 0x7fee24100d60 2024-04-15T20:58:10.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55132/0 (socket says 172.21.15.72:55132) 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 -- 172.21.15.72:0/2433221420 learned_addr learned my addr 172.21.15.72:0/2433221420 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee237fe700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 0x7fee24195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 -- 172.21.15.72:0/2433221420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 msgr2=0x7fee24195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 0x7fee24195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee1bfff700 1 -- 172.21.15.72:0/2433221420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140095f0 con 0x7fee24103680 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.454+0000 7fee237fe700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 0x7fee24195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee1bfff700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c930 tx=0x7fee0c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c007ad0 con 0x7fee24103680 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee0c007c30 con 0x7fee24103680 2024-04-15T20:58:10.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2419b180 con 0x7fee24103680 2024-04-15T20:58:10.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c018630 con 0x7fee24103680 2024-04-15T20:58:10.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.455+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2419b6a0 con 0x7fee24103680 2024-04-15T20:58:10.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.456+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2418fbc0 con 0x7fee24103680 2024-04-15T20:58:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.456+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fee0c00f450 con 0x7fee24103680 2024-04-15T20:58:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.457+0000 7fee217fa700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 0x7fee1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.457+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7fee0c08b630 con 0x7fee24103680 2024-04-15T20:58:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.457+0000 7fee237fe700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 0x7fee1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.457+0000 7fee237fe700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 0x7fee1006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee14006010 tx=0x7fee14005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:10.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.461+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fee0c059bf0 con 0x7fee24103680 2024-04-15T20:58:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.655+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fee2402cc30 con 0x7fee24103680 2024-04-15T20:58:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.656+0000 7fee217fa700 1 -- 172.21.15.72:0/2433221420 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fee0c059780 con 0x7fee24103680 2024-04-15T20:58:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 msgr2=0x7fee1006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 0x7fee1006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee14006010 tx=0x7fee14005960 comp rx=0 tx=0).stop 2024-04-15T20:58:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 msgr2=0x7fee24195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c930 tx=0x7fee0c00ccf0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 shutdown_connections 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fee1006c680 0x7fee1006eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee24100d60 0x7fee24195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 --2- 172.21.15.72:0/2433221420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee24103680 0x7fee24195ff0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 >> 172.21.15.72:0/2433221420 conn(0x7fee240fa780 msgr2=0x7fee240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 shutdown_connections 2024-04-15T20:58:10.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:10.658+0000 7fee29d85700 1 -- 172.21.15.72:0/2433221420 wait complete. 2024-04-15T20:58:10.784 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:10 smithi149 ceph-mon[36029]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:58:10.785 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:10 smithi149 ceph-mon[36029]: osdmap e38: 6 total, 5 up, 6 in 2024-04-15T20:58:10.785 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:10 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:10.785 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:10 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:10.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:10 smithi072 ceph-mon[29079]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-04-15T20:58:10.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:10 smithi072 ceph-mon[29079]: osdmap e38: 6 total, 5 up, 6 in 2024-04-15T20:58:10.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:10 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:10.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:10 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:11.251 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1713214690,"num_in_osds":6,"osd_in_since":1713214671,"num_remapped_pgs":0} 2024-04-15T20:58:11.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd dump --format=json 2024-04-15T20:58:11.467 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:11.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: purged_snaps scrub starts 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: purged_snaps scrub ok 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] boot 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: osdmap e39: 6 total, 6 up, 6 in 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:11 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2433221420' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: purged_snaps scrub starts 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: purged_snaps scrub ok 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: osd.5 [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] boot 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: osdmap e39: 6 total, 6 up, 6 in 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T20:58:11.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:11 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2433221420' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-15T20:58:12.656 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: osdmap e40: 6 total, 6 up, 6 in 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:12 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:58:12.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: osdmap e40: 6 total, 6 up, 6 in 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:12.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:12 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:58:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 -- 172.21.15.72:0/911718975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0328104130 msgr2=0x7f0328104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 --2- 172.21.15.72:0/911718975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0328104130 0x7f0328104500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f031c009910 tx=0x7f031c009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 -- 172.21.15.72:0/911718975 shutdown_connections 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 --2- 172.21.15.72:0/911718975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03280ffbd0 0x7f0328100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 --2- 172.21.15.72:0/911718975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0328104130 0x7f0328104500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 -- 172.21.15.72:0/911718975 >> 172.21.15.72:0/911718975 conn(0x7f0328075130 msgr2=0x7f0328075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 -- 172.21.15.72:0/911718975 shutdown_connections 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 -- 172.21.15.72:0/911718975 wait complete. 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.132+0000 7f032e104700 1 Processor -- start 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f032e104700 1 -- start start 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f032e104700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f032e104700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 0x7f0328198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f032e104700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0328198d10 con 0x7f03280ffbd0 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f032e104700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032819caa0 con 0x7f0328104130 2024-04-15T20:58:13.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42468/0 (socket says 172.21.15.72:42468) 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 -- 172.21.15.72:0/167877030 learned_addr learned my addr 172.21.15.72:0/167877030 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 -- 172.21.15.72:0/167877030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 msgr2=0x7f0328198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f0326ffd700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 0x7f0328198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 0x7f0328198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 -- 172.21.15.72:0/167877030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c0095f0 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f0326ffd700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 0x7f0328198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f03277fe700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f031c006010 tx=0x7f031c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f031c01d070 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.133+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f031c00f460 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.134+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f031c017630 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.134+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032819cd20 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.134+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032819d210 con 0x7f03280ffbd0 2024-04-15T20:58:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.134+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032804f2a0 con 0x7f03280ffbd0 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.135+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f031c00f5d0 con 0x7f03280ffbd0 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.135+0000 7f0324ff9700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 0x7f031006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.135+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f031c08cb10 con 0x7f03280ffbd0 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.136+0000 7f0326ffd700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 0x7f031006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.136+0000 7f0326ffd700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 0x7f031006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0328199710 tx=0x7f0318008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.140+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f031c0575b0 con 0x7f03280ffbd0 2024-04-15T20:58:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.331+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0328199450 con 0x7f03280ffbd0 2024-04-15T20:58:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.331+0000 7f0324ff9700 1 -- 172.21.15.72:0/167877030 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7f031c05abd0 con 0x7f03280ffbd0 2024-04-15T20:58:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:13.325 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T20:58:11.507874+0000","last_up_change":"2024-04-15T20:58:10.497355+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6803","nonce":4266586545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6805","nonce":4266586545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6809","nonce":4266586545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6807","nonce":4266586545}]},"public_addr":"172.21.15.72:6803/4266586545","cluster_addr":"172.21.15.72:6805/4266586545","heartbeat_back_addr":"172.21.15.72:6809/4266586545","heartbeat_front_addr":"172.21.15.72:6807/4266586545","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6811","nonce":3902265924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6813","nonce":3902265924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6817","nonce":3902265924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6815","nonce":3902265924}]},"public_addr":"172.21.15.72:6811/3902265924","cluster_addr":"172.21.15.72:6813/3902265924","heartbeat_back_addr":"172.21.15.72:6817/3902265924","heartbeat_front_addr":"172.21.15.72:6815/3902265924","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6819","nonce":3531980190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6821","nonce":3531980190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6825","nonce":3531980190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6823","nonce":3531980190}]},"public_addr":"172.21.15.72:6819/3531980190","cluster_addr":"172.21.15.72:6821/3531980190","heartbeat_back_addr":"172.21.15.72:6825/3531980190","heartbeat_front_addr":"172.21.15.72:6823/3531980190","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6801","nonce":1961067780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6803","nonce":1961067780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6807","nonce":1961067780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6805","nonce":1961067780}]},"public_addr":"172.21.15.149:6801/1961067780","cluster_addr":"172.21.15.149:6803/1961067780","heartbeat_back_addr":"172.21.15.149:6807/1961067780","heartbeat_front_addr":"172.21.15.149:6805/1961067780","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6809","nonce":1800407801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6811","nonce":1800407801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6815","nonce":1800407801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6813","nonce":1800407801}]},"public_addr":"172.21.15.149:6809/1800407801","cluster_addr":"172.21.15.149:6811/1800407801","heartbeat_back_addr":"172.21.15.149:6815/1800407801","heartbeat_front_addr":"172.21.15.149:6813/1800407801","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6817","nonce":3380944788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6819","nonce":3380944788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6823","nonce":3380944788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6821","nonce":3380944788}]},"public_addr":"172.21.15.149:6817/3380944788","cluster_addr":"172.21.15.149:6819/3380944788","heartbeat_back_addr":"172.21.15.149:6823/3380944788","heartbeat_front_addr":"172.21.15.149:6821/3380944788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T20:58:13.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 msgr2=0x7f031006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 0x7f031006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0328199710 tx=0x7f0318008040 comp rx=0 tx=0).stop 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 msgr2=0x7f03281980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f031c006010 tx=0x7f031c00be20 comp rx=0 tx=0).stop 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 shutdown_connections 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f031006c680 0x7f031006eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03280ffbd0 0x7f03281980f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.333+0000 7f032e104700 1 --2- 172.21.15.72:0/167877030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0328104130 0x7f0328198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.334+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 >> 172.21.15.72:0/167877030 conn(0x7f0328075130 msgr2=0x7f03280fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.334+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 shutdown_connections 2024-04-15T20:58:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:13.334+0000 7f032e104700 1 -- 172.21.15.72:0/167877030 wait complete. 2024-04-15T20:58:13.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: Detected new or changed devices on smithi149 2024-04-15T20:58:13.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi149 to 1213M 2024-04-15T20:58:13.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:13.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:58:13.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:58:13.629 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:13.629 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:13 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/167877030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: Detected new or changed devices on smithi149 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi149 to 1213M 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:58:13.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:13 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/167877030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:14.030 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T20:56:58.477159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T20:58:14.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-15T20:58:14.243 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:15.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:15 smithi072 ceph-mon[29079]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:15.821 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:15 smithi149 ceph-mon[36029]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 -- 172.21.15.72:0/4080738080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 msgr2=0x7fb7d81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 --2- 172.21.15.72:0/4080738080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81008b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009910 tx=0x7fb7d4009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 -- 172.21.15.72:0/4080738080 shutdown_connections 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 --2- 172.21.15.72:0/4080738080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 0x7fb7d8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 --2- 172.21.15.72:0/4080738080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81008b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 -- 172.21.15.72:0/4080738080 >> 172.21.15.72:0/4080738080 conn(0x7fb7d80fbda0 msgr2=0x7fb7d80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 -- 172.21.15.72:0/4080738080 shutdown_connections 2024-04-15T20:58:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.959+0000 7fb7df23a700 1 -- 172.21.15.72:0/4080738080 wait complete. 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 Processor -- start 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 -- start start 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 0x7fb7d8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8198c80 con 0x7fb7d81004e0 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7df23a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8198dc0 con 0x7fb7d8100e80 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42486/0 (socket says 172.21.15.72:42486) 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 -- 172.21.15.72:0/3623016870 learned_addr learned my addr 172.21.15.72:0/3623016870 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7cffff700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 0x7fb7d8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 -- 172.21.15.72:0/3623016870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 msgr2=0x7fb7d8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 0x7fb7d8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 -- 172.21.15.72:0/3623016870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40095f0 con 0x7fb7d81004e0 2024-04-15T20:58:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.960+0000 7fb7dcfd6700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4006010 tx=0x7fb7d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.961+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d401d070 con 0x7fb7d81004e0 2024-04-15T20:58:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.961+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7d4004fa0 con 0x7fb7d81004e0 2024-04-15T20:58:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.961+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d819cbb0 con 0x7fb7d81004e0 2024-04-15T20:58:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.961+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d400f690 con 0x7fb7d81004e0 2024-04-15T20:58:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.961+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d819d0a0 con 0x7fb7d81004e0 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.962+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d81045d0 con 0x7fb7d81004e0 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.962+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb7d4022470 con 0x7fb7d81004e0 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.963+0000 7fb7cdffb700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 0x7fb7c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.963+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb7d408cb80 con 0x7fb7d81004e0 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.963+0000 7fb7cffff700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 0x7fb7c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.963+0000 7fb7cffff700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 0x7fb7c006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8199710 tx=0x7fb7c800a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:15.967+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb7d4057620 con 0x7fb7d81004e0 2024-04-15T20:58:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.153+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7d8103fb0 con 0x7fb7d81004e0 2024-04-15T20:58:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.153+0000 7fb7cdffb700 1 -- 172.21.15.72:0/3623016870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7d405ac40 con 0x7fb7d81004e0 2024-04-15T20:58:16.147 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 msgr2=0x7fb7c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 0x7fb7c006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8199710 tx=0x7fb7c800a380 comp rx=0 tx=0).stop 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 msgr2=0x7fb7d81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4006010 tx=0x7fb7d400bd70 comp rx=0 tx=0).stop 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 shutdown_connections 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb7c006c680 0x7fb7c006eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d81004e0 0x7fb7d81980f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 --2- 172.21.15.72:0/3623016870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7d8100e80 0x7fb7d8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 >> 172.21.15.72:0/3623016870 conn(0x7fb7d80fbda0 msgr2=0x7fb7d80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:16.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 shutdown_connections 2024-04-15T20:58:16.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:16.156+0000 7fb7df23a700 1 -- 172.21.15.72:0/3623016870 wait complete. 2024-04-15T20:58:16.708 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:16 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3623016870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T20:58:16.730 INFO:tasks.cephadm:Setting up client nodes... 2024-04-15T20:58:16.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-15T20:58:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:16.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:16 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3623016870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T20:58:17.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:17 smithi072 ceph-mon[29079]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:17 smithi149 ceph-mon[36029]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/3941623366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 msgr2=0x7fe0c80ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/3941623366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80ff8a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009910 tx=0x7fe0bc009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/3941623366 shutdown_connections 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/3941623366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80ff8a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/3941623366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 0x7fe0c8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/3941623366 >> 172.21.15.72:0/3941623366 conn(0x7fe0c80f9f10 msgr2=0x7fe0c80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/3941623366 shutdown_connections 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/3941623366 wait complete. 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.569+0000 7fe0cd7ca700 1 Processor -- start 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0cd7ca700 1 -- start start 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0cd7ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0cd7ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 0x7fe0c819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0cd7ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8196710 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0cd7ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c819d1e0 con 0x7fe0c8100730 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42516/0 (socket says 172.21.15.72:42516) 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 -- 172.21.15.72:0/2466737424 learned_addr learned my addr 172.21.15.72:0/2466737424 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c67fc700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 0x7fe0c819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 -- 172.21.15.72:0/2466737424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 msgr2=0x7fe0c819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 0x7fe0c819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 -- 172.21.15.72:0/2466737424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0095f0 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.570+0000 7fe0c6ffd700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800b4e0 tx=0x7fe0b800b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.571+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b8011800 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.571+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c819d490 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.571+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe0b8011e10 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.571+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b800f2e0 con 0x7fe0c80ff430 2024-04-15T20:58:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.571+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c819d9e0 con 0x7fe0c80ff430 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.572+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c8107c70 con 0x7fe0c80ff430 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.572+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe0b8010380 con 0x7fe0c80ff430 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.572+0000 7fe0affff700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 0x7fe0b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.573+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe0b808b0c0 con 0x7fe0c80ff430 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.573+0000 7fe0c67fc700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 0x7fe0b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.573+0000 7fe0c67fc700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 0x7fe0b006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80ff400 tx=0x7fe0bc00b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.577+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe0b8059570 con 0x7fe0c80ff430 2024-04-15T20:58:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.845+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe0c8107e60 con 0x7fe0c80ff430 2024-04-15T20:58:18.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.849+0000 7fe0affff700 1 -- 172.21.15.72:0/2466737424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe0b8059100 con 0x7fe0c80ff430 2024-04-15T20:58:18.842 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-04-15T20:58:18.842 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDqlB1m9UB3MhAAtrMaAPqQ7XZIYZGawB98xw== 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 msgr2=0x7fe0b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 0x7fe0b006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80ff400 tx=0x7fe0bc00b540 comp rx=0 tx=0).stop 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 msgr2=0x7fe0c80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800b4e0 tx=0x7fe0b800b7f0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 shutdown_connections 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe0b006c680 0x7fe0b006eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ff430 0x7fe0c80fee80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 --2- 172.21.15.72:0/2466737424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c8100730 0x7fe0c819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:18.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 >> 172.21.15.72:0/2466737424 conn(0x7fe0c80f9f10 msgr2=0x7fe0c8103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:18.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 shutdown_connections 2024-04-15T20:58:18.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:18.851+0000 7fe0cd7ca700 1 -- 172.21.15.72:0/2466737424 wait complete. 2024-04-15T20:58:19.565 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T20:58:19.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-15T20:58:19.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-15T20:58:19.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-15T20:58:19.834 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi149/config 2024-04-15T20:58:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:19 smithi072 ceph-mon[29079]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:19 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2466737424' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:19 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2466737424' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-15T20:58:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:19 smithi149 ceph-mon[36029]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:19 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2466737424' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:19 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2466737424' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-15T20:58:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:21.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1871551398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 msgr2=0x7fcfdc105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1871551398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc105790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009910 tx=0x7fcfc8009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1871551398 shutdown_connections 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1871551398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc105790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1871551398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc069270 0x7fcfdc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1871551398 >> 172.21.15.149:0/1871551398 conn(0x7fcfdc0fa780 msgr2=0x7fcfdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1871551398 shutdown_connections 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1871551398 wait complete. 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 Processor -- start 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.402+0000 7fcfe2bf3700 1 -- start start 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe2bf3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe2bf3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc0fed70 0x7fcfdc0ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:21.397 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe2bf3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0ff720 con 0x7fcfdc0fed70 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe2bf3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0ff890 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38222/0 (socket says 172.21.15.149:38222) 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 -- 172.21.15.149:0/1099254700 learned_addr learned my addr 172.21.15.149:0/1099254700 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfdbfff700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc0fed70 0x7fcfdc0ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 -- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc0fed70 msgr2=0x7fcfdc0ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc0fed70 0x7fcfdc0ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 -- 172.21.15.149:0/1099254700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80095f0 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe098f700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b480 tx=0x7fcfd000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd0011800 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfd0011e10 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc0ffb70 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.403+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd0010ea0 con 0x7fcfdc103310 2024-04-15T20:58:21.398 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.404+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc19ddd0 con 0x7fcfdc103310 2024-04-15T20:58:21.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.405+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc18fc70 con 0x7fcfdc103310 2024-04-15T20:58:21.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.405+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcfd0010380 con 0x7fcfdc103310 2024-04-15T20:58:21.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.405+0000 7fcfd9ffb700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 0x7fcfcc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:21.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.406+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcfd008b020 con 0x7fcfdc103310 2024-04-15T20:58:21.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.406+0000 7fcfdbfff700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 0x7fcfcc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:21.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.406+0000 7fcfdbfff700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 0x7fcfcc06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8006010 tx=0x7fcfc800b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:21.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.410+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcfd0059550 con 0x7fcfdc103310 2024-04-15T20:58:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.680+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcfdc069270 con 0x7fcfdc103310 2024-04-15T20:58:21.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.685+0000 7fcfd9ffb700 1 -- 172.21.15.149:0/1099254700 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcfd00590e0 con 0x7fcfdc103310 2024-04-15T20:58:21.678 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-04-15T20:58:21.678 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDtlB1mJR2nKBAAbfskRS+SJCgWEO6KE5x8SQ== 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 msgr2=0x7fcfcc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 0x7fcfcc06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8006010 tx=0x7fcfc800b540 comp rx=0 tx=0).stop 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 msgr2=0x7fcfdc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b480 tx=0x7fcfd000b790 comp rx=0 tx=0).stop 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 shutdown_connections 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcfcc06c680 0x7fcfcc06eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfdc103310 0x7fcfdc100720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 --2- 172.21.15.149:0/1099254700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfdc0fed70 0x7fcfdc0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 >> 172.21.15.149:0/1099254700 conn(0x7fcfdc0fa780 msgr2=0x7fcfdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 shutdown_connections 2024-04-15T20:58:21.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T20:58:21.687+0000 7fcfe2bf3700 1 -- 172.21.15.149:0/1099254700 wait complete. 2024-04-15T20:58:21.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:21 smithi072 ceph-mon[29079]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:21.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:21 smithi149 ceph-mon[36029]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:22.291 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T20:58:22.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-15T20:58:22.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-15T20:58:22.337 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T20:58:22.337 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-15T20:58:22.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph mgr dump --format=json 2024-04-15T20:58:22.559 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:22 smithi072 ceph-mon[29079]: from='client.? 172.21.15.149:0/1099254700' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:22 smithi072 ceph-mon[29079]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:22.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:22 smithi072 ceph-mon[29079]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-15T20:58:22.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:22 smithi149 ceph-mon[36029]: from='client.? 172.21.15.149:0/1099254700' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:22.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:22 smithi149 ceph-mon[36029]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-15T20:58:22.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:22 smithi149 ceph-mon[36029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-15T20:58:23.789 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:23 smithi072 ceph-mon[29079]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:23 smithi149 ceph-mon[36029]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 -- 172.21.15.72:0/1467044580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 msgr2=0x7fed84104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 --2- 172.21.15.72:0/1467044580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84104e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009910 tx=0x7fed6c009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 -- 172.21.15.72:0/1467044580 shutdown_connections 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 --2- 172.21.15.72:0/1467044580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84104e50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 --2- 172.21.15.72:0/1467044580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed841004e0 0x7fed841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 -- 172.21.15.72:0/1467044580 >> 172.21.15.72:0/1467044580 conn(0x7fed840fbda0 msgr2=0x7fed840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 -- 172.21.15.72:0/1467044580 shutdown_connections 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.123+0000 7fed8a70b700 1 -- 172.21.15.72:0/1467044580 wait complete. 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 Processor -- start 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 -- start start 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed841004e0 0x7fed84073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed84073ad0 con 0x7fed84100e80 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed8a70b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed84073c10 con 0x7fed841004e0 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42256/0 (socket says 172.21.15.72:42256) 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 -- 172.21.15.72:0/2649390647 learned_addr learned my addr 172.21.15.72:0/2649390647 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 -- 172.21.15.72:0/2649390647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed841004e0 msgr2=0x7fed84073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed841004e0 0x7fed84073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 -- 172.21.15.72:0/2649390647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0095f0 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.124+0000 7fed7bfff700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0092e0 tx=0x7fed6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.125+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6c01d070 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.125+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed6c022470 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.125+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed84073e90 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.125+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6c00f690 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.125+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed841a2470 con 0x7fed84100e80 2024-04-15T20:58:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.126+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed841087a0 con 0x7fed84100e80 2024-04-15T20:58:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.126+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fed6c0225e0 con 0x7fed84100e80 2024-04-15T20:58:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.126+0000 7fed81ffb700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 0x7fed7006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.127+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fed6c08cb70 con 0x7fed84100e80 2024-04-15T20:58:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.127+0000 7fed83fff700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 0x7fed7006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.127+0000 7fed83fff700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 0x7fed7006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed740097b0 tx=0x7fed74006d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.131+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fed6c057640 con 0x7fed84100e80 2024-04-15T20:58:24.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.376+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fed8404f2a0 con 0x7fed84100e80 2024-04-15T20:58:24.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.379+0000 7fed81ffb700 1 -- 172.21.15.72:0/2649390647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172855 (secure 0 0 0) 0x7fed6c05ac60 con 0x7fed84100e80 2024-04-15T20:58:24.375 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 msgr2=0x7fed7006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 0x7fed7006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed740097b0 tx=0x7fed74006d20 comp rx=0 tx=0).stop 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 msgr2=0x7fed84073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0092e0 tx=0x7fed6c00be20 comp rx=0 tx=0).stop 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 shutdown_connections 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fed7006c680 0x7fed7006eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed841004e0 0x7fed84073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 --2- 172.21.15.72:0/2649390647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed84100e80 0x7fed84073590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.382+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 >> 172.21.15.72:0/2649390647 conn(0x7fed840fbda0 msgr2=0x7fed840fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.383+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 shutdown_connections 2024-04-15T20:58:24.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:24.383+0000 7fed8a70b700 1 -- 172.21.15.72:0/2649390647 wait complete. 2024-04-15T20:58:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:24 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2649390647' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-15T20:58:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:24 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2649390647' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-15T20:58:24.997 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"active_gid":14223,"active_name":"smithi072.wfjmmp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3446136011},{"type":"v1","addr":"172.21.15.72:6801","nonce":3446136011}]},"active_addr":"172.21.15.72:6801/3446136011","active_change":"2024-04-15T20:54:34.152324+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14246,"name":"smithi149.qgbaiy","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.72:8443/","prometheus":"http://172.21.15.72:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3176148571}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3235340110}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2634029415}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2285147601}]}]} 2024-04-15T20:58:25.002 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-15T20:58:25.002 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-15T20:58:25.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd dump --format=json 2024-04-15T20:58:25.220 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:25.595 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:25 smithi072 ceph-mon[29079]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:25.896 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:25 smithi149 ceph-mon[36029]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 -- 172.21.15.72:0/3753171890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 msgr2=0x7f79b4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/3753171890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4103d30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f799c009910 tx=0x7f799c009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 -- 172.21.15.72:0/3753171890 shutdown_connections 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/3753171890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4103d30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/3753171890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 0x7f79b40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 -- 172.21.15.72:0/3753171890 >> 172.21.15.72:0/3753171890 conn(0x7f79b40fac80 msgr2=0x7f79b40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 -- 172.21.15.72:0/3753171890 shutdown_connections 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.883+0000 7f79ba2cd700 1 -- 172.21.15.72:0/3753171890 wait complete. 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 Processor -- start 2024-04-15T20:58:26.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 -- start start 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 0x7f79b4195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4196b50 con 0x7f79b40ffd60 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79ba2cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b419a8e0 con 0x7f79b40ff3c0 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42272/0 (socket says 172.21.15.72:42272) 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.884+0000 7f79abfff700 1 -- 172.21.15.72:0/4241501426 learned_addr learned my addr 172.21.15.72:0/4241501426 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79b3fff700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 0x7f79b4195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79abfff700 1 -- 172.21.15.72:0/4241501426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 msgr2=0x7f79b4195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79abfff700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 0x7f79b4195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79abfff700 1 -- 172.21.15.72:0/4241501426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0095f0 con 0x7f79b40ffd60 2024-04-15T20:58:26.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79abfff700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f799c0092e0 tx=0x7f799c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f799c01d070 con 0x7f79b40ffd60 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f799c022470 con 0x7f79b40ffd60 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b419ab60 con 0x7f79b40ffd60 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f799c00f690 con 0x7f79b40ffd60 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.885+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b419b050 con 0x7f79b40ffd60 2024-04-15T20:58:26.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.886+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b404f2a0 con 0x7f79b40ffd60 2024-04-15T20:58:26.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.886+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f799c0225e0 con 0x7f79b40ffd60 2024-04-15T20:58:26.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.887+0000 7f79b1ffb700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 0x7f79a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:26.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.887+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f799c08ca90 con 0x7f79b40ffd60 2024-04-15T20:58:26.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.887+0000 7f79b3fff700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 0x7f79a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:26.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.887+0000 7f79b3fff700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 0x7f79a006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006fd0 tx=0x7f79a4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:26.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:26.891+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f799c0575e0 con 0x7f79b40ffd60 2024-04-15T20:58:27.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.083+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79b419b270 con 0x7f79b40ffd60 2024-04-15T20:58:27.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.084+0000 7f79b1ffb700 1 -- 172.21.15.72:0/4241501426 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7f799c06ee60 con 0x7f79b40ffd60 2024-04-15T20:58:27.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:27.077 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T20:58:11.507874+0000","last_up_change":"2024-04-15T20:58:10.497355+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6803","nonce":4266586545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6805","nonce":4266586545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6809","nonce":4266586545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6807","nonce":4266586545}]},"public_addr":"172.21.15.72:6803/4266586545","cluster_addr":"172.21.15.72:6805/4266586545","heartbeat_back_addr":"172.21.15.72:6809/4266586545","heartbeat_front_addr":"172.21.15.72:6807/4266586545","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6811","nonce":3902265924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6813","nonce":3902265924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6817","nonce":3902265924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6815","nonce":3902265924}]},"public_addr":"172.21.15.72:6811/3902265924","cluster_addr":"172.21.15.72:6813/3902265924","heartbeat_back_addr":"172.21.15.72:6817/3902265924","heartbeat_front_addr":"172.21.15.72:6815/3902265924","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6819","nonce":3531980190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6821","nonce":3531980190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6825","nonce":3531980190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6823","nonce":3531980190}]},"public_addr":"172.21.15.72:6819/3531980190","cluster_addr":"172.21.15.72:6821/3531980190","heartbeat_back_addr":"172.21.15.72:6825/3531980190","heartbeat_front_addr":"172.21.15.72:6823/3531980190","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6801","nonce":1961067780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6803","nonce":1961067780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6807","nonce":1961067780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6805","nonce":1961067780}]},"public_addr":"172.21.15.149:6801/1961067780","cluster_addr":"172.21.15.149:6803/1961067780","heartbeat_back_addr":"172.21.15.149:6807/1961067780","heartbeat_front_addr":"172.21.15.149:6805/1961067780","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6809","nonce":1800407801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6811","nonce":1800407801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6815","nonce":1800407801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6813","nonce":1800407801}]},"public_addr":"172.21.15.149:6809/1800407801","cluster_addr":"172.21.15.149:6811/1800407801","heartbeat_back_addr":"172.21.15.149:6815/1800407801","heartbeat_front_addr":"172.21.15.149:6813/1800407801","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6817","nonce":3380944788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6819","nonce":3380944788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6823","nonce":3380944788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6821","nonce":3380944788}]},"public_addr":"172.21.15.149:6817/3380944788","cluster_addr":"172.21.15.149:6819/3380944788","heartbeat_back_addr":"172.21.15.149:6823/3380944788","heartbeat_front_addr":"172.21.15.149:6821/3380944788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 msgr2=0x7f79a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 0x7f79a006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79a4006fd0 tx=0x7f79a4008040 comp rx=0 tx=0).stop 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 msgr2=0x7f79b4196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f799c0092e0 tx=0x7f799c00be20 comp rx=0 tx=0).stop 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 shutdown_connections 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f79a006c680 0x7f79a006eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79b40ff3c0 0x7f79b4195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 --2- 172.21.15.72:0/4241501426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b40ffd60 0x7f79b4196470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 >> 172.21.15.72:0/4241501426 conn(0x7f79b40fac80 msgr2=0x7f79b41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:27.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 shutdown_connections 2024-04-15T20:58:27.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:27.086+0000 7f79ba2cd700 1 -- 172.21.15.72:0/4241501426 wait complete. 2024-04-15T20:58:27.690 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-15T20:58:27.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd dump --format=json 2024-04-15T20:58:27.897 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:27 smithi072 ceph-mon[29079]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:27 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/4241501426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:27 smithi149 ceph-mon[36029]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:27 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/4241501426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 -- 172.21.15.72:0/3674898528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ffc60 msgr2=0x7fbf5010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 --2- 172.21.15.72:0/3674898528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ffc60 0x7fbf5010a6d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009910 tx=0x7fbf3c009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 -- 172.21.15.72:0/3674898528 shutdown_connections 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 --2- 172.21.15.72:0/3674898528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ffc60 0x7fbf5010a6d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 --2- 172.21.15.72:0/3674898528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ff350 0x7fbf500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 -- 172.21.15.72:0/3674898528 >> 172.21.15.72:0/3674898528 conn(0x7fbf500748b0 msgr2=0x7fbf50074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 -- 172.21.15.72:0/3674898528 shutdown_connections 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 -- 172.21.15.72:0/3674898528 wait complete. 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.525+0000 7fbf56e47700 1 Processor -- start 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 -- start start 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ffc60 0x7fbf50100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50100fb0 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501010f0 con 0x7fbf500ffc60 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42288/0 (socket says 172.21.15.72:42288) 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 -- 172.21.15.72:0/2611832907 learned_addr learned my addr 172.21.15.72:0/2611832907 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf4ffff700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ffc60 0x7fbf50100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 -- 172.21.15.72:0/2611832907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ffc60 msgr2=0x7fbf50100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ffc60 0x7fbf50100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 -- 172.21.15.72:0/2611832907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0095f0 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf54be3700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400b4b0 tx=0x7fbf4400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf44011800 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf44011e10 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf501a20f0 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.526+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4400f2e0 con 0x7fbf500ff350 2024-04-15T20:58:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.527+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501a2450 con 0x7fbf500ff350 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.528+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf50107dd0 con 0x7fbf500ff350 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.528+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbf44010380 con 0x7fbf500ff350 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.528+0000 7fbf4dffb700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 0x7fbf4006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.528+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbf4408b1b0 con 0x7fbf500ff350 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.528+0000 7fbf4ffff700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 0x7fbf4006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.529+0000 7fbf4ffff700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 0x7fbf4006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf50101cb0 tx=0x7fbf3c005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.533+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbf44055bd0 con 0x7fbf500ff350 2024-04-15T20:58:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.727+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf501012b0 con 0x7fbf500ff350 2024-04-15T20:58:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.728+0000 7fbf4dffb700 1 -- 172.21.15.72:0/2611832907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7fbf440591f0 con 0x7fbf500ff350 2024-04-15T20:58:29.721 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:29.721 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T20:58:11.507874+0000","last_up_change":"2024-04-15T20:58:10.497355+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6803","nonce":4266586545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6805","nonce":4266586545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6809","nonce":4266586545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6807","nonce":4266586545}]},"public_addr":"172.21.15.72:6803/4266586545","cluster_addr":"172.21.15.72:6805/4266586545","heartbeat_back_addr":"172.21.15.72:6809/4266586545","heartbeat_front_addr":"172.21.15.72:6807/4266586545","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6811","nonce":3902265924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6813","nonce":3902265924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6817","nonce":3902265924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6815","nonce":3902265924}]},"public_addr":"172.21.15.72:6811/3902265924","cluster_addr":"172.21.15.72:6813/3902265924","heartbeat_back_addr":"172.21.15.72:6817/3902265924","heartbeat_front_addr":"172.21.15.72:6815/3902265924","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6819","nonce":3531980190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6821","nonce":3531980190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6825","nonce":3531980190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6823","nonce":3531980190}]},"public_addr":"172.21.15.72:6819/3531980190","cluster_addr":"172.21.15.72:6821/3531980190","heartbeat_back_addr":"172.21.15.72:6825/3531980190","heartbeat_front_addr":"172.21.15.72:6823/3531980190","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6801","nonce":1961067780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6803","nonce":1961067780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6807","nonce":1961067780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6805","nonce":1961067780}]},"public_addr":"172.21.15.149:6801/1961067780","cluster_addr":"172.21.15.149:6803/1961067780","heartbeat_back_addr":"172.21.15.149:6807/1961067780","heartbeat_front_addr":"172.21.15.149:6805/1961067780","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6809","nonce":1800407801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6811","nonce":1800407801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6815","nonce":1800407801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6813","nonce":1800407801}]},"public_addr":"172.21.15.149:6809/1800407801","cluster_addr":"172.21.15.149:6811/1800407801","heartbeat_back_addr":"172.21.15.149:6815/1800407801","heartbeat_front_addr":"172.21.15.149:6813/1800407801","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6817","nonce":3380944788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6819","nonce":3380944788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6823","nonce":3380944788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6821","nonce":3380944788}]},"public_addr":"172.21.15.149:6817/3380944788","cluster_addr":"172.21.15.149:6819/3380944788","heartbeat_back_addr":"172.21.15.149:6823/3380944788","heartbeat_front_addr":"172.21.15.149:6821/3380944788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 msgr2=0x7fbf4006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 0x7fbf4006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf50101cb0 tx=0x7fbf3c005940 comp rx=0 tx=0).stop 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 msgr2=0x7fbf50100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400b4b0 tx=0x7fbf4400b870 comp rx=0 tx=0).stop 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 shutdown_connections 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbf4006c680 0x7fbf4006eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf500ff350 0x7fbf50100530 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 --2- 172.21.15.72:0/2611832907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf500ffc60 0x7fbf50100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 >> 172.21.15.72:0/2611832907 conn(0x7fbf500748b0 msgr2=0x7fbf50104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 shutdown_connections 2024-04-15T20:58:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:29.730+0000 7fbf56e47700 1 -- 172.21.15.72:0/2611832907 wait complete. 2024-04-15T20:58:29.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:29 smithi072 ceph-mon[29079]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:29.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:29 smithi149 ceph-mon[36029]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:30.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-15T20:58:30.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-15T20:58:30.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-15T20:58:30.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-15T20:58:30.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-15T20:58:30.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-15T20:58:30.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:30 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2611832907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:30.717 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:30.933 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:30 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2611832907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:58:31.397 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:31.748 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:31 smithi072 ceph-mon[29079]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:31.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:31 smithi149 ceph-mon[36029]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:33.465 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:33.660 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:33 smithi072 ceph-mon[29079]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3293317559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ffc60 msgr2=0x7fbbe410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3293317559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ffc60 0x7fbbe410a6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009910 tx=0x7fbbd8009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3293317559 shutdown_connections 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3293317559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ffc60 0x7fbbe410a6d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3293317559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ff350 0x7fbbe40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3293317559 >> 172.21.15.72:0/3293317559 conn(0x7fbbe40748b0 msgr2=0x7fbbe4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3293317559 shutdown_connections 2024-04-15T20:58:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.670+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3293317559 wait complete. 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 Processor -- start 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 -- start start 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ffc60 0x7fbbe41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4196a80 con 0x7fbbe40ff350 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe88a3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe419a810 con 0x7fbbe40ffc60 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46222/0 (socket says 172.21.15.72:46222) 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe259c700 1 -- 172.21.15.72:0/3752823685 learned_addr learned my addr 172.21.15.72:0/3752823685 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.671+0000 7fbbe1d9b700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ffc60 0x7fbbe41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe259c700 1 -- 172.21.15.72:0/3752823685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ffc60 msgr2=0x7fbbe41963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe259c700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ffc60 0x7fbbe41963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe259c700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80095f0 con 0x7fbbe40ff350 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe259c700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e920 tx=0x7fbbd400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd400c9d0 con 0x7fbbe40ff350 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbd4010430 con 0x7fbbe40ff350 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd4018650 con 0x7fbbe40ff350 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe419aaf0 con 0x7fbbe40ff350 2024-04-15T20:58:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.672+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe419aff0 con 0x7fbbe40ff350 2024-04-15T20:58:33.667 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.673+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbe410d600 con 0x7fbbe40ff350 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbbd40105a0 con 0x7fbbe40ff350 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 0x7fbbcc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbbd4014070 con 0x7fbbe40ff350 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbe1d9b700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 0x7fbbcc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 0x7fbbcc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbcc074e10 con 0x7fbbcc072350 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.674+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd408de20 con 0x7fbbe40ff350 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.675+0000 7fbbe2d9d700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 0x7fbbcc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.675+0000 7fbbe1d9b700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 0x7fbbcc06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4197480 tx=0x7fbbd8005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.675+0000 7fbbe2d9d700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 0x7fbbcc074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.676+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== osd.2 v2:172.21.15.72:6818/3531980190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbbcc074e10 con 0x7fbbcc072350 2024-04-15T20:58:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.702+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 --> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbe404f2a0 con 0x7fbbcc072350 2024-04-15T20:58:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbd37fe700 1 -- 172.21.15.72:0/3752823685 <== osd.2 v2:172.21.15.72:6818/3531980190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbe404f2a0 con 0x7fbbcc072350 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 msgr2=0x7fbbcc074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 0x7fbbcc074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 msgr2=0x7fbbcc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 0x7fbbcc06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4197480 tx=0x7fbbd8005940 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 msgr2=0x7fbbe4195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e920 tx=0x7fbbd400ec30 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 shutdown_connections 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6818/3531980190,v1:172.21.15.72:6819/3531980190] conn(0x7fbbcc072350 0x7fbbcc074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbbcc06c680 0x7fbbcc06eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbe40ff350 0x7fbbe4195e60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 --2- 172.21.15.72:0/3752823685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe40ffc60 0x7fbbe41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 >> 172.21.15.72:0/3752823685 conn(0x7fbbe40748b0 msgr2=0x7fbbe4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 shutdown_connections 2024-04-15T20:58:33.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:33.703+0000 7fbbe88a3700 1 -- 172.21.15.72:0/3752823685 wait complete. 2024-04-15T20:58:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:33 smithi149 ceph-mon[36029]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:34.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:35.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:35 smithi072 ceph-mon[29079]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:35.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:35 smithi149 ceph-mon[36029]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:37.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 -- 172.21.15.72:0/2357283937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101410 msgr2=0x7f607c1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 --2- 172.21.15.72:0/2357283937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101410 0x7f607c1017e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f606c00b0a0 tx=0x7f606c00b3b0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 -- 172.21.15.72:0/2357283937 shutdown_connections 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 --2- 172.21.15.72:0/2357283937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101d20 0x7f607c10a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 --2- 172.21.15.72:0/2357283937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101410 0x7f607c1017e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 -- 172.21.15.72:0/2357283937 >> 172.21.15.72:0/2357283937 conn(0x7f607c0fac90 msgr2=0x7f607c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 -- 172.21.15.72:0/2357283937 shutdown_connections 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.101+0000 7f6083ab7700 1 -- 172.21.15.72:0/2357283937 wait complete. 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 Processor -- start 2024-04-15T20:58:37.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 -- start start 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 0x7f607c0ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0ffaf0 con 0x7f607c101d20 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6083ab7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0ffc30 con 0x7f607c101410 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081052700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081052700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46240/0 (socket says 172.21.15.72:46240) 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081052700 1 -- 172.21.15.72:0/3028817088 learned_addr learned my addr 172.21.15.72:0/3028817088 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081853700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 0x7f607c0ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081052700 1 -- 172.21.15.72:0/3028817088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 msgr2=0x7f607c0ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.102+0000 7f6081052700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 0x7f607c0ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f6081052700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009d00 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f6081853700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 0x7f607c0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f6081052700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f607000b4b0 tx=0x7f607000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6070011800 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6070011e10 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607000f2e0 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c1a2150 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.103+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c1a2560 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.104+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f607c10d6a0 con 0x7f607c101d20 2024-04-15T20:58:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.104+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6070010380 con 0x7f607c101d20 2024-04-15T20:58:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f607affd700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 0x7f606406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f607008b7a0 con 0x7f607c101d20 2024-04-15T20:58:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f6081853700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 0x7f606406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f607affd700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 0x7f6064074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6064074e10 con 0x7f6064072350 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f607008bc00 con 0x7f607c101d20 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f6082054700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 0x7f6064074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f6081853700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 0x7f606406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f606c009480 tx=0x7f606c0097a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.105+0000 7f6082054700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 0x7f6064074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.106+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== osd.0 v2:172.21.15.72:6802/4266586545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6064074e10 con 0x7f6064072350 2024-04-15T20:58:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.121+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 --> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f607c04f2a0 con 0x7f6064072350 2024-04-15T20:58:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f607affd700 1 -- 172.21.15.72:0/3028817088 <== osd.0 v2:172.21.15.72:6802/4266586545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f607c04f2a0 con 0x7f6064072350 2024-04-15T20:58:37.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 msgr2=0x7f6064074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:37.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 0x7f6064074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 msgr2=0x7f606406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 0x7f606406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f606c009480 tx=0x7f606c0097a0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 msgr2=0x7f607c0ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f607000b4b0 tx=0x7f607000b870 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 shutdown_connections 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6802/4266586545,v1:172.21.15.72:6803/4266586545] conn(0x7f6064072350 0x7f6064074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f606406c680 0x7f606406eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607c101410 0x7f607c0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 --2- 172.21.15.72:0/3028817088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607c101d20 0x7f607c0ff5b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 >> 172.21.15.72:0/3028817088 conn(0x7f607c0fac90 msgr2=0x7f607c104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 shutdown_connections 2024-04-15T20:58:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:37.122+0000 7f6083ab7700 1 -- 172.21.15.72:0/3028817088 wait complete. 2024-04-15T20:58:37.427 INFO:teuthology.orchestra.run.smithi072.stdout:81604378647 2024-04-15T20:58:37.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-15T20:58:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:37 smithi072 ceph-mon[29079]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:37.832 INFO:teuthology.orchestra.run.smithi072.stdout:38654705700 2024-04-15T20:58:37.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-15T20:58:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:37 smithi149 ceph-mon[36029]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- 172.21.15.72:0/942907058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100ed0 msgr2=0x7fe1dc104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 --2- 172.21.15.72:0/942907058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc104ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009910 tx=0x7fe1c8009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- 172.21.15.72:0/942907058 shutdown_connections 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 --2- 172.21.15.72:0/942907058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc104ea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 --2- 172.21.15.72:0/942907058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100530 0x7fe1dc100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- 172.21.15.72:0/942907058 >> 172.21.15.72:0/942907058 conn(0x7fe1dc0fbe10 msgr2=0x7fe1dc0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- 172.21.15.72:0/942907058 shutdown_connections 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- 172.21.15.72:0/942907058 wait complete. 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 Processor -- start 2024-04-15T20:58:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.043+0000 7fe1e319e700 1 -- start start 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e319e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e319e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e319e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc196b10 con 0x7fe1dc100530 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e319e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc19a8a0 con 0x7fe1dc100ed0 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46260/0 (socket says 172.21.15.72:46260) 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 -- 172.21.15.72:0/2299576242 learned_addr learned my addr 172.21.15.72:0/2299576242 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1dbfff700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 -- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100ed0 msgr2=0x7fe1dc196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80095f0 con 0x7fe1dc100530 2024-04-15T20:58:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e0f3a700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d8d0 tx=0x7fe1d000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d00098a0 con 0x7fe1dc100530 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1d0010460 con 0x7fe1dc100530 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.044+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc19ab80 con 0x7fe1dc100530 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.045+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d000f5f0 con 0x7fe1dc100530 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.045+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc19b0d0 con 0x7fe1dc100530 2024-04-15T20:58:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.046+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1dc10d6a0 con 0x7fe1dc100530 2024-04-15T20:58:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.047+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe1d0009a00 con 0x7fe1dc100530 2024-04-15T20:58:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.047+0000 7fe1d9ffb700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 0x7fe1cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.047+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe1d008b4c0 con 0x7fe1dc100530 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1dbfff700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 0x7fe1cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1d9ffb700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 0x7fe1cc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1cc074e10 con 0x7fe1cc072350 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d008daf0 con 0x7fe1dc100530 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1e173b700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 0x7fe1cc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1dbfff700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 0x7fe1cc06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc197510 tx=0x7fe1c801a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.048+0000 7fe1e173b700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 0x7fe1cc074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.049+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== osd.3 v2:172.21.15.149:6800/1961067780 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe1cc074e10 con 0x7fe1cc072350 2024-04-15T20:58:39.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.065+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 --> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1dc04f2a0 con 0x7fe1cc072350 2024-04-15T20:58:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1d9ffb700 1 -- 172.21.15.72:0/2299576242 <== osd.3 v2:172.21.15.149:6800/1961067780 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe1dc04f2a0 con 0x7fe1cc072350 2024-04-15T20:58:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 msgr2=0x7fe1cc074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 0x7fe1cc074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 msgr2=0x7fe1cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 0x7fe1cc06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc197510 tx=0x7fe1c801a040 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 msgr2=0x7fe1dc195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.066+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d8d0 tx=0x7fe1d000dbe0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 shutdown_connections 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:6800/1961067780,v1:172.21.15.149:6801/1961067780] conn(0x7fe1cc072350 0x7fe1cc074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe1cc06c680 0x7fe1cc06eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1dc100530 0x7fe1dc195ef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 --2- 172.21.15.72:0/2299576242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1dc100ed0 0x7fe1dc196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 >> 172.21.15.72:0/2299576242 conn(0x7fe1dc0fbe10 msgr2=0x7fe1dc0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 shutdown_connections 2024-04-15T20:58:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.067+0000 7fe1e319e700 1 -- 172.21.15.72:0/2299576242 wait complete. 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 -- 172.21.15.72:0/1554527171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 msgr2=0x7fc3cc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1554527171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc104e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009910 tx=0x7fc3c0009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 -- 172.21.15.72:0/1554527171 shutdown_connections 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1554527171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc104e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1554527171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 -- 172.21.15.72:0/1554527171 >> 172.21.15.72:0/1554527171 conn(0x7fc3cc0fbda0 msgr2=0x7fc3cc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 -- 172.21.15.72:0/1554527171 shutdown_connections 2024-04-15T20:58:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 -- 172.21.15.72:0/1554527171 wait complete. 2024-04-15T20:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.269+0000 7fc3d3692700 1 Processor -- start 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d3692700 1 -- start start 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d3692700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d3692700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d3692700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc196b30 con 0x7fc3cc100e80 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d3692700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc19a8c0 con 0x7fc3cc1004e0 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46282/0 (socket says 172.21.15.72:46282) 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 -- 172.21.15.72:0/1272877924 learned_addr learned my addr 172.21.15.72:0/1272877924 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d142e700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 -- 172.21.15.72:0/1272877924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 msgr2=0x7fc3cc195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00095f0 con 0x7fc3cc100e80 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d142e700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3d0c2d700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c001d070 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.270+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3c0005640 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.271+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc19ab40 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.271+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c00226a0 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.271+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc19b030 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.271+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3cc10d650 con 0x7fc3cc100e80 2024-04-15T20:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.272+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc3c0003680 con 0x7fc3cc100e80 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.272+0000 7fc3ca7fc700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 0x7fc3b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.272+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc3c008c8c0 con 0x7fc3cc100e80 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3d142e700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 0x7fc3b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3ca7fc700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 0x7fc3b4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3b4074e10 con 0x7fc3b4072350 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c00912a0 con 0x7fc3cc100e80 2024-04-15T20:58:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3d1c2f700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 0x7fc3b4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3d142e700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 0x7fc3b406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40093a0 tx=0x7fc3c400b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.273+0000 7fc3d1c2f700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 0x7fc3b4074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.274+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== osd.1 v2:172.21.15.72:6810/3902265924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc3b4074e10 con 0x7fc3b4072350 2024-04-15T20:58:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 --> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3cc04f2a0 con 0x7fc3b4072350 2024-04-15T20:58:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3ca7fc700 1 -- 172.21.15.72:0/1272877924 <== osd.1 v2:172.21.15.72:6810/3902265924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3cc04f2a0 con 0x7fc3b4072350 2024-04-15T20:58:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 msgr2=0x7fc3b4074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 0x7fc3b4074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 msgr2=0x7fc3b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.293+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 0x7fc3b406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40093a0 tx=0x7fc3c400b040 comp rx=0 tx=0).stop 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 msgr2=0x7fc3cc196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c000fab0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 shutdown_connections 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6810/3902265924,v1:172.21.15.72:6811/3902265924] conn(0x7fc3b4072350 0x7fc3b4074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc3b406c680 0x7fc3b406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3cc1004e0 0x7fc3cc195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 --2- 172.21.15.72:0/1272877924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc100e80 0x7fc3cc196450 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 >> 172.21.15.72:0/1272877924 conn(0x7fc3cc0fbda0 msgr2=0x7fc3cc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 shutdown_connections 2024-04-15T20:58:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:39.294+0000 7fc3d3692700 1 -- 172.21.15.72:0/1272877924 wait complete. 2024-04-15T20:58:39.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:39 smithi072 ceph-mon[29079]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:39.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:39 smithi149 ceph-mon[36029]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:40.105 INFO:teuthology.orchestra.run.smithi072.stdout:111669149715 2024-04-15T20:58:40.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-15T20:58:40.857 INFO:teuthology.orchestra.run.smithi072.stdout:60129542174 2024-04-15T20:58:40.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-15T20:58:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 -- 172.21.15.72:0/1776911673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4100e80 msgr2=0x7f5dc4104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/1776911673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4100e80 0x7f5dc4104e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009910 tx=0x7f5db8009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 -- 172.21.15.72:0/1776911673 shutdown_connections 2024-04-15T20:58:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/1776911673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4100e80 0x7f5dc4104e50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/1776911673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc41004e0 0x7f5dc41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 -- 172.21.15.72:0/1776911673 >> 172.21.15.72:0/1776911673 conn(0x7f5dc40fbda0 msgr2=0x7f5dc40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 -- 172.21.15.72:0/1776911673 shutdown_connections 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.292+0000 7f5dc9f30700 1 -- 172.21.15.72:0/1776911673 wait complete. 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 Processor -- start 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 -- start start 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 0x7f5dc41964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:41.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4196b90 con 0x7f5dc41004e0 2024-04-15T20:58:41.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc9f30700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc419a920 con 0x7f5dc4100e80 2024-04-15T20:58:41.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:41.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46304/0 (socket says 172.21.15.72:46304) 2024-04-15T20:58:41.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.293+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3603627637 learned_addr learned my addr 172.21.15.72:0/3603627637 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 0x7f5dc41964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 msgr2=0x7f5dc41964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 0x7f5dc41964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc37fe700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80095f0 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 0x7f5dc41964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc37fe700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5db400ba50 tx=0x7f5db400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db400ca00 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc419ac00 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5db400cb60 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db4007580 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.294+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc419b150 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.295+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dc410d6d0 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5db400ccd0 con 0x7f5dc41004e0 2024-04-15T20:58:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 0x7f5dac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5db4006e40 con 0x7f5dc41004e0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 0x7f5dac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 0x7f5dac074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dac074e10 con 0x7f5dac072350 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db408b770 con 0x7f5dc41004e0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.296+0000 7f5dc2ffd700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 0x7f5dac06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b5c0 tx=0x7f5db8005480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.297+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 0x7f5dac074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.297+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 0x7f5dac074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.298+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== osd.5 v2:172.21.15.149:6816/3380944788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5dac074e10 con 0x7f5dac072350 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.313+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 --> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5dc404f2a0 con 0x7f5dac072350 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc0ff9700 1 -- 172.21.15.72:0/3603627637 <== osd.5 v2:172.21.15.149:6816/3380944788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5dc404f2a0 con 0x7f5dac072350 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 msgr2=0x7f5dac074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 0x7f5dac074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 msgr2=0x7f5dac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 0x7f5dac06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b5c0 tx=0x7f5db8005480 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 msgr2=0x7f5dc4195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5db400ba50 tx=0x7f5db400be10 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 shutdown_connections 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:6816/3380944788,v1:172.21.15.149:6817/3380944788] conn(0x7f5dac072350 0x7f5dac074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5dac06c680 0x7f5dac06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc41004e0 0x7f5dc4195f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 --2- 172.21.15.72:0/3603627637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc4100e80 0x7f5dc41964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 >> 172.21.15.72:0/3603627637 conn(0x7f5dc40fbda0 msgr2=0x7f5dc40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 shutdown_connections 2024-04-15T20:58:41.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:41.314+0000 7f5dc9f30700 1 -- 172.21.15.72:0/3603627637 wait complete. 2024-04-15T20:58:41.834 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:41 smithi072 ceph-mon[29079]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:41 smithi149 ceph-mon[36029]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:42.318 INFO:teuthology.orchestra.run.smithi072.stdout:167503724551 2024-04-15T20:58:42.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-15T20:58:42.371 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:42.371 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:43.639 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:43 smithi072 ceph-mon[29079]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 -- 172.21.15.72:0/3376505305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100d70 msgr2=0x7fdb5c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3376505305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100d70 0x7fdb5c1094d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009940 tx=0x7fdb4c009c50 comp rx=0 tx=0).stop 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 -- 172.21.15.72:0/3376505305 shutdown_connections 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3376505305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100d70 0x7fdb5c1094d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3376505305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100460 0x7fdb5c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 -- 172.21.15.72:0/3376505305 >> 172.21.15.72:0/3376505305 conn(0x7fdb5c0748b0 msgr2=0x7fdb5c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 -- 172.21.15.72:0/3376505305 shutdown_connections 2024-04-15T20:58:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.916+0000 7fdb6437d700 1 -- 172.21.15.72:0/3376505305 wait complete. 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 Processor -- start 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 -- start start 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100d70 0x7fdb5c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c196b30 con 0x7fdb5c100460 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.917+0000 7fdb6437d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c19a8c0 con 0x7fdb5c100d70 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40132/0 (socket says 172.21.15.72:40132) 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 -- 172.21.15.72:0/3251788852 learned_addr learned my addr 172.21.15.72:0/3251788852 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb61918700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100d70 0x7fdb5c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 -- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100d70 msgr2=0x7fdb5c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100d70 0x7fdb5c196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0095f0 con 0x7fdb5c100460 2024-04-15T20:58:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb62119700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800d8d0 tx=0x7fdb5800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb580098a0 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c19aba0 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb58010460 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb5800f5f0 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.918+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c19b0c0 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.919+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb5c10c640 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdb58009a00 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 0x7fdb4806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdb5808b420 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb61918700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 0x7fdb4806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 0x7fdb48074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb48074e10 con 0x7fdb48072350 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.920+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb5808daf0 con 0x7fdb5c100460 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.921+0000 7fdb6291a700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 0x7fdb48074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.921+0000 7fdb61918700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 0x7fdb4806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c006010 tx=0x7fdb4c005a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.921+0000 7fdb6291a700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 0x7fdb48074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.922+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== osd.4 v2:172.21.15.149:6808/1800407801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdb48074e10 con 0x7fdb48072350 2024-04-15T20:58:43.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:43 smithi149 ceph-mon[36029]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:43.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.954+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 --> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb5c04f2a0 con 0x7fdb48072350 2024-04-15T20:58:43.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb537fe700 1 -- 172.21.15.72:0/3251788852 <== osd.4 v2:172.21.15.149:6808/1800407801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdb5c04f2a0 con 0x7fdb48072350 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 msgr2=0x7fdb48074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 0x7fdb48074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 msgr2=0x7fdb4806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 0x7fdb4806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c006010 tx=0x7fdb4c005a90 comp rx=0 tx=0).stop 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 msgr2=0x7fdb5c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800d8d0 tx=0x7fdb5800dbe0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 shutdown_connections 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:6808/1800407801,v1:172.21.15.149:6809/1800407801] conn(0x7fdb48072350 0x7fdb48074760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb4806c680 0x7fdb4806eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c100460 0x7fdb5c195f10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 --2- 172.21.15.72:0/3251788852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c100d70 0x7fdb5c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 >> 172.21.15.72:0/3251788852 conn(0x7fdb5c0748b0 msgr2=0x7fdb5c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 shutdown_connections 2024-04-15T20:58:43.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:43.955+0000 7fdb6437d700 1 -- 172.21.15.72:0/3251788852 wait complete. 2024-04-15T20:58:44.178 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:45.450 INFO:teuthology.orchestra.run.smithi072.stdout:146028888078 2024-04-15T20:58:45.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-15T20:58:45.692 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:45 smithi072 ceph-mon[29079]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:45.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:45 smithi149 ceph-mon[36029]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:46.037 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:47.644 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:47 smithi072 ceph-mon[29079]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:47.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:47 smithi149 ceph-mon[36029]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 -- 172.21.15.72:0/3683992520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91381004e0 msgr2=0x7f91381008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 --2- 172.21.15.72:0/3683992520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91381004e0 0x7f91381008b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9128009910 tx=0x7f9128009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 -- 172.21.15.72:0/3683992520 shutdown_connections 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 --2- 172.21.15.72:0/3683992520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9138100e80 0x7f9138104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 --2- 172.21.15.72:0/3683992520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91381004e0 0x7f91381008b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 -- 172.21.15.72:0/3683992520 >> 172.21.15.72:0/3683992520 conn(0x7f91380fbda0 msgr2=0x7f91380fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:47.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 -- 172.21.15.72:0/3683992520 shutdown_connections 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.959+0000 7f913e0a6700 1 -- 172.21.15.72:0/3683992520 wait complete. 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 Processor -- start 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 -- start start 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91381004e0 0x7f9138195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138196b10 con 0x7f9138100e80 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f913e0a6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913819a8a0 con 0x7f91381004e0 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f912ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f912ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40146/0 (socket says 172.21.15.72:40146) 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f912ffff700 1 -- 172.21.15.72:0/2086126875 learned_addr learned my addr 172.21.15.72:0/2086126875 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.960+0000 7f91377fe700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91381004e0 0x7f9138195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f912ffff700 1 -- 172.21.15.72:0/2086126875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91381004e0 msgr2=0x7f9138195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f912ffff700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91381004e0 0x7f9138195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:47.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f912ffff700 1 -- 172.21.15.72:0/2086126875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280095f0 con 0x7f9138100e80 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f912ffff700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f912000d900 tx=0x7f912000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9120009900 con 0x7f9138100e80 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913819ab80 con 0x7f9138100e80 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9120010460 con 0x7f9138100e80 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912000f5f0 con 0x7f9138100e80 2024-04-15T20:58:47.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.961+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913819b0d0 con 0x7f9138100e80 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.962+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91381087f0 con 0x7f9138100e80 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.962+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f91200105d0 con 0x7f9138100e80 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.963+0000 7f91357fa700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 0x7f912406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.963+0000 7f91377fe700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 0x7f912406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.963+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f912008b010 con 0x7f9138100e80 2024-04-15T20:58:47.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.963+0000 7f91377fe700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 0x7f912406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9128006010 tx=0x7f912801a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:47.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:47.968+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9120055ab0 con 0x7f9138100e80 2024-04-15T20:58:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.167+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f913819b340 con 0x7f9138100e80 2024-04-15T20:58:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.167+0000 7f91357fa700 1 -- 172.21.15.72:0/2086126875 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91200590d0 con 0x7f9138100e80 2024-04-15T20:58:48.160 INFO:teuthology.orchestra.run.smithi072.stdout:111669149717 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 msgr2=0x7f912406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 0x7f912406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9128006010 tx=0x7f912801a040 comp rx=0 tx=0).stop 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 msgr2=0x7f9138196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f912000d900 tx=0x7f912000dc10 comp rx=0 tx=0).stop 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 shutdown_connections 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f912406c680 0x7f912406eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91381004e0 0x7f9138195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 --2- 172.21.15.72:0/2086126875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9138100e80 0x7f9138196430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 >> 172.21.15.72:0/2086126875 conn(0x7f91380fbda0 msgr2=0x7f91380fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 shutdown_connections 2024-04-15T20:58:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:48.170+0000 7f913e0a6700 1 -- 172.21.15.72:0/2086126875 wait complete. 2024-04-15T20:58:48.861 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:48 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2086126875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-15T20:58:48.862 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:48 smithi072 ceph-mon[29079]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:48.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:48 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2086126875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-15T20:58:48.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:48 smithi149 ceph-mon[36029]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:49.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:58:50.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 -- 172.21.15.72:0/3254426497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 msgr2=0x7fd91c100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3254426497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c100830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd918009940 tx=0x7fd918009c50 comp rx=0 tx=0).stop 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 -- 172.21.15.72:0/3254426497 shutdown_connections 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3254426497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 0x7fd91c1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3254426497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c100830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 -- 172.21.15.72:0/3254426497 >> 172.21.15.72:0/3254426497 conn(0x7fd91c0748b0 msgr2=0x7fd91c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 -- 172.21.15.72:0/3254426497 shutdown_connections 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.599+0000 7fd9239ba700 1 -- 172.21.15.72:0/3254426497 wait complete. 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 Processor -- start 2024-04-15T20:58:50.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 -- start start 2024-04-15T20:58:50.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 0x7fd91c105810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1073b0 con 0x7fd91c100460 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd9239ba700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c107520 con 0x7fd91c100d70 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd921756700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd921756700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40162/0 (socket says 172.21.15.72:40162) 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd921756700 1 -- 172.21.15.72:0/3810594572 learned_addr learned my addr 172.21.15.72:0/3810594572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.600+0000 7fd920f55700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 0x7fd91c105810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.601+0000 7fd921756700 1 -- 172.21.15.72:0/3810594572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 msgr2=0x7fd91c105810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.601+0000 7fd921756700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 0x7fd91c105810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.601+0000 7fd921756700 1 -- 172.21.15.72:0/3810594572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9180095f0 con 0x7fd91c100460 2024-04-15T20:58:50.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.601+0000 7fd921756700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9180055f0 tx=0x7fd918005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:50.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.602+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91801d070 con 0x7fd91c100460 2024-04-15T20:58:50.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.602+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd91800f460 con 0x7fd91c100460 2024-04-15T20:58:50.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.602+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd918021640 con 0x7fd91c100460 2024-04-15T20:58:50.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.602+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c105e40 con 0x7fd91c100460 2024-04-15T20:58:50.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.602+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c1a67f0 con 0x7fd91c100460 2024-04-15T20:58:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.603+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c194150 con 0x7fd91c100460 2024-04-15T20:58:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.604+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd91800fab0 con 0x7fd91c100460 2024-04-15T20:58:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.604+0000 7fd9127fc700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 0x7fd90806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.604+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd91808c790 con 0x7fd91c100460 2024-04-15T20:58:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.604+0000 7fd920f55700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 0x7fd90806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.605+0000 7fd920f55700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 0x7fd90806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd91c106ac0 tx=0x7fd90c00a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:50.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.609+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd918057230 con 0x7fd91c100460 2024-04-15T20:58:50.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:50 smithi072 ceph-mon[29079]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.807+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd91c04f2a0 con 0x7fd91c100460 2024-04-15T20:58:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.807+0000 7fd9127fc700 1 -- 172.21.15.72:0/3810594572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd91805a850 con 0x7fd91c100460 2024-04-15T20:58:50.800 INFO:teuthology.orchestra.run.smithi072.stdout:38654705702 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 msgr2=0x7fd90806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 0x7fd90806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd91c106ac0 tx=0x7fd90c00a380 comp rx=0 tx=0).stop 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 msgr2=0x7fd91c1052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9180055f0 tx=0x7fd918005620 comp rx=0 tx=0).stop 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 shutdown_connections 2024-04-15T20:58:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd90806c680 0x7fd90806eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd91c100460 0x7fd91c1052d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 --2- 172.21.15.72:0/3810594572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd91c100d70 0x7fd91c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 >> 172.21.15.72:0/3810594572 conn(0x7fd91c0748b0 msgr2=0x7fd91c0fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 shutdown_connections 2024-04-15T20:58:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.809+0000 7fd9239ba700 1 -- 172.21.15.72:0/3810594572 wait complete. 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 -- 172.21.15.72:0/4139594067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 msgr2=0x7fce5410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/4139594067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce5410a230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce50009910 tx=0x7fce50009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 -- 172.21.15.72:0/4139594067 shutdown_connections 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/4139594067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce5410a230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/4139594067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce541017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 -- 172.21.15.72:0/4139594067 >> 172.21.15.72:0/4139594067 conn(0x7fce540fac60 msgr2=0x7fce540fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 -- 172.21.15.72:0/4139594067 shutdown_connections 2024-04-15T20:58:50.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.827+0000 7fce5c0f5700 1 -- 172.21.15.72:0/4139594067 wait complete. 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 Processor -- start 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 -- start start 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce54195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54196a70 con 0x7fce54101d30 2024-04-15T20:58:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce5c0f5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5419a800 con 0x7fce54101420 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40176/0 (socket says 172.21.15.72:40176) 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 -- 172.21.15.72:0/3618336213 learned_addr learned my addr 172.21.15.72:0/3618336213 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59e91700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce54195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 -- 172.21.15.72:0/3618336213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 msgr2=0x7fce54195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce54195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59690700 1 -- 172.21.15.72:0/3618336213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500095f0 con 0x7fce54101d30 2024-04-15T20:58:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.828+0000 7fce59e91700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce54195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce59690700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce50006010 tx=0x7fce5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce5001d070 con 0x7fce54101d30 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce50004f50 con 0x7fce54101d30 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5419aa80 con 0x7fce54101d30 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce50021410 con 0x7fce54101d30 2024-04-15T20:58:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.829+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5419af70 con 0x7fce54101d30 2024-04-15T20:58:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.830+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce541078a0 con 0x7fce54101d30 2024-04-15T20:58:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.830+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fce5002b440 con 0x7fce54101d30 2024-04-15T20:58:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.831+0000 7fce4affd700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 0x7fce4006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.831+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fce5008c730 con 0x7fce54101d30 2024-04-15T20:58:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.831+0000 7fce59e91700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 0x7fce4006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.832+0000 7fce59e91700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 0x7fce4006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce44005d90 tx=0x7fce44005d00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:50.837+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fce50057150 con 0x7fce54101d30 2024-04-15T20:58:50.843 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:50 smithi149 ceph-mon[36029]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:51.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.030+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce5404f2a0 con 0x7fce54101d30 2024-04-15T20:58:51.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.030+0000 7fce4affd700 1 -- 172.21.15.72:0/3618336213 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce5005a770 con 0x7fce54101d30 2024-04-15T20:58:51.024 INFO:teuthology.orchestra.run.smithi072.stdout:81604378650 2024-04-15T20:58:51.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 msgr2=0x7fce4006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:51.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 0x7fce4006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce44005d90 tx=0x7fce44005d00 comp rx=0 tx=0).stop 2024-04-15T20:58:51.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 msgr2=0x7fce54196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:51.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce50006010 tx=0x7fce5000be20 comp rx=0 tx=0).stop 2024-04-15T20:58:51.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 shutdown_connections 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fce4006c680 0x7fce4006eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce54101420 0x7fce54195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 --2- 172.21.15.72:0/3618336213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54101d30 0x7fce54196390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 >> 172.21.15.72:0/3618336213 conn(0x7fce540fac60 msgr2=0x7fce541049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 shutdown_connections 2024-04-15T20:58:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:51.033+0000 7fce5c0f5700 1 -- 172.21.15.72:0/3618336213 wait complete. 2024-04-15T20:58:51.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-04-15T20:58:51.788 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:51.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:51 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3810594572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-15T20:58:51.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:51 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3618336213' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-15T20:58:51.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:51 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3810594572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-15T20:58:51.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:51 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3618336213' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-15T20:58:52.144 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-04-15T20:58:52.144 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:52.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 -- 172.21.15.72:0/325008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ffd60 msgr2=0x7f0990103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:52.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 --2- 172.21.15.72:0/325008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ffd60 0x7f0990103d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0984009910 tx=0x7f0984009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 -- 172.21.15.72:0/325008790 shutdown_connections 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 --2- 172.21.15.72:0/325008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ffd60 0x7f0990103d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 --2- 172.21.15.72:0/325008790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ff3c0 0x7f09900ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.342+0000 7f0995a82700 1 -- 172.21.15.72:0/325008790 >> 172.21.15.72:0/325008790 conn(0x7f09900fac80 msgr2=0x7f09900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.343+0000 7f0995a82700 1 -- 172.21.15.72:0/325008790 shutdown_connections 2024-04-15T20:58:52.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.343+0000 7f0995a82700 1 -- 172.21.15.72:0/325008790 wait complete. 2024-04-15T20:58:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.343+0000 7f0995a82700 1 Processor -- start 2024-04-15T20:58:52.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.343+0000 7f0995a82700 1 -- start start 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 0x7f09901963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990196aa0 con 0x7f09900ff3c0 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099019a830 con 0x7f09900ffd60 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53406/0 (socket says 172.21.15.72:53406) 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 -- 172.21.15.72:0/1944961738 learned_addr learned my addr 172.21.15.72:0/1944961738 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098effd700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 0x7f09901963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 -- 172.21.15.72:0/1944961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 msgr2=0x7f09901963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 0x7f09901963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 -- 172.21.15.72:0/1944961738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840095f0 con 0x7f09900ff3c0 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098effd700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 0x7f09901963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T20:58:52.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098f7fe700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09800060b0 tx=0x7f098000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:52.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098000dda0 con 0x7f09900ff3c0 2024-04-15T20:58:52.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f098000f040 con 0x7f09900ff3c0 2024-04-15T20:58:52.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09800146f0 con 0x7f09900ff3c0 2024-04-15T20:58:52.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099019ab10 con 0x7f09900ff3c0 2024-04-15T20:58:52.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.344+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099019b010 con 0x7f09900ff3c0 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.345+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099004f2a0 con 0x7f09900ff3c0 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.346+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0980015400 con 0x7f09900ff3c0 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.346+0000 7f098cff9700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 0x7f097806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.346+0000 7f098effd700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 0x7f097806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.346+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f098008af90 con 0x7f09900ff3c0 2024-04-15T20:58:52.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.347+0000 7f098effd700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 0x7f097806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09901974a0 tx=0x7f098401a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:52.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.351+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f098004f720 con 0x7f09900ff3c0 2024-04-15T20:58:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.545+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09901971e0 con 0x7f09900ff3c0 2024-04-15T20:58:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.545+0000 7f098cff9700 1 -- 172.21.15.72:0/1944961738 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0980055a60 con 0x7f09900ff3c0 2024-04-15T20:58:52.538 INFO:teuthology.orchestra.run.smithi072.stdout:60129542176 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 msgr2=0x7f097806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 0x7f097806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09901974a0 tx=0x7f098401a040 comp rx=0 tx=0).stop 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 msgr2=0x7f0990195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09800060b0 tx=0x7f098000d3b0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 shutdown_connections 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f097806c680 0x7f097806eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09900ff3c0 0x7f0990195e80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 --2- 172.21.15.72:0/1944961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09900ffd60 0x7f09901963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 >> 172.21.15.72:0/1944961738 conn(0x7f09900fac80 msgr2=0x7f0990068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 shutdown_connections 2024-04-15T20:58:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:52.547+0000 7f0995a82700 1 -- 172.21.15.72:0/1944961738 wait complete. 2024-04-15T20:58:52.704 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:52 smithi072 ceph-mon[29079]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:52.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:52 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1944961738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-15T20:58:52.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:52 smithi149 ceph-mon[36029]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:52.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:52 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1944961738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-15T20:58:53.082 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-04-15T20:58:53.083 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:53.264 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:54.075 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-04-15T20:58:54.076 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:55.310 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:55 smithi072 ceph-mon[29079]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:55.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.621+0000 7f968574c700 1 -- 172.21.15.72:0/3028383752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 msgr2=0x7f96800ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.621+0000 7f968574c700 1 --2- 172.21.15.72:0/3028383752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f96800ff790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9670009910 tx=0x7f9670009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 -- 172.21.15.72:0/3028383752 shutdown_connections 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 --2- 172.21.15.72:0/3028383752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f9680103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 --2- 172.21.15.72:0/3028383752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f96800ff790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 -- 172.21.15.72:0/3028383752 >> 172.21.15.72:0/3028383752 conn(0x7f96800fac60 msgr2=0x7f96800fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 -- 172.21.15.72:0/3028383752 shutdown_connections 2024-04-15T20:58:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 -- 172.21.15.72:0/3028383752 wait complete. 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 Processor -- start 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.622+0000 7f968574c700 1 -- start start 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f968574c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f968574c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f96801963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f968574c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680196a80 con 0x7f96800ff3c0 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f968574c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968019a810 con 0x7f96800ffd60 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53434/0 (socket says 172.21.15.72:53434) 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 -- 172.21.15.72:0/2394018843 learned_addr learned my addr 172.21.15.72:0/2394018843 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 -- 172.21.15.72:0/2394018843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 msgr2=0x7f96801963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967e7fc700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f96801963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f96801963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 -- 172.21.15.72:0/2394018843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700095f0 con 0x7f96800ff3c0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967e7fc700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f96801963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f967effd700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9670006010 tx=0x7f967000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967001d070 con 0x7f96800ff3c0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f967000f460 con 0x7f96800ff3c0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9670021640 con 0x7f96800ff3c0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.623+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968019aa90 con 0x7f96800ff3c0 2024-04-15T20:58:55.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.624+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968019af80 con 0x7f96800ff3c0 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.625+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96801086e0 con 0x7f96800ff3c0 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.625+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f967000faf0 con 0x7f96800ff3c0 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.625+0000 7f9667fff700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 0x7f966806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.626+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f967008c810 con 0x7f96800ff3c0 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.626+0000 7f967e7fc700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 0x7f966806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.626+0000 7f967e7fc700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 0x7f966806eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9674005fd0 tx=0x7f9674005dc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.630+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9670057230 con 0x7f96800ff3c0 2024-04-15T20:58:55.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:55 smithi149 ceph-mon[36029]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 -- 172.21.15.72:0/3890388228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 msgr2=0x7f075810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 --2- 172.21.15.72:0/3890388228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f075810a6d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f074c009910 tx=0x7f074c009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 -- 172.21.15.72:0/3890388228 shutdown_connections 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 --2- 172.21.15.72:0/3890388228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f075810a6d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 --2- 172.21.15.72:0/3890388228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 0x7f07580ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 -- 172.21.15.72:0/3890388228 >> 172.21.15.72:0/3890388228 conn(0x7f07580748b0 msgr2=0x7f0758074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 -- 172.21.15.72:0/3890388228 shutdown_connections 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.510+0000 7f075ddfa700 1 -- 172.21.15.72:0/3890388228 wait complete. 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 Processor -- start 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 -- start start 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 0x7f0758195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758196b40 con 0x7f07580ffc60 2024-04-15T20:58:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f075ddfa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075819a8d0 con 0x7f07580ff350 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53420/0 (socket says 172.21.15.72:53420) 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f0756ffd700 1 -- 172.21.15.72:0/2512654329 learned_addr learned my addr 172.21.15.72:0/2512654329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.511+0000 7f07577fe700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 0x7f0758195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0756ffd700 1 -- 172.21.15.72:0/2512654329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 msgr2=0x7f0758195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0756ffd700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 0x7f0758195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0756ffd700 1 -- 172.21.15.72:0/2512654329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0095f0 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0756ffd700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f074c0092e0 tx=0x7f074c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c01d070 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f074c005e00 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075819ab50 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c017400 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.512+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075819b040 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.513+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758107dd0 con 0x7f07580ffc60 2024-04-15T20:58:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.513+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f074c00f460 con 0x7f07580ffc60 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.514+0000 7f0754ff9700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 0x7f074006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.514+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f074c08ca50 con 0x7f07580ffc60 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.514+0000 7f07577fe700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 0x7f074006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.514+0000 7f07577fe700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 0x7f074006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f075806a640 tx=0x7f074800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.518+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f074c057470 con 0x7f07580ffc60 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stdout:167503724554 2024-04-15T20:58:55.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.731+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f07581077b0 con 0x7f07580ffc60 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.731+0000 7f0754ff9700 1 -- 172.21.15.72:0/2512654329 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f074c05aa90 con 0x7f07580ffc60 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 msgr2=0x7f074006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 0x7f074006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f075806a640 tx=0x7f074800b410 comp rx=0 tx=0).stop 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 msgr2=0x7f0758196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f074c0092e0 tx=0x7f074c00bd70 comp rx=0 tx=0).stop 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 shutdown_connections 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f074006c680 0x7f074006eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07580ff350 0x7f0758195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 --2- 172.21.15.72:0/2512654329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07580ffc60 0x7f0758196460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.733+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 >> 172.21.15.72:0/2512654329 conn(0x7f07580748b0 msgr2=0x7f0758104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.734+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 shutdown_connections 2024-04-15T20:58:55.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.734+0000 7f075ddfa700 1 -- 172.21.15.72:0/2512654329 wait complete. 2024-04-15T20:58:55.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.834+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f968004f2a0 con 0x7f96800ff3c0 2024-04-15T20:58:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.835+0000 7f9667fff700 1 -- 172.21.15.72:0/2394018843 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9670026090 con 0x7f96800ff3c0 2024-04-15T20:58:55.828 INFO:teuthology.orchestra.run.smithi072.stdout:146028888080 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 msgr2=0x7f966806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 0x7f966806eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9674005fd0 tx=0x7f9674005dc0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 msgr2=0x7f9680195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9670006010 tx=0x7f967000be20 comp rx=0 tx=0).stop 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 shutdown_connections 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f966806c680 0x7f966806eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96800ff3c0 0x7f9680195e60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 --2- 172.21.15.72:0/2394018843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96800ffd60 0x7f96801963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 >> 172.21.15.72:0/2394018843 conn(0x7f96800fac60 msgr2=0x7f9680069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 shutdown_connections 2024-04-15T20:58:55.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:55.837+0000 7f968574c700 1 -- 172.21.15.72:0/2394018843 wait complete. 2024-04-15T20:58:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:56 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2512654329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-15T20:58:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:56 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2394018843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-15T20:58:56.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:56 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2512654329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-15T20:58:56.546 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:56 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2394018843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-15T20:58:56.570 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888080 for osd.4 2024-04-15T20:58:56.570 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:57.022 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724551 got 167503724554 for osd.5 2024-04-15T20:58:57.022 DEBUG:teuthology.parallel:result is None 2024-04-15T20:58:57.022 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-15T20:58:57.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph pg dump --format=json 2024-04-15T20:58:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:57.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:57 smithi072 ceph-mon[29079]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:57.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:57 smithi149 ceph-mon[36029]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:58.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.841+0000 7f880645d700 1 -- 172.21.15.72:0/772201158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 msgr2=0x7f88001008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:58.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.841+0000 7f880645d700 1 --2- 172.21.15.72:0/772201158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f88001008b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009910 tx=0x7f87f0009c20 comp rx=0 tx=0).stop 2024-04-15T20:58:58.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 -- 172.21.15.72:0/772201158 shutdown_connections 2024-04-15T20:58:58.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 --2- 172.21.15.72:0/772201158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f8800104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 --2- 172.21.15.72:0/772201158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f88001008b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 -- 172.21.15.72:0/772201158 >> 172.21.15.72:0/772201158 conn(0x7f88000fbda0 msgr2=0x7f88000fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 -- 172.21.15.72:0/772201158 shutdown_connections 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 -- 172.21.15.72:0/772201158 wait complete. 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 Processor -- start 2024-04-15T20:58:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.842+0000 7f880645d700 1 -- start start 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f88001964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8800196b90 con 0x7f88001004e0 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880019a920 con 0x7f8800100e80 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53458/0 (socket says 172.21.15.72:53458) 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 -- 172.21.15.72:0/2746110009 learned_addr learned my addr 172.21.15.72:0/2746110009 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:58:58.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87ff7fe700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f88001964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 -- 172.21.15.72:0/2746110009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 msgr2=0x7f88001964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f88001964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 -- 172.21.15.72:0/2746110009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00095f0 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87ff7fe700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f88001964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fffff700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87f0006010 tx=0x7f87f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f001d070 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87f000f460 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880019aba0 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f0021640 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.843+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880019b090 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.844+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88001087f0 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.845+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f87f000faf0 con 0x7f88001004e0 2024-04-15T20:58:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.845+0000 7f87fd7fa700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 0x7f87e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:58:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.845+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f87f008c7f0 con 0x7f88001004e0 2024-04-15T20:58:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.845+0000 7f87ff7fe700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 0x7f87e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:58:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.846+0000 7f87ff7fe700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 0x7f87e806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8800197590 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:58:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:58.850+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f87f0057290 con 0x7f88001004e0 2024-04-15T20:58:59.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.036+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f880019b3c0 con 0x7f87e806c680 2024-04-15T20:58:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.037+0000 7f87fd7fa700 1 -- 172.21.15.72:0/2746110009 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28008 (secure 0 0 0) 0x7f880019b3c0 con 0x7f87e806c680 2024-04-15T20:58:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:58:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 msgr2=0x7f87e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 0x7f87e806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8800197590 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2024-04-15T20:58:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 msgr2=0x7f8800195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:58:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87f0006010 tx=0x7f87f000be20 comp rx=0 tx=0).stop 2024-04-15T20:58:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 shutdown_connections 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f87e806c680 0x7f87e806eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88001004e0 0x7f8800195f70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 --2- 172.21.15.72:0/2746110009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8800100e80 0x7f88001964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 >> 172.21.15.72:0/2746110009 conn(0x7f88000fbda0 msgr2=0x7f88000fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 shutdown_connections 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:58:59.039+0000 7f880645d700 1 -- 172.21.15.72:0/2746110009 wait complete. 2024-04-15T20:58:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-15T20:58:59.701 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:58:59 smithi072 ceph-mon[29079]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:58:59.724 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-15T20:58:58.203669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165584,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305328,"statfs":{"total":575970213888,"available":575800655872,"internally_reserved":0,"allocated":3964928,"data_stored":2606569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002216"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-15T20:58:10.501220+0000","last_change":"2024-04-15T20:57:44.617973+0000","last_active":"2024-04-15T20:58:10.501220+0000","last_peered":"2024-04-15T20:58:10.501220+0000","last_clean":"2024-04-15T20:58:10.501220+0000","last_became_active":"2024-04-15T20:57:44.617690+0000","last_became_peered":"2024-04-15T20:57:44.617690+0000","last_unstale":"2024-04-15T20:58:10.501220+0000","last_undegraded":"2024-04-15T20:58:10.501220+0000","last_fullsized":"2024-04-15T20:58:10.501220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T20:56:58.496549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T20:56:58.496549+0000","last_clean_scrub_stamp":"2024-04-15T20:56:58.496549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:19:59.624978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.434}]},{"osd":2,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.32500000000000001}]},{"osd":3,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.248}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":729378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.438}]},{"osd":1,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Apr 15 20:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.31}]},{"osd":1,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Apr 15 20:58:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 15 20:58:27 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.28999999999999998},"min":{"1min":0.25600000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.313,"15min":0.30299999999999999},"min":{"1min":0.28699999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Apr 15 20:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Apr 15 20:58:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:28 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.307,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.497}]},{"osd":3,"last update":"Mon Apr 15 20:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.873},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.88600000000000001}]},{"osd":4,"last update":"Mon Apr 15 20:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T20:58:59.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph pg dump --format=json 2024-04-15T20:58:59.935 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:58:59.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:58:59 smithi149 ceph-mon[36029]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:00.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:00 smithi072 ceph-mon[29079]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-15T20:59:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:00 smithi149 ceph-mon[36029]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-15T20:59:01.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 -- 172.21.15.72:0/1186665257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 msgr2=0x7f1a9c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/1186665257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c1008b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009910 tx=0x7f1a8c009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 -- 172.21.15.72:0/1186665257 shutdown_connections 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/1186665257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 0x7f1a9c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/1186665257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c1008b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 -- 172.21.15.72:0/1186665257 >> 172.21.15.72:0/1186665257 conn(0x7f1a9c0fbda0 msgr2=0x7f1a9c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 -- 172.21.15.72:0/1186665257 shutdown_connections 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 -- 172.21.15.72:0/1186665257 wait complete. 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.509+0000 7f1aa15cd700 1 Processor -- start 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 -- start start 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 0x7f1a9c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c196b30 con 0x7f1a9c1004e0 2024-04-15T20:59:01.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c19a8c0 con 0x7f1a9c100e80 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53466/0 (socket says 172.21.15.72:53466) 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 -- 172.21.15.72:0/2833615360 learned_addr learned my addr 172.21.15.72:0/2833615360 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9a7fc700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 0x7f1a9c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 -- 172.21.15.72:0/2833615360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 msgr2=0x7f1a9c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 0x7f1a9c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 -- 172.21.15.72:0/2833615360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0095f0 con 0x7f1a9c1004e0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a9affd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c006010 tx=0x7f1a8c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8c01d070 con 0x7f1a9c1004e0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.510+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c19ab40 con 0x7f1a9c1004e0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.511+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a8c004f50 con 0x7f1a9c1004e0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.511+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8c021640 con 0x7f1a9c1004e0 2024-04-15T20:59:01.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.511+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c19b030 con 0x7f1a9c1004e0 2024-04-15T20:59:01.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.511+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c1087f0 con 0x7f1a9c1004e0 2024-04-15T20:59:01.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.512+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1a8c00f460 con 0x7f1a9c1004e0 2024-04-15T20:59:01.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.512+0000 7f1a83fff700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 0x7f1a8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:01.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.513+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1a8c08c770 con 0x7f1a9c1004e0 2024-04-15T20:59:01.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.513+0000 7f1a9a7fc700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 0x7f1a8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:01.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.513+0000 7f1a9a7fc700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 0x7f1a8406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005950 tx=0x7f1a900058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:01.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.517+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1a8c057190 con 0x7f1a9c1004e0 2024-04-15T20:59:01.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:01 smithi072 ceph-mon[29079]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.702+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a9c19b310 con 0x7f1a8406c680 2024-04-15T20:59:01.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.704+0000 7f1a83fff700 1 -- 172.21.15.72:0/2833615360 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28022 (secure 0 0 0) 0x7f1a9c19b310 con 0x7f1a8406c680 2024-04-15T20:59:01.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 msgr2=0x7f1a8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 0x7f1a8406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005950 tx=0x7f1a900058e0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 msgr2=0x7f1a9c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c006010 tx=0x7f1a8c00be20 comp rx=0 tx=0).stop 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 shutdown_connections 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f1a8406c680 0x7f1a8406eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a9c1004e0 0x7f1a9c195f10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 --2- 172.21.15.72:0/2833615360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a9c100e80 0x7f1a9c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 >> 172.21.15.72:0/2833615360 conn(0x7f1a9c0fbda0 msgr2=0x7f1a9c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 shutdown_connections 2024-04-15T20:59:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:01.706+0000 7f1aa15cd700 1 -- 172.21.15.72:0/2833615360 wait complete. 2024-04-15T20:59:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-04-15T20:59:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:01 smithi149 ceph-mon[36029]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:02.363 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-15T20:59:00.203999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165584,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305328,"statfs":{"total":575970213888,"available":575800655872,"internally_reserved":0,"allocated":3964928,"data_stored":2606569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002108"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-15T20:58:10.501220+0000","last_change":"2024-04-15T20:57:44.617973+0000","last_active":"2024-04-15T20:58:10.501220+0000","last_peered":"2024-04-15T20:58:10.501220+0000","last_clean":"2024-04-15T20:58:10.501220+0000","last_became_active":"2024-04-15T20:57:44.617690+0000","last_became_peered":"2024-04-15T20:57:44.617690+0000","last_unstale":"2024-04-15T20:58:10.501220+0000","last_undegraded":"2024-04-15T20:58:10.501220+0000","last_fullsized":"2024-04-15T20:58:10.501220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T20:56:58.496549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T20:56:58.496549+0000","last_clean_scrub_stamp":"2024-04-15T20:56:58.496549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:19:59.624978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.53100000000000003}]},{"osd":3,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.441},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":729378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.438}]},{"osd":1,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Apr 15 20:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Apr 15 20:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.31}]},{"osd":1,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Apr 15 20:58:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 15 20:58:27 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.28999999999999998},"min":{"1min":0.25600000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.313,"15min":0.30299999999999999},"min":{"1min":0.28699999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Apr 15 20:58:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Apr 15 20:58:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Mon Apr 15 20:58:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 15 20:58:28 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.307,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Apr 15 20:57:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.497}]},{"osd":3,"last update":"Mon Apr 15 20:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.873},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.88600000000000001}]},{"osd":4,"last update":"Mon Apr 15 20:58:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T20:59:02.364 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-15T20:59:02.364 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T20:59:02.364 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-15T20:59:02.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph health --format=json 2024-04-15T20:59:02.575 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:03.799 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:03 smithi072 ceph-mon[29079]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-15T20:59:03.799 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:03 smithi072 ceph-mon[29079]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:03 smithi149 ceph-mon[36029]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-15T20:59:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:03 smithi149 ceph-mon[36029]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 -- 172.21.15.72:0/1781685631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100460 msgr2=0x7ff04c100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 --2- 172.21.15.72:0/1781685631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100460 0x7ff04c100830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009940 tx=0x7ff03c009c50 comp rx=0 tx=0).stop 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 -- 172.21.15.72:0/1781685631 shutdown_connections 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 --2- 172.21.15.72:0/1781685631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100d70 0x7ff04c1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 --2- 172.21.15.72:0/1781685631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100460 0x7ff04c100830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 -- 172.21.15.72:0/1781685631 >> 172.21.15.72:0/1781685631 conn(0x7ff04c0748b0 msgr2=0x7ff04c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 -- 172.21.15.72:0/1781685631 shutdown_connections 2024-04-15T20:59:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 -- 172.21.15.72:0/1781685631 wait complete. 2024-04-15T20:59:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.188+0000 7ff0514ca700 1 Processor -- start 2024-04-15T20:59:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0514ca700 1 -- start start 2024-04-15T20:59:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0514ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100460 0x7ff04c195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0514ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0514ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1968d0 con 0x7ff04c100d70 2024-04-15T20:59:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0514ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c196a10 con 0x7ff04c100460 2024-04-15T20:59:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47250/0 (socket says 172.21.15.72:47250) 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 -- 172.21.15.72:0/3378676760 learned_addr learned my addr 172.21.15.72:0/3378676760 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff04affd700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100460 0x7ff04c195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 -- 172.21.15.72:0/3378676760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100460 msgr2=0x7ff04c195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100460 0x7ff04c195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 -- 172.21.15.72:0/3378676760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c0095f0 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff0427fc700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c930 tx=0x7ff03400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.189+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff034007ad0 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.190+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c19a860 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.190+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff03400ce80 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.190+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff034018630 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.190+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c19adb0 con 0x7ff04c100d70 2024-04-15T20:59:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.191+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c107e40 con 0x7ff04c100d70 2024-04-15T20:59:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.191+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff034007c30 con 0x7ff04c100d70 2024-04-15T20:59:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.192+0000 7ff048ff9700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 0x7ff03806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.192+0000 7ff04affd700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 0x7ff03806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.192+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff03408b540 con 0x7ff04c100d70 2024-04-15T20:59:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.192+0000 7ff04affd700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 0x7ff03806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006010 tx=0x7ff03c00b9a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.196+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff034055f60 con 0x7ff04c100d70 2024-04-15T20:59:04.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.429+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff04c04f2a0 con 0x7ff04c100d70 2024-04-15T20:59:04.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.429+0000 7ff048ff9700 1 -- 172.21.15.72:0/3378676760 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff034059580 con 0x7ff04c100d70 2024-04-15T20:59:04.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:04.423 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 msgr2=0x7ff03806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 0x7ff03806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006010 tx=0x7ff03c00b9a0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 msgr2=0x7ff04c196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff03400c930 tx=0x7ff03400cc40 comp rx=0 tx=0).stop 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 shutdown_connections 2024-04-15T20:59:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7ff03806c680 0x7ff03806eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff04c100460 0x7ff04c195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 --2- 172.21.15.72:0/3378676760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c100d70 0x7ff04c196280 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.431+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 >> 172.21.15.72:0/3378676760 conn(0x7ff04c0748b0 msgr2=0x7ff04c0ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.432+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 shutdown_connections 2024-04-15T20:59:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:04.432+0000 7ff0514ca700 1 -- 172.21.15.72:0/3378676760 wait complete. 2024-04-15T20:59:04.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:04.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:04 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3378676760' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-15T20:59:04.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:04.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:04 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3378676760' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-15T20:59:05.154 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-15T20:59:05.155 INFO:tasks.cephadm:Setup complete, yielding 2024-04-15T20:59:05.155 INFO:teuthology.run_tasks:Running task print... 2024-04-15T20:59:05.167 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-04-15T20:59:05.168 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:05.200 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:05.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-15T20:59:05.412 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:05.837 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:05 smithi072 ceph-mon[29079]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:05 smithi149 ceph-mon[36029]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:07.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 -- 172.21.15.72:0/1756568078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 msgr2=0x7f20d80fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:07.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/1756568078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d80fecd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009910 tx=0x7f20d4009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:07.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 -- 172.21.15.72:0/1756568078 shutdown_connections 2024-04-15T20:59:07.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/1756568078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 0x7f20d80fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/1756568078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d80fecd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 -- 172.21.15.72:0/1756568078 >> 172.21.15.72:0/1756568078 conn(0x7f20d80f9f10 msgr2=0x7f20d80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 -- 172.21.15.72:0/1756568078 shutdown_connections 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.085+0000 7f20dfb2f700 1 -- 172.21.15.72:0/1756568078 wait complete. 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 Processor -- start 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 -- start start 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 0x7f20d8100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8101480 con 0x7f20d80fe8c0 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81015c0 con 0x7f20d80ffb60 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47280/0 (socket says 172.21.15.72:47280) 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 -- 172.21.15.72:0/50443569 learned_addr learned my addr 172.21.15.72:0/50443569 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd0ca700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 0x7f20d8100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:07.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 -- 172.21.15.72:0/50443569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 msgr2=0x7f20d8100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 0x7f20d8100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 -- 172.21.15.72:0/50443569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d40095f0 con 0x7f20d80fe8c0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dd8cb700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bd70 tx=0x7f20d400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d401d070 con 0x7f20d80fe8c0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20d4022470 con 0x7f20d80fe8c0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.086+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d8101840 con 0x7f20d80fe8c0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.087+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d400f670 con 0x7f20d80fe8c0 2024-04-15T20:59:07.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.087+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d8101d30 con 0x7f20d80fe8c0 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.087+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8106b00 con 0x7f20d80fe8c0 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.088+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f20d4022a50 con 0x7f20d80fe8c0 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.088+0000 7f20ceffd700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 0x7f20c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.089+0000 7f20dd0ca700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 0x7f20c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.089+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f20d408cb90 con 0x7f20d80fe8c0 2024-04-15T20:59:07.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.089+0000 7f20dd0ca700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 0x7f20c406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20c8005ea0 tx=0x7f20c8005e30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:07.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.093+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f20d405b0f0 con 0x7f20d80fe8c0 2024-04-15T20:59:07.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.282+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f20d8106cf0 con 0x7f20d80fe8c0 2024-04-15T20:59:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.287+0000 7f20ceffd700 1 -- 172.21.15.72:0/50443569 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f20d405ac80 con 0x7f20d80fe8c0 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 msgr2=0x7f20c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 0x7f20c406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20c8005ea0 tx=0x7f20c8005e30 comp rx=0 tx=0).stop 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 msgr2=0x7f20d81028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bd70 tx=0x7f20d400be50 comp rx=0 tx=0).stop 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 shutdown_connections 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f20c406c680 0x7f20c406eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d80fe8c0 0x7f20d81028f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 --2- 172.21.15.72:0/50443569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20d80ffb60 0x7f20d8100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:07.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 >> 172.21.15.72:0/50443569 conn(0x7f20d80f9f10 msgr2=0x7f20d80fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 shutdown_connections 2024-04-15T20:59:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:07.289+0000 7f20dfb2f700 1 -- 172.21.15.72:0/50443569 wait complete. 2024-04-15T20:59:07.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:07.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/50443569' entity='client.admin' 2024-04-15T20:59:07.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:07.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:07.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:07.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:07.934 INFO:teuthology.run_tasks:Running task print... 2024-04-15T20:59:07.944 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-15T20:59:07.944 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:07.978 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:07.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph orch status' 2024-04-15T20:59:07.979 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:07.979 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/50443569' entity='client.admin' 2024-04-15T20:59:07.980 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:07.980 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:07.980 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:07.980 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:08.188 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:09.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:09 smithi072 ceph-mon[29079]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- 172.21.15.72:0/3597445782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 msgr2=0x7efd50101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 --2- 172.21.15.72:0/3597445782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50101890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd40009910 tx=0x7efd40009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- 172.21.15.72:0/3597445782 shutdown_connections 2024-04-15T20:59:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 --2- 172.21.15.72:0/3597445782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50101890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 --2- 172.21.15.72:0/3597445782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 0x7efd50100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- 172.21.15.72:0/3597445782 >> 172.21.15.72:0/3597445782 conn(0x7efd500fb7f0 msgr2=0x7efd500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- 172.21.15.72:0/3597445782 shutdown_connections 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- 172.21.15.72:0/3597445782 wait complete. 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 Processor -- start 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.826+0000 7efd58032700 1 -- start start 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 0x7efd50195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501965f0 con 0x7efd50101440 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50196730 con 0x7efd50100240 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47296/0 (socket says 172.21.15.72:47296) 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 -- 172.21.15.72:0/3766821319 learned_addr learned my addr 172.21.15.72:0/3766821319 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd55dce700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 0x7efd50195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 -- 172.21.15.72:0/3766821319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 msgr2=0x7efd50195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 0x7efd50195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 -- 172.21.15.72:0/3766821319 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400095f0 con 0x7efd50101440 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd555cd700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd40006010 tx=0x7efd4000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4001d070 con 0x7efd50101440 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd4000f460 con 0x7efd50101440 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5019b180 con 0x7efd50101440 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd40021640 con 0x7efd50101440 2024-04-15T20:59:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.827+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5019b670 con 0x7efd50101440 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.828+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50108d90 con 0x7efd50101440 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.829+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd4000fab0 con 0x7efd50101440 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.829+0000 7efd46ffd700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 0x7efd3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.830+0000 7efd55dce700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 0x7efd3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.830+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efd4008c690 con 0x7efd50101440 2024-04-15T20:59:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.830+0000 7efd55dce700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 0x7efd3c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd501012a0 tx=0x7efd4c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:09.834+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd4005abc0 con 0x7efd50101440 2024-04-15T20:59:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:09 smithi149 ceph-mon[36029]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:10.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.039+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd50105d90 con 0x7efd3c06c680 2024-04-15T20:59:10.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.040+0000 7efd46ffd700 1 -- 172.21.15.72:0/3766821319 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7efd50105d90 con 0x7efd3c06c680 2024-04-15T20:59:10.034 INFO:teuthology.orchestra.run.smithi072.stdout:Backend: cephadm 2024-04-15T20:59:10.034 INFO:teuthology.orchestra.run.smithi072.stdout:Available: Yes 2024-04-15T20:59:10.034 INFO:teuthology.orchestra.run.smithi072.stdout:Paused: No 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 msgr2=0x7efd3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 0x7efd3c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd501012a0 tx=0x7efd4c00b410 comp rx=0 tx=0).stop 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 msgr2=0x7efd50195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd40006010 tx=0x7efd4000bd70 comp rx=0 tx=0).stop 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 shutdown_connections 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.042+0000 7efd58032700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd3c06c680 0x7efd3c06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.043+0000 7efd58032700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd50100240 0x7efd50195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.043+0000 7efd58032700 1 --2- 172.21.15.72:0/3766821319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd50101440 0x7efd50195fd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.043+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 >> 172.21.15.72:0/3766821319 conn(0x7efd500fb7f0 msgr2=0x7efd50104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.043+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 shutdown_connections 2024-04-15T20:59:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:10.043+0000 7efd58032700 1 -- 172.21.15.72:0/3766821319 wait complete. 2024-04-15T20:59:10.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-15T20:59:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:11.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:11 smithi072 ceph-mon[29079]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:11.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:11 smithi072 ceph-mon[29079]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:11.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:11 smithi149 ceph-mon[36029]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:11.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:11 smithi149 ceph-mon[36029]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 -- 172.21.15.72:0/1388089708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 msgr2=0x7f0d80103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1388089708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80103140 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009910 tx=0x7f0d70009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 -- 172.21.15.72:0/1388089708 shutdown_connections 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1388089708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 0x7f0d80105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1388089708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80103140 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 -- 172.21.15.72:0/1388089708 >> 172.21.15.72:0/1388089708 conn(0x7f0d800fa780 msgr2=0x7f0d800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 -- 172.21.15.72:0/1388089708 shutdown_connections 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 -- 172.21.15.72:0/1388089708 wait complete. 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.466+0000 7f0d84f29700 1 Processor -- start 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 -- start start 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 0x7f0d80196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80196690 con 0x7f0d80100d60 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801967d0 con 0x7f0d80103680 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52250/0 (socket says 172.21.15.72:52250) 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 -- 172.21.15.72:0/1154785608 learned_addr learned my addr 172.21.15.72:0/1154785608 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 -- 172.21.15.72:0/1154785608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 msgr2=0x7f0d80196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:12.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d75d9b700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 0x7f0d80196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:12.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 0x7f0d80196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 -- 172.21.15.72:0/1154785608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700095f0 con 0x7f0d80100d60 2024-04-15T20:59:12.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d7e59c700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000bda0 tx=0x7f0d7000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7001d070 con 0x7f0d80100d60 2024-04-15T20:59:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8019b220 con 0x7f0d80100d60 2024-04-15T20:59:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.467+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d70004c50 con 0x7f0d80100d60 2024-04-15T20:59:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.468+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7000f690 con 0x7f0d80100d60 2024-04-15T20:59:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.468+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8019b710 con 0x7f0d80100d60 2024-04-15T20:59:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.469+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8018fc40 con 0x7f0d80100d60 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.469+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0d700229b0 con 0x7f0d80100d60 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.469+0000 7f0d77fff700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.470+0000 7f0d75d9b700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.470+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0d7008cc30 con 0x7f0d80100d60 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.470+0000 7f0d75d9b700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 0x7f0d6c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006fd0 tx=0x7f0d68008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.474+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0d7005b190 con 0x7f0d80100d60 2024-04-15T20:59:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.674+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d80061190 con 0x7f0d6c06c680 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.683+0000 7f0d77fff700 1 -- 172.21.15.72:0/1154785608 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f0d80061190 con 0x7f0d6c06c680 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (3m) 2m ago 5m 26.3M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (5m) 2m ago 5m 7042k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (4m) 63s ago 4m 6933k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (5m) 2m ago 5m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T20:59:12.677 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (4m) 63s ago 4m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (3m) 2m ago 5m 78.3M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (6m) 2m ago 6m 478M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (4m) 63s ago 4m 437M - 18.2.0 dc2bc1663786 a2048a211a48 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (6m) 2m ago 7m 46.7M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (4m) 63s ago 4m 40.5M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (4m) 63s ago 4m 16.8M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (3m) 2m ago 3m 43.9M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (2m) 2m ago 2m 39.5M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (2m) 2m ago 2m 41.5M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T20:59:12.678 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (2m) 63s ago 2m 44.3M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T20:59:12.679 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (95s) 63s ago 94s 41.3M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T20:59:12.679 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (69s) 63s ago 68s 11.0M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T20:59:12.679 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 2m ago 4m 41.3M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T20:59:12.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 msgr2=0x7f0d6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:12.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 0x7f0d6c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006fd0 tx=0x7f0d68008040 comp rx=0 tx=0).stop 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 msgr2=0x7f0d80195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000bda0 tx=0x7f0d7000be80 comp rx=0 tx=0).stop 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 shutdown_connections 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d80100d60 0x7f0d80195b30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 --2- 172.21.15.72:0/1154785608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d80103680 0x7f0d80196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 >> 172.21.15.72:0/1154785608 conn(0x7f0d800fa780 msgr2=0x7f0d800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 shutdown_connections 2024-04-15T20:59:12.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:12.685+0000 7f0d84f29700 1 -- 172.21.15.72:0/1154785608 wait complete. 2024-04-15T20:59:13.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-15T20:59:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:13.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:13 smithi072 ceph-mon[29079]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:13.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:13 smithi149 ceph-mon[36029]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:14.624 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:14 smithi072 ceph-mon[29079]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:14 smithi149 ceph-mon[36029]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 -- 172.21.15.72:0/4087605654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 msgr2=0x7f2cd4101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 --2- 172.21.15.72:0/4087605654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4101580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009910 tx=0x7f2cc8009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 -- 172.21.15.72:0/4087605654 shutdown_connections 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 --2- 172.21.15.72:0/4087605654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4101580 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 --2- 172.21.15.72:0/4087605654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd40fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.164+0000 7f2cd904c700 1 -- 172.21.15.72:0/4087605654 >> 172.21.15.72:0/4087605654 conn(0x7f2cd40f9f10 msgr2=0x7f2cd40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.165+0000 7f2cd904c700 1 -- 172.21.15.72:0/4087605654 shutdown_connections 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.165+0000 7f2cd904c700 1 -- 172.21.15.72:0/4087605654 wait complete. 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.165+0000 7f2cd904c700 1 Processor -- start 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 -- start start 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41965e0 con 0x7f2cd40fee50 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4196720 con 0x7f2cd40fe500 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52264/0 (socket says 172.21.15.72:52264) 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 -- 172.21.15.72:0/1901061975 learned_addr learned my addr 172.21.15.72:0/1901061975 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd2d9d700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 -- 172.21.15.72:0/1901061975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 msgr2=0x7f2cd4195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd4195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 -- 172.21.15.72:0/1901061975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80095f0 con 0x7f2cd40fee50 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd2d9d700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd259c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005850 tx=0x7f2cc800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc801d070 con 0x7f2cd40fee50 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2cc8004bb0 con 0x7f2cd40fee50 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc80176c0 con 0x7f2cd40fee50 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.166+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd419b180 con 0x7f2cd40fee50 2024-04-15T20:59:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.167+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd419b640 con 0x7f2cd40fee50 2024-04-15T20:59:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.168+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4108d10 con 0x7f2cd40fee50 2024-04-15T20:59:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.168+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2cc8004d20 con 0x7f2cd40fee50 2024-04-15T20:59:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.169+0000 7f2cbbfff700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 0x7f2cbc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.169+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2cc808cb40 con 0x7f2cd40fee50 2024-04-15T20:59:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.169+0000 7f2cd2d9d700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 0x7f2cbc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.169+0000 7f2cd2d9d700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 0x7f2cbc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005fd0 tx=0x7f2cc4005e30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.173+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2cc805aff0 con 0x7f2cd40fee50 2024-04-15T20:59:15.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.369+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd4105ed0 con 0x7f2cbc06c680 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.373+0000 7f2cbbfff700 1 -- 172.21.15.72:0/1901061975 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f2cd4105ed0 con 0x7f2cbc06c680 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter 2/2 2m ago 6m * 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:crash 2/2 2m ago 6m * 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:mgr 2/2 2m ago 6m count:2 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:mon 2/2 2m ago 5m smithi072:172.21.15.72=smithi072;smithi149:172.21.15.149=smithi149;count:2 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-04-15T20:59:15.366 INFO:teuthology.orchestra.run.smithi072.stdout:osd 6 2m ago - 2024-04-15T20:59:15.367 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 msgr2=0x7f2cbc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 0x7f2cbc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005fd0 tx=0x7f2cc4005e30 comp rx=0 tx=0).stop 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 msgr2=0x7f2cd4196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005850 tx=0x7f2cc800be20 comp rx=0 tx=0).stop 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 shutdown_connections 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f2cbc06c680 0x7f2cbc06eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2cd40fe500 0x7f2cd4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 --2- 172.21.15.72:0/1901061975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd40fee50 0x7f2cd4196050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 >> 172.21.15.72:0/1901061975 conn(0x7f2cd40f9f10 msgr2=0x7f2cd41047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 shutdown_connections 2024-04-15T20:59:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:15.375+0000 7f2cd904c700 1 -- 172.21.15.72:0/1901061975 wait complete. 2024-04-15T20:59:15.657 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:15 smithi072 ceph-mon[29079]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:15.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:15 smithi149 ceph-mon[36029]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:16.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-15T20:59:16.258 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:16.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:16 smithi072 ceph-mon[29079]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:16.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:16 smithi149 ceph-mon[36029]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:17.590 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:17 smithi072 ceph-mon[29079]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 -- 172.21.15.72:0/3273691209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 msgr2=0x7fb0f0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 --2- 172.21.15.72:0/3273691209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0100840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009910 tx=0x7fb0ec009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 -- 172.21.15.72:0/3273691209 shutdown_connections 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 --2- 172.21.15.72:0/3273691209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0100840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 --2- 172.21.15.72:0/3273691209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 0x7fb0f00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 -- 172.21.15.72:0/3273691209 >> 172.21.15.72:0/3273691209 conn(0x7fb0f00fa780 msgr2=0x7fb0f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 -- 172.21.15.72:0/3273691209 shutdown_connections 2024-04-15T20:59:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.857+0000 7fb0f7935700 1 -- 172.21.15.72:0/3273691209 wait complete. 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 Processor -- start 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 -- start start 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 0x7fb0f0194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01954c0 con 0x7fb0f01003d0 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f7935700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0195600 con 0x7fb0f00ff130 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52280/0 (socket says 172.21.15.72:52280) 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 -- 172.21.15.72:0/2598156564 learned_addr learned my addr 172.21.15.72:0/2598156564 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f56d1700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 0x7fb0f0194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 -- 172.21.15.72:0/2598156564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 msgr2=0x7fb0f0194960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 0x7fb0f0194960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.858+0000 7fb0f4ed0700 1 -- 172.21.15.72:0/2598156564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0095f0 con 0x7fb0f01003d0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0f4ed0700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec006010 tx=0x7fb0ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ec01d070 con 0x7fb0f01003d0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0ec00f460 con 0x7fb0f01003d0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f019a050 con 0x7fb0f01003d0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ec021640 con 0x7fb0f01003d0 2024-04-15T20:59:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.859+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f019a540 con 0x7fb0f01003d0 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.860+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0107c10 con 0x7fb0f01003d0 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.860+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb0ec00fab0 con 0x7fb0f01003d0 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.861+0000 7fb0e67fc700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 0x7fb0dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.861+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb0ec08c6f0 con 0x7fb0f01003d0 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.861+0000 7fb0f56d1700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 0x7fb0dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.861+0000 7fb0f56d1700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 0x7fb0dc06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005950 tx=0x7fb0e000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:17.865+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb0ec05ac20 con 0x7fb0f01003d0 2024-04-15T20:59:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:17 smithi149 ceph-mon[36029]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.058+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f019abd0 con 0x7fb0dc06c680 2024-04-15T20:59:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.059+0000 7fb0e67fc700 1 -- 172.21.15.72:0/2598156564 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fb0f019abd0 con 0x7fb0dc06c680 2024-04-15T20:59:18.053 INFO:teuthology.orchestra.run.smithi072.stdout:HOST ADDR LABELS STATUS 2024-04-15T20:59:18.053 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 172.21.15.72 2024-04-15T20:59:18.053 INFO:teuthology.orchestra.run.smithi072.stdout:smithi149 172.21.15.149 2024-04-15T20:59:18.054 INFO:teuthology.orchestra.run.smithi072.stdout:2 hosts in cluster 2024-04-15T20:59:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 msgr2=0x7fb0dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 0x7fb0dc06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005950 tx=0x7fb0e000b410 comp rx=0 tx=0).stop 2024-04-15T20:59:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 msgr2=0x7fb0f0194ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec006010 tx=0x7fb0ec00bd70 comp rx=0 tx=0).stop 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 shutdown_connections 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb0dc06c680 0x7fb0dc06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f00ff130 0x7fb0f0194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 --2- 172.21.15.72:0/2598156564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f01003d0 0x7fb0f0194ea0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 >> 172.21.15.72:0/2598156564 conn(0x7fb0f00fa780 msgr2=0x7fb0f0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 shutdown_connections 2024-04-15T20:59:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:18.061+0000 7fb0f7935700 1 -- 172.21.15.72:0/2598156564 wait complete. 2024-04-15T20:59:18.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-15T20:59:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:19 smithi072 ceph-mon[29079]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:19 smithi072 ceph-mon[29079]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:19.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:19 smithi149 ceph-mon[36029]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:19 smithi149 ceph-mon[36029]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 -- 172.21.15.72:0/3296046807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 msgr2=0x7f0e18101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/3296046807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18101890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009910 tx=0x7f0e0c009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 -- 172.21.15.72:0/3296046807 shutdown_connections 2024-04-15T20:59:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/3296046807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18101890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/3296046807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 0x7f0e18100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.564+0000 7f0e1dccb700 1 -- 172.21.15.72:0/3296046807 >> 172.21.15.72:0/3296046807 conn(0x7f0e180fb7f0 msgr2=0x7f0e180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 -- 172.21.15.72:0/3296046807 shutdown_connections 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 -- 172.21.15.72:0/3296046807 wait complete. 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 Processor -- start 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 -- start start 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 0x7f0e18195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18196560 con 0x7f0e18101440 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.565+0000 7f0e1dccb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181966a0 con 0x7f0e18100240 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52298/0 (socket says 172.21.15.72:52298) 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 -- 172.21.15.72:0/1182671251 learned_addr learned my addr 172.21.15.72:0/1182671251 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e177fe700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 0x7f0e18195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 -- 172.21.15.72:0/1182671251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 msgr2=0x7f0e18195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 0x7f0e18195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 -- 172.21.15.72:0/1182671251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0095f0 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e16ffd700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00bd70 tx=0x7f0e0c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0c01d070 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0e0c005940 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0c021430 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1819b100 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.566+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1819b5c0 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.567+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18108d90 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.568+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0e0c00f860 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.568+0000 7f0e14ff9700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.568+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0e0c08c8f0 con 0x7f0e18101440 2024-04-15T20:59:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.568+0000 7f0e177fe700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:20.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.569+0000 7f0e177fe700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 0x7f0e0006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e181012a0 tx=0x7f0e0800a3b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:20.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.573+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0e0c05ada0 con 0x7f0e18101440 2024-04-15T20:59:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.773+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e18105d90 con 0x7f0e0006c680 2024-04-15T20:59:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.775+0000 7f0e14ff9700 1 -- 172.21.15.72:0/1182671251 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f0e18105d90 con 0x7f0e0006c680 2024-04-15T20:59:20.768 INFO:teuthology.orchestra.run.smithi072.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-15T20:59:20.768 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V7400BGN 372G No 2m ago LVM detected, locked 2024-04-15T20:59:20.768 INFO:teuthology.orchestra.run.smithi072.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 68s ago LVM detected, locked 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 msgr2=0x7f0e0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 0x7f0e0006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e181012a0 tx=0x7f0e0800a3b0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 msgr2=0x7f0e18195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00bd70 tx=0x7f0e0c00bda0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 shutdown_connections 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e18100240 0x7f0e18195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 --2- 172.21.15.72:0/1182671251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18101440 0x7f0e18195fd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 >> 172.21.15.72:0/1182671251 conn(0x7f0e180fb7f0 msgr2=0x7f0e18104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 shutdown_connections 2024-04-15T20:59:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:20.777+0000 7f0e1dccb700 1 -- 172.21.15.72:0/1182671251 wait complete. 2024-04-15T20:59:21.393 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:21.403 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:21.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-15T20:59:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:21 smithi072 ceph-mon[29079]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:21 smithi149 ceph-mon[36029]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:22.701 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:22 smithi072 ceph-mon[29079]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:22 smithi149 ceph-mon[36029]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 -- 172.21.15.72:0/2337450999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 msgr2=0x7f6d18100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/2337450999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18100650 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009910 tx=0x7f6d10009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 -- 172.21.15.72:0/2337450999 shutdown_connections 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/2337450999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d18101440 0x7f6d18101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/2337450999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18100650 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 -- 172.21.15.72:0/2337450999 >> 172.21.15.72:0/2337450999 conn(0x7f6d180fb7f0 msgr2=0x7f6d180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 -- 172.21.15.72:0/2337450999 shutdown_connections 2024-04-15T20:59:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.203+0000 7f6d1dda7700 1 -- 172.21.15.72:0/2337450999 wait complete. 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 Processor -- start 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 -- start start 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d18101440 0x7f6d18195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18196580 con 0x7f6d18100240 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d1dda7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181966c0 con 0x7f6d18101440 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42956/0 (socket says 172.21.15.72:42956) 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 -- 172.21.15.72:0/3609630870 learned_addr learned my addr 172.21.15.72:0/3609630870 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 -- 172.21.15.72:0/3609630870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d18101440 msgr2=0x7f6d18195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d18101440 0x7f6d18195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.204+0000 7f6d177fe700 1 -- 172.21.15.72:0/3609630870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100095f0 con 0x7f6d18100240 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d177fe700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000bda0 tx=0x7f6d1000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1001d070 con 0x7f6d18100240 2024-04-15T20:59:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d10004c50 con 0x7f6d18100240 2024-04-15T20:59:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1000f690 con 0x7f6d18100240 2024-04-15T20:59:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1819b120 con 0x7f6d18100240 2024-04-15T20:59:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.205+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1819b5e0 con 0x7f6d18100240 2024-04-15T20:59:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.206+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d18108d90 con 0x7f6d18100240 2024-04-15T20:59:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.206+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6d10022470 con 0x7f6d18100240 2024-04-15T20:59:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.207+0000 7f6d14ff9700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 0x7f6d0406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.207+0000 7f6d16ffd700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 0x7f6d0406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.207+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6d1008cc20 con 0x7f6d18100240 2024-04-15T20:59:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.207+0000 7f6d16ffd700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 0x7f6d0406eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d0e0 tx=0x7f6d000085a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.211+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6d1005b150 con 0x7f6d18100240 2024-04-15T20:59:23.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:23.427+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d18105d90 con 0x7f6d0406c680 2024-04-15T20:59:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:23 smithi072 ceph-mon[29079]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:23.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:23 smithi149 ceph-mon[36029]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:24.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.750+0000 7f6d14ff9700 1 -- 172.21.15.72:0/3609630870 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6d18105d90 con 0x7f6d0406c680 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 msgr2=0x7f6d0406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 0x7f6d0406eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d0e0 tx=0x7f6d000085a0 comp rx=0 tx=0).stop 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 msgr2=0x7f6d18195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000bda0 tx=0x7f6d1000be80 comp rx=0 tx=0).stop 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 shutdown_connections 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f6d0406c680 0x7f6d0406eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d18100240 0x7f6d18195ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:24.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 --2- 172.21.15.72:0/3609630870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d18101440 0x7f6d18195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:24.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 >> 172.21.15.72:0/3609630870 conn(0x7f6d180fb7f0 msgr2=0x7f6d18104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:24.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 shutdown_connections 2024-04-15T20:59:24.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:24.752+0000 7f6d1dda7700 1 -- 172.21.15.72:0/3609630870 wait complete. 2024-04-15T20:59:24.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:24.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-15T20:59:24.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-15T20:59:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: osdmap e41: 6 total, 6 up, 6 in 2024-04-15T20:59:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-15T20:59:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-mon[29079]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:24.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:24 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[29075]: 2024-04-15T20:59:24.728+0000 7f5089599700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T20:59:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T20:59:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-15T20:59:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-15T20:59:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: osdmap e41: 6 total, 6 up, 6 in 2024-04-15T20:59:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-15T20:59:24.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:24 smithi149 ceph-mon[36029]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:25.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-15T20:59:25.976 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-15T20:59:25.976 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: osdmap e42: 6 total, 6 up, 6 in 2024-04-15T20:59:25.976 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-15T20:59:25.976 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: osdmap e43: 6 total, 6 up, 6 in 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: fsmap cephfs:0 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: Saving service mds.cephfs spec with placement count:4 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:25.977 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:25 smithi072 ceph-mon[29079]: Deploying daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T20:59:26.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: osdmap e42: 6 total, 6 up, 6 in 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: osdmap e43: 6 total, 6 up, 6 in 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: fsmap cephfs:0 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: Saving service mds.cephfs spec with placement count:4 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:26.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:26.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:25 smithi149 ceph-mon[36029]: Deploying daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T20:59:26.800 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:26.963 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:26 smithi072 ceph-mon[29079]: osdmap e44: 6 total, 6 up, 6 in 2024-04-15T20:59:26.963 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:26 smithi072 ceph-mon[29079]: pgmap v178: 65 pgs: 26 active+clean, 14 creating+peering, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:27.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:26 smithi149 ceph-mon[36029]: osdmap e44: 6 total, 6 up, 6 in 2024-04-15T20:59:27.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:26 smithi149 ceph-mon[36029]: pgmap v178: 65 pgs: 26 active+clean, 14 creating+peering, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:27.949 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:27 smithi072 ceph-mon[29079]: osdmap e45: 6 total, 6 up, 6 in 2024-04-15T20:59:28.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:27 smithi149 ceph-mon[36029]: osdmap e45: 6 total, 6 up, 6 in 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 -- 172.21.15.72:0/3034671172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4101440 msgr2=0x7fd3f4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/3034671172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4101440 0x7fd3f4101890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009910 tx=0x7fd3e4009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 -- 172.21.15.72:0/3034671172 shutdown_connections 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/3034671172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4101440 0x7fd3f4101890 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/3034671172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4100240 0x7fd3f4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 -- 172.21.15.72:0/3034671172 >> 172.21.15.72:0/3034671172 conn(0x7fd3f40fb7f0 msgr2=0x7fd3f40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 -- 172.21.15.72:0/3034671172 shutdown_connections 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.481+0000 7fd3fafdf700 1 -- 172.21.15.72:0/3034671172 wait complete. 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 Processor -- start 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 -- start start 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4101440 0x7fd3f41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41987e0 con 0x7fd3f4100240 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4198950 con 0x7fd3f4101440 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42970/0 (socket says 172.21.15.72:42970) 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 -- 172.21.15.72:0/2403003881 learned_addr learned my addr 172.21.15.72:0/2403003881 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 -- 172.21.15.72:0/2403003881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4101440 msgr2=0x7fd3f41981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4101440 0x7fd3f41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 -- 172.21.15.72:0/2403003881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40095f0 con 0x7fd3f4100240 2024-04-15T20:59:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3f8d7b700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000d900 tx=0x7fd3f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f00041f0 con 0x7fd3f4100240 2024-04-15T20:59:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f419d3e0 con 0x7fd3f4100240 2024-04-15T20:59:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd3f0004350 con 0x7fd3f4100240 2024-04-15T20:59:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.482+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f0003da0 con 0x7fd3f4100240 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.483+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f419d930 con 0x7fd3f4100240 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.484+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f4105520 con 0x7fd3f4100240 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.484+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd3f0009730 con 0x7fd3f4100240 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.484+0000 7fd3e9ffb700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 0x7fd3dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.485+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd3f008ba50 con 0x7fd3f4100240 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.485+0000 7fd3ebfff700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 0x7fd3dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.485+0000 7fd3ebfff700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 0x7fd3dc06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b5c0 tx=0x7fd3e4005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.489+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd3f0056130 con 0x7fd3f4100240 2024-04-15T20:59:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.737+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3f402cc30 con 0x7fd3f4100240 2024-04-15T20:59:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.738+0000 7fd3e9ffb700 1 -- 172.21.15.72:0/2403003881 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7fd3f0059750 con 0x7fd3f4100240 2024-04-15T20:59:28.734 INFO:teuthology.orchestra.run.smithi072.stdout:e2 2024-04-15T20:59:28.734 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 2 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:24.729191+0000 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T20:59:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:in 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:up {} 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data disabled 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T20:59:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 0 2024-04-15T20:59:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 msgr2=0x7fd3dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 0x7fd3dc06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b5c0 tx=0x7fd3e4005960 comp rx=0 tx=0).stop 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 msgr2=0x7fd3f4197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000d900 tx=0x7fd3f000dcc0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 shutdown_connections 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd3dc06c680 0x7fd3dc06eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f4100240 0x7fd3f4197ca0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 --2- 172.21.15.72:0/2403003881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3f4101440 0x7fd3f41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 >> 172.21.15.72:0/2403003881 conn(0x7fd3f40fb7f0 msgr2=0x7fd3f4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 shutdown_connections 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:28.740+0000 7fd3fafdf700 1 -- 172.21.15.72:0/2403003881 wait complete. 2024-04-15T20:59:28.738 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2024-04-15T20:59:28.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:28 smithi072 ceph-mon[29079]: pgmap v180: 65 pgs: 48 active+clean, 14 creating+peering, 3 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:28.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:28 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2403003881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T20:59:29.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:28 smithi149 ceph-mon[36029]: pgmap v180: 65 pgs: 48 active+clean, 14 creating+peering, 3 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:29.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:28 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2403003881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T20:59:29.453 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:29.464 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:29.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-15T20:59:29.742 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: Deploying daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.72:6826/3675018183,v1:172.21.15.72:6827/3675018183] up:boot 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: daemon mds.cephfs.smithi072.zkrubp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-15T20:59:30.859 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: Cluster is now healthy 2024-04-15T20:59:30.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: fsmap cephfs:0 1 up:standby 2024-04-15T20:59:30.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:creating} 2024-04-15T20:59:30.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T20:59:30.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: daemon mds.cephfs.smithi072.zkrubp is now active in filesystem cephfs as rank 0 2024-04-15T20:59:30.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:30 smithi072 ceph-mon[29079]: pgmap v181: 65 pgs: 54 active+clean, 11 creating+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: Deploying daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.72:6826/3675018183,v1:172.21.15.72:6827/3675018183] up:boot 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: daemon mds.cephfs.smithi072.zkrubp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: Cluster is now healthy 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: fsmap cephfs:0 1 up:standby 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:creating} 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: daemon mds.cephfs.smithi072.zkrubp is now active in filesystem cephfs as rank 0 2024-04-15T20:59:30.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:30 smithi149 ceph-mon[36029]: pgmap v181: 65 pgs: 54 active+clean, 11 creating+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 -- 172.21.15.72:0/3293313370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b04100750 msgr2=0x7f0b04100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 --2- 172.21.15.72:0/3293313370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b04100750 0x7f0b04100b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009910 tx=0x7f0af4009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 -- 172.21.15.72:0/3293313370 shutdown_connections 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 --2- 172.21.15.72:0/3293313370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b041010a0 0x7f0b040ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 --2- 172.21.15.72:0/3293313370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b04100750 0x7f0b04100b60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 -- 172.21.15.72:0/3293313370 >> 172.21.15.72:0/3293313370 conn(0x7f0b040f9f10 msgr2=0x7f0b040fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 -- 172.21.15.72:0/3293313370 shutdown_connections 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.410+0000 7f0b0927d700 1 -- 172.21.15.72:0/3293313370 wait complete. 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 Processor -- start 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 -- start start 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b04100750 0x7f0b040feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0419ae10 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b0927d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0419af50 con 0x7f0b04100750 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42998/0 (socket says 172.21.15.72:42998) 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0b02ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b04100750 0x7f0b040feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 -- 172.21.15.72:0/2111444792 learned_addr learned my addr 172.21.15.72:0/2111444792 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 -- 172.21.15.72:0/2111444792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b04100750 msgr2=0x7f0b040feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b04100750 0x7f0b040feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.411+0000 7f0afbfff700 1 -- 172.21.15.72:0/2111444792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40095f0 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0afbfff700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00d8d0 tx=0x7f0aec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aec0098a0 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0aec010460 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0419b230 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aec00f5f0 con 0x7f0b041010a0 2024-04-15T20:59:31.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.412+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0419b780 con 0x7f0b041010a0 2024-04-15T20:59:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.413+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b04107c00 con 0x7f0b041010a0 2024-04-15T20:59:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.413+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0aec009a00 con 0x7f0b041010a0 2024-04-15T20:59:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.414+0000 7f0b00ff9700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 0x7f0af006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.414+0000 7f0b02ffd700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 0x7f0af006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.414+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0aec08b660 con 0x7f0b041010a0 2024-04-15T20:59:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.414+0000 7f0b02ffd700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 0x7f0af006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0af4006010 tx=0x7f0af400b560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:31.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.418+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0aec059850 con 0x7f0b041010a0 2024-04-15T20:59:31.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:31.651+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f0b0419be10 con 0x7f0b041010a0 2024-04-15T20:59:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:31 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.72:6826/3675018183,v1:172.21.15.72:6827/3675018183] up:active 2024-04-15T20:59:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:31 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 2024-04-15T20:59:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:31 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2111444792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-15T20:59:32.107 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:31 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.72:6826/3675018183,v1:172.21.15.72:6827/3675018183] up:active 2024-04-15T20:59:32.107 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:31 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 2024-04-15T20:59:32.107 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:31 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2111444792' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-15T20:59:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.507+0000 7f0b00ff9700 1 -- 172.21.15.72:0/2111444792 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0aec0593e0 con 0x7f0b041010a0 2024-04-15T20:59:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 msgr2=0x7f0af006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 0x7f0af006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0af4006010 tx=0x7f0af400b560 comp rx=0 tx=0).stop 2024-04-15T20:59:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 msgr2=0x7f0b0419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00d8d0 tx=0x7f0aec00dbe0 comp rx=0 tx=0).stop 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 shutdown_connections 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0af006c680 0x7f0af006eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b04100750 0x7f0b040feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.510+0000 7f0b0927d700 1 --2- 172.21.15.72:0/2111444792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b041010a0 0x7f0b0419a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.511+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 >> 172.21.15.72:0/2111444792 conn(0x7f0b040f9f10 msgr2=0x7f0b04103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.511+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 shutdown_connections 2024-04-15T20:59:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:32.511+0000 7f0b0927d700 1 -- 172.21.15.72:0/2111444792 wait complete. 2024-04-15T20:59:33.170 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:33.180 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:33.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-15T20:59:33.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: Deploying daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2111444792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:boot 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 1 up:standby 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T20:59:33.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:33 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 1 up:standby 2024-04-15T20:59:33.571 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-04-15T20:59:33.571 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: Deploying daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2111444792' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:boot 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 1 up:standby 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T20:59:33.572 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:33 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 1 up:standby 2024-04-15T20:59:34.373 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:34.475 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:34.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:35.590 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:35 smithi072 ceph-mon[29079]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-15T20:59:35.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:35 smithi149 ceph-mon[36029]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-15T20:59:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 -- 172.21.15.72:0/2516396455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc300ff130 msgr2=0x7fdc300ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2516396455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc300ff130 0x7fdc300ff540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009910 tx=0x7fdc20009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 -- 172.21.15.72:0/2516396455 shutdown_connections 2024-04-15T20:59:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2516396455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc301003d0 0x7fdc30100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2516396455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc300ff130 0x7fdc300ff540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 -- 172.21.15.72:0/2516396455 >> 172.21.15.72:0/2516396455 conn(0x7fdc300fa780 msgr2=0x7fdc300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 -- 172.21.15.72:0/2516396455 shutdown_connections 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.134+0000 7fdc3608b700 1 -- 172.21.15.72:0/2516396455 wait complete. 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 Processor -- start 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 -- start start 2024-04-15T20:59:36.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc300ff130 0x7fdc30195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30196660 con 0x7fdc301003d0 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc3608b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301967a0 con 0x7fdc300ff130 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40636/0 (socket says 172.21.15.72:40636) 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 -- 172.21.15.72:0/2903496892 learned_addr learned my addr 172.21.15.72:0/2903496892 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc2f7fe700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc300ff130 0x7fdc30195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 -- 172.21.15.72:0/2903496892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc300ff130 msgr2=0x7fdc30195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc300ff130 0x7fdc30195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.135+0000 7fdc27fff700 1 -- 172.21.15.72:0/2903496892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200095f0 con 0x7fdc301003d0 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc27fff700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800b4b0 tx=0x7fdc1800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc18011800 con 0x7fdc301003d0 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc18011e10 con 0x7fdc301003d0 2024-04-15T20:59:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3019b250 con 0x7fdc301003d0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc1800f2e0 con 0x7fdc301003d0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.136+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3019b7a0 con 0x7fdc301003d0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.137+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30107c90 con 0x7fdc301003d0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.137+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdc18010380 con 0x7fdc301003d0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.138+0000 7fdc2d7fa700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.138+0000 7fdc2f7fe700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.138+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fdc1808b4f0 con 0x7fdc301003d0 2024-04-15T20:59:36.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.138+0000 7fdc2f7fe700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 0x7fdc1c06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000b5c0 tx=0x7fdc20005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:36.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.142+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdc18059660 con 0x7fdc301003d0 2024-04-15T20:59:36.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:36.376+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc30107e50 con 0x7fdc301003d0 2024-04-15T20:59:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.332+0000 7fdc2d7fa700 1 -- 172.21.15.72:0/2903496892 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc180591f0 con 0x7fdc301003d0 2024-04-15T20:59:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.334+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 msgr2=0x7fdc1c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.334+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 0x7fdc1c06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000b5c0 tx=0x7fdc20005960 comp rx=0 tx=0).stop 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.334+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 msgr2=0x7fdc30196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.334+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800b4b0 tx=0x7fdc1800b870 comp rx=0 tx=0).stop 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.334+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 shutdown_connections 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc300ff130 0x7fdc30195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 --2- 172.21.15.72:0/2903496892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc301003d0 0x7fdc30196040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 >> 172.21.15.72:0/2903496892 conn(0x7fdc300fa780 msgr2=0x7fdc30068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 shutdown_connections 2024-04-15T20:59:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:37.335+0000 7fdc3608b700 1 -- 172.21.15.72:0/2903496892 wait complete. 2024-04-15T20:59:37.590 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2903496892' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:37.591 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:37 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2903496892' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-15T20:59:37.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:37 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:37.960 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:37.971 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:37.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-04-15T20:59:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:38.562 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:38 smithi072 ceph-mon[29079]: Deploying daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T20:59:38.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:38 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2903496892' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-15T20:59:38.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:38 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] up:boot 2024-04-15T20:59:38.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:38 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 2 up:standby 2024-04-15T20:59:38.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:38 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T20:59:38.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:38 smithi149 ceph-mon[36029]: Deploying daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T20:59:38.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:38 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2903496892' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-15T20:59:38.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:38 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] up:boot 2024-04-15T20:59:38.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:38 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 2 up:standby 2024-04-15T20:59:38.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:38 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T20:59:39.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:39 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.604 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:39 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 -- 172.21.15.72:0/274462234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000ff130 msgr2=0x7f42000ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 --2- 172.21.15.72:0/274462234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000ff130 0x7f42000ff540 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009910 tx=0x7f41f0009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 -- 172.21.15.72:0/274462234 shutdown_connections 2024-04-15T20:59:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 --2- 172.21.15.72:0/274462234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42001003d0 0x7f4200100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 --2- 172.21.15.72:0/274462234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42000ff130 0x7f42000ff540 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 -- 172.21.15.72:0/274462234 >> 172.21.15.72:0/274462234 conn(0x7f42000fa780 msgr2=0x7f42000fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 -- 172.21.15.72:0/274462234 shutdown_connections 2024-04-15T20:59:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.844+0000 7f4205092700 1 -- 172.21.15.72:0/274462234 wait complete. 2024-04-15T20:59:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 Processor -- start 2024-04-15T20:59:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 -- start start 2024-04-15T20:59:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42001003d0 0x7f420019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420019ade0 con 0x7f42001003d0 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.845+0000 7f4205092700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420019af20 con 0x7f42000ff130 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:40674/0 (socket says 172.21.15.72:40674) 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 -- 172.21.15.72:0/2519994952 learned_addr learned my addr 172.21.15.72:0/2519994952 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fe59c700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42001003d0 0x7f420019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 -- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42001003d0 msgr2=0x7f420019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42001003d0 0x7f420019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 -- 172.21.15.72:0/2519994952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00095f0 con 0x7f42000ff130 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41fed9d700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41f000f690 tx=0x7f41f000f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.846+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f001d070 con 0x7f42000ff130 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.847+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420019b1a0 con 0x7f42000ff130 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.847+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41f0005dc0 con 0x7f42000ff130 2024-04-15T20:59:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.847+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41f00226a0 con 0x7f42000ff130 2024-04-15T20:59:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.847+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420019b690 con 0x7f42000ff130 2024-04-15T20:59:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.848+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4200107c10 con 0x7f42000ff130 2024-04-15T20:59:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.848+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f41f00038f0 con 0x7f42000ff130 2024-04-15T20:59:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.849+0000 7f41e7fff700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 0x7f41e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:39.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.849+0000 7f41fe59c700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 0x7f41e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:39.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.849+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f41f008cd60 con 0x7f42000ff130 2024-04-15T20:59:39.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.849+0000 7f41fe59c700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 0x7f41e806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4200069620 tx=0x7f41f4009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:39.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:39.853+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f41f005aff0 con 0x7f42000ff130 2024-04-15T20:59:40.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.098+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4200107e00 con 0x7f42000ff130 2024-04-15T20:59:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.352+0000 7f41e7fff700 1 -- 172.21.15.72:0/2519994952 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7f41f005ab80 con 0x7f42000ff130 2024-04-15T20:59:40.345 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:boot 2024-04-15T20:59:40.345 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T20:59:40.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T20:59:40.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:40.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2519994952' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-15T20:59:40.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:40 smithi072 ceph-mon[29079]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 msgr2=0x7f41e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 0x7f41e806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4200069620 tx=0x7f41f4009260 comp rx=0 tx=0).stop 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 msgr2=0x7f42000690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41f000f690 tx=0x7f41f000f6c0 comp rx=0 tx=0).stop 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 shutdown_connections 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f41e806c680 0x7f41e806eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42000ff130 0x7f42000690a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 --2- 172.21.15.72:0/2519994952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42001003d0 0x7f420019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.355+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 >> 172.21.15.72:0/2519994952 conn(0x7f42000fa780 msgr2=0x7f4200103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.356+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 shutdown_connections 2024-04-15T20:59:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:40.356+0000 7f4205092700 1 -- 172.21.15.72:0/2519994952 wait complete. 2024-04-15T20:59:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:inline data enabled 2024-04-15T20:59:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:boot 2024-04-15T20:59:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T20:59:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T20:59:40.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:40.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2519994952' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-15T20:59:40.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:40 smithi149 ceph-mon[36029]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-15T20:59:41.218 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T20:59:41.278 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T20:59:41.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:standby 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: Dropping low affinity active daemon mds.cephfs.smithi072.zkrubp in favor of higher affinity standby. 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: Replacing daemon mds.cephfs.smithi072.zkrubp as rank 0 with standby daemon mds.cephfs.smithi149.mflbpn 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: osdmap e46: 6 total, 6 up, 6 in 2024-04-15T20:59:41.600 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:41 smithi072 ceph-mon[29079]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:replay} 2 up:standby 2024-04-15T20:59:41.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-15T20:59:41.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:standby 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: Dropping low affinity active daemon mds.cephfs.smithi072.zkrubp in favor of higher affinity standby. 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: Replacing daemon mds.cephfs.smithi072.zkrubp as rank 0 with standby daemon mds.cephfs.smithi149.mflbpn 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: osdmap e46: 6 total, 6 up, 6 in 2024-04-15T20:59:41.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:41 smithi149 ceph-mon[36029]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:replay} 2 up:standby 2024-04-15T20:59:42.454 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:reconnect 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] up:boot 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] up:standby 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:reconnect} 3 up:standby 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T20:59:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:42.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:42 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:42.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:reconnect 2024-04-15T20:59:42.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] up:boot 2024-04-15T20:59:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] up:standby 2024-04-15T20:59:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:reconnect} 3 up:standby 2024-04-15T20:59:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T20:59:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:42 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:43.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 3 op/s 2024-04-15T20:59:43.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:rejoin 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:rejoin} 3 up:standby 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: daemon mds.cephfs.smithi149.mflbpn is now active in filesystem cephfs as rank 0 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:active 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:standby 2024-04-15T20:59:43.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:43 smithi072 ceph-mon[29079]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T20:59:43.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 3 op/s 2024-04-15T20:59:43.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:rejoin 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: fsmap cephfs:1/1 {0=cephfs.smithi149.mflbpn=up:rejoin} 3 up:standby 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: daemon mds.cephfs.smithi149.mflbpn is now active in filesystem cephfs as rank 0 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] up:active 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:standby 2024-04-15T20:59:43.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:43 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T20:59:44.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 -- 172.21.15.72:0/3270913598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf401003f0 msgr2=0x7faf40100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:44.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3270913598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf401003f0 0x7faf40100860 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf30009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 -- 172.21.15.72:0/3270913598 shutdown_connections 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3270913598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf401003f0 0x7faf40100860 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3270913598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf400ff150 0x7faf400ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 -- 172.21.15.72:0/3270913598 >> 172.21.15.72:0/3270913598 conn(0x7faf400fa7a0 msgr2=0x7faf400fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 -- 172.21.15.72:0/3270913598 shutdown_connections 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.295+0000 7faf47e4d700 1 -- 172.21.15.72:0/3270913598 wait complete. 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 Processor -- start 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 -- start start 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf401003f0 0x7faf401951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf401957f0 con 0x7faf400ff150 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf47e4d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf40195960 con 0x7faf401003f0 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:44.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45752/0 (socket says 172.21.15.72:45752) 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 -- 172.21.15.72:0/3291774980 learned_addr learned my addr 172.21.15.72:0/3291774980 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf453e8700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf401003f0 0x7faf401951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 -- 172.21.15.72:0/3291774980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf401003f0 msgr2=0x7faf401951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf401003f0 0x7faf401951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 -- 172.21.15.72:0/3291774980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300095f0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.296+0000 7faf45be9700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c8a0 tx=0x7faf3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.297+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3c00cea0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.297+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf3c004830 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.297+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4019a3f0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.297+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3c0055b0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.297+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4019a940 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.298+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf40068ab0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.298+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7faf3c007ad0 con 0x7faf400ff150 2024-04-15T20:59:44.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.299+0000 7faf36ffd700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 0x7faf2c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:44.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.299+0000 7faf453e8700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 0x7faf2c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:44.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.299+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faf3c08b590 con 0x7faf400ff150 2024-04-15T20:59:44.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.299+0000 7faf453e8700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 0x7faf2c06eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf300059d0 tx=0x7faf30005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:44.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.303+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf3c055c90 con 0x7faf400ff150 2024-04-15T20:59:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.540+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf4019b0d0 con 0x7faf400ff150 2024-04-15T20:59:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.540+0000 7faf36ffd700 1 -- 172.21.15.72:0/3291774980 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7faf3c0592b0 con 0x7faf400ff150 2024-04-15T20:59:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T20:59:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T20:59:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T20:59:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 msgr2=0x7faf2c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 0x7faf2c06eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf300059d0 tx=0x7faf30005960 comp rx=0 tx=0).stop 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 msgr2=0x7faf40194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c8a0 tx=0x7faf3c00cc60 comp rx=0 tx=0).stop 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 shutdown_connections 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7faf2c06c680 0x7faf2c06eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400ff150 0x7faf40194cb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 --2- 172.21.15.72:0/3291774980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf401003f0 0x7faf401951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 >> 172.21.15.72:0/3291774980 conn(0x7faf400fa7a0 msgr2=0x7faf40103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.543+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 shutdown_connections 2024-04-15T20:59:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:44.544+0000 7faf47e4d700 1 -- 172.21.15.72:0/3291774980 wait complete. 2024-04-15T20:59:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T20:59:45.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-15T20:59:45.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:45 smithi072 ceph-mon[29079]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-15T20:59:45.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:45 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:45.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:45 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3291774980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T20:59:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:45 smithi149 ceph-mon[36029]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-15T20:59:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:45 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:45 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3291774980' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T20:59:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:47.549 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:47 smithi072 ceph-mon[29079]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 4 op/s 2024-04-15T20:59:47.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:47 smithi149 ceph-mon[36029]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 4 op/s 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 -- 172.21.15.72:0/4045132494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 msgr2=0x7f21c0101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/4045132494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0101c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009910 tx=0x7f21b0009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 -- 172.21.15.72:0/4045132494 shutdown_connections 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/4045132494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 0x7f21c00fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/4045132494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0101c90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 -- 172.21.15.72:0/4045132494 >> 172.21.15.72:0/4045132494 conn(0x7f21c00f9f10 msgr2=0x7f21c00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 -- 172.21.15.72:0/4045132494 shutdown_connections 2024-04-15T20:59:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.049+0000 7f21c5ea6700 1 -- 172.21.15.72:0/4045132494 wait complete. 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 Processor -- start 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 -- start start 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 0x7f21c00ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00ffb10 con 0x7f21c0101880 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21c5ea6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00ffc50 con 0x7f21c01021d0 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21bf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21bf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45756/0 (socket says 172.21.15.72:45756) 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.050+0000 7f21bf7fe700 1 -- 172.21.15.72:0/2970408945 learned_addr learned my addr 172.21.15.72:0/2970408945 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21beffd700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 0x7f21c00ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bf7fe700 1 -- 172.21.15.72:0/2970408945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 msgr2=0x7f21c00ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bf7fe700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 0x7f21c00ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bf7fe700 1 -- 172.21.15.72:0/2970408945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00095f0 con 0x7f21c0101880 2024-04-15T20:59:48.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bf7fe700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bd70 tx=0x7f21b000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21b001d070 con 0x7f21c0101880 2024-04-15T20:59:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c00ffed0 con 0x7f21c0101880 2024-04-15T20:59:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21b0005940 con 0x7f21c0101880 2024-04-15T20:59:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21b0021430 con 0x7f21c0101880 2024-04-15T20:59:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.051+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c01003c0 con 0x7f21c0101880 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.052+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0108d40 con 0x7f21c0101880 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.053+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f21b0003a60 con 0x7f21c0101880 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.053+0000 7f21bcff9700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 0x7f21a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.053+0000 7f21beffd700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 0x7f21a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.053+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f21b008cc90 con 0x7f21c0101880 2024-04-15T20:59:48.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.054+0000 7f21beffd700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 0x7f21a806eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c0102600 tx=0x7f21b400a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:48.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.060+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21b005ada0 con 0x7f21c0101880 2024-04-15T20:59:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.329+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21c0108f00 con 0x7f21c0101880 2024-04-15T20:59:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.329+0000 7f21bcff9700 1 -- 172.21.15.72:0/2970408945 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f21b005a930 con 0x7f21c0101880 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 msgr2=0x7f21a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 0x7f21a806eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c0102600 tx=0x7f21b400a380 comp rx=0 tx=0).stop 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 msgr2=0x7f21c0100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bd70 tx=0x7f21b000bda0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 shutdown_connections 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21a806c680 0x7f21a806eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c0101880 0x7f21c0100f80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 --2- 172.21.15.72:0/2970408945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01021d0 0x7f21c00ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.331+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 >> 172.21.15.72:0/2970408945 conn(0x7f21c00f9f10 msgr2=0x7f21c0104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.332+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 shutdown_connections 2024-04-15T20:59:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:48.332+0000 7f21c5ea6700 1 -- 172.21.15.72:0/2970408945 wait complete. 2024-04-15T20:59:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T20:59:48.334 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T20:59:49.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-15T20:59:49.246 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:49.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2970408945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T20:59:49.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2970408945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T20:59:49.609 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T20:59:50.612 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:50 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:50.612 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:50 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:50 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:50 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.404+0000 7f3338c86700 1 -- 172.21.15.72:0/1684597646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fee50 msgr2=0x7f3334101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.404+0000 7f3338c86700 1 --2- 172.21.15.72:0/1684597646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fee50 0x7f3334101580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3328009910 tx=0x7f3328009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 -- 172.21.15.72:0/1684597646 shutdown_connections 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 --2- 172.21.15.72:0/1684597646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fee50 0x7f3334101580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 --2- 172.21.15.72:0/1684597646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fe500 0x7f33340fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 -- 172.21.15.72:0/1684597646 >> 172.21.15.72:0/1684597646 conn(0x7f33340f9f10 msgr2=0x7f33340fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 -- 172.21.15.72:0/1684597646 shutdown_connections 2024-04-15T20:59:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 -- 172.21.15.72:0/1684597646 wait complete. 2024-04-15T20:59:51.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 Processor -- start 2024-04-15T20:59:51.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.405+0000 7f3338c86700 1 -- start start 2024-04-15T20:59:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 0x7f33341960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33341966f0 con 0x7f33340fe500 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334196830 con 0x7f33340fee50 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45764/0 (socket says 172.21.15.72:45764) 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 -- 172.21.15.72:0/2784852323 learned_addr learned my addr 172.21.15.72:0/2784852323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3331d9b700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 0x7f33341960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 -- 172.21.15.72:0/2784852323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 msgr2=0x7f33341960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 0x7f33341960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 -- 172.21.15.72:0/2784852323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280095f0 con 0x7f33340fe500 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3331d9b700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 0x7f33341960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f333259c700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f332400b4b0 tx=0x7f332400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3324011800 con 0x7f33340fe500 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3324011e10 con 0x7f33340fe500 2024-04-15T20:59:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333419b2e0 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f332400f2e0 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.406+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333419b830 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.407+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3334108d90 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.408+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3324010380 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.408+0000 7f33237fe700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 0x7f331c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.408+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f332408b540 con 0x7f33340fe500 2024-04-15T20:59:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.408+0000 7f3331d9b700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 0x7f331c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.409+0000 7f3331d9b700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 0x7f331c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3328005090 tx=0x7f3328005920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:51.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.413+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3324059650 con 0x7f33340fe500 2024-04-15T20:59:51.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:51 smithi072 ceph-mon[29079]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-04-15T20:59:51.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:51 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:51.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:51 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.694+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f3334108f50 con 0x7f33340fe500 2024-04-15T20:59:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.694+0000 7f33237fe700 1 -- 172.21.15.72:0/2784852323 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+83 (secure 0 0 0) 0x7f33240591e0 con 0x7f33340fe500 2024-04-15T20:59:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.696+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 msgr2=0x7f331c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.696+0000 7f3338c86700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 0x7f331c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3328005090 tx=0x7f3328005920 comp rx=0 tx=0).stop 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.696+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 msgr2=0x7f3334195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.696+0000 7f3338c86700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f332400b4b0 tx=0x7f332400b870 comp rx=0 tx=0).stop 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 shutdown_connections 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f331c06c680 0x7f331c06eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33340fe500 0x7f3334195b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 --2- 172.21.15.72:0/2784852323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33340fee50 0x7f33341960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 >> 172.21.15.72:0/2784852323 conn(0x7f33340f9f10 msgr2=0x7f33341047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 shutdown_connections 2024-04-15T20:59:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:51.697+0000 7f3338c86700 1 -- 172.21.15.72:0/2784852323 wait complete. 2024-04-15T20:59:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:51 smithi149 ceph-mon[36029]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-04-15T20:59:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:51 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:51.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:51 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:51.700 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T20:59:52.756 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:52 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2784852323' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-15T20:59:52.777 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-15T20:59:52.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T20:59:52.797 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:52 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2784852323' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-15T20:59:52.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- 172.21.15.72:0/2242739325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 msgr2=0x7fcc341024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 --2- 172.21.15.72:0/2242739325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc341024b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcc300098b0 tx=0x7fcc3002bcd0 comp rx=0 tx=0).stop 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- 172.21.15.72:0/2242739325 shutdown_connections 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 --2- 172.21.15.72:0/2242739325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 --2- 172.21.15.72:0/2242739325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc341024b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- 172.21.15.72:0/2242739325 >> 172.21.15.72:0/2242739325 conn(0x7fcc340f9af0 msgr2=0x7fcc340fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- 172.21.15.72:0/2242739325 shutdown_connections 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- 172.21.15.72:0/2242739325 wait complete. 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 Processor -- start 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 -- start start 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.923+0000 7fcc3c395640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34195500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3c395640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34195ad0 con 0x7fcc341000d0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3c395640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34195c40 con 0x7fcc341029f0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43018/0 (socket says 172.21.15.72:43018) 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 -- 172.21.15.72:0/4197123206 learned_addr learned my addr 172.21.15.72:0/4197123206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc39930640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34195500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 -- 172.21.15.72:0/4197123206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 msgr2=0x7fcc34195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34195500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 -- 172.21.15.72:0/4197123206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009560 con 0x7fcc341000d0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc39930640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34195500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3a131640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009880 tx=0x7fcc30004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc30004420 con 0x7fcc341000d0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc300054b0 con 0x7fcc341000d0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3419a670 con 0x7fcc341000d0 2024-04-15T20:59:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc30003de0 con 0x7fcc341000d0 2024-04-15T20:59:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.924+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3419ab70 con 0x7fcc341000d0 2024-04-15T20:59:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.925+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc341083c0 con 0x7fcc341000d0 2024-04-15T20:59:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.926+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcc30003680 con 0x7fcc341000d0 2024-04-15T20:59:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.926+0000 7fcc2b7fe640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 0x7fcc2006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.926+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcc300addc0 con 0x7fcc341000d0 2024-04-15T20:59:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.926+0000 7fcc39930640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 0x7fcc2006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.926+0000 7fcc39930640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 0x7fcc2006eb00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc341964d0 tx=0x7fcc24005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:52.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:52.931+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcc30078440 con 0x7fcc341000d0 2024-04-15T20:59:53.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.103+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc3419aed0 con 0x7fcc341000d0 2024-04-15T20:59:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.104+0000 7fcc2b7fe640 1 -- 172.21.15.72:0/4197123206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15142 (secure 0 0 0) 0x7fcc30041090 con 0x7fcc341000d0 2024-04-15T20:59:53.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:53.097 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T20:59:40.349333+0000","last_up_change":"2024-04-15T20:58:10.497355+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-15T20:59:23.666009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-15T20:59:23.962027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6803","nonce":4266586545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6805","nonce":4266586545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6809","nonce":4266586545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":4266586545},{"type":"v1","addr":"172.21.15.72:6807","nonce":4266586545}]},"public_addr":"172.21.15.72:6803/4266586545","cluster_addr":"172.21.15.72:6805/4266586545","heartbeat_back_addr":"172.21.15.72:6809/4266586545","heartbeat_front_addr":"172.21.15.72:6807/4266586545","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6811","nonce":3902265924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6813","nonce":3902265924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6817","nonce":3902265924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3902265924},{"type":"v1","addr":"172.21.15.72:6815","nonce":3902265924}]},"public_addr":"172.21.15.72:6811/3902265924","cluster_addr":"172.21.15.72:6813/3902265924","heartbeat_back_addr":"172.21.15.72:6817/3902265924","heartbeat_front_addr":"172.21.15.72:6815/3902265924","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6819","nonce":3531980190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6821","nonce":3531980190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6825","nonce":3531980190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3531980190},{"type":"v1","addr":"172.21.15.72:6823","nonce":3531980190}]},"public_addr":"172.21.15.72:6819/3531980190","cluster_addr":"172.21.15.72:6821/3531980190","heartbeat_back_addr":"172.21.15.72:6825/3531980190","heartbeat_front_addr":"172.21.15.72:6823/3531980190","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6801","nonce":1961067780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6803","nonce":1961067780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6807","nonce":1961067780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1961067780},{"type":"v1","addr":"172.21.15.149:6805","nonce":1961067780}]},"public_addr":"172.21.15.149:6801/1961067780","cluster_addr":"172.21.15.149:6803/1961067780","heartbeat_back_addr":"172.21.15.149:6807/1961067780","heartbeat_front_addr":"172.21.15.149:6805/1961067780","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6809","nonce":1800407801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6811","nonce":1800407801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6815","nonce":1800407801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1800407801},{"type":"v1","addr":"172.21.15.149:6813","nonce":1800407801}]},"public_addr":"172.21.15.149:6809/1800407801","cluster_addr":"172.21.15.149:6811/1800407801","heartbeat_back_addr":"172.21.15.149:6815/1800407801","heartbeat_front_addr":"172.21.15.149:6813/1800407801","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6817","nonce":3380944788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6819","nonce":3380944788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6823","nonce":3380944788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3380944788},{"type":"v1","addr":"172.21.15.149:6821","nonce":3380944788}]},"public_addr":"172.21.15.149:6817/3380944788","cluster_addr":"172.21.15.149:6819/3380944788","heartbeat_back_addr":"172.21.15.149:6823/3380944788","heartbeat_front_addr":"172.21.15.149:6821/3380944788","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6827/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6826/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 msgr2=0x7fcc2006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 0x7fcc2006eb00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc341964d0 tx=0x7fcc24005f90 comp rx=0 tx=0).stop 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 msgr2=0x7fcc34194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009880 tx=0x7fcc30004e90 comp rx=0 tx=0).stop 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 shutdown_connections 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcc2006c650 0x7fcc2006eb00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc341029f0 0x7fcc34195500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 --2- 172.21.15.72:0/4197123206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc341000d0 0x7fcc34194fc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 >> 172.21.15.72:0/4197123206 conn(0x7fcc340f9af0 msgr2=0x7fcc340fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 shutdown_connections 2024-04-15T20:59:53.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.106+0000 7fcc3c395640 1 -- 172.21.15.72:0/4197123206 wait complete. 2024-04-15T20:59:53.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T20:56:58.477159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-15T20:59:23.666009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-15T20:59:23.962027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T20:59:53.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 -- 172.21.15.72:0/3622158302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 msgr2=0x7fbea00fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3622158302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea00fe960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009880 tx=0x7fbe9402bce0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 -- 172.21.15.72:0/3622158302 shutdown_connections 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3622158302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 0x7fbea00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3622158302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea00fe960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 -- 172.21.15.72:0/3622158302 >> 172.21.15.72:0/3622158302 conn(0x7fbea00f9ad0 msgr2=0x7fbea00fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 -- 172.21.15.72:0/3622158302 shutdown_connections 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.227+0000 7fbea6f51640 1 -- 172.21.15.72:0/3622158302 wait complete. 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 Processor -- start 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 -- start start 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 0x7fbea0199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea019a2d0 con 0x7fbea00fe550 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea6f51640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea019a410 con 0x7fbea00ff740 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43036/0 (socket says 172.21.15.72:43036) 2024-04-15T20:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 -- 172.21.15.72:0/3820978772 learned_addr learned my addr 172.21.15.72:0/3820978772 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbe9ffff640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 0x7fbea0199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 -- 172.21.15.72:0/3820978772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 msgr2=0x7fbea0199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 0x7fbea0199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 -- 172.21.15.72:0/3820978772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94009560 con 0x7fbea00fe550 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.228+0000 7fbea4ced640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009230 tx=0x7fbe94004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.229+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe940044e0 con 0x7fbea00fe550 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.229+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe940054b0 con 0x7fbea00fe550 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.229+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea019a660 con 0x7fbea00fe550 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.229+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe94034440 con 0x7fbea00fe550 2024-04-15T20:59:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.229+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea019ab60 con 0x7fbea00fe550 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.230+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0107280 con 0x7fbea00fe550 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.230+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbe94003810 con 0x7fbea00fe550 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.231+0000 7fbe9dffb640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 0x7fbe9006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.231+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbe940add80 con 0x7fbea00fe550 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.231+0000 7fbe9ffff640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 0x7fbe9006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.231+0000 7fbe9ffff640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 0x7fbe9006eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbea0068c60 tx=0x7fbe8c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.235+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbe940784b0 con 0x7fbea00fe550 2024-04-15T20:59:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.405+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbea019ad80 con 0x7fbea00fe550 2024-04-15T20:59:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.405+0000 7fbe9dffb640 1 -- 172.21.15.72:0/3820978772 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe9404b020 con 0x7fbea00fe550 2024-04-15T20:59:53.398 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-15T20:59:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 msgr2=0x7fbe9006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 0x7fbe9006eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbea0068c60 tx=0x7fbe8c005f90 comp rx=0 tx=0).stop 2024-04-15T20:59:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 msgr2=0x7fbea0068ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009230 tx=0x7fbe94004dc0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 shutdown_connections 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbe9006c5f0 0x7fbe9006eaa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00ff740 0x7fbea0199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 --2- 172.21.15.72:0/3820978772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea00fe550 0x7fbea0068ef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 >> 172.21.15.72:0/3820978772 conn(0x7fbea00f9ad0 msgr2=0x7fbea0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 shutdown_connections 2024-04-15T20:59:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.407+0000 7fbea6f51640 1 -- 172.21.15.72:0/3820978772 wait complete. 2024-04-15T20:59:53.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 -- 172.21.15.72:0/1852270799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f80ff650 msgr2=0x7f16f80ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 --2- 172.21.15.72:0/1852270799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f80ff650 0x7f16f80ffa60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009880 tx=0x7f16e802bce0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 -- 172.21.15.72:0/1852270799 shutdown_connections 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 --2- 172.21.15.72:0/1852270799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f8100840 0x7f16f8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 --2- 172.21.15.72:0/1852270799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f80ff650 0x7f16f80ffa60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 -- 172.21.15.72:0/1852270799 >> 172.21.15.72:0/1852270799 conn(0x7f16f80fabd0 msgr2=0x7f16f80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 -- 172.21.15.72:0/1852270799 shutdown_connections 2024-04-15T20:59:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.528+0000 7f16fd415640 1 -- 172.21.15.72:0/1852270799 wait complete. 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 Processor -- start 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 -- start start 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f80ff650 0x7f16f8194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8195aa0 con 0x7f16f8100840 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16fd415640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8195c10 con 0x7f16f80ff650 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43058/0 (socket says 172.21.15.72:43058) 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16effff640 1 -- 172.21.15.72:0/3300181580 learned_addr learned my addr 172.21.15.72:0/3300181580 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.529+0000 7f16f6ffd640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f80ff650 0x7f16f8194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16effff640 1 -- 172.21.15.72:0/3300181580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f80ff650 msgr2=0x7f16f8194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16effff640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f80ff650 0x7f16f8194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16effff640 1 -- 172.21.15.72:0/3300181580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009560 con 0x7f16f8100840 2024-04-15T20:59:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16effff640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16e000e970 tx=0x7f16e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e000cc90 con 0x7f16f8100840 2024-04-15T20:59:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f819a6a0 con 0x7f16f8100840 2024-04-15T20:59:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f819ac00 con 0x7f16f8100840 2024-04-15T20:59:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f16e000cdf0 con 0x7f16f8100840 2024-04-15T20:59:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.530+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e0010430 con 0x7f16f8100840 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.531+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8005280 con 0x7f16f8100840 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.532+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f16e0010590 con 0x7f16f8100840 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.532+0000 7f16f4ff9640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 0x7f16e406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.532+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f16e0014070 con 0x7f16f8100840 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.532+0000 7f16f6ffd640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 0x7f16e406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.533+0000 7f16f6ffd640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 0x7f16e406eaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000c00 tx=0x7f16e8005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.537+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f16e0056570 con 0x7f16f8100840 2024-04-15T20:59:53.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:53 smithi072 ceph-mon[29079]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-15T20:59:53.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:53 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/4197123206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:59:53.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:53 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3820978772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T20:59:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.717+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f16d8005ab0 con 0x7f16f8100840 2024-04-15T20:59:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.717+0000 7f16f4ff9640 1 -- 172.21.15.72:0/3300181580 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f16e0059b90 con 0x7f16f8100840 2024-04-15T20:59:53.710 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T20:59:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 msgr2=0x7f16e406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 0x7f16e406eaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000c00 tx=0x7f16e8005fd0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 msgr2=0x7f16f81954d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f16e000e970 tx=0x7f16e000ed70 comp rx=0 tx=0).stop 2024-04-15T20:59:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 shutdown_connections 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f16e406c5f0 0x7f16e406eaa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f8100840 0x7f16f81954d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 --2- 172.21.15.72:0/3300181580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16f80ff650 0x7f16f8194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 >> 172.21.15.72:0/3300181580 conn(0x7f16f80fabd0 msgr2=0x7f16f8103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 shutdown_connections 2024-04-15T20:59:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.719+0000 7f16fd415640 1 -- 172.21.15.72:0/3300181580 wait complete. 2024-04-15T20:59:53.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-15T20:59:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 -- 172.21.15.72:0/638633646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 msgr2=0x7f66ac104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 --2- 172.21.15.72:0/638633646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac104dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f66940098b0 tx=0x7f669402bcd0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 -- 172.21.15.72:0/638633646 shutdown_connections 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 --2- 172.21.15.72:0/638633646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac104dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 --2- 172.21.15.72:0/638633646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 0x7f66ac1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 -- 172.21.15.72:0/638633646 >> 172.21.15.72:0/638633646 conn(0x7f66ac0f9a80 msgr2=0x7f66ac0fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 -- 172.21.15.72:0/638633646 shutdown_connections 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 -- 172.21.15.72:0/638633646 wait complete. 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.843+0000 7f66b2547640 1 Processor -- start 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 -- start start 2024-04-15T20:59:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 0x7f66ac194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac195ac0 con 0x7f66ac1029e0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac195c30 con 0x7f66ac1000c0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43072/0 (socket says 172.21.15.72:43072) 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 -- 172.21.15.72:0/2875927613 learned_addr learned my addr 172.21.15.72:0/2875927613 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66abfff640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 0x7f66ac194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 -- 172.21.15.72:0/2875927613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 msgr2=0x7f66ac194fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 0x7f66ac194fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 -- 172.21.15.72:0/2875927613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009560 con 0x7f66ac1029e0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a3fff640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6694000c00 tx=0x7f6694004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6694005000 con 0x7f66ac1029e0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac19a660 con 0x7f66ac1029e0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.844+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6694005610 con 0x7f66ac1029e0 2024-04-15T20:59:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.845+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6694034670 con 0x7f66ac1029e0 2024-04-15T20:59:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.845+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac19ab60 con 0x7f66ac1029e0 2024-04-15T20:59:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.846+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac18f050 con 0x7f66ac1029e0 2024-04-15T20:59:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.846+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f66940035f0 con 0x7f66ac1029e0 2024-04-15T20:59:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.847+0000 7f66a9ffb640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 0x7f669806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.847+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f66940add40 con 0x7f66ac1029e0 2024-04-15T20:59:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.847+0000 7f66abfff640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 0x7f669806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.848+0000 7f66abfff640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 0x7f669806eaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f669c00bbe0 tx=0x7f669c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:53.851+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6694078470 con 0x7f66ac1029e0 2024-04-15T20:59:53.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:53 smithi149 ceph-mon[36029]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-15T20:59:53.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:53 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/4197123206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T20:59:53.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:53 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3820978772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T20:59:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.029+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f66ac1082e0 con 0x7f66ac1029e0 2024-04-15T20:59:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.029+0000 7f66a9ffb640 1 -- 172.21.15.72:0/2875927613 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f669404b020 con 0x7f66ac1029e0 2024-04-15T20:59:54.022 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 msgr2=0x7f669806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 0x7f669806eaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f669c00bbe0 tx=0x7f669c00b390 comp rx=0 tx=0).stop 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 msgr2=0x7f66ac1954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6694000c00 tx=0x7f6694004e30 comp rx=0 tx=0).stop 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 shutdown_connections 2024-04-15T20:59:54.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f669806c5f0 0x7f669806eaa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66ac1029e0 0x7f66ac1954f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 --2- 172.21.15.72:0/2875927613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66ac1000c0 0x7f66ac194fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 >> 172.21.15.72:0/2875927613 conn(0x7f66ac0f9a80 msgr2=0x7f66ac0fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 shutdown_connections 2024-04-15T20:59:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.031+0000 7f66b2547640 1 -- 172.21.15.72:0/2875927613 wait complete. 2024-04-15T20:59:54.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 -- 172.21.15.72:0/2520250388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480ff740 msgr2=0x7f83480ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 --2- 172.21.15.72:0/2520250388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480ff740 0x7f83480ffbb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8330009880 tx=0x7f833002bce0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 -- 172.21.15.72:0/2520250388 shutdown_connections 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 --2- 172.21.15.72:0/2520250388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480ff740 0x7f83480ffbb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 --2- 172.21.15.72:0/2520250388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480fe550 0x7f83480fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 -- 172.21.15.72:0/2520250388 >> 172.21.15.72:0/2520250388 conn(0x7f83480f9a90 msgr2=0x7f83480fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 -- 172.21.15.72:0/2520250388 shutdown_connections 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.146+0000 7f834d421640 1 -- 172.21.15.72:0/2520250388 wait complete. 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 Processor -- start 2024-04-15T20:59:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 -- start start 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480ff740 0x7f8348195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348195a40 con 0x7f83480fe550 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f834d421640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348195bb0 con 0x7f83480ff740 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43098/0 (socket says 172.21.15.72:43098) 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 -- 172.21.15.72:0/1299451311 learned_addr learned my addr 172.21.15.72:0/1299451311 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 -- 172.21.15.72:0/1299451311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480ff740 msgr2=0x7f8348195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480ff740 0x7f8348195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.147+0000 7f8346ffd640 1 -- 172.21.15.72:0/1299451311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009560 con 0x7f83480fe550 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f8346ffd640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f833800d8d0 tx=0x7f833800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f833800bea0 con 0x7f83480fe550 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8338009c00 con 0x7f83480fe550 2024-04-15T20:59:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834819a640 con 0x7f83480fe550 2024-04-15T20:59:54.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f833800f780 con 0x7f83480fe550 2024-04-15T20:59:54.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.148+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834819aba0 con 0x7f83480fe550 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.149+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8348107270 con 0x7f83480fe550 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.149+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f833800fa40 con 0x7f83480fe550 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.150+0000 7f8344ff9640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 0x7f833406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.150+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f833808b8d0 con 0x7f83480fe550 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.150+0000 7f833ffff640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 0x7f833406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:54.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.150+0000 7f833ffff640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 0x7f833406eb60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f833002c7c0 tx=0x7f8330000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:54.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.154+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8338055f50 con 0x7f83480fe550 2024-04-15T20:59:54.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.378+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f834819ae20 con 0x7f83480fe550 2024-04-15T20:59:54.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.378+0000 7f8344ff9640 1 -- 172.21.15.72:0/1299451311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f8338059570 con 0x7f83480fe550 2024-04-15T20:59:54.371 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T20:59:54.371 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.72:6829/4081954875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":4081954875},{"type":"v1","addr":"172.21.15.72:6829","nonce":4081954875}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14492,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/3963533271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3963533271},{"type":"v1","addr":"172.21.15.72:6827","nonce":3963533271}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T20:59:43.360239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi149.mflbpn","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6825/2041346775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2041346775},{"type":"v1","addr":"172.21.15.149:6825","nonce":2041346775}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-15T20:59:54.371 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 msgr2=0x7f833406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 0x7f833406eb60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f833002c7c0 tx=0x7f8330000bc0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 msgr2=0x7f8348194f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f833800d8d0 tx=0x7f833800dd90 comp rx=0 tx=0).stop 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 shutdown_connections 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f833406c6b0 0x7f833406eb60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83480ff740 0x7f8348195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 --2- 172.21.15.72:0/1299451311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480fe550 0x7f8348194f30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 >> 172.21.15.72:0/1299451311 conn(0x7f83480f9a90 msgr2=0x7f83480fb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 shutdown_connections 2024-04-15T20:59:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:54.380+0000 7f834d421640 1 -- 172.21.15.72:0/1299451311 wait complete. 2024-04-15T20:59:54.384 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-04-15T20:59:54.384 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-15T20:59:54.413 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-15T20:59:54.413 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-15T20:59:54.413 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-15T20:59:54.413 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T20:59:54.414 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T20:59:54.414 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-15T20:59:54.414 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T20:59:54.414 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T20:59:54.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:54.415 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-15T20:59:54.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:54.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-04-15T20:59:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-04-15T20:59:54.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:59:54.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:54.504 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-04-15T20:59:54.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:54.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-04-15T20:59:54.559 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:54 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3300181580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T20:59:54.559 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:54 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2875927613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T20:59:54.559 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:54 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1299451311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T20:59:54.601 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-04-15T20:59:54.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T20:59:54.603 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-15T20:59:54.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph fs ls 2024-04-15T20:59:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:54 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3300181580' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T20:59:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:54 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2875927613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T20:59:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:54 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1299451311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T20:59:55.148 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T20:59:55.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:55 smithi072 ceph-mon[29079]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T20:59:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:55 smithi149 ceph-mon[36029]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 -- 172.21.15.72:0/871056369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 msgr2=0x7f560c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 --2- 172.21.15.72:0/871056369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c104e50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5600009910 tx=0x7f5600009c20 comp rx=0 tx=0).stop 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 -- 172.21.15.72:0/871056369 shutdown_connections 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 --2- 172.21.15.72:0/871056369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c104e50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 --2- 172.21.15.72:0/871056369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.794+0000 7f56125b2700 1 -- 172.21.15.72:0/871056369 >> 172.21.15.72:0/871056369 conn(0x7f560c0fbda0 msgr2=0x7f560c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.795+0000 7f56125b2700 1 -- 172.21.15.72:0/871056369 shutdown_connections 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.795+0000 7f56125b2700 1 -- 172.21.15.72:0/871056369 wait complete. 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.795+0000 7f56125b2700 1 Processor -- start 2024-04-15T20:59:56.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.795+0000 7f56125b2700 1 -- start start 2024-04-15T20:59:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f56125b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f56125b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f56125b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c196b30 con 0x7f560c100e80 2024-04-15T20:59:56.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f56125b2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c19a8c0 con 0x7f560c1004e0 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43114/0 (socket says 172.21.15.72:43114) 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 -- 172.21.15.72:0/1224611454 learned_addr learned my addr 172.21.15.72:0/1224611454 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560bfff700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 -- 172.21.15.72:0/1224611454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 msgr2=0x7f560c195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 -- 172.21.15.72:0/1224611454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000095f0 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560bfff700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.796+0000 7f560b7fe700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f560000bda0 tx=0x7f560000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.797+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560001d070 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.797+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f560000f460 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.797+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c19ab40 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.797+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5600017630 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.797+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c19b030 con 0x7f560c100e80 2024-04-15T20:59:56.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.798+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c108850 con 0x7f560c100e80 2024-04-15T20:59:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.799+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f560000fad0 con 0x7f560c100e80 2024-04-15T20:59:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.799+0000 7f56097fa700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 0x7f55f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T20:59:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.800+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f560008cfa0 con 0x7f560c100e80 2024-04-15T20:59:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.800+0000 7f560bfff700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 0x7f55f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T20:59:56.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.800+0000 7f560bfff700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 0x7f55f406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00bc10 tx=0x7f55fc00b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T20:59:56.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:56.803+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f56000576a0 con 0x7f560c100e80 2024-04-15T20:59:56.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:56.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:56.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:56.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:56.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:56.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:56 smithi149 ceph-mon[36029]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T20:59:57.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.038+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f560c04f2a0 con 0x7f560c100e80 2024-04-15T20:59:57.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.038+0000 7f56097fa700 1 -- 172.21.15.72:0/1224611454 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f560005acc0 con 0x7f560c100e80 2024-04-15T20:59:57.032 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-15T20:59:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.040+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 msgr2=0x7f55f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.040+0000 7f56125b2700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 0x7f55f406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00bc10 tx=0x7f55fc00b5f0 comp rx=0 tx=0).stop 2024-04-15T20:59:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.040+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 msgr2=0x7f560c196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T20:59:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.040+0000 7f56125b2700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f560000bda0 tx=0x7f560000be80 comp rx=0 tx=0).stop 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 shutdown_connections 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55f406c680 0x7f55f406eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f560c1004e0 0x7f560c195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 --2- 172.21.15.72:0/1224611454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f560c100e80 0x7f560c196450 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 >> 172.21.15.72:0/1224611454 conn(0x7f560c0fbda0 msgr2=0x7f560c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 shutdown_connections 2024-04-15T20:59:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57.041+0000 7f56125b2700 1 -- 172.21.15.72:0/1224611454 wait complete. 2024-04-15T20:59:57.045 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:57.045 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:57.045 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T20:59:57.045 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T20:59:57.046 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T20:59:57.046 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:56 smithi072 ceph-mon[29079]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T20:59:57.683 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T20:59:57.684 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T20:59:57.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:57.684 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T20:59:57.702 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42257sec preferred_lft 42257sec 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-04-15T20:59:57.703 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-04-15T20:59:57.704 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T20:59:57.704 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-15T20:59:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T20:59:57.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:57 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1224611454' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-15T20:59:57.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:57.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:57.925 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T20:59:57.953 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-15T20:59:57.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:57.955 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-04-15T20:59:58.023 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-04-15T20:59:58.024 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T20:59:58.024 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T20:59:58.024 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T20:59:58.024 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T20:59:58.024 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T20:59:58.025 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-15T20:59:58.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T20:59:58.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T20:59:58.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T20:59:58.025 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-15T20:59:58.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T20:59:58.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:57 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1224611454' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-15T20:59:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:58.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:58.354 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-04-15T20:59:58.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:58.371 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-04-15T20:59:58.426 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T20:59:58.426 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-15T20:59:58.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T20:59:58.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-15T20:59:58.427 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-15T20:59:58.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T20:59:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:58.551 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-15T20:59:58.551 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T20:59:58.551 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-15T20:59:58.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-15T20:59:58.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T20:59:58.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-15T20:59:58.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-15T20:59:58.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-15T20:59:58.552 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-15T20:59:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T20:59:58.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:58.696 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T20:59:58.697 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-04-15T20:59:58.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-04-15T20:59:58.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T20:59:58.697 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-04-15T20:59:58.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T20:59:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:58.780 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-15T20:59:58.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T20:59:58.781 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T20:59:58.799 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T20:59:58.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T20:59:58.799 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T20:59:58.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-15T20:59:58.925 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-15T20:59:58.982 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T20:59:58.983 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/d59e7f7a9f2f4dc4d45addafc78b84f5253330226e983ff43ef20385f843d1a2/merged 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/a8a1721a74fad1d613468f82c816371f1941782d9494f259c26ecc6e9535ebdc/merged 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/0 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b376bb674b34c1db77ffba3e6b357d0273eb7fb1a635e90cef627095c5f8f72e/merged 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/fcf434dd91abd52ae5055f20310a4fbe0cc7bc77612c5f0139046fb6f59b4cc4/merged 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/35ad7d68257e3b8dc20d30ad2684aa94f811bbaf7d94e918a982c9af5ae7d3f9/merged 2024-04-15T20:59:58.984 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/748f54e4ecb3deb6b7846aa0610106da139aaa93971a57c46822594fa40ec142/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/bf8b8b35d09f1ae483bfa0af6ca48c2462f20c95005ecb6ea1f7154957ce20a7/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/796d39dceb53b408ec240f43eac529315bb22433a81a2323c153765f913ed5ba/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/7b3fb69b38d87e4e64584d6029c3ef4a8527904cf51ef8261958a724c2d33e0a/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/fad7e7669c2a7be641d8008202cf535f667c3509dbb1b3afaa6c28e33260e704/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/93933aa267e5b4b5a9c40117bfa98d810b2c4b96c99c9d55c167ac06aa914b17/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/06cdb0692a90cb952162ae617c7e9a058627c892bec55286762ce10add40f526/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/5aad36bc7eba124a88648b71174e38e5548c3683395d8ee23b5bd75d335e9acd/merged 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T20:59:58.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:58.986 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-15T20:59:59.038 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T20:59:59.038 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-15T20:59:59.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-04-15T20:59:59.108 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T20:59:59.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 20:59:58 smithi072 ceph-mon[29079]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-04-15T20:59:59.138 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T20:59:59.139 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/d59e7f7a9f2f4dc4d45addafc78b84f5253330226e983ff43ef20385f843d1a2/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/a8a1721a74fad1d613468f82c816371f1941782d9494f259c26ecc6e9535ebdc/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/0 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b376bb674b34c1db77ffba3e6b357d0273eb7fb1a635e90cef627095c5f8f72e/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/fcf434dd91abd52ae5055f20310a4fbe0cc7bc77612c5f0139046fb6f59b4cc4/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/35ad7d68257e3b8dc20d30ad2684aa94f811bbaf7d94e918a982c9af5ae7d3f9/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/748f54e4ecb3deb6b7846aa0610106da139aaa93971a57c46822594fa40ec142/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/bf8b8b35d09f1ae483bfa0af6ca48c2462f20c95005ecb6ea1f7154957ce20a7/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/796d39dceb53b408ec240f43eac529315bb22433a81a2323c153765f913ed5ba/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/7b3fb69b38d87e4e64584d6029c3ef4a8527904cf51ef8261958a724c2d33e0a/merged 2024-04-15T20:59:59.140 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/fad7e7669c2a7be641d8008202cf535f667c3509dbb1b3afaa6c28e33260e704/merged 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/93933aa267e5b4b5a9c40117bfa98d810b2c4b96c99c9d55c167ac06aa914b17/merged 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/06cdb0692a90cb952162ae617c7e9a058627c892bec55286762ce10add40f526/merged 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/5aad36bc7eba124a88648b71174e38e5548c3683395d8ee23b5bd75d335e9acd/merged 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T20:59:59.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:59.141 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-04-15T20:59:59.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2024-04-15T20:59:59.192+0000 7faded16e480 -1 init, newargv = 0x5631755b9360 newargc=15 2024-04-15T20:59:59.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[67138]: starting ceph client 2024-04-15T20:59:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 20:59:58 smithi149 ceph-mon[36029]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-15T20:59:59.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[67138]: starting fuse 2024-04-15T20:59:59.194 INFO:teuthology.orchestra.run.smithi072.stdout:125 2024-04-15T20:59:59.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [125] 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-04-15T20:59:59.195 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> 2024-04-15T20:59:59.196 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2024-04-15T20:59:59.197 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-04-15T20:59:59.316 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.67138.asok 2024-04-15T20:59:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T20:59:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T20:59:59.327 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.67138.asok 2024-04-15T20:59:59.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T20:59:59.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.67138.asok status 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2024-04-15T20:59:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "67138", 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 14532, 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 14532 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-15T20:59:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2863142207 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2863142207 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.14532 192.168.0.1:0/2863142207", 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/2863142207", 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-04-15T20:59:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 14, 2024-04-15T20:59:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 46, 2024-04-15T20:59:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-04-15T20:59:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-04-15T20:59:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-04-15T20:59:59.467 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T20:59:59.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- ceph fs ls 2024-04-15T20:59:59.683 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:00.116 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:00 smithi072 ceph-mon[29079]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:00.116 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:00 smithi072 ceph-mon[29079]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:00.116 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:00 smithi072 ceph-mon[29079]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:00:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:00 smithi149 ceph-mon[36029]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:00 smithi149 ceph-mon[36029]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:00 smithi149 ceph-mon[36029]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 -- 172.21.15.72:0/2579775448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c1004e0 msgr2=0x7fc08c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 --2- 172.21.15.72:0/2579775448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c1004e0 0x7fc08c1008b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009910 tx=0x7fc07c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 -- 172.21.15.72:0/2579775448 shutdown_connections 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 --2- 172.21.15.72:0/2579775448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c100e80 0x7fc08c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 --2- 172.21.15.72:0/2579775448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c1004e0 0x7fc08c1008b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 -- 172.21.15.72:0/2579775448 >> 172.21.15.72:0/2579775448 conn(0x7fc08c0fbda0 msgr2=0x7fc08c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 -- 172.21.15.72:0/2579775448 shutdown_connections 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.273+0000 7fc092136700 1 -- 172.21.15.72:0/2579775448 wait complete. 2024-04-15T21:00:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.274+0000 7fc092136700 1 Processor -- start 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.274+0000 7fc092136700 1 -- start start 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c1004e0 0x7fc08c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c196b10 con 0x7fc08c100e80 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19a8a0 con 0x7fc08c1004e0 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43126/0 (socket says 172.21.15.72:43126) 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 -- 172.21.15.72:0/141015688 learned_addr learned my addr 172.21.15.72:0/141015688 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08b7fe700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c1004e0 0x7fc08c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 -- 172.21.15.72:0/141015688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c1004e0 msgr2=0x7fc08c195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c1004e0 0x7fc08c195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 -- 172.21.15.72:0/141015688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0095f0 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc08affd700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c8f0 tx=0x7fc08000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc080007a50 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c19ab80 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc080007bb0 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc080018630 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.275+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c19b0d0 con 0x7fc08c100e80 2024-04-15T21:00:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.276+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c1087f0 con 0x7fc08c100e80 2024-04-15T21:00:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.277+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc080007d20 con 0x7fc08c100e80 2024-04-15T21:00:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.277+0000 7fc088ff9700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 0x7fc07406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.277+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc08008b8a0 con 0x7fc08c100e80 2024-04-15T21:00:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.277+0000 7fc08b7fe700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 0x7fc07406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.278+0000 7fc08b7fe700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 0x7fc07406eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b5c0 tx=0x7fc07c01a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.282+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc080055f20 con 0x7fc08c100e80 2024-04-15T21:00:01.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:01 smithi072 ceph-mon[29079]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-15T21:00:01.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:01 smithi149 ceph-mon[36029]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-15T21:00:01.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.519+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc08c19b350 con 0x7fc08c100e80 2024-04-15T21:00:01.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.519+0000 7fc088ff9700 1 -- 172.21.15.72:0/141015688 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc080059540 con 0x7fc08c100e80 2024-04-15T21:00:01.513 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 msgr2=0x7fc07406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 0x7fc07406eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b5c0 tx=0x7fc07c01a040 comp rx=0 tx=0).stop 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 msgr2=0x7fc08c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c8f0 tx=0x7fc08000ccb0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 shutdown_connections 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc07406c680 0x7fc07406eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c1004e0 0x7fc08c195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 --2- 172.21.15.72:0/141015688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc08c100e80 0x7fc08c196430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.521+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 >> 172.21.15.72:0/141015688 conn(0x7fc08c0fbda0 msgr2=0x7fc08c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.522+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 shutdown_connections 2024-04-15T21:00:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:01.522+0000 7fc092136700 1 -- 172.21.15.72:0/141015688 wait complete. 2024-04-15T21:00:02.104 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T21:00:02.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T21:00:02.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T21:00:02.105 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-15T21:00:02.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:02.105 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T21:00:02.125 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42232sec preferred_lft 42232sec 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-04-15T21:00:02.126 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-04-15T21:00:02.127 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T21:00:02.127 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-04-15T21:00:02.222 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T21:00:02.345 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:02.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:02.352 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T21:00:02.380 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-04-15T21:00:02.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:02.382 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-04-15T21:00:02.446 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-04-15T21:00:02.446 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T21:00:02.446 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T21:00:02.446 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T21:00:02.446 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T21:00:02.447 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-04-15T21:00:02.535 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T21:00:02.740 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:02.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:02.746 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-04-15T21:00:02.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:02.762 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-04-15T21:00:02.818 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T21:00:02.818 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-04-15T21:00:02.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T21:00:02.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-15T21:00:02.818 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-04-15T21:00:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T21:00:02.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:02 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/141015688' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-15T21:00:02.919 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/141015688' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-15T21:00:02.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:02.946 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-15T21:00:02.947 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-04-15T21:00:02.995 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T21:00:03.094 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:03.100 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T21:00:03.101 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-04-15T21:00:03.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-04-15T21:00:03.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T21:00:03.101 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-04-15T21:00:03.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T21:00:03.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:03.186 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-15T21:00:03.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T21:00:03.186 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:03.201 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-15T21:00:03.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T21:00:03.202 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:03.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-04-15T21:00:03.325 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-04-15T21:00:03.383 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-04-15T21:00:03.384 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/0 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/7aef5c1b78cfd688088934091afe5e9741c0707c7d0795e8c2bcddb14f5d75d5/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/bc6bd8f70169ad755c8eaea7d7408f1b63965cc3de20b72bb4fbe24f94aac61b/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/14a7f0274334a5354f9e907de60afbd0f6e1216a98513cce0fc84b3f1d19d964/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/ae8913458b71931c74d12c8858bb9b7b19e8e5ee1e6a01a78f367eea391c56cf/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/1690156ba63bb1b57e47c1f88b18e64748f2539efa91b9aadafb9d540dd87903/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/6116a5881ff60c891ee6e127d43d76b06cdcba257db84ed3a03cd787dfd842fd/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/7fc90cb511e9e8b96d3800d113a87f4ee7170f80a35a6e4bb20b388d6e1d9e4a/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/0018d36c60a7bd6960c60d59d1cf98031956c32358891d1adab8e6ad99a06f47/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/5a3a5865022b14713e1ab4a638ef7ef31c82a2ad5345b6e41bb7f5dec9ad6f98/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/c79f9810992e9e124f42434542b6b44d55ff800e2fc4f174f815c0966bf6c500/merged 2024-04-15T21:00:03.385 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-04-15T21:00:03.386 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T21:00:03.386 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T21:00:03.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:03.386 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-04-15T21:00:03.439 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T21:00:03.439 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-15T21:00:03.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-04-15T21:00:03.510 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T21:00:03.566 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-04-15T21:00:03.567 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/selinux 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/0 2024-04-15T21:00:03.568 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/7aef5c1b78cfd688088934091afe5e9741c0707c7d0795e8c2bcddb14f5d75d5/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/bc6bd8f70169ad755c8eaea7d7408f1b63965cc3de20b72bb4fbe24f94aac61b/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/14a7f0274334a5354f9e907de60afbd0f6e1216a98513cce0fc84b3f1d19d964/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/ae8913458b71931c74d12c8858bb9b7b19e8e5ee1e6a01a78f367eea391c56cf/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/1690156ba63bb1b57e47c1f88b18e64748f2539efa91b9aadafb9d540dd87903/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/6116a5881ff60c891ee6e127d43d76b06cdcba257db84ed3a03cd787dfd842fd/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/7fc90cb511e9e8b96d3800d113a87f4ee7170f80a35a6e4bb20b388d6e1d9e4a/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/0018d36c60a7bd6960c60d59d1cf98031956c32358891d1adab8e6ad99a06f47/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/5a3a5865022b14713e1ab4a638ef7ef31c82a2ad5345b6e41bb7f5dec9ad6f98/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/containers/storage/overlay/c79f9810992e9e124f42434542b6b44d55ff800e2fc4f174f815c0966bf6c500/merged 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T21:00:03.569 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-15T21:00:03.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:03.570 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-04-15T21:00:03.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:2024-04-15T21:00:03.608+0000 7f7d09efa480 -1 init, newargv = 0x5584037e4330 newargc=15 2024-04-15T21:00:03.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[55952]: starting ceph client 2024-04-15T21:00:03.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[55952]: starting fuse 2024-04-15T21:00:03.617 INFO:teuthology.orchestra.run.smithi149.stdout:126 2024-04-15T21:00:03.617 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [126] 2024-04-15T21:00:03.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer -- python3 -c ' 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> import re 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> import os 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2024-04-15T21:00:03.618 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> return f 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.1")) 2024-04-15T21:00:03.619 DEBUG:teuthology.orchestra.run.smithi149:> ' 2024-04-15T21:00:03.740 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.1.55952.asok 2024-04-15T21:00:03.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-04-15T21:00:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T21:00:03.751 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.55952.asok 2024-04-15T21:00:03.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:03.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.55952.asok status 2024-04-15T21:00:03.817 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:03 smithi149 ceph-mon[36029]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-15T21:00:03.889 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "1", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "55952", 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2024-04-15T21:00:03.890 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 24305, 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 24305 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 108029171 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-04-15T21:00:03.891 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 108029171 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.24305 192.168.0.1:0/108029171", 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.1:0/108029171", 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 14, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 46, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2024-04-15T21:00:03.892 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-04-15T21:00:03.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:03.898 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-04-15T21:00:03.898 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:03 smithi072 ceph-mon[29079]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-15T21:00:03.920 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-04-15T21:00:03.921 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:03.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:03.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:03.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:04.000 DEBUG:teuthology.orchestra.run.smithi149:> stat --file-system '--printf=%T 2024-04-15T21:00:04.000 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.016 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2024-04-15T21:00:04.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:00:04.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.089 INFO:teuthology.run_tasks:Running task print... 2024-04-15T21:00:04.101 INFO:teuthology.task.print:**** done client 2024-04-15T21:00:04.101 INFO:teuthology.run_tasks:Running task parallel... 2024-04-15T21:00:04.139 INFO:teuthology.task.parallel:starting parallel... 2024-04-15T21:00:04.140 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-15T21:00:04.141 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-15T21:00:04.141 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T21:00:04.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-15T21:00:04.142 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-15T21:00:04.142 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-15T21:00:04.145 INFO:tasks.workunit:Pulling workunits from ref 3f7db60e5ba4c4d053b594b7ec58703d2833c55b 2024-04-15T21:00:04.146 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-15T21:00:04.146 INFO:tasks.workunit:timeout=3h 2024-04-15T21:00:04.146 INFO:tasks.workunit:cleanup=True 2024-04-15T21:00:04.146 DEBUG:teuthology.orchestra.run.smithi072:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 7dh/125d Inode: 1 Links: 2 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-15T21:00:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-15 20:59:29.760107040 +0000 2024-04-15T21:00:04.168 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-15 21:00:04.004888306 +0000 2024-04-15T21:00:04.168 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-15T21:00:04.168 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-15T21:00:04.168 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-15T21:00:04.243 DEBUG:teuthology.orchestra.run.smithi149:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.260 INFO:teuthology.orchestra.run.smithi149.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 7eh/126d Inode: 1 Links: 3 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-04-15 21:00:04.246233148 +0000 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-04-15 21:00:04.246233148 +0000 2024-04-15T21:00:04.261 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2024-04-15T21:00:04.261 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-15T21:00:04.261 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-15T21:00:04.333 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3f7db60e5ba4c4d053b594b7ec58703d2833c55b 2024-04-15T21:00:04.334 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3f7db60e5ba4c4d053b594b7ec58703d2833c55b 2024-04-15T21:00:04.351 INFO:tasks.workunit.client.0.smithi072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-15T21:00:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:04.390 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-15T21:00:04.640 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:05.731 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:05 smithi072 ceph-mon[29079]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-15T21:00:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:05 smithi149 ceph-mon[36029]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-15T21:00:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 -- 172.21.15.72:0/1270272269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0ff130 msgr2=0x7f75bc0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 --2- 172.21.15.72:0/1270272269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0ff130 0x7f75bc0ff540 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f75b800b0a0 tx=0x7f75b800b3b0 comp rx=0 tx=0).stop 2024-04-15T21:00:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 -- 172.21.15.72:0/1270272269 shutdown_connections 2024-04-15T21:00:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 --2- 172.21.15.72:0/1270272269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc1003d0 0x7f75bc100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 --2- 172.21.15.72:0/1270272269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0ff130 0x7f75bc0ff540 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 -- 172.21.15.72:0/1270272269 >> 172.21.15.72:0/1270272269 conn(0x7f75bc0fa780 msgr2=0x7f75bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 -- 172.21.15.72:0/1270272269 shutdown_connections 2024-04-15T21:00:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.990+0000 7f75c32e7700 1 -- 172.21.15.72:0/1270272269 wait complete. 2024-04-15T21:00:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 Processor -- start 2024-04-15T21:00:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 -- start start 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc0ff130 0x7f75bc0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc19ae00 con 0x7f75bc1003d0 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c32e7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc19af40 con 0x7f75bc0ff130 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49102/0 (socket says 172.21.15.72:49102) 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 -- 172.21.15.72:0/3922045928 learned_addr learned my addr 172.21.15.72:0/3922045928 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c1083700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc0ff130 0x7f75bc0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 -- 172.21.15.72:0/3922045928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc0ff130 msgr2=0x7f75bc0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc0ff130 0x7f75bc0690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.991+0000 7f75c0882700 1 -- 172.21.15.72:0/3922045928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8009d00 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75c0882700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c8a0 tx=0x7f75ac00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75ac0078e0 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75ac00f450 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc19b220 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc19b770 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.992+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75ac00e5e0 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.993+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a0005320 con 0x7f75bc1003d0 2024-04-15T21:00:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.993+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f75ac00e740 con 0x7f75bc1003d0 2024-04-15T21:00:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.994+0000 7f75b27fc700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 0x7f75a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.994+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f75ac08b460 con 0x7f75bc1003d0 2024-04-15T21:00:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.994+0000 7f75c1083700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 0x7f75a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.994+0000 7f75c1083700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 0x7f75a806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75b8000f80 tx=0x7f75b8009340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:05.998+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f75ac059730 con 0x7f75bc1003d0 2024-04-15T21:00:06.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.193+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f75a0005f70 con 0x7f75bc1003d0 2024-04-15T21:00:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.198+0000 7f75b27fc700 1 -- 172.21.15.72:0/3922045928 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7f75ac0592c0 con 0x7f75bc1003d0 2024-04-15T21:00:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 msgr2=0x7f75a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 0x7f75a806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75b8000f80 tx=0x7f75b8009340 comp rx=0 tx=0).stop 2024-04-15T21:00:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 msgr2=0x7f75bc19a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c8a0 tx=0x7f75ac00cbb0 comp rx=0 tx=0).stop 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 shutdown_connections 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f75a806c680 0x7f75a806eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75bc0ff130 0x7f75bc0690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 --2- 172.21.15.72:0/3922045928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc1003d0 0x7f75bc19a830 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 >> 172.21.15.72:0/3922045928 conn(0x7f75bc0fa780 msgr2=0x7f75bc103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 shutdown_connections 2024-04-15T21:00:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:06.200+0000 7f75c32e7700 1 -- 172.21.15.72:0/3922045928 wait complete. 2024-04-15T21:00:07.180 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-15T21:00:07.181 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T21:00:07.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-15T21:00:07.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3922045928' entity='client.admin' 2024-04-15T21:00:07.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:07.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:00:07.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:00:07.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:00:07.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:07 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:07.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3922045928' entity='client.admin' 2024-04-15T21:00:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:00:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:00:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:00:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:07 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 -- 172.21.15.72:0/2532725777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10100d30 msgr2=0x7f0c10103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 --2- 172.21.15.72:0/2532725777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10100d30 0x7f0c10103110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009910 tx=0x7f0c00009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 -- 172.21.15.72:0/2532725777 shutdown_connections 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 --2- 172.21.15.72:0/2532725777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10103650 0x7f0c10105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 --2- 172.21.15.72:0/2532725777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10100d30 0x7f0c10103110 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 -- 172.21.15.72:0/2532725777 >> 172.21.15.72:0/2532725777 conn(0x7f0c100fa6d0 msgr2=0x7f0c100fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 -- 172.21.15.72:0/2532725777 shutdown_connections 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.070+0000 7f0c16375700 1 -- 172.21.15.72:0/2532725777 wait complete. 2024-04-15T21:00:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 Processor -- start 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 -- start start 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10100d30 0x7f0c10195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101965d0 con 0x7f0c10103650 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c16375700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10196710 con 0x7f0c10100d30 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49124/0 (socket says 172.21.15.72:49124) 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 -- 172.21.15.72:0/3205928625 learned_addr learned my addr 172.21.15.72:0/3205928625 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 -- 172.21.15.72:0/3205928625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10100d30 msgr2=0x7f0c10195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10100d30 0x7f0c10195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10100d30 0x7f0c10195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.071+0000 7f0c07fff700 1 -- 172.21.15.72:0/3205928625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000095f0 con 0x7f0c10103650 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c07fff700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800d8d0 tx=0x7f0bf800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf8009940 con 0x7f0c10103650 2024-04-15T21:00:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0bf8010460 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1019b1c0 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf800f5f0 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.072+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1019b710 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.073+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1018fc60 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.073+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0bf80105d0 con 0x7f0c10103650 2024-04-15T21:00:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.074+0000 7f0c0dffb700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 0x7f0bfc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.074+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0bf808b8e0 con 0x7f0c10103650 2024-04-15T21:00:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.074+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 0x7f0bfc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:09.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.074+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 0x7f0bfc06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000b5c0 tx=0x7f0c00005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:09.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.078+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0bf80599f0 con 0x7f0c10103650 2024-04-15T21:00:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.267+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0c1002cc30 con 0x7f0c10103650 2024-04-15T21:00:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.267+0000 7f0c0dffb700 1 -- 172.21.15.72:0/3205928625 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0bf8059580 con 0x7f0c10103650 2024-04-15T21:00:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 msgr2=0x7f0bfc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 0x7f0bfc06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000b5c0 tx=0x7f0c00005960 comp rx=0 tx=0).stop 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 msgr2=0x7f0c10195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800d8d0 tx=0x7f0bf800dc90 comp rx=0 tx=0).stop 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 shutdown_connections 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f0bfc06c680 0x7f0bfc06eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c10100d30 0x7f0c10195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 --2- 172.21.15.72:0/3205928625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c10103650 0x7f0c10195fb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 >> 172.21.15.72:0/3205928625 conn(0x7f0c100fa6d0 msgr2=0x7f0c100fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 shutdown_connections 2024-04-15T21:00:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:09.270+0000 7f0c16375700 1 -- 172.21.15.72:0/3205928625 wait complete. 2024-04-15T21:00:09.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:09 smithi072 ceph-mon[29079]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:09.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:09 smithi149 ceph-mon[36029]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:09.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-15T21:00:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:11.567 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:11 smithi072 ceph-mon[29079]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:11.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:11 smithi149 ceph-mon[36029]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-15T21:00:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 -- 172.21.15.72:0/3467676324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 msgr2=0x7f21c00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 --2- 172.21.15.72:0/3467676324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c00ff540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00b0a0 tx=0x7f21bc00b3b0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 -- 172.21.15.72:0/3467676324 shutdown_connections 2024-04-15T21:00:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 --2- 172.21.15.72:0/3467676324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01003d0 0x7f21c0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 --2- 172.21.15.72:0/3467676324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c00ff540 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 -- 172.21.15.72:0/3467676324 >> 172.21.15.72:0/3467676324 conn(0x7f21c00fa780 msgr2=0x7f21c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 -- 172.21.15.72:0/3467676324 shutdown_connections 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.788+0000 7f21c7c71700 1 -- 172.21.15.72:0/3467676324 wait complete. 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 Processor -- start 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 -- start start 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01003d0 0x7f21c01017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0101cf0 con 0x7f21c00ff130 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0101e30 con 0x7f21c01003d0 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46672/0 (socket says 172.21.15.72:46672) 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 -- 172.21.15.72:0/1187338965 learned_addr learned my addr 172.21.15.72:0/1187338965 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 -- 172.21.15.72:0/1187338965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01003d0 msgr2=0x7f21c01017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01003d0 0x7f21c01017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 -- 172.21.15.72:0/1187338965 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009d00 con 0x7f21c00ff130 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c5a0d700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0077b0 tx=0x7f21bc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc00e040 con 0x7f21c00ff130 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c01020b0 con 0x7f21c00ff130 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21bc00ce60 con 0x7f21c00ff130 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc01daf0 con 0x7f21c00ff130 2024-04-15T21:00:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.789+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c01025a0 con 0x7f21c00ff130 2024-04-15T21:00:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.790+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0107c90 con 0x7f21c00ff130 2024-04-15T21:00:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.791+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f21bc004250 con 0x7f21c00ff130 2024-04-15T21:00:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.791+0000 7f21b6ffd700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 0x7f21ac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.791+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f21bc08d3a0 con 0x7f21c00ff130 2024-04-15T21:00:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.791+0000 7f21c520c700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 0x7f21ac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.792+0000 7f21c520c700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 0x7f21ac06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097b0 tx=0x7f21b0006d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.796+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21bc05b4b0 con 0x7f21c00ff130 2024-04-15T21:00:11.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.987+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f21c0107e80 con 0x7f21c00ff130 2024-04-15T21:00:11.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.987+0000 7f21b6ffd700 1 -- 172.21.15.72:0/1187338965 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7f21bc05b040 con 0x7f21c00ff130 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 msgr2=0x7f21ac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 0x7f21ac06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097b0 tx=0x7f21b0006d20 comp rx=0 tx=0).stop 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 msgr2=0x7f21c0103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0077b0 tx=0x7f21bc003ce0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 shutdown_connections 2024-04-15T21:00:11.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f21ac06c680 0x7f21ac06eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c00ff130 0x7f21c0103160 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 --2- 172.21.15.72:0/1187338965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c01003d0 0x7f21c01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:11.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 >> 172.21.15.72:0/1187338965 conn(0x7f21c00fa780 msgr2=0x7f21c0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:11.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 shutdown_connections 2024-04-15T21:00:11.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:11.989+0000 7f21c7c71700 1 -- 172.21.15.72:0/1187338965 wait complete. 2024-04-15T21:00:12.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-15T21:00:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:13 smithi072 ceph-mon[29079]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-15T21:00:13.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:13 smithi149 ceph-mon[36029]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-15T21:00:14.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 -- 172.21.15.72:0/2962038585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 msgr2=0x7f5c98100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 --2- 172.21.15.72:0/2962038585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98100650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009910 tx=0x7f5c8c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 -- 172.21.15.72:0/2962038585 shutdown_connections 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 --2- 172.21.15.72:0/2962038585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c98101440 0x7f5c98101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 --2- 172.21.15.72:0/2962038585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98100650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 -- 172.21.15.72:0/2962038585 >> 172.21.15.72:0/2962038585 conn(0x7f5c980fb7f0 msgr2=0x7f5c980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 -- 172.21.15.72:0/2962038585 shutdown_connections 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 -- 172.21.15.72:0/2962038585 wait complete. 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.495+0000 7f5c9eead700 1 Processor -- start 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 -- start start 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c98101440 0x7f5c98073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:14.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98073680 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980737c0 con 0x7f5c98101440 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46696/0 (socket says 172.21.15.72:46696) 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 -- 172.21.15.72:0/179976437 learned_addr learned my addr 172.21.15.72:0/179976437 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 -- 172.21.15.72:0/179976437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c98101440 msgr2=0x7f5c98073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c98101440 0x7f5c98073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 -- 172.21.15.72:0/179976437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0095f0 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9cc49700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00bda0 tx=0x7f5c8c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c8c01d070 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c8c00f460 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c98073a40 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.496+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c8c021640 con 0x7f5c98100240 2024-04-15T21:00:14.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.497+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c98073f30 con 0x7f5c98100240 2024-04-15T21:00:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.498+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c98108d90 con 0x7f5c98100240 2024-04-15T21:00:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.498+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5c8c00fa00 con 0x7f5c98100240 2024-04-15T21:00:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.499+0000 7f5c95ffb700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 0x7f5c8806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.499+0000 7f5c97fff700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 0x7f5c8806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.499+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5c8c08cae0 con 0x7f5c98100240 2024-04-15T21:00:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.499+0000 7f5c97fff700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 0x7f5c8806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c84005950 tx=0x7f5c840058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:14.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.503+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5c8c05abf0 con 0x7f5c98100240 2024-04-15T21:00:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.695+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5c9819e010 con 0x7f5c98100240 2024-04-15T21:00:14.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.695+0000 7f5c95ffb700 1 -- 172.21.15.72:0/179976437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5c8c05a780 con 0x7f5c98100240 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 msgr2=0x7f5c8806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 0x7f5c8806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c84005950 tx=0x7f5c840058e0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 msgr2=0x7f5c98074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00bda0 tx=0x7f5c8c00be80 comp rx=0 tx=0).stop 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 shutdown_connections 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5c8806c680 0x7f5c8806eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98100240 0x7f5c98074af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 --2- 172.21.15.72:0/179976437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c98101440 0x7f5c98073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 >> 172.21.15.72:0/179976437 conn(0x7f5c980fb7f0 msgr2=0x7f5c98104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 shutdown_connections 2024-04-15T21:00:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:14.697+0000 7f5c9eead700 1 -- 172.21.15.72:0/179976437 wait complete. 2024-04-15T21:00:15.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-15T21:00:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:15.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:15 smithi072 ceph-mon[29079]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-15T21:00:15.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:15 smithi149 ceph-mon[36029]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-15T21:00:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 -- 172.21.15.72:0/716054401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 msgr2=0x7fb3440ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 --2- 172.21.15.72:0/716054401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb3440ff560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb334009910 tx=0x7fb334009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 -- 172.21.15.72:0/716054401 shutdown_connections 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 --2- 172.21.15.72:0/716054401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3441003f0 0x7fb344100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 --2- 172.21.15.72:0/716054401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb3440ff560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 -- 172.21.15.72:0/716054401 >> 172.21.15.72:0/716054401 conn(0x7fb3440fa7a0 msgr2=0x7fb3440fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 -- 172.21.15.72:0/716054401 shutdown_connections 2024-04-15T21:00:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.436+0000 7fb34a669700 1 -- 172.21.15.72:0/716054401 wait complete. 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 Processor -- start 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 -- start start 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3441003f0 0x7fb344198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344198b60 con 0x7fb3440ff150 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb34a669700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344198ca0 con 0x7fb3441003f0 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb343fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb343fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46712/0 (socket says 172.21.15.72:46712) 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.437+0000 7fb343fff700 1 -- 172.21.15.72:0/3385139943 learned_addr learned my addr 172.21.15.72:0/3385139943 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb343fff700 1 -- 172.21.15.72:0/3385139943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3441003f0 msgr2=0x7fb344198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb343fff700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3441003f0 0x7fb344198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb343fff700 1 -- 172.21.15.72:0/3385139943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340095f0 con 0x7fb3440ff150 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb343fff700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb33400bd70 tx=0x7fb33400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33401d070 con 0x7fb3440ff150 2024-04-15T21:00:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb334022470 con 0x7fb3440ff150 2024-04-15T21:00:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34419d6f0 con 0x7fb3440ff150 2024-04-15T21:00:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33400f670 con 0x7fb3440ff150 2024-04-15T21:00:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.438+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34419dbe0 con 0x7fb3440ff150 2024-04-15T21:00:17.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.439+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344068ab0 con 0x7fb3440ff150 2024-04-15T21:00:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.440+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb334022a50 con 0x7fb3440ff150 2024-04-15T21:00:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.440+0000 7fb341ffb700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 0x7fb33006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.440+0000 7fb33bfff700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 0x7fb33006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.440+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb33408ce80 con 0x7fb3440ff150 2024-04-15T21:00:17.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.441+0000 7fb33bfff700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 0x7fb33006eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00a990 tx=0x7fb32c005c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:17.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.445+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb33405b0c0 con 0x7fb3440ff150 2024-04-15T21:00:17.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.655+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29", "target": ["mon-mgr", ""]}) v1 -- 0x7fb344069580 con 0x7fb33006c680 2024-04-15T21:00:17.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.662+0000 7fb341ffb700 1 -- 172.21.15.72:0/3385139943 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fb344069580 con 0x7fb33006c680 2024-04-15T21:00:17.655 INFO:teuthology.orchestra.run.smithi072.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T21:00:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 msgr2=0x7fb33006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 0x7fb33006eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00a990 tx=0x7fb32c005c80 comp rx=0 tx=0).stop 2024-04-15T21:00:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 msgr2=0x7fb344198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb33400bd70 tx=0x7fb33400be50 comp rx=0 tx=0).stop 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 shutdown_connections 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb33006c680 0x7fb33006eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3440ff150 0x7fb344198000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 --2- 172.21.15.72:0/3385139943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3441003f0 0x7fb344198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.664+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 >> 172.21.15.72:0/3385139943 conn(0x7fb3440fa7a0 msgr2=0x7fb344068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.665+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 shutdown_connections 2024-04-15T21:00:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:17.665+0000 7fb34a669700 1 -- 172.21.15.72:0/3385139943 wait complete. 2024-04-15T21:00:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:17 smithi072 ceph-mon[29079]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-15T21:00:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:17 smithi149 ceph-mon[36029]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-15T21:00:18.373 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-15T21:00:18.374 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T21:00:18.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-15T21:00:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:00:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T21:00:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:00:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:00:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:00:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T21:00:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:18 smithi072 ceph-mon[29079]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:18.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:18.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T21:00:18.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:18 smithi149 ceph-mon[36029]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:19.949 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 -- 172.21.15.72:0/681600649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 msgr2=0x7f3960100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 --2- 172.21.15.72:0/681600649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960100650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f395c009910 tx=0x7f395c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 -- 172.21.15.72:0/681600649 shutdown_connections 2024-04-15T21:00:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 --2- 172.21.15.72:0/681600649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 0x7f3960101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 --2- 172.21.15.72:0/681600649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960100650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 -- 172.21.15.72:0/681600649 >> 172.21.15.72:0/681600649 conn(0x7f39600fb890 msgr2=0x7f39600fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 -- 172.21.15.72:0/681600649 shutdown_connections 2024-04-15T21:00:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.510+0000 7f396769c700 1 -- 172.21.15.72:0/681600649 wait complete. 2024-04-15T21:00:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 Processor -- start 2024-04-15T21:00:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 -- start start 2024-04-15T21:00:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 0x7f39601981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601987d0 con 0x7f3960100240 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f396769c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960198940 con 0x7f39601014e0 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f3965438700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f3965438700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46724/0 (socket says 172.21.15.72:46724) 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.511+0000 7f3965438700 1 -- 172.21.15.72:0/2550716464 learned_addr learned my addr 172.21.15.72:0/2550716464 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f3964c37700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 0x7f39601981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f3965438700 1 -- 172.21.15.72:0/2550716464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 msgr2=0x7f39601981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f3965438700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 0x7f39601981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f3965438700 1 -- 172.21.15.72:0/2550716464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0095f0 con 0x7f3960100240 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f3965438700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f395c006010 tx=0x7f395c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c01d070 con 0x7f3960100240 2024-04-15T21:00:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f395c00f460 con 0x7f3960100240 2024-04-15T21:00:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396019d370 con 0x7f3960100240 2024-04-15T21:00:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.512+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c021640 con 0x7f3960100240 2024-04-15T21:00:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.513+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396019d860 con 0x7f3960100240 2024-04-15T21:00:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.514+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39601055c0 con 0x7f3960100240 2024-04-15T21:00:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.514+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f395c00fab0 con 0x7f3960100240 2024-04-15T21:00:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.515+0000 7f39567fc700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 0x7f394c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.515+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f395c08ca90 con 0x7f3960100240 2024-04-15T21:00:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.515+0000 7f3964c37700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 0x7f394c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.515+0000 7f3964c37700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 0x7f394c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39601991a0 tx=0x7f395000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.519+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f395c057190 con 0x7f3960100240 2024-04-15T21:00:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.749+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3960061190 con 0x7f394c06c680 2024-04-15T21:00:20.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.750+0000 7f39567fc700 1 -- 172.21.15.72:0/2550716464 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f3960061190 con 0x7f394c06c680 2024-04-15T21:00:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 msgr2=0x7f394c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 0x7f394c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39601991a0 tx=0x7f395000b410 comp rx=0 tx=0).stop 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 msgr2=0x7f3960197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f395c006010 tx=0x7f395c00bd70 comp rx=0 tx=0).stop 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 shutdown_connections 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f394c06c680 0x7f394c06eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3960100240 0x7f3960197c90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 --2- 172.21.15.72:0/2550716464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39601014e0 0x7f39601981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.752+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 >> 172.21.15.72:0/2550716464 conn(0x7f39600fb890 msgr2=0x7f3960102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.753+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 shutdown_connections 2024-04-15T21:00:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.753+0000 7f396769c700 1 -- 172.21.15.72:0/2550716464 wait complete. 2024-04-15T21:00:20.756 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:00:20.756 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:20 smithi072 ceph-mon[29079]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 -- 172.21.15.72:0/2198876332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4100240 msgr2=0x7f43c4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/2198876332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4100240 0x7f43c4100650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009910 tx=0x7f43c0009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 -- 172.21.15.72:0/2198876332 shutdown_connections 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/2198876332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4101440 0x7f43c4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/2198876332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4100240 0x7f43c4100650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 -- 172.21.15.72:0/2198876332 >> 172.21.15.72:0/2198876332 conn(0x7f43c40fb7f0 msgr2=0x7f43c40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 -- 172.21.15.72:0/2198876332 shutdown_connections 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.865+0000 7f43cc1b1700 1 -- 172.21.15.72:0/2198876332 wait complete. 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 Processor -- start 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 -- start start 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4100240 0x7f43c4195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41966c0 con 0x7f43c4101440 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43cc1b1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4196800 con 0x7f43c4100240 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46740/0 (socket says 172.21.15.72:46740) 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 -- 172.21.15.72:0/4188031667 learned_addr learned my addr 172.21.15.72:0/4188031667 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c9f4d700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4100240 0x7f43c4195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 -- 172.21.15.72:0/4188031667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4100240 msgr2=0x7f43c4195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4100240 0x7f43c4195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 -- 172.21.15.72:0/4188031667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00095f0 con 0x7f43c4101440 2024-04-15T21:00:20.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.866+0000 7f43c974c700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009a20 tx=0x7f43b4009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.867+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b400e4e0 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.867+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4072fe0 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.867+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43b400eaf0 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.867+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b4011cc0 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.867+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4073530 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.868+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4108e10 con 0x7f43c4101440 2024-04-15T21:00:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.868+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f43b400ec60 con 0x7f43c4101440 2024-04-15T21:00:20.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.869+0000 7f43baffd700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 0x7f43b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:20.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.869+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f43b408f110 con 0x7f43c4101440 2024-04-15T21:00:20.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.869+0000 7f43c9f4d700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 0x7f43b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:20.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.869+0000 7f43c9f4d700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 0x7f43b006eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43c0006010 tx=0x7f43c000b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:20.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:20.874+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f43b405d220 con 0x7f43c4101440 2024-04-15T21:00:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:20 smithi149 ceph-mon[36029]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.120+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c4105d90 con 0x7f43b006c680 2024-04-15T21:00:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.121+0000 7f43baffd700 1 -- 172.21.15.72:0/4188031667 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f43c4105d90 con 0x7f43b006c680 2024-04-15T21:00:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 msgr2=0x7f43b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 0x7f43b006eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43c0006010 tx=0x7f43c000b580 comp rx=0 tx=0).stop 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 msgr2=0x7f43c41960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009a20 tx=0x7f43b4009de0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 shutdown_connections 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f43b006c680 0x7f43b006eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43c4100240 0x7f43c4195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 --2- 172.21.15.72:0/4188031667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4101440 0x7f43c41960a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 >> 172.21.15.72:0/4188031667 conn(0x7f43c40fb7f0 msgr2=0x7f43c4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 shutdown_connections 2024-04-15T21:00:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.124+0000 7f43cc1b1700 1 -- 172.21.15.72:0/4188031667 wait complete. 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 -- 172.21.15.72:0/3871593258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501021f0 msgr2=0x7fcb500fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/3871593258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501021f0 0x7fcb500fe320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009910 tx=0x7fcb3c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 -- 172.21.15.72:0/3871593258 shutdown_connections 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/3871593258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501021f0 0x7fcb500fe320 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/3871593258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501018a0 0x7fcb50101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 -- 172.21.15.72:0/3871593258 >> 172.21.15.72:0/3871593258 conn(0x7fcb500f9f10 msgr2=0x7fcb500fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 -- 172.21.15.72:0/3871593258 shutdown_connections 2024-04-15T21:00:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.240+0000 7fcb56cf9700 1 -- 172.21.15.72:0/3871593258 wait complete. 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 Processor -- start 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 -- start start 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 0x7fcb50196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50196640 con 0x7fcb501018a0 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb56cf9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50196780 con 0x7fcb501021f0 2024-04-15T21:00:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb54a95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb54a95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46752/0 (socket says 172.21.15.72:46752) 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.241+0000 7fcb54a95700 1 -- 172.21.15.72:0/1686050777 learned_addr learned my addr 172.21.15.72:0/1686050777 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb4ffff700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 0x7fcb50196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb54a95700 1 -- 172.21.15.72:0/1686050777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 msgr2=0x7fcb50196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb54a95700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 0x7fcb50196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb54a95700 1 -- 172.21.15.72:0/1686050777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0095f0 con 0x7fcb501018a0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb4ffff700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 0x7fcb50196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb54a95700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400d8d0 tx=0x7fcb4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb44009940 con 0x7fcb501018a0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5019b230 con 0x7fcb501018a0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb44010460 con 0x7fcb501018a0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb4400f5f0 con 0x7fcb501018a0 2024-04-15T21:00:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.242+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5019b780 con 0x7fcb501018a0 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.244+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcb440105d0 con 0x7fcb501018a0 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.244+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50108d10 con 0x7fcb501018a0 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.244+0000 7fcb4dffb700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 0x7fcb4006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.244+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcb4408b7f0 con 0x7fcb501018a0 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.244+0000 7fcb4ffff700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 0x7fcb4006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.245+0000 7fcb4ffff700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 0x7fcb4006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006010 tx=0x7fcb3c005a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:21.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.249+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcb44059980 con 0x7fcb501018a0 2024-04-15T21:00:21.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.482+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb50105f90 con 0x7fcb4006c680 2024-04-15T21:00:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.493+0000 7fcb4dffb700 1 -- 172.21.15.72:0/1686050777 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fcb50105f90 con 0x7fcb4006c680 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (4m) 25s ago 6m 25.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (6m) 25s ago 6m 7428k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (5m) 31s ago 5m 7352k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (6m) 25s ago 6m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (5m) 31s ago 5m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (4m) 25s ago 6m 79.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (45s) 25s ago 44s 13.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (52s) 25s ago 51s 11.3M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (42s) 31s ago 42s 13.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:00:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (49s) 31s ago 49s 17.2M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (8m) 25s ago 8m 487M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (5m) 31s ago 5m 438M - 18.2.0 dc2bc1663786 a2048a211a48 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (8m) 25s ago 8m 48.3M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (5m) 31s ago 5m 36.1M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (6m) 25s ago 6m 16.4M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (5m) 31s ago 5m 16.6M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (4m) 25s ago 4m 50.1M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 25s ago 4m 47.7M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (3m) 25s ago 3m 48.4M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (3m) 31s ago 3m 48.9M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (2m) 31s ago 2m 46.4M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (2m) 31s ago 2m 43.4M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:00:21.487 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 25s ago 5m 62.8M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 msgr2=0x7fcb4006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 0x7fcb4006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006010 tx=0x7fcb3c005a90 comp rx=0 tx=0).stop 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 msgr2=0x7fcb50195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400d8d0 tx=0x7fcb4400dc90 comp rx=0 tx=0).stop 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 shutdown_connections 2024-04-15T21:00:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcb4006c680 0x7fcb4006eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb501018a0 0x7fcb50195ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 --2- 172.21.15.72:0/1686050777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb501021f0 0x7fcb50196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 >> 172.21.15.72:0/1686050777 conn(0x7fcb500f9f10 msgr2=0x7fcb50104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 shutdown_connections 2024-04-15T21:00:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.495+0000 7fcb56cf9700 1 -- 172.21.15.72:0/1686050777 wait complete. 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 -- 172.21.15.72:0/1339389585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 msgr2=0x7fdca8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 --2- 172.21.15.72:0/1339389585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca8100840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009910 tx=0x7fdc9c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 -- 172.21.15.72:0/1339389585 shutdown_connections 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 --2- 172.21.15.72:0/1339389585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca8100840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 --2- 172.21.15.72:0/1339389585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 0x7fdca80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.617+0000 7fdcae98f700 1 -- 172.21.15.72:0/1339389585 >> 172.21.15.72:0/1339389585 conn(0x7fdca80fa780 msgr2=0x7fdca80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.618+0000 7fdcae98f700 1 -- 172.21.15.72:0/1339389585 shutdown_connections 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.618+0000 7fdcae98f700 1 -- 172.21.15.72:0/1339389585 wait complete. 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.618+0000 7fdcae98f700 1 Processor -- start 2024-04-15T21:00:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.618+0000 7fdcae98f700 1 -- start start 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdcae98f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 0x7fdca80690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdcae98f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdcae98f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca819ad90 con 0x7fdca81003d0 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdcae98f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca819aed0 con 0x7fdca80ff130 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41128/0 (socket says 172.21.15.72:41128) 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 -- 172.21.15.72:0/3191836234 learned_addr learned my addr 172.21.15.72:0/3191836234 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca7fff700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 0x7fdca80690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 -- 172.21.15.72:0/3191836234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 msgr2=0x7fdca80690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 0x7fdca80690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 -- 172.21.15.72:0/3191836234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0095f0 con 0x7fdca81003d0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.619+0000 7fdca77fe700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c006010 tx=0x7fdc9c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.620+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c01d070 con 0x7fdca81003d0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.620+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc9c00f460 con 0x7fdca81003d0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.620+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca819b150 con 0x7fdca81003d0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.620+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c021640 con 0x7fdca81003d0 2024-04-15T21:00:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.620+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca819b640 con 0x7fdca81003d0 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.621+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8107c10 con 0x7fdca81003d0 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.622+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdc9c00f5d0 con 0x7fdca81003d0 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.622+0000 7fdca57fa700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 0x7fdc9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.622+0000 7fdca7fff700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 0x7fdc9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.622+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdc9c08ceb0 con 0x7fdca81003d0 2024-04-15T21:00:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.623+0000 7fdca7fff700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 0x7fdc9006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc98005950 tx=0x7fdc9800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.626+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdc9c05b040 con 0x7fdca81003d0 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.921+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdca8107e30 con 0x7fdca81003d0 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.922+0000 7fdca57fa700 1 -- 172.21.15.72:0/3191836234 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fdc9c05abd0 con 0x7fdca81003d0 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:21.915 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:00:21.916 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:00:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 msgr2=0x7fdc9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 0x7fdc9006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc98005950 tx=0x7fdc9800b410 comp rx=0 tx=0).stop 2024-04-15T21:00:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 msgr2=0x7fdca819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c006010 tx=0x7fdc9c00bd70 comp rx=0 tx=0).stop 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 shutdown_connections 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdc9006c680 0x7fdc9006eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca80ff130 0x7fdca80690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 --2- 172.21.15.72:0/3191836234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca81003d0 0x7fdca819a7c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 >> 172.21.15.72:0/3191836234 conn(0x7fdca80fa780 msgr2=0x7fdca8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 shutdown_connections 2024-04-15T21:00:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:21.925+0000 7fdcae98f700 1 -- 172.21.15.72:0/3191836234 wait complete. 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 -- 172.21.15.72:0/1709585221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 msgr2=0x7f10e81018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 --2- 172.21.15.72:0/1709585221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e81018a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009910 tx=0x7f10d8009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 -- 172.21.15.72:0/1709585221 shutdown_connections 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 --2- 172.21.15.72:0/1709585221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e81018a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 --2- 172.21.15.72:0/1709585221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 0x7f10e8100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 -- 172.21.15.72:0/1709585221 >> 172.21.15.72:0/1709585221 conn(0x7f10e80fb7e0 msgr2=0x7f10e80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 -- 172.21.15.72:0/1709585221 shutdown_connections 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 -- 172.21.15.72:0/1709585221 wait complete. 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.035+0000 7f10eff78700 1 Processor -- start 2024-04-15T21:00:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10eff78700 1 -- start start 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10eff78700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 0x7f10e8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10eff78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10eff78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8196790 con 0x7f10e8101450 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10eff78700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e819b1a0 con 0x7f10e8100250 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41154/0 (socket says 172.21.15.72:41154) 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 -- 172.21.15.72:0/3101685433 learned_addr learned my addr 172.21.15.72:0/3101685433 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10edd14700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 0x7f10e8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 -- 172.21.15.72:0/3101685433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 msgr2=0x7f10e8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 0x7f10e8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 -- 172.21.15.72:0/3101685433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80095f0 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.036+0000 7f10ed513700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f10d80092e0 tx=0x7f10d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.037+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d801d070 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.037+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e819b340 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.037+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10d800f460 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.037+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d8021640 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.037+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e819b800 con 0x7f10e8101450 2024-04-15T21:00:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.038+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e8108e40 con 0x7f10e8101450 2024-04-15T21:00:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.039+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f10d800fa90 con 0x7f10e8101450 2024-04-15T21:00:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.039+0000 7f10deffd700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 0x7f10d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.039+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f10d808d050 con 0x7f10e8101450 2024-04-15T21:00:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.039+0000 7f10edd14700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 0x7f10d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.040+0000 7f10edd14700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 0x7f10d406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10e4006fd0 tx=0x7f10e4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.043+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f10d8057750 con 0x7f10e8101450 2024-04-15T21:00:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.306+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f10e8109030 con 0x7f10e8101450 2024-04-15T21:00:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.306+0000 7f10deffd700 1 -- 172.21.15.72:0/3101685433 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f10d8026740 con 0x7f10e8101450 2024-04-15T21:00:22.299 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:00:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:00:22.301 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:22.302 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 msgr2=0x7f10d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 0x7f10d406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10e4006fd0 tx=0x7f10e4008040 comp rx=0 tx=0).stop 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 msgr2=0x7f10e8196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f10d80092e0 tx=0x7f10d800be20 comp rx=0 tx=0).stop 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 shutdown_connections 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f10d406c680 0x7f10d406eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e8100250 0x7f10e8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 --2- 172.21.15.72:0/3101685433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8101450 0x7f10e8196170 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 >> 172.21.15.72:0/3101685433 conn(0x7f10e80fb7e0 msgr2=0x7f10e8104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 shutdown_connections 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.309+0000 7f10eff78700 1 -- 172.21.15.72:0/3101685433 wait complete. 2024-04-15T21:00:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:00:22.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2008538663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c00ff150 msgr2=0x7f55c00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2008538663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c00ff150 0x7f55c00ff560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009910 tx=0x7f55b4009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2008538663 shutdown_connections 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2008538663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c0100350 0x7f55c01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2008538663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c00ff150 0x7f55c00ff560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2008538663 >> 172.21.15.72:0/2008538663 conn(0x7f55c00fa700 msgr2=0x7f55c00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2008538663 shutdown_connections 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.420+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2008538663 wait complete. 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 Processor -- start 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 -- start start 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 0x7f55c0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 0x7f55c019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c019ae10 con 0x7f55c0100350 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c6f0c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c019af50 con 0x7f55c00ff150 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 0x7f55c019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 0x7f55c019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41180/0 (socket says 172.21.15.72:41180) 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55bffff700 1 -- 172.21.15.72:0/2187903068 learned_addr learned my addr 172.21.15.72:0/2187903068 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:22.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c4ca8700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 0x7f55c0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c4ca8700 1 -- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 msgr2=0x7f55c019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c4ca8700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 0x7f55c019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.421+0000 7f55c4ca8700 1 -- 172.21.15.72:0/2187903068 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40095f0 con 0x7f55c00ff150 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55c4ca8700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 0x7f55c0069930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55c01001b0 tx=0x7f55b400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b401d070 con 0x7f55c00ff150 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c019b1d0 con 0x7f55c00ff150 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55b4005dc0 con 0x7f55c00ff150 2024-04-15T21:00:22.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b4017630 con 0x7f55c00ff150 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.422+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c019b6c0 con 0x7f55c00ff150 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.423+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0107ca0 con 0x7f55c00ff150 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.424+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f55b40038a0 con 0x7f55c00ff150 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.424+0000 7f55bdffb700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 0x7f55b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.424+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f55b408cca0 con 0x7f55c00ff150 2024-04-15T21:00:22.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.424+0000 7f55bffff700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 0x7f55b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.425+0000 7f55bffff700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 0x7f55b006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55c0069eb0 tx=0x7f55ac009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.429+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55b405ad10 con 0x7f55c00ff150 2024-04-15T21:00:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.652+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55c0104ca0 con 0x7f55b006c680 2024-04-15T21:00:22.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:22 smithi072 ceph-mon[29079]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:22 smithi072 ceph-mon[29079]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:22 smithi072 ceph-mon[29079]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:22 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3191836234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:00:22.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:22 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3101685433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.653+0000 7f55bdffb700 1 -- 172.21.15.72:0/2187903068 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f55c0104ca0 con 0x7f55b006c680 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29", 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "", 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 image", 2024-04-15T21:00:22.646 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:00:22.647 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:00:22.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 msgr2=0x7f55b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 0x7f55b006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55c0069eb0 tx=0x7f55ac009260 comp rx=0 tx=0).stop 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 msgr2=0x7f55c0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 0x7f55c0069930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55c01001b0 tx=0x7f55b400f690 comp rx=0 tx=0).stop 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 shutdown_connections 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f55b006c680 0x7f55b006eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f55c00ff150 0x7f55c0069930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 --2- 172.21.15.72:0/2187903068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0100350 0x7f55c019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 >> 172.21.15.72:0/2187903068 conn(0x7f55c00fa700 msgr2=0x7f55c0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 shutdown_connections 2024-04-15T21:00:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.656+0000 7f55c6f0c700 1 -- 172.21.15.72:0/2187903068 wait complete. 2024-04-15T21:00:22.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 -- 172.21.15.72:0/1812507887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 msgr2=0x7fdb7c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 --2- 172.21.15.72:0/1812507887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c100840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009910 tx=0x7fdb68009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 -- 172.21.15.72:0/1812507887 shutdown_connections 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 --2- 172.21.15.72:0/1812507887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c100840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 --2- 172.21.15.72:0/1812507887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 0x7fdb7c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 -- 172.21.15.72:0/1812507887 >> 172.21.15.72:0/1812507887 conn(0x7fdb7c0fa780 msgr2=0x7fdb7c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 -- 172.21.15.72:0/1812507887 shutdown_connections 2024-04-15T21:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.765+0000 7fdb83083700 1 -- 172.21.15.72:0/1812507887 wait complete. 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 Processor -- start 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 -- start start 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 0x7fdb7c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c1987b0 con 0x7fdb7c1003d0 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb83083700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c198920 con 0x7fdb7c0ff130 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41204/0 (socket says 172.21.15.72:41204) 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 -- 172.21.15.72:0/2918858417 learned_addr learned my addr 172.21.15.72:0/2918858417 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb80e1f700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 0x7fdb7c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 -- 172.21.15.72:0/2918858417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 msgr2=0x7fdb7c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 0x7fdb7c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 -- 172.21.15.72:0/2918858417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680095f0 con 0x7fdb7c1003d0 2024-04-15T21:00:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.766+0000 7fdb7bfff700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800bd70 tx=0x7fdb6800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.767+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6801d070 con 0x7fdb7c1003d0 2024-04-15T21:00:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.767+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c19d350 con 0x7fdb7c1003d0 2024-04-15T21:00:22.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.767+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb68005dc0 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.767+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb68021410 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.767+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c19d840 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.768+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c107c10 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.769+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdb6800f7d0 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.769+0000 7fdb79ffb700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 0x7fdb6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.769+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdb6808cbd0 con 0x7fdb7c1003d0 2024-04-15T21:00:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.769+0000 7fdb80e1f700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 0x7fdb6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.770+0000 7fdb80e1f700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 0x7fdb6c06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c198b50 tx=0x7fdb700073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:22.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:22.775+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdb68057250 con 0x7fdb7c1003d0 2024-04-15T21:00:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:22 smithi149 ceph-mon[36029]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:22 smithi149 ceph-mon[36029]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:22 smithi149 ceph-mon[36029]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:22.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:22 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3191836234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:00:22.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:22 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3101685433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:00:23.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.074+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdb7c107e00 con 0x7fdb7c1003d0 2024-04-15T21:00:23.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.074+0000 7fdb79ffb700 1 -- 172.21.15.72:0/2918858417 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fdb6800f460 con 0x7fdb7c1003d0 2024-04-15T21:00:23.067 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:23.067 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:23.068 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 msgr2=0x7fdb6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 0x7fdb6c06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c198b50 tx=0x7fdb700073d0 comp rx=0 tx=0).stop 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 msgr2=0x7fdb7c1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800bd70 tx=0x7fdb6800bda0 comp rx=0 tx=0).stop 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 shutdown_connections 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdb6c06c680 0x7fdb6c06eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb7c0ff130 0x7fdb7c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 --2- 172.21.15.72:0/2918858417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb7c1003d0 0x7fdb7c1981b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 >> 172.21.15.72:0/2918858417 conn(0x7fdb7c0fa780 msgr2=0x7fdb7c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 shutdown_connections 2024-04-15T21:00:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:23.077+0000 7fdb83083700 1 -- 172.21.15.72:0/2918858417 wait complete. 2024-04-15T21:00:23.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:23 smithi149 ceph-mon[36029]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:23.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:23 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2918858417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:00:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:23 smithi072 ceph-mon[29079]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-15T21:00:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:23 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2918858417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:00:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:24 smithi072 ceph-mon[29079]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:24 smithi149 ceph-mon[36029]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:25.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:25 smithi072 ceph-mon[29079]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-15T21:00:25.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:25 smithi149 ceph-mon[36029]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-15T21:00:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:27 smithi072 ceph-mon[29079]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-15T21:00:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:27 smithi149 ceph-mon[36029]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-15T21:00:29.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:29 smithi072 ceph-mon[29079]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:29.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:29 smithi149 ceph-mon[36029]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:31 smithi072 ceph-mon[29079]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:31.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:31 smithi149 ceph-mon[36029]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:33.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:33 smithi072 ceph-mon[29079]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:33 smithi149 ceph-mon[36029]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:34.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:35.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:35 smithi072 ceph-mon[29079]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:35.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:35 smithi149 ceph-mon[36029]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:37.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:37 smithi072 ceph-mon[29079]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:37 smithi149 ceph-mon[36029]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:39.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:39 smithi072 ceph-mon[29079]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:39.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:39 smithi149 ceph-mon[36029]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:41.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:41 smithi072 ceph-mon[29079]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:41 smithi149 ceph-mon[36029]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:43 smithi072 ceph-mon[29079]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:43.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:43 smithi149 ceph-mon[36029]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:45 smithi072 ceph-mon[29079]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:45.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:45 smithi149 ceph-mon[36029]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:47.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:47 smithi072 ceph-mon[29079]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:47.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:47 smithi149 ceph-mon[36029]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:49.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:49 smithi072 ceph-mon[29079]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:49.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:49 smithi149 ceph-mon[36029]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:00:51.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:51 smithi072 ceph-mon[29079]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:51.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:51 smithi149 ceph-mon[36029]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.222+0000 7f0421222700 1 -- 172.21.15.72:0/3738482904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c069270 msgr2=0x7f041c1051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.222+0000 7f0421222700 1 --2- 172.21.15.72:0/3738482904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c069270 0x7f041c1051d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f040c009910 tx=0x7f040c009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.222+0000 7f0421222700 1 -- 172.21.15.72:0/3738482904 shutdown_connections 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.223+0000 7f0421222700 1 --2- 172.21.15.72:0/3738482904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c105710 0x7f041c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.223+0000 7f0421222700 1 --2- 172.21.15.72:0/3738482904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c069270 0x7f041c1051d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.223+0000 7f0421222700 1 -- 172.21.15.72:0/3738482904 >> 172.21.15.72:0/3738482904 conn(0x7f041c0fa780 msgr2=0x7f041c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.223+0000 7f0421222700 1 -- 172.21.15.72:0/3738482904 shutdown_connections 2024-04-15T21:00:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.223+0000 7f0421222700 1 -- 172.21.15.72:0/3738482904 wait complete. 2024-04-15T21:00:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 Processor -- start 2024-04-15T21:00:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 -- start start 2024-04-15T21:00:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c198220 0x7f041c19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c198690 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f0421222700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c198800 con 0x7f041c198220 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46698/0 (socket says 172.21.15.72:46698) 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041ad9d700 1 -- 172.21.15.72:0/1998722115 learned_addr learned my addr 172.21.15.72:0/1998722115 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041a59c700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c198220 0x7f041c19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041ad9d700 1 -- 172.21.15.72:0/1998722115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c198220 msgr2=0x7f041c19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.224+0000 7f041ad9d700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c198220 0x7f041c19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f041ad9d700 1 -- 172.21.15.72:0/1998722115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0095f0 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f041ad9d700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f040c00bda0 tx=0x7f040c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f040c01d070 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f040c00f460 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f040c021640 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c19d790 con 0x7f041c105710 2024-04-15T21:00:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.225+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c19dc50 con 0x7f041c105710 2024-04-15T21:00:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.226+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c191dd0 con 0x7f041c105710 2024-04-15T21:00:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.227+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f040c00f5d0 con 0x7f041c105710 2024-04-15T21:00:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.228+0000 7f0403fff700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 0x7f040406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.228+0000 7f041a59c700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 0x7f040406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.228+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f040c08cba0 con 0x7f041c105710 2024-04-15T21:00:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.228+0000 7f041a59c700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 0x7f040406eb80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0410005950 tx=0x7f041000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.236+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f040c057200 con 0x7f041c105710 2024-04-15T21:00:53.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.471+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f041c02cf30 con 0x7f040406c6d0 2024-04-15T21:00:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.473+0000 7f0403fff700 1 -- 172.21.15.72:0/1998722115 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f041c02cf30 con 0x7f040406c6d0 2024-04-15T21:00:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 msgr2=0x7f040406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 0x7f040406eb80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0410005950 tx=0x7f041000b410 comp rx=0 tx=0).stop 2024-04-15T21:00:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 msgr2=0x7f041c197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f040c00bda0 tx=0x7f040c00bdd0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 shutdown_connections 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f040406c6d0 0x7f040406eb80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f041c105710 0x7f041c197ce0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 --2- 172.21.15.72:0/1998722115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f041c198220 0x7f041c19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 >> 172.21.15.72:0/1998722115 conn(0x7f041c0fa780 msgr2=0x7f041c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 shutdown_connections 2024-04-15T21:00:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.476+0000 7f0421222700 1 -- 172.21.15.72:0/1998722115 wait complete. 2024-04-15T21:00:53.482 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:00:53.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 -- 172.21.15.72:0/1013606340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c101440 msgr2=0x7f8c0c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 --2- 172.21.15.72:0/1013606340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c101440 0x7f8c0c101890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009910 tx=0x7f8bfc009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 -- 172.21.15.72:0/1013606340 shutdown_connections 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 --2- 172.21.15.72:0/1013606340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c101440 0x7f8c0c101890 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 --2- 172.21.15.72:0/1013606340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c100240 0x7f8c0c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.631+0000 7f8c1412e700 1 -- 172.21.15.72:0/1013606340 >> 172.21.15.72:0/1013606340 conn(0x7f8c0c0fb7f0 msgr2=0x7f8c0c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.632+0000 7f8c1412e700 1 -- 172.21.15.72:0/1013606340 shutdown_connections 2024-04-15T21:00:53.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.632+0000 7f8c1412e700 1 -- 172.21.15.72:0/1013606340 wait complete. 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.632+0000 7f8c1412e700 1 Processor -- start 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.632+0000 7f8c1412e700 1 -- start start 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c1412e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c100240 0x7f8c0c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c1412e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c1412e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c196610 con 0x7f8c0c100240 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c1412e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c196750 con 0x7f8c0c101440 2024-04-15T21:00:53.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c11eca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c100240 0x7f8c0c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:60556/0 (socket says 172.21.15.72:60556) 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 -- 172.21.15.72:0/2918479833 learned_addr learned my addr 172.21.15.72:0/2918479833 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 -- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c100240 msgr2=0x7f8c0c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c100240 0x7f8c0c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.633+0000 7f8c116c9700 1 -- 172.21.15.72:0/2918479833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0095f0 con 0x7f8c0c101440 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c116c9700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc000c00 tx=0x7f8bfc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bfc01d070 con 0x7f8c0c101440 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c19b1a0 con 0x7f8c0c101440 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8bfc005dc0 con 0x7f8c0c101440 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c19b690 con 0x7f8c0c101440 2024-04-15T21:00:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.634+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bfc0226a0 con 0x7f8c0c101440 2024-04-15T21:00:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.635+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c108d90 con 0x7f8c0c101440 2024-04-15T21:00:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.636+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8bfc0038f0 con 0x7f8c0c101440 2024-04-15T21:00:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.636+0000 7f8c02ffd700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 0x7f8bf806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.637+0000 7f8c11eca700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 0x7f8bf806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.637+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8bfc08cec0 con 0x7f8c0c101440 2024-04-15T21:00:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.637+0000 7f8c11eca700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 0x7f8bf806eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c1012a0 tx=0x7f8c08009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:53.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:53.644+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8bfc05b080 con 0x7f8c0c101440 2024-04-15T21:00:53.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:53 smithi072 ceph-mon[29079]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:53.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:53 smithi149 ceph-mon[36029]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.026+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c0c105d90 con 0x7f8bf806c680 2024-04-15T21:00:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.027+0000 7f8c02ffd700 1 -- 172.21.15.72:0/2918479833 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8c0c105d90 con 0x7f8bf806c680 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 msgr2=0x7f8bf806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 0x7f8bf806eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c1012a0 tx=0x7f8c08009260 comp rx=0 tx=0).stop 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 msgr2=0x7f8c0c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc000c00 tx=0x7f8bfc00f690 comp rx=0 tx=0).stop 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 shutdown_connections 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f8bf806c680 0x7f8bf806eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c100240 0x7f8c0c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 --2- 172.21.15.72:0/2918479833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c0c101440 0x7f8c0c195ff0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.029+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 >> 172.21.15.72:0/2918479833 conn(0x7f8c0c0fb7f0 msgr2=0x7f8c0c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:54.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.030+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 shutdown_connections 2024-04-15T21:00:54.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.030+0000 7f8c1412e700 1 -- 172.21.15.72:0/2918479833 wait complete. 2024-04-15T21:00:54.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 -- 172.21.15.72:0/2408848087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4100250 msgr2=0x7f5cc4100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 --2- 172.21.15.72:0/2408848087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4100250 0x7f5cc4100660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009910 tx=0x7f5cc0009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 -- 172.21.15.72:0/2408848087 shutdown_connections 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 --2- 172.21.15.72:0/2408848087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4101450 0x7f5cc41018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 --2- 172.21.15.72:0/2408848087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4100250 0x7f5cc4100660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.155+0000 7f5ccc139700 1 -- 172.21.15.72:0/2408848087 >> 172.21.15.72:0/2408848087 conn(0x7f5cc40fb7e0 msgr2=0x7f5cc40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.156+0000 7f5ccc139700 1 -- 172.21.15.72:0/2408848087 shutdown_connections 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.156+0000 7f5ccc139700 1 -- 172.21.15.72:0/2408848087 wait complete. 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.156+0000 7f5ccc139700 1 Processor -- start 2024-04-15T21:00:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.156+0000 7f5ccc139700 1 -- start start 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.156+0000 7f5ccc139700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 0x7f5cc4197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5ccc139700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5ccc139700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc41987a0 con 0x7f5cc4101450 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5ccc139700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4198910 con 0x7f5cc4100250 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc9ed5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 0x7f5cc4197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46728/0 (socket says 172.21.15.72:46728) 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 -- 172.21.15.72:0/987789297 learned_addr learned my addr 172.21.15.72:0/987789297 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 -- 172.21.15.72:0/987789297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 msgr2=0x7f5cc4197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 0x7f5cc4197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 -- 172.21.15.72:0/987789297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00095f0 con 0x7f5cc4101450 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc9ed5700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 0x7f5cc4197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cc96d4700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d8d0 tx=0x7f5cb400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb40098a0 con 0x7f5cc4101450 2024-04-15T21:00:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc419d3a0 con 0x7f5cc4101450 2024-04-15T21:00:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5cb4010460 con 0x7f5cc4101450 2024-04-15T21:00:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb400f5f0 con 0x7f5cc4101450 2024-04-15T21:00:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.157+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc419d8f0 con 0x7f5cc4101450 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.159+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4105530 con 0x7f5cc4101450 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.159+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5cb4009a00 con 0x7f5cc4101450 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.159+0000 7f5cbaffd700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 0x7f5cb006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.160+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5cb408b7c0 con 0x7f5cc4101450 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.160+0000 7f5cc9ed5700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 0x7f5cb006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.160+0000 7f5cc9ed5700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 0x7f5cb006eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0005090 tx=0x7f5cc000b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.164+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5cb4055e40 con 0x7f5cc4101450 2024-04-15T21:00:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.419+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc4061190 con 0x7f5cb006c680 2024-04-15T21:00:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.437+0000 7f5cbaffd700 1 -- 172.21.15.72:0/987789297 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f5cc4061190 con 0x7f5cb006c680 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (5m) 58s ago 7m 25.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (7m) 58s ago 7m 7428k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (6m) 64s ago 6m 7352k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (7m) 58s ago 7m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (6m) 64s ago 6m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (5m) 58s ago 6m 79.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (77s) 58s ago 77s 13.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (85s) 58s ago 84s 11.3M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (75s) 64s ago 75s 13.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:00:54.430 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (82s) 64s ago 82s 17.2M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (8m) 58s ago 8m 487M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (5m) 64s ago 5m 438M - 18.2.0 dc2bc1663786 a2048a211a48 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (8m) 58s ago 8m 48.3M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (5m) 64s ago 5m 36.1M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (7m) 58s ago 7m 16.4M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 64s ago 6m 16.6M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 58s ago 5m 50.1M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 58s ago 4m 47.7M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 58s ago 4m 48.4M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (3m) 64s ago 3m 48.9M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (3m) 64s ago 3m 46.4M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (2m) 64s ago 2m 43.4M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:00:54.431 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (5m) 58s ago 6m 62.8M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:00:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 msgr2=0x7f5cb006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 0x7f5cb006eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0005090 tx=0x7f5cc000b540 comp rx=0 tx=0).stop 2024-04-15T21:00:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 msgr2=0x7f5cc41981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d8d0 tx=0x7f5cb400dbe0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 shutdown_connections 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5cb006c680 0x7f5cb006eb30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cc4100250 0x7f5cc4197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 --2- 172.21.15.72:0/987789297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc4101450 0x7f5cc41981a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 >> 172.21.15.72:0/987789297 conn(0x7f5cc40fb7e0 msgr2=0x7f5cc4102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 shutdown_connections 2024-04-15T21:00:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.439+0000 7f5ccc139700 1 -- 172.21.15.72:0/987789297 wait complete. 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 -- 172.21.15.72:0/212624315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 msgr2=0x7f4e18100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 --2- 172.21.15.72:0/212624315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e18100840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009910 tx=0x7f4e04009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 -- 172.21.15.72:0/212624315 shutdown_connections 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 --2- 172.21.15.72:0/212624315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e18100840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 --2- 172.21.15.72:0/212624315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e180ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 -- 172.21.15.72:0/212624315 >> 172.21.15.72:0/212624315 conn(0x7f4e180fa780 msgr2=0x7f4e180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 -- 172.21.15.72:0/212624315 shutdown_connections 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.555+0000 7f4e1f009700 1 -- 172.21.15.72:0/212624315 wait complete. 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 Processor -- start 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 -- start start 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e18069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1819d0a0 con 0x7f4e181003d0 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.556+0000 7f4e1f009700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1819d1e0 con 0x7f4e180ff130 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e1cda5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e18069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46748/0 (socket says 172.21.15.72:46748) 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 -- 172.21.15.72:0/2714519460 learned_addr learned my addr 172.21.15.72:0/2714519460 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 -- 172.21.15.72:0/2714519460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 msgr2=0x7f4e18069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e18069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 -- 172.21.15.72:0/2714519460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040095f0 con 0x7f4e181003d0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e1cda5700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e18069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e17fff700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e04006010 tx=0x7f4e0400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0401d070 con 0x7f4e181003d0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1819d380 con 0x7f4e181003d0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e0400f460 con 0x7f4e181003d0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.557+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e04021640 con 0x7f4e181003d0 2024-04-15T21:00:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.558+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1819d840 con 0x7f4e181003d0 2024-04-15T21:00:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.559+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e18107c10 con 0x7f4e181003d0 2024-04-15T21:00:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.560+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4e0400fa70 con 0x7f4e181003d0 2024-04-15T21:00:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.560+0000 7f4e15ffb700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 0x7f4e0806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.561+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4e0408cb30 con 0x7f4e181003d0 2024-04-15T21:00:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.561+0000 7f4e1cda5700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 0x7f4e0806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:54.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.561+0000 7f4e1cda5700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 0x7f4e0806eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c007fd0 tx=0x7f4e0c0073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:54.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.565+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e0405ac20 con 0x7f4e181003d0 2024-04-15T21:00:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.864+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e1819df90 con 0x7f4e181003d0 2024-04-15T21:00:54.857 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:54 smithi072 ceph-mon[29079]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.865+0000 7f4e15ffb700 1 -- 172.21.15.72:0/2714519460 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f4e0405a7b0 con 0x7f4e181003d0 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:00:54.858 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:00:54.859 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:00:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 msgr2=0x7f4e0806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 0x7f4e0806eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c007fd0 tx=0x7f4e0c0073d0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 msgr2=0x7f4e1819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e04006010 tx=0x7f4e0400bd70 comp rx=0 tx=0).stop 2024-04-15T21:00:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 shutdown_connections 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f4e0806c680 0x7f4e0806eb30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e180ff130 0x7f4e18069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 --2- 172.21.15.72:0/2714519460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e181003d0 0x7f4e1819cb60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.868+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 >> 172.21.15.72:0/2714519460 conn(0x7f4e180fa780 msgr2=0x7f4e18103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.869+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 shutdown_connections 2024-04-15T21:00:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:54.869+0000 7f4e1f009700 1 -- 172.21.15.72:0/2714519460 wait complete. 2024-04-15T21:00:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:54 smithi149 ceph-mon[36029]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:55.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 -- 172.21.15.72:0/4017642573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e341003d0 msgr2=0x7f7e34100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/4017642573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e341003d0 0x7f7e34100840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009910 tx=0x7f7e28009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 -- 172.21.15.72:0/4017642573 shutdown_connections 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/4017642573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e341003d0 0x7f7e34100840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/4017642573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e340ff130 0x7f7e340ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 -- 172.21.15.72:0/4017642573 >> 172.21.15.72:0/4017642573 conn(0x7f7e340fa780 msgr2=0x7f7e340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.011+0000 7f7e3a21c700 1 -- 172.21.15.72:0/4017642573 shutdown_connections 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.012+0000 7f7e3a21c700 1 -- 172.21.15.72:0/4017642573 wait complete. 2024-04-15T21:00:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.012+0000 7f7e3a21c700 1 Processor -- start 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.012+0000 7f7e3a21c700 1 -- start start 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e3a21c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e3a21c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 0x7f7e34194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e3a21c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e341954c0 con 0x7f7e340ff130 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e3a21c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e34195600 con 0x7f7e341003d0 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46776/0 (socket says 172.21.15.72:46776) 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 -- 172.21.15.72:0/3798648263 learned_addr learned my addr 172.21.15.72:0/3798648263 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e32ffd700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 0x7f7e34194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 -- 172.21.15.72:0/3798648263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 msgr2=0x7f7e34194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 0x7f7e34194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 -- 172.21.15.72:0/3798648263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280095f0 con 0x7f7e340ff130 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e32ffd700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 0x7f7e34194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.013+0000 7f7e337fe700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e920 tx=0x7f7e2400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.014+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e2400c9d0 con 0x7f7e340ff130 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.014+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e24010430 con 0x7f7e340ff130 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.014+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3419a0b0 con 0x7f7e340ff130 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.014+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e240185f0 con 0x7f7e340ff130 2024-04-15T21:00:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.014+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e34068540 con 0x7f7e340ff130 2024-04-15T21:00:55.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.015+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7e240105a0 con 0x7f7e340ff130 2024-04-15T21:00:55.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.015+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e34107c10 con 0x7f7e340ff130 2024-04-15T21:00:55.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.016+0000 7f7e30ff9700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 0x7f7e1c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.016+0000 7f7e32ffd700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 0x7f7e1c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.016+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7e24014070 con 0x7f7e340ff130 2024-04-15T21:00:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.017+0000 7f7e32ffd700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 0x7f7e1c06eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009fd0 tx=0x7f7e28005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:55.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.024+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e24051720 con 0x7f7e340ff130 2024-04-15T21:00:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.385+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e340690d0 con 0x7f7e340ff130 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.385+0000 7f7e30ff9700 1 -- 172.21.15.72:0/3798648263 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f7e24059de0 con 0x7f7e340ff130 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:00:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:00:55.379 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:55.380 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:00:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:00:55.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:55.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:55.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:00:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 msgr2=0x7f7e1c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 0x7f7e1c06eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009fd0 tx=0x7f7e28005940 comp rx=0 tx=0).stop 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 msgr2=0x7f7e34194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e920 tx=0x7f7e2400ec30 comp rx=0 tx=0).stop 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 shutdown_connections 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f7e1c06c680 0x7f7e1c06eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e340ff130 0x7f7e34194960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 --2- 172.21.15.72:0/3798648263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e341003d0 0x7f7e34194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.388+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 >> 172.21.15.72:0/3798648263 conn(0x7f7e340fa780 msgr2=0x7f7e34103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.389+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 shutdown_connections 2024-04-15T21:00:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.389+0000 7f7e3a21c700 1 -- 172.21.15.72:0/3798648263 wait complete. 2024-04-15T21:00:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:00:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.545+0000 7f19fea4f700 1 -- 172.21.15.72:0/1651861256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81018a0 msgr2=0x7f19f8101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.545+0000 7f19fea4f700 1 --2- 172.21.15.72:0/1651861256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81018a0 0x7f19f8101cb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009910 tx=0x7f19e8009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 -- 172.21.15.72:0/1651861256 shutdown_connections 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 --2- 172.21.15.72:0/1651861256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81021f0 0x7f19f80fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 --2- 172.21.15.72:0/1651861256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81018a0 0x7f19f8101cb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 -- 172.21.15.72:0/1651861256 >> 172.21.15.72:0/1651861256 conn(0x7f19f80f9f10 msgr2=0x7f19f80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 -- 172.21.15.72:0/1651861256 shutdown_connections 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 -- 172.21.15.72:0/1651861256 wait complete. 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 Processor -- start 2024-04-15T21:00:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.546+0000 7f19fea4f700 1 -- start start 2024-04-15T21:00:55.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19fea4f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81018a0 0x7f19f8197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19fea4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19fea4f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81988b0 con 0x7f19f81021f0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19fea4f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81989f0 con 0x7f19f81018a0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46806/0 (socket says 172.21.15.72:46806) 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 -- 172.21.15.72:0/59571920 learned_addr learned my addr 172.21.15.72:0/59571920 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f7fff700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81018a0 0x7f19f8197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 -- 172.21.15.72:0/59571920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81018a0 msgr2=0x7f19f8197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81018a0 0x7f19f8197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 -- 172.21.15.72:0/59571920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80095f0 con 0x7f19f81021f0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f77fe700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e8f0 tx=0x7f19ec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.547+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec009790 con 0x7f19f81021f0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.548+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19ec00c810 con 0x7f19f81021f0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.548+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f819d4a0 con 0x7f19f81021f0 2024-04-15T21:00:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.548+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec0055b0 con 0x7f19f81021f0 2024-04-15T21:00:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.548+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f819d9f0 con 0x7f19f81021f0 2024-04-15T21:00:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.549+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8105720 con 0x7f19f81021f0 2024-04-15T21:00:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.550+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f19ec00c980 con 0x7f19f81021f0 2024-04-15T21:00:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.550+0000 7f19f57fa700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 0x7f19e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.550+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f19ec014070 con 0x7f19f81021f0 2024-04-15T21:00:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.550+0000 7f19f7fff700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 0x7f19e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.551+0000 7f19f7fff700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 0x7f19e006eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.558+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f19ec059d70 con 0x7f19f81021f0 2024-04-15T21:00:55.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:55 smithi072 ceph-mon[29079]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:55.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:55 smithi072 ceph-mon[29079]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:55.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:55 smithi072 ceph-mon[29079]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:55.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:55 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2714519460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:00:55.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:55 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3798648263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:00:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.933+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f8061190 con 0x7f19e006c680 2024-04-15T21:00:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.935+0000 7f19f57fa700 1 -- 172.21.15.72:0/59571920 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f19f8061190 con 0x7f19e006c680 2024-04-15T21:00:55.927 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29", 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "", 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:87dbfb632e974cb2c28d17423071d2d833b53b29 image", 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:00:55.928 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:00:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.937+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 msgr2=0x7f19e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.937+0000 7f19fea4f700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 0x7f19e006eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8005940 comp rx=0 tx=0).stop 2024-04-15T21:00:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.937+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 msgr2=0x7f19f8198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.937+0000 7f19fea4f700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e8f0 tx=0x7f19ec00ec00 comp rx=0 tx=0).stop 2024-04-15T21:00:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 shutdown_connections 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f19e006c680 0x7f19e006eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f81018a0 0x7f19f8197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 --2- 172.21.15.72:0/59571920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19f81021f0 0x7f19f8198290 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 >> 172.21.15.72:0/59571920 conn(0x7f19f80f9f10 msgr2=0x7f19f8102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 shutdown_connections 2024-04-15T21:00:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:55.938+0000 7f19fea4f700 1 -- 172.21.15.72:0/59571920 wait complete. 2024-04-15T21:00:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:55 smithi149 ceph-mon[36029]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:55 smithi149 ceph-mon[36029]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:55 smithi149 ceph-mon[36029]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:55 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2714519460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:00:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:55 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3798648263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:00:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 -- 172.21.15.72:0/1819066400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 msgr2=0x7f4254103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 --2- 172.21.15.72:0/1819066400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f4254103160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4250009910 tx=0x7f4250009c20 comp rx=0 tx=0).stop 2024-04-15T21:00:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 -- 172.21.15.72:0/1819066400 shutdown_connections 2024-04-15T21:00:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 --2- 172.21.15.72:0/1819066400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 0x7f4254105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 --2- 172.21.15.72:0/1819066400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f4254103160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.048+0000 7f425be84700 1 -- 172.21.15.72:0/1819066400 >> 172.21.15.72:0/1819066400 conn(0x7f42540fa7a0 msgr2=0x7f42540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.049+0000 7f425be84700 1 -- 172.21.15.72:0/1819066400 shutdown_connections 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.049+0000 7f425be84700 1 -- 172.21.15.72:0/1819066400 wait complete. 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.049+0000 7f425be84700 1 Processor -- start 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425be84700 1 -- start start 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425be84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425be84700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 0x7f42540fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425be84700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540ff270 con 0x7f4254100d80 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425be84700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540ff3b0 con 0x7f42541036a0 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46818/0 (socket says 172.21.15.72:46818) 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 -- 172.21.15.72:0/4245407531 learned_addr learned my addr 172.21.15.72:0/4245407531 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:00:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f425941f700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 0x7f42540fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 -- 172.21.15.72:0/4245407531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 msgr2=0x7f42540fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 0x7f42540fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 -- 172.21.15.72:0/4245407531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500095f0 con 0x7f4254100d80 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.050+0000 7f4259c20700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f425000bda0 tx=0x7f425000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.051+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f425001d070 con 0x7f4254100d80 2024-04-15T21:00:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.051+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f425000f460 con 0x7f4254100d80 2024-04-15T21:00:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.051+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4250021620 con 0x7f4254100d80 2024-04-15T21:00:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.051+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42540ff630 con 0x7f4254100d80 2024-04-15T21:00:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.051+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42540ffb20 con 0x7f4254100d80 2024-04-15T21:00:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.052+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425418fbe0 con 0x7f4254100d80 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.053+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f425002b440 con 0x7f4254100d80 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.053+0000 7f424affd700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 0x7f424006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.054+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f425008cad0 con 0x7f4254100d80 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.054+0000 7f425941f700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 0x7f424006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.054+0000 7f425941f700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 0x7f424006eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4244005950 tx=0x7f424400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:00:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.058+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f425005ad40 con 0x7f4254100d80 2024-04-15T21:00:56.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.498+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4254068ab0 con 0x7f4254100d80 2024-04-15T21:00:56.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.499+0000 7f424affd700 1 -- 172.21.15.72:0/4245407531 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f425005a8d0 con 0x7f4254100d80 2024-04-15T21:00:56.492 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:56.492 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:00:56.492 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 msgr2=0x7f424006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 0x7f424006eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4244005950 tx=0x7f424400b410 comp rx=0 tx=0).stop 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 msgr2=0x7f42541006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f425000bda0 tx=0x7f425000bdd0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 shutdown_connections 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f424006c680 0x7f424006eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4254100d80 0x7f42541006e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 --2- 172.21.15.72:0/4245407531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42541036a0 0x7f42540fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 >> 172.21.15.72:0/4245407531 conn(0x7f42540fa7a0 msgr2=0x7f42540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 shutdown_connections 2024-04-15T21:00:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:00:56.501+0000 7f425be84700 1 -- 172.21.15.72:0/4245407531 wait complete. 2024-04-15T21:00:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:56 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/4245407531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:00:56.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:56 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/4245407531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:00:57.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:57 smithi072 ceph-mon[29079]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:57.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:57 smithi072 ceph-mon[29079]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:57.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:57 smithi149 ceph-mon[36029]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:00:57.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:57 smithi149 ceph-mon[36029]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:59.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:00:59 smithi072 ceph-mon[29079]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:00:59.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:00:59 smithi149 ceph-mon[36029]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:01.802 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:01 smithi072 ceph-mon[29079]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:01 smithi149 ceph-mon[36029]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:03 smithi072 ceph-mon[29079]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:03 smithi149 ceph-mon[36029]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:04.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:05.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:05 smithi072 ceph-mon[29079]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:05.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:05 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:05.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:05 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:01:05.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:05 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:05 smithi149 ceph-mon[36029]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:05 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:05 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:01:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:05 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:06.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:06 smithi072 ceph-mon[29079]: Upgrade: Target is version 19.0.0-3084-g87dbfb63 (unknown) 2024-04-15T21:01:06.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:06 smithi072 ceph-mon[29079]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f'] 2024-04-15T21:01:06.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:06 smithi072 ceph-mon[29079]: Upgrade: Need to upgrade myself (mgr.smithi072.wfjmmp) 2024-04-15T21:01:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:06 smithi149 ceph-mon[36029]: Upgrade: Target is version 19.0.0-3084-g87dbfb63 (unknown) 2024-04-15T21:01:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:06 smithi149 ceph-mon[36029]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f'] 2024-04-15T21:01:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:06 smithi149 ceph-mon[36029]: Upgrade: Need to upgrade myself (mgr.smithi072.wfjmmp) 2024-04-15T21:01:07.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:07 smithi149 ceph-mon[36029]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f on smithi149 2024-04-15T21:01:07.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:07 smithi149 ceph-mon[36029]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:07 smithi072 ceph-mon[29079]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f on smithi149 2024-04-15T21:01:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:07 smithi072 ceph-mon[29079]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:09.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:09 smithi072 ceph-mon[29079]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:09 smithi149 ceph-mon[36029]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:11.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:11 smithi072 ceph-mon[29079]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:11.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:11 smithi149 ceph-mon[36029]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:13.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:13 smithi072 ceph-mon[29079]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:13.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:13 smithi149 ceph-mon[36029]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:15.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:15 smithi072 ceph-mon[29079]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:15.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:15 smithi149 ceph-mon[36029]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:17 smithi072 ceph-mon[29079]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:17 smithi149 ceph-mon[36029]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:Note: switching to '3f7db60e5ba4c4d053b594b7ec58703d2833c55b'. 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T21:01:19.720 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: git switch -c 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr:Or undo this operation with: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: git switch - 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-04-15T21:01:19.721 INFO:tasks.workunit.client.0.smithi072.stderr:HEAD is now at 3f7db60e5ba Merge pull request #56767 from adk3798/cephadm-log-only-match 2024-04-15T21:01:19.723 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-15T21:01:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:19 smithi072 ceph-mon[29079]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:19 smithi149 ceph-mon[36029]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:20.144 INFO:tasks.workunit.client.0.smithi072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T21:01:20.147 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T21:01:20.147 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T21:01:21.065 INFO:tasks.workunit.client.1.smithi149.stderr:Updating files: 93% (11692/12482) Updating files: 94% (11734/12482) Updating files: 95% (11858/12482) Updating files: 96% (11983/12482) Updating files: 97% (12108/12482) Updating files: 98% (12233/12482) Updating files: 99% (12358/12482) Updating files: 100% (12482/12482) Updating files: 100% (12482/12482), done. 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:Note: switching to '3f7db60e5ba4c4d053b594b7ec58703d2833c55b'. 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T21:01:21.156 INFO:tasks.workunit.client.1.smithi149.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: git switch -c 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr:Or undo this operation with: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: git switch - 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-04-15T21:01:21.157 INFO:tasks.workunit.client.1.smithi149.stderr:HEAD is now at 3f7db60e5ba Merge pull request #56767 from adk3798/cephadm-log-only-match 2024-04-15T21:01:21.158 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-15T21:01:21.225 INFO:tasks.workunit.client.1.smithi149.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T21:01:21.228 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-15T21:01:21.228 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T21:01:21.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:21 smithi072 ceph-mon[29079]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:21.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:21 smithi149 ceph-mon[36029]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:21.946 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T21:01:22.012 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T21:01:22.054 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-15T21:01:22.056 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-15T21:01:22.056 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T21:01:22.096 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-15T21:01:22.100 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-04-15T21:01:22.100 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-15T21:01:22.157 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-15T21:01:22.160 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-15T21:01:22.160 DEBUG:teuthology.orchestra.run.smithi149:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f7db60e5ba4c4d053b594b7ec58703d2833c55b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-15T21:01:22.224 INFO:tasks.workunit.client.1.smithi149.stderr:+ mkdir -p fsstress 2024-04-15T21:01:22.227 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd fsstress 2024-04-15T21:01:22.228 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-15T21:01:22.228 INFO:tasks.workunit.client.1.smithi149.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-15T21:01:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:23 smithi072 ceph-mon[29079]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:23.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:23 smithi149 ceph-mon[36029]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:24.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:24 smithi149 ceph-mon[36029]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:25.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:24 smithi072 ceph-mon[29079]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 -- 172.21.15.72:0/4083884688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 msgr2=0x7f17fc100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 --2- 172.21.15.72:0/4083884688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc100840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009910 tx=0x7f17f0009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 -- 172.21.15.72:0/4083884688 shutdown_connections 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 --2- 172.21.15.72:0/4083884688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc100840 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 --2- 172.21.15.72:0/4083884688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 -- 172.21.15.72:0/4083884688 >> 172.21.15.72:0/4083884688 conn(0x7f17fc0fa780 msgr2=0x7f17fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 -- 172.21.15.72:0/4083884688 shutdown_connections 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.617+0000 7f1801181700 1 -- 172.21.15.72:0/4083884688 wait complete. 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.618+0000 7f1801181700 1 Processor -- start 2024-04-15T21:01:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f1801181700 1 -- start start 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f1801181700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f1801181700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f1801181700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1965c0 con 0x7f17fc1003d0 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f1801181700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc196700 con 0x7f17fc0ff130 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:56248/0 (socket says 172.21.15.72:56248) 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f17fad9d700 1 -- 172.21.15.72:0/369247364 learned_addr learned my addr 172.21.15.72:0/369247364 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.619+0000 7f17fa59c700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.620+0000 7f17fad9d700 1 -- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 msgr2=0x7f17fc195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.620+0000 7f17fad9d700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.620+0000 7f17fad9d700 1 -- 172.21.15.72:0/369247364 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00095f0 con 0x7f17fc0ff130 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.620+0000 7f17fad9d700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d8d0 tx=0x7f17ec00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.620+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ec0098a0 con 0x7f17fc0ff130 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.621+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17ec010460 con 0x7f17fc0ff130 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.621+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc19b1b0 con 0x7f17fc0ff130 2024-04-15T21:01:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.621+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ec00f5f0 con 0x7f17fc0ff130 2024-04-15T21:01:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.621+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc19b700 con 0x7f17fc0ff130 2024-04-15T21:01:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.622+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc107c10 con 0x7f17fc0ff130 2024-04-15T21:01:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.623+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f17ec009a00 con 0x7f17fc0ff130 2024-04-15T21:01:26.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.624+0000 7f17e3fff700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 0x7f17e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.624+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f17ec08b770 con 0x7f17fc0ff130 2024-04-15T21:01:26.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.624+0000 7f17fa59c700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 0x7f17e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.624+0000 7f17fa59c700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 0x7f17e406eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006010 tx=0x7f17f000b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.628+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f17ec059990 con 0x7f17fc0ff130 2024-04-15T21:01:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.848+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17fc068c50 con 0x7f17e406c680 2024-04-15T21:01:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.850+0000 7f17e3fff700 1 -- 172.21.15.72:0/369247364 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f17fc068c50 con 0x7f17e406c680 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.851+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 msgr2=0x7f17e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.851+0000 7f1801181700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 0x7f17e406eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006010 tx=0x7f17f000b540 comp rx=0 tx=0).stop 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.851+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 msgr2=0x7f17fc195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.851+0000 7f1801181700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00d8d0 tx=0x7f17ec00dbe0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 shutdown_connections 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f17e406c680 0x7f17e406eb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17fc0ff130 0x7f17fc195a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 --2- 172.21.15.72:0/369247364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17fc1003d0 0x7f17fc195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 >> 172.21.15.72:0/369247364 conn(0x7f17fc0fa780 msgr2=0x7f17fc068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 shutdown_connections 2024-04-15T21:01:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.852+0000 7f1801181700 1 -- 172.21.15.72:0/369247364 wait complete. 2024-04-15T21:01:26.854 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:01:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 -- 172.21.15.72:0/4115780454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fe500 msgr2=0x7f26100fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 --2- 172.21.15.72:0/4115780454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fe500 0x7f26100fe910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2600009910 tx=0x7f2600009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 -- 172.21.15.72:0/4115780454 shutdown_connections 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 --2- 172.21.15.72:0/4115780454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fee50 0x7f2610101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 --2- 172.21.15.72:0/4115780454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fe500 0x7f26100fe910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 -- 172.21.15.72:0/4115780454 >> 172.21.15.72:0/4115780454 conn(0x7f26100f9f10 msgr2=0x7f26100fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 -- 172.21.15.72:0/4115780454 shutdown_connections 2024-04-15T21:01:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.963+0000 7f2614e48700 1 -- 172.21.15.72:0/4115780454 wait complete. 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 Processor -- start 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 -- start start 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fe500 0x7f2610195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2610196690 con 0x7f26100fee50 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f2614e48700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101967d0 con 0x7f26100fe500 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50522/0 (socket says 172.21.15.72:50522) 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 -- 172.21.15.72:0/3687297267 learned_addr learned my addr 172.21.15.72:0/3687297267 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260e59c700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fe500 0x7f2610195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 -- 172.21.15.72:0/3687297267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fe500 msgr2=0x7f2610195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fe500 0x7f2610195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.964+0000 7f260dd9b700 1 -- 172.21.15.72:0/3687297267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000095f0 con 0x7f26100fee50 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f260dd9b700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f260400e8c0 tx=0x7f260400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260400c9b0 con 0x7f26100fee50 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261019b280 con 0x7f26100fee50 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2604010430 con 0x7f26100fee50 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2604018650 con 0x7f26100fee50 2024-04-15T21:01:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.965+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261019b7d0 con 0x7f26100fee50 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.966+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2610108d50 con 0x7f26100fee50 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.967+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f26040188d0 con 0x7f26100fee50 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.967+0000 7f25ff7fe700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 0x7f25f806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.967+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2604014070 con 0x7f26100fee50 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.967+0000 7f260e59c700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 0x7f25f806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.968+0000 7f260e59c700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 0x7f25f806eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f260000b6f0 tx=0x7f2600005a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:26.972+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2604051720 con 0x7f26100fee50 2024-04-15T21:01:27.049 INFO:tasks.workunit.client.1.smithi149.stderr:+ tar xzf ltp-full.tgz 2024-04-15T21:01:27.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.189+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2610105ed0 con 0x7f25f806c680 2024-04-15T21:01:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.190+0000 7f25ff7fe700 1 -- 172.21.15.72:0/3687297267 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f2610105ed0 con 0x7f25f806c680 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 msgr2=0x7f25f806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 0x7f25f806eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f260000b6f0 tx=0x7f2600005a90 comp rx=0 tx=0).stop 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 msgr2=0x7f2610196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f260400e8c0 tx=0x7f260400ebd0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 shutdown_connections 2024-04-15T21:01:27.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f25f806c680 0x7f25f806eb30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26100fe500 0x7f2610195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 --2- 172.21.15.72:0/3687297267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26100fee50 0x7f2610196070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 >> 172.21.15.72:0/3687297267 conn(0x7f26100f9f10 msgr2=0x7f26101047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 shutdown_connections 2024-04-15T21:01:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.193+0000 7f2614e48700 1 -- 172.21.15.72:0/3687297267 wait complete. 2024-04-15T21:01:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 -- 172.21.15.72:0/2387355311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0101440 msgr2=0x7effa0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 --2- 172.21.15.72:0/2387355311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0101440 0x7effa0101890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009910 tx=0x7eff8c009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 -- 172.21.15.72:0/2387355311 shutdown_connections 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 --2- 172.21.15.72:0/2387355311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0101440 0x7effa0101890 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 --2- 172.21.15.72:0/2387355311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0100240 0x7effa0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 -- 172.21.15.72:0/2387355311 >> 172.21.15.72:0/2387355311 conn(0x7effa00fb7f0 msgr2=0x7effa00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 -- 172.21.15.72:0/2387355311 shutdown_connections 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.300+0000 7effa6a94700 1 -- 172.21.15.72:0/2387355311 wait complete. 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 Processor -- start 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 -- start start 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0101440 0x7effa0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0073680 con 0x7effa0100240 2024-04-15T21:01:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa6a94700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00737c0 con 0x7effa0101440 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50526/0 (socket says 172.21.15.72:50526) 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 -- 172.21.15.72:0/3544465163 learned_addr learned my addr 172.21.15.72:0/3544465163 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7eff9ffff700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0101440 0x7effa0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 -- 172.21.15.72:0/3544465163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0101440 msgr2=0x7effa0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0101440 0x7effa0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.301+0000 7effa4830700 1 -- 172.21.15.72:0/3544465163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0095f0 con 0x7effa0100240 2024-04-15T21:01:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7effa4830700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff9400d900 tx=0x7eff9400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff940041f0 con 0x7effa0100240 2024-04-15T21:01:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa0073aa0 con 0x7effa0100240 2024-04-15T21:01:27.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff94004350 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff94003d20 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.302+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa019daf0 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.303+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0108d90 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.303+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7eff94009730 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.304+0000 7eff9dffb700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 0x7eff9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.304+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7eff9408b7e0 con 0x7effa0100240 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.304+0000 7eff9ffff700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 0x7eff9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.304+0000 7eff9ffff700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 0x7eff9006eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff8c006010 tx=0x7eff8c00b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:27.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.308+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7eff940598f0 con 0x7effa0100240 2024-04-15T21:01:27.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.519+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effa0105d90 con 0x7eff9006c680 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.529+0000 7eff9dffb700 1 -- 172.21.15.72:0/3544465163 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7effa0105d90 con 0x7eff9006c680 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (6m) 91s ago 7m 25.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (7m) 91s ago 7m 7428k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (6m) 97s ago 6m 7352k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (7m) 91s ago 7m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (6m) 97s ago 6m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:01:27.522 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (5m) 91s ago 7m 79.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (111s) 91s ago 110s 13.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (118s) 91s ago 117s 11.3M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (108s) 97s ago 108s 13.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (115s) 97s ago 115s 17.2M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (9m) 91s ago 9m 487M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (6m) 97s ago 6m 438M - 18.2.0 dc2bc1663786 a2048a211a48 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 91s ago 9m 48.3M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (6m) 97s ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (7m) 91s ago 7m 16.4M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 97s ago 6m 16.6M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 91s ago 5m 50.1M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 91s ago 5m 47.7M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 91s ago 4m 48.4M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (4m) 97s ago 4m 48.9M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:01:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (3m) 97s ago 3m 46.4M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (3m) 97s ago 3m 43.4M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (5m) 91s ago 7m 62.8M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 msgr2=0x7eff9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 0x7eff9006eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff8c006010 tx=0x7eff8c00b540 comp rx=0 tx=0).stop 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 msgr2=0x7effa0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff9400d900 tx=0x7eff9400dc10 comp rx=0 tx=0).stop 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 shutdown_connections 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9006c680 0x7eff9006eb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0100240 0x7effa0074af0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 --2- 172.21.15.72:0/3544465163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa0101440 0x7effa0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 >> 172.21.15.72:0/3544465163 conn(0x7effa00fb7f0 msgr2=0x7effa0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 shutdown_connections 2024-04-15T21:01:27.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.531+0000 7effa6a94700 1 -- 172.21.15.72:0/3544465163 wait complete. 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 -- 172.21.15.72:0/2484967853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd01003d0 msgr2=0x7fefd0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/2484967853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd01003d0 0x7fefd0100840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009910 tx=0x7fefc0009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 -- 172.21.15.72:0/2484967853 shutdown_connections 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/2484967853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd01003d0 0x7fefd0100840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/2484967853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd00ff130 0x7fefd00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 -- 172.21.15.72:0/2484967853 >> 172.21.15.72:0/2484967853 conn(0x7fefd00fa780 msgr2=0x7fefd00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:27.632 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:27 smithi072 ceph-mon[29079]: pgmap v240: 65 pgs: 65 active+clean; 599 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-15T21:01:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 -- 172.21.15.72:0/2484967853 shutdown_connections 2024-04-15T21:01:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.639+0000 7fefd7d9e700 1 -- 172.21.15.72:0/2484967853 wait complete. 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 Processor -- start 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 -- start start 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 0x7fefd0195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01965c0 con 0x7fefd00ff130 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd7d9e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0196700 con 0x7fefd01003d0 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50534/0 (socket says 172.21.15.72:50534) 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 -- 172.21.15.72:0/516297621 learned_addr learned my addr 172.21.15.72:0/516297621 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5339700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 0x7fefd0195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 -- 172.21.15.72:0/516297621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 msgr2=0x7fefd0195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 0x7fefd0195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 -- 172.21.15.72:0/516297621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00095f0 con 0x7fefd00ff130 2024-04-15T21:01:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5339700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 0x7fefd0195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.640+0000 7fefd5b3a700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d8d0 tx=0x7fefcc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefcc009940 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefcc010460 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefcc00f5f0 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd019b1b0 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd019b700 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.641+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd0107c10 con 0x7fefd00ff130 2024-04-15T21:01:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.642+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fefcc0105d0 con 0x7fefd00ff130 2024-04-15T21:01:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.642+0000 7fefc6ffd700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 0x7fefbc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.643+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fefcc08b810 con 0x7fefd00ff130 2024-04-15T21:01:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.643+0000 7fefd5339700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 0x7fefbc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.643+0000 7fefd5339700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 0x7fefbc06eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006010 tx=0x7fefc000b560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.647+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fefcc0599a0 con 0x7fefd00ff130 2024-04-15T21:01:27.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.930+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fefd019bd90 con 0x7fefd00ff130 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.930+0000 7fefc6ffd700 1 -- 172.21.15.72:0/516297621 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fefcc05de60 con 0x7fefd00ff130 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:01:27.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:01:27.924 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 msgr2=0x7fefbc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 0x7fefbc06eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006010 tx=0x7fefc000b560 comp rx=0 tx=0).stop 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 msgr2=0x7fefd0195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d8d0 tx=0x7fefcc00dc90 comp rx=0 tx=0).stop 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 shutdown_connections 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fefbc06c680 0x7fefbc06eb30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd00ff130 0x7fefd0195a60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 --2- 172.21.15.72:0/516297621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefd01003d0 0x7fefd0195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 >> 172.21.15.72:0/516297621 conn(0x7fefd00fa780 msgr2=0x7fefd0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 shutdown_connections 2024-04-15T21:01:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:27.932+0000 7fefd7d9e700 1 -- 172.21.15.72:0/516297621 wait complete. 2024-04-15T21:01:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:27 smithi149 ceph-mon[36029]: pgmap v240: 65 pgs: 65 active+clean; 599 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-15T21:01:28.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.041+0000 7fded545e700 1 -- 172.21.15.72:0/1408714694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0101440 msgr2=0x7fded0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.041+0000 7fded545e700 1 --2- 172.21.15.72:0/1408714694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0101440 0x7fded0101890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009910 tx=0x7fdeb8009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 -- 172.21.15.72:0/1408714694 shutdown_connections 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 --2- 172.21.15.72:0/1408714694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0101440 0x7fded0101890 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 --2- 172.21.15.72:0/1408714694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0100240 0x7fded0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 -- 172.21.15.72:0/1408714694 >> 172.21.15.72:0/1408714694 conn(0x7fded00fb7f0 msgr2=0x7fded00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 -- 172.21.15.72:0/1408714694 shutdown_connections 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 -- 172.21.15.72:0/1408714694 wait complete. 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 Processor -- start 2024-04-15T21:01:28.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 -- start start 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.042+0000 7fded545e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fded545e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0101440 0x7fded0196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fded545e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0196650 con 0x7fded0100240 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fded545e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0196790 con 0x7fded0101440 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50542/0 (socket says 172.21.15.72:50542) 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 -- 172.21.15.72:0/3666003081 learned_addr learned my addr 172.21.15.72:0/3666003081 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdec7fff700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0101440 0x7fded0196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 -- 172.21.15.72:0/3666003081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0101440 msgr2=0x7fded0196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0101440 0x7fded0196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 -- 172.21.15.72:0/3666003081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80095f0 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeceffd700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdec000e970 tx=0x7fdec000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec0004a00 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec000cc70 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded019b240 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec00055c0 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.043+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded019b790 con 0x7fded0100240 2024-04-15T21:01:28.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.044+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0108db0 con 0x7fded0100240 2024-04-15T21:01:28.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.045+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdec000c7c0 con 0x7fded0100240 2024-04-15T21:01:28.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.046+0000 7fdeccff9700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 0x7fdebc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.046+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdec0014070 con 0x7fded0100240 2024-04-15T21:01:28.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.046+0000 7fdec7fff700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 0x7fdebc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.046+0000 7fdec7fff700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 0x7fdebc06eb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b6f0 tx=0x7fdeb8005a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.050+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdec0059d30 con 0x7fded0100240 2024-04-15T21:01:28.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.298+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fded019c340 con 0x7fded0100240 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.298+0000 7fdeccff9700 1 -- 172.21.15.72:0/3666003081 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7fdec00598c0 con 0x7fded0100240 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:01:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:01:28.292 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:01:28.293 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:01:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 msgr2=0x7fdebc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 0x7fdebc06eb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b6f0 tx=0x7fdeb8005a90 comp rx=0 tx=0).stop 2024-04-15T21:01:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 msgr2=0x7fded0195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdec000e970 tx=0x7fdec000ec80 comp rx=0 tx=0).stop 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 shutdown_connections 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fdebc06c680 0x7fdebc06eb30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fded0100240 0x7fded0195af0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 --2- 172.21.15.72:0/3666003081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded0101440 0x7fded0196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 >> 172.21.15.72:0/3666003081 conn(0x7fded00fb7f0 msgr2=0x7fded0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 shutdown_connections 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.301+0000 7fded545e700 1 -- 172.21.15.72:0/3666003081 wait complete. 2024-04-15T21:01:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:01:28.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/3382869081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8103680 msgr2=0x7fe3d8105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/3382869081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8103680 0x7fe3d8105a60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009910 tx=0x7fe3c0009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/3382869081 shutdown_connections 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/3382869081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8103680 0x7fe3d8105a60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/3382869081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8100d60 0x7fe3d8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/3382869081 >> 172.21.15.72:0/3382869081 conn(0x7fe3d80fa780 msgr2=0x7fe3d80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/3382869081 shutdown_connections 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.412+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/3382869081 wait complete. 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 Processor -- start 2024-04-15T21:01:28.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 -- start start 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8103680 0x7fe3d8196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8196640 con 0x7fe3d8100d60 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.413+0000 7fe3dd7a9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8196780 con 0x7fe3d8103680 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50564/0 (socket says 172.21.15.72:50564) 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 -- 172.21.15.72:0/1343905990 learned_addr learned my addr 172.21.15.72:0/1343905990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8103680 0x7fe3d8196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 -- 172.21.15.72:0/1343905990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8103680 msgr2=0x7fe3d8196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8103680 0x7fe3d8196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 -- 172.21.15.72:0/1343905990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00095f0 con 0x7fe3d8100d60 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d6ffd700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800e8f0 tx=0x7fe3c800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8009790 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3c800c810 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d819b230 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c80055b0 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.414+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d819b780 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.415+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d818fbe0 con 0x7fe3d8100d60 2024-04-15T21:01:28.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.416+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe3c800c980 con 0x7fe3d8100d60 2024-04-15T21:01:28.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.416+0000 7fe3d4ff9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 0x7fe3c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.416+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe3c8014070 con 0x7fe3d8100d60 2024-04-15T21:01:28.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.416+0000 7fe3cffff700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 0x7fe3c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.417+0000 7fe3cffff700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 0x7fe3c406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009fd0 tx=0x7fe3c0005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.421+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe3c8059da0 con 0x7fe3d8100d60 2024-04-15T21:01:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.641+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d8061190 con 0x7fe3c406c680 2024-04-15T21:01:28.634 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:28 smithi072 ceph-mon[29079]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:28 smithi072 ceph-mon[29079]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:28 smithi072 ceph-mon[29079]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:28 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/516297621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:01:28.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:28 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3666003081' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:01:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.642+0000 7fe3d4ff9700 1 -- 172.21.15.72:0/1343905990 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fe3d8061190 con 0x7fe3c406c680 2024-04-15T21:01:28.635 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:01:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "0/23 daemons upgraded", 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f image on host smithi149", 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:01:28.636 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.644+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 msgr2=0x7fe3c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.644+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 0x7fe3c406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009fd0 tx=0x7fe3c0005940 comp rx=0 tx=0).stop 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.644+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 msgr2=0x7fe3d8195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.644+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800e8f0 tx=0x7fe3c800ec00 comp rx=0 tx=0).stop 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 shutdown_connections 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe3c406c680 0x7fe3c406eb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d8100d60 0x7fe3d8195ae0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 --2- 172.21.15.72:0/1343905990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d8103680 0x7fe3d8196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 >> 172.21.15.72:0/1343905990 conn(0x7fe3d80fa780 msgr2=0x7fe3d80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 shutdown_connections 2024-04-15T21:01:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.645+0000 7fe3dd7a9700 1 -- 172.21.15.72:0/1343905990 wait complete. 2024-04-15T21:01:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 -- 172.21.15.72:0/2763947592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 msgr2=0x7effb0100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 --2- 172.21.15.72:0/2763947592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0100860 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7effa4009910 tx=0x7effa4009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 -- 172.21.15.72:0/2763947592 shutdown_connections 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 --2- 172.21.15.72:0/2763947592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0100860 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 --2- 172.21.15.72:0/2763947592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 0x7effb00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 -- 172.21.15.72:0/2763947592 >> 172.21.15.72:0/2763947592 conn(0x7effb00fa7a0 msgr2=0x7effb00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 -- 172.21.15.72:0/2763947592 shutdown_connections 2024-04-15T21:01:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.751+0000 7effb615a700 1 -- 172.21.15.72:0/2763947592 wait complete. 2024-04-15T21:01:28.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 Processor -- start 2024-04-15T21:01:28.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 -- start start 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 0x7effb0195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0196930 con 0x7effb01003f0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effb615a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0196a70 con 0x7effb00ff150 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effaeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effaf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 0x7effb0195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effaeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50586/0 (socket says 172.21.15.72:50586) 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effaeffd700 1 -- 172.21.15.72:0/3208574624 learned_addr learned my addr 172.21.15.72:0/3208574624 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.752+0000 7effaeffd700 1 -- 172.21.15.72:0/3208574624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 msgr2=0x7effb0195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effaeffd700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 0x7effb0195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effaeffd700 1 -- 172.21.15.72:0/3208574624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40095f0 con 0x7effb01003f0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effaeffd700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7effa4000c00 tx=0x7effa400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa401d070 con 0x7effb01003f0 2024-04-15T21:01:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7effa4005dc0 con 0x7effb01003f0 2024-04-15T21:01:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb019b4c0 con 0x7effb01003f0 2024-04-15T21:01:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa40226a0 con 0x7effb01003f0 2024-04-15T21:01:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.753+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb019b9b0 con 0x7effb01003f0 2024-04-15T21:01:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.754+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb0068ab0 con 0x7effb01003f0 2024-04-15T21:01:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.754+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7effa40038f0 con 0x7effb01003f0 2024-04-15T21:01:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.755+0000 7effacff9700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 0x7eff9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.755+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7effa408cd70 con 0x7effb01003f0 2024-04-15T21:01:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.755+0000 7effaf7fe700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 0x7eff9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.755+0000 7effaf7fe700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 0x7eff9806eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7effa0009c60 tx=0x7effa0009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:28.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:28.759+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7effa405ae80 con 0x7effb01003f0 2024-04-15T21:01:28.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:28 smithi149 ceph-mon[36029]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:28 smithi149 ceph-mon[36029]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:28 smithi149 ceph-mon[36029]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:28.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:28 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/516297621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:01:28.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:28 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3666003081' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:01:29.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.035+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effb019bbd0 con 0x7effb01003f0 2024-04-15T21:01:29.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.035+0000 7effacff9700 1 -- 172.21.15.72:0/3208574624 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7effa4003680 con 0x7effb01003f0 2024-04-15T21:01:29.029 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:01:29.029 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:01:29.030 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:01:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.037+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 msgr2=0x7eff9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.037+0000 7effb615a700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 0x7eff9806eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7effa0009c60 tx=0x7effa0009260 comp rx=0 tx=0).stop 2024-04-15T21:01:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.037+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 msgr2=0x7effb0196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.037+0000 7effb615a700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7effa4000c00 tx=0x7effa400f690 comp rx=0 tx=0).stop 2024-04-15T21:01:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 shutdown_connections 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7eff9806c680 0x7eff9806eb30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effb00ff150 0x7effb0195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 --2- 172.21.15.72:0/3208574624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb01003f0 0x7effb0196310 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 >> 172.21.15.72:0/3208574624 conn(0x7effb00fa7a0 msgr2=0x7effb01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 shutdown_connections 2024-04-15T21:01:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:29.038+0000 7effb615a700 1 -- 172.21.15.72:0/3208574624 wait complete. 2024-04-15T21:01:29.422 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T21:01:29.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:29 smithi072 ceph-mon[29079]: pgmap v241: 65 pgs: 65 active+clean; 665 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-04-15T21:01:29.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:29 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3208574624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:01:29.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:29 smithi149 ceph-mon[36029]: pgmap v241: 65 pgs: 65 active+clean; 665 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 1 op/s 2024-04-15T21:01:29.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:29 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3208574624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:01:30.037 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T21:01:30.233 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T21:01:30.235 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T21:01:30.235 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T21:01:30.317 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T21:01:30.320 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T21:01:30.320 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-15T21:01:30.377 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-15T21:01:30.378 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-15T21:01:30.378 DEBUG:teuthology.orchestra.run.smithi072:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f7db60e5ba4c4d053b594b7ec58703d2833c55b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-15T21:01:30.442 INFO:tasks.workunit.client.0.smithi072.stderr:+ mkdir -p fsstress 2024-04-15T21:01:30.444 INFO:tasks.workunit.client.0.smithi072.stderr:+ pushd fsstress 2024-04-15T21:01:30.445 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T21:01:30.445 INFO:tasks.workunit.client.0.smithi072.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-15T21:01:30.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:30 smithi072 ceph-mon[29079]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:30.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:30 smithi149 ceph-mon[36029]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:01:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:31 smithi072 ceph-mon[29079]: pgmap v242: 65 pgs: 65 active+clean; 1.0 MiB data, 174 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 41 KiB/s wr, 3 op/s 2024-04-15T21:01:31.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:31 smithi149 ceph-mon[36029]: pgmap v242: 65 pgs: 65 active+clean; 1.0 MiB data, 174 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 41 KiB/s wr, 3 op/s 2024-04-15T21:01:32.627 INFO:tasks.workunit.client.0.smithi072.stderr:+ tar xzf ltp-full.tgz 2024-04-15T21:01:33.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:33 smithi072 ceph-mon[29079]: pgmap v243: 65 pgs: 65 active+clean; 15 MiB data, 206 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 35 op/s 2024-04-15T21:01:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:33 smithi149 ceph-mon[36029]: pgmap v243: 65 pgs: 65 active+clean; 15 MiB data, 206 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 35 op/s 2024-04-15T21:01:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:34.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:35.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:35 smithi072 ceph-mon[29079]: pgmap v244: 65 pgs: 65 active+clean; 15 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 42 op/s 2024-04-15T21:01:35.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:35 smithi149 ceph-mon[36029]: pgmap v244: 65 pgs: 65 active+clean; 15 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 42 op/s 2024-04-15T21:01:37.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:37 smithi072 ceph-mon[29079]: pgmap v245: 65 pgs: 65 active+clean; 31 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 87 op/s 2024-04-15T21:01:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:37 smithi149 ceph-mon[36029]: pgmap v245: 65 pgs: 65 active+clean; 31 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 87 op/s 2024-04-15T21:01:39.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:39 smithi072 ceph-mon[29079]: pgmap v246: 65 pgs: 65 active+clean; 37 MiB data, 274 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 109 op/s 2024-04-15T21:01:39.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:39 smithi149 ceph-mon[36029]: pgmap v246: 65 pgs: 65 active+clean; 37 MiB data, 274 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 109 op/s 2024-04-15T21:01:41.837 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:41 smithi072 ceph-mon[29079]: pgmap v247: 65 pgs: 65 active+clean; 38 MiB data, 297 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 118 op/s 2024-04-15T21:01:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:41 smithi149 ceph-mon[36029]: pgmap v247: 65 pgs: 65 active+clean; 38 MiB data, 297 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 118 op/s 2024-04-15T21:01:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:43 smithi072 ceph-mon[29079]: pgmap v248: 65 pgs: 65 active+clean; 59 MiB data, 358 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 183 op/s 2024-04-15T21:01:43.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:43 smithi149 ceph-mon[36029]: pgmap v248: 65 pgs: 65 active+clean; 59 MiB data, 358 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.9 MiB/s wr, 183 op/s 2024-04-15T21:01:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:45 smithi149 ceph-mon[36029]: pgmap v249: 65 pgs: 65 active+clean; 64 MiB data, 371 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 162 op/s 2024-04-15T21:01:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:45 smithi072 ceph-mon[29079]: pgmap v249: 65 pgs: 65 active+clean; 64 MiB data, 371 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 162 op/s 2024-04-15T21:01:47.904 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:47 smithi149 ceph-mon[36029]: pgmap v250: 65 pgs: 65 active+clean; 79 MiB data, 409 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 195 op/s 2024-04-15T21:01:47.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:47 smithi072 ceph-mon[29079]: pgmap v250: 65 pgs: 65 active+clean; 79 MiB data, 409 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 195 op/s 2024-04-15T21:01:49.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:49 smithi072 ceph-mon[29079]: pgmap v251: 65 pgs: 65 active+clean; 81 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 168 op/s 2024-04-15T21:01:49.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:49 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:49 smithi149 ceph-mon[36029]: pgmap v251: 65 pgs: 65 active+clean; 81 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 168 op/s 2024-04-15T21:01:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:49 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:01:51.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:51 smithi072 ceph-mon[29079]: pgmap v252: 65 pgs: 65 active+clean; 82 MiB data, 445 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 152 op/s 2024-04-15T21:01:51.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:51 smithi149 ceph-mon[36029]: pgmap v252: 65 pgs: 65 active+clean; 82 MiB data, 445 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 152 op/s 2024-04-15T21:01:53.912 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:53 smithi149 ceph-mon[36029]: pgmap v253: 65 pgs: 65 active+clean; 102 MiB data, 509 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 215 op/s 2024-04-15T21:01:53.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:53 smithi072 ceph-mon[29079]: pgmap v253: 65 pgs: 65 active+clean; 102 MiB data, 509 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.4 MiB/s wr, 215 op/s 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: Upgrade: Updating mgr.smithi149.qgbaiy 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:01:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:54 smithi072 ceph-mon[29079]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: Upgrade: Updating mgr.smithi149.qgbaiy 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:01:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:54 smithi149 ceph-mon[36029]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:01:55.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:55 smithi072 ceph-mon[29079]: pgmap v254: 65 pgs: 65 active+clean; 103 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 155 op/s 2024-04-15T21:01:55.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:55 smithi149 ceph-mon[36029]: pgmap v254: 65 pgs: 65 active+clean; 103 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 155 op/s 2024-04-15T21:01:57.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:57 smithi072 ceph-mon[29079]: pgmap v255: 65 pgs: 65 active+clean; 113 MiB data, 552 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 181 op/s 2024-04-15T21:01:57.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:57 smithi149 ceph-mon[36029]: pgmap v255: 65 pgs: 65 active+clean; 113 MiB data, 552 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 181 op/s 2024-04-15T21:01:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 -- 172.21.15.72:0/3067352050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc468100340 msgr2=0x7fc468100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 --2- 172.21.15.72:0/3067352050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc468100340 0x7fc468100790 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009910 tx=0x7fc45c009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 -- 172.21.15.72:0/3067352050 shutdown_connections 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 --2- 172.21.15.72:0/3067352050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc468100340 0x7fc468100790 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 --2- 172.21.15.72:0/3067352050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4680ff140 0x7fc4680ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 -- 172.21.15.72:0/3067352050 >> 172.21.15.72:0/3067352050 conn(0x7fc4680fa6d0 msgr2=0x7fc4680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 -- 172.21.15.72:0/3067352050 shutdown_connections 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.165+0000 7fc46d662700 1 -- 172.21.15.72:0/3067352050 wait complete. 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 Processor -- start 2024-04-15T21:01:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 -- start start 2024-04-15T21:01:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 0x7fc4681030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 0x7fc468101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468101c60 con 0x7fc4680ff140 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc46d662700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468101da0 con 0x7fc468100340 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 0x7fc4681030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.166+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 0x7fc4681030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45958/0 (socket says 172.21.15.72:45958) 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.167+0000 7fc466ffd700 1 -- 172.21.15.72:0/1008871609 learned_addr learned my addr 172.21.15.72:0/1008871609 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.167+0000 7fc4667fc700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 0x7fc468101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.167+0000 7fc4667fc700 1 -- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 msgr2=0x7fc4681030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.167+0000 7fc4667fc700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 0x7fc4681030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.167+0000 7fc4667fc700 1 -- 172.21.15.72:0/1008871609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0095f0 con 0x7fc468100340 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc4667fc700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 0x7fc468101720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009910 tx=0x7fc45c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c01d070 con 0x7fc468100340 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc45c00f460 con 0x7fc468100340 2024-04-15T21:01:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc468102020 con 0x7fc468100340 2024-04-15T21:01:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c021640 con 0x7fc468100340 2024-04-15T21:01:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.168+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc468102510 con 0x7fc468100340 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.169+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc468107c90 con 0x7fc468100340 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.170+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc45c00f5d0 con 0x7fc468100340 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.170+0000 7fc44ffff700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 0x7fc45006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.170+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc45c08cc70 con 0x7fc468100340 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.170+0000 7fc466ffd700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 0x7fc45006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.171+0000 7fc466ffd700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 0x7fc45006eb30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc45800bcd0 tx=0x7fc45800b2c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.177+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc45c093080 con 0x7fc468100340 2024-04-15T21:01:59.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.411+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc46819df10 con 0x7fc45006c680 2024-04-15T21:01:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.412+0000 7fc44ffff700 1 -- 172.21.15.72:0/1008871609 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc46819df10 con 0x7fc45006c680 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 msgr2=0x7fc45006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 0x7fc45006eb30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc45800bcd0 tx=0x7fc45800b2c0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 msgr2=0x7fc468101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 0x7fc468101720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009910 tx=0x7fc45c00be20 comp rx=0 tx=0).stop 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 shutdown_connections 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc45006c680 0x7fc45006eb30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4680ff140 0x7fc4681030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 --2- 172.21.15.72:0/1008871609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc468100340 0x7fc468101720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.414+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 >> 172.21.15.72:0/1008871609 conn(0x7fc4680fa6d0 msgr2=0x7fc468068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.415+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 shutdown_connections 2024-04-15T21:01:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.415+0000 7fc46d662700 1 -- 172.21.15.72:0/1008871609 wait complete. 2024-04-15T21:01:59.417 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 -- 172.21.15.72:0/2784961846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43481003d0 msgr2=0x7f4348100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 --2- 172.21.15.72:0/2784961846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43481003d0 0x7f4348100840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f433c009910 tx=0x7f433c009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 -- 172.21.15.72:0/2784961846 shutdown_connections 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 --2- 172.21.15.72:0/2784961846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43481003d0 0x7f4348100840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 --2- 172.21.15.72:0/2784961846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43480ff130 0x7f43480ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 -- 172.21.15.72:0/2784961846 >> 172.21.15.72:0/2784961846 conn(0x7f43480fa780 msgr2=0x7f43480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 -- 172.21.15.72:0/2784961846 shutdown_connections 2024-04-15T21:01:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.526+0000 7f434e27b700 1 -- 172.21.15.72:0/2784961846 wait complete. 2024-04-15T21:01:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 Processor -- start 2024-04-15T21:01:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 -- start start 2024-04-15T21:01:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43481003d0 0x7f4348194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43481954c0 con 0x7f43480ff130 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.527+0000 7f434e27b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348195600 con 0x7f43481003d0 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45978/0 (socket says 172.21.15.72:45978) 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 -- 172.21.15.72:0/1426020802 learned_addr learned my addr 172.21.15.72:0/1426020802 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f43477fe700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43481003d0 0x7f4348194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 -- 172.21.15.72:0/1426020802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43481003d0 msgr2=0x7f4348194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43481003d0 0x7f4348194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 -- 172.21.15.72:0/1426020802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0095f0 con 0x7f43480ff130 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f4347fff700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4338007910 tx=0x7f4338007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4338012070 con 0x7f43480ff130 2024-04-15T21:01:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4338007e60 con 0x7f43480ff130 2024-04-15T21:01:59.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43480685a0 con 0x7f43480ff130 2024-04-15T21:01:59.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43380054c0 con 0x7f43480ff130 2024-04-15T21:01:59.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.528+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348068af0 con 0x7f43480ff130 2024-04-15T21:01:59.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.529+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348107c10 con 0x7f43480ff130 2024-04-15T21:01:59.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.530+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4338016070 con 0x7f43480ff130 2024-04-15T21:01:59.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.530+0000 7f43457fa700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 0x7f433006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.530+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f433808caa0 con 0x7f43480ff130 2024-04-15T21:01:59.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.530+0000 7f43477fe700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 0x7f433006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.531+0000 7f43477fe700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 0x7f433006eb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f433c006010 tx=0x7f433c00b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.534+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f433805a920 con 0x7f43480ff130 2024-04-15T21:01:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.757+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4348104d20 con 0x7f433006c680 2024-04-15T21:01:59.750 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:01:59 smithi072 ceph-mon[29079]: pgmap v256: 65 pgs: 65 active+clean; 119 MiB data, 576 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 178 op/s 2024-04-15T21:01:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.758+0000 7f43457fa700 1 -- 172.21.15.72:0/1426020802 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f4348104d20 con 0x7f433006c680 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.760+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 msgr2=0x7f433006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.760+0000 7f434e27b700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 0x7f433006eb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f433c006010 tx=0x7f433c00b540 comp rx=0 tx=0).stop 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.760+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 msgr2=0x7f4348194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.760+0000 7f434e27b700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4338007910 tx=0x7f4338007c20 comp rx=0 tx=0).stop 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.760+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 shutdown_connections 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f433006c680 0x7f433006eb30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43480ff130 0x7f4348194960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 --2- 172.21.15.72:0/1426020802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43481003d0 0x7f4348194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 >> 172.21.15.72:0/1426020802 conn(0x7f43480fa780 msgr2=0x7f4348103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 shutdown_connections 2024-04-15T21:01:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.761+0000 7f434e27b700 1 -- 172.21.15.72:0/1426020802 wait complete. 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/3120800381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58103680 msgr2=0x7fcf58105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/3120800381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58103680 0x7fcf58105a60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009910 tx=0x7fcf48009c20 comp rx=0 tx=0).stop 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/3120800381 shutdown_connections 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/3120800381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58103680 0x7fcf58105a60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/3120800381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58100d60 0x7fcf58103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.882+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/3120800381 >> 172.21.15.72:0/3120800381 conn(0x7fcf580fa780 msgr2=0x7fcf580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:01:59.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.883+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/3120800381 shutdown_connections 2024-04-15T21:01:59.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.883+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/3120800381 wait complete. 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.883+0000 7fcf5fbc0700 1 Processor -- start 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.883+0000 7fcf5fbc0700 1 -- start start 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5fbc0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5fbc0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58103680 0x7fcf580fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5fbc0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ff250 con 0x7fcf58100d60 2024-04-15T21:01:59.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5fbc0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ff390 con 0x7fcf58103680 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46008/0 (socket says 172.21.15.72:46008) 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 -- 172.21.15.72:0/2367923276 learned_addr learned my addr 172.21.15.72:0/2367923276 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d15b700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58103680 0x7fcf580fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 -- 172.21.15.72:0/2367923276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58103680 msgr2=0x7fcf580fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58103680 0x7fcf580fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.884+0000 7fcf5d95c700 1 -- 172.21.15.72:0/2367923276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480095f0 con 0x7fcf58100d60 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf5d95c700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e8f0 tx=0x7fcf5400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf54009790 con 0x7fcf58100d60 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf5400c810 con 0x7fcf58100d60 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580ff670 con 0x7fcf58100d60 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf540055b0 con 0x7fcf58100d60 2024-04-15T21:01:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.885+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5819db40 con 0x7fcf58100d60 2024-04-15T21:01:59.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.886+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5818fbe0 con 0x7fcf58100d60 2024-04-15T21:01:59.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.887+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcf5400c980 con 0x7fcf58100d60 2024-04-15T21:01:59.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.887+0000 7fcf4effd700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 0x7fcf4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:01:59.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.887+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcf54014070 con 0x7fcf58100d60 2024-04-15T21:01:59.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.887+0000 7fcf5d15b700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 0x7fcf4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:01:59.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.888+0000 7fcf5d15b700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 0x7fcf4406eb30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009fd0 tx=0x7fcf48005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:01:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:01:59.892+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf54059d80 con 0x7fcf58100d60 2024-04-15T21:01:59.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:01:59 smithi149 ceph-mon[36029]: pgmap v256: 65 pgs: 65 active+clean; 119 MiB data, 576 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 178 op/s 2024-04-15T21:02:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.131+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf58061190 con 0x7fcf4406c680 2024-04-15T21:02:00.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.144+0000 7fcf4effd700 1 -- 172.21.15.72:0/2367923276 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3456 (secure 0 0 0) 0x7fcf58061190 con 0x7fcf4406c680 2024-04-15T21:02:00.136 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (6m) 2m ago 8m 25.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (8m) 2m ago 8m 7428k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (7m) 2m ago 7m 7352k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (8m) 2m ago 8m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (7m) 2m ago 7m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (6m) 2m ago 7m 79.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (2m) 2m ago 2m 13.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (2m) 2m ago 2m 11.3M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (2m) 2m ago 2m 13.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (2m) 2m ago 2m 17.2M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (7m) 2m ago 7m 438M - 18.2.0 dc2bc1663786 a2048a211a48 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 2m ago 9m 48.3M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (6m) 2m ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:02:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (8m) 2m ago 8m 16.4M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 2m ago 7m 16.6M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 2m ago 6m 50.1M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 2m ago 5m 47.7M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 2m ago 5m 48.4M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (4m) 2m ago 4m 48.9M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (4m) 2m ago 4m 46.4M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (3m) 2m ago 3m 43.4M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:02:00.138 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 2m ago 7m 62.8M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 msgr2=0x7fcf4406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 0x7fcf4406eb30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009fd0 tx=0x7fcf48005940 comp rx=0 tx=0).stop 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 msgr2=0x7fcf581006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e8f0 tx=0x7fcf5400ec00 comp rx=0 tx=0).stop 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 shutdown_connections 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fcf4406c680 0x7fcf4406eb30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf58100d60 0x7fcf581006c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 --2- 172.21.15.72:0/2367923276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf58103680 0x7fcf580fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 >> 172.21.15.72:0/2367923276 conn(0x7fcf580fa780 msgr2=0x7fcf580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 shutdown_connections 2024-04-15T21:02:00.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.146+0000 7fcf5fbc0700 1 -- 172.21.15.72:0/2367923276 wait complete. 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 -- 172.21.15.72:0/2816568537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac103680 msgr2=0x7efdac105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/2816568537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac103680 0x7efdac105a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efda0009910 tx=0x7efda0009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 -- 172.21.15.72:0/2816568537 shutdown_connections 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/2816568537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac103680 0x7efdac105a60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/2816568537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac100d60 0x7efdac103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 -- 172.21.15.72:0/2816568537 >> 172.21.15.72:0/2816568537 conn(0x7efdac0fa700 msgr2=0x7efdac0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 -- 172.21.15.72:0/2816568537 shutdown_connections 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 -- 172.21.15.72:0/2816568537 wait complete. 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.258+0000 7efdb1ed1700 1 Processor -- start 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdb1ed1700 1 -- start start 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdb1ed1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdb1ed1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 0x7efdac195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdb1ed1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac196560 con 0x7efdac100d60 2024-04-15T21:02:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdb1ed1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1966a0 con 0x7efdac103680 2024-04-15T21:02:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46014/0 (socket says 172.21.15.72:46014) 2024-04-15T21:02:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 -- 172.21.15.72:0/753007489 learned_addr learned my addr 172.21.15.72:0/753007489 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdaaffd700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 0x7efdac195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 -- 172.21.15.72:0/753007489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 msgr2=0x7efdac195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 0x7efdac195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdab7fe700 1 -- 172.21.15.72:0/753007489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda00095f0 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.259+0000 7efdaaffd700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 0x7efdac195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efdab7fe700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00e920 tx=0x7efd9c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9c00c9d0 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac19b150 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd9c010430 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9c018650 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.260+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac19b6a0 con 0x7efdac100d60 2024-04-15T21:02:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.261+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac18fc70 con 0x7efdac100d60 2024-04-15T21:02:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.261+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd9c0105a0 con 0x7efdac100d60 2024-04-15T21:02:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.262+0000 7efda8ff9700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 0x7efd9406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.262+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efd9c014070 con 0x7efdac100d60 2024-04-15T21:02:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.262+0000 7efdaaffd700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 0x7efd9406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.262+0000 7efdaaffd700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 0x7efd9406eb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efda0009fd0 tx=0x7efda0005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:00.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.267+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd9c051720 con 0x7efdac100d60 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.575+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efdac02cc30 con 0x7efdac100d60 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.575+0000 7efda8ff9700 1 -- 172.21.15.72:0/753007489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7efd9c059de0 con 0x7efdac100d60 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:02:00.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:02:00.569 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 msgr2=0x7efd9406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 0x7efd9406eb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efda0009fd0 tx=0x7efda0005940 comp rx=0 tx=0).stop 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 msgr2=0x7efdac195a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00e920 tx=0x7efd9c00ec30 comp rx=0 tx=0).stop 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 shutdown_connections 2024-04-15T21:02:00.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7efd9406c680 0x7efd9406eb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdac100d60 0x7efdac195a00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 --2- 172.21.15.72:0/753007489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdac103680 0x7efdac195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 >> 172.21.15.72:0/753007489 conn(0x7efdac0fa700 msgr2=0x7efdac0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:00.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 shutdown_connections 2024-04-15T21:02:00.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.578+0000 7efdb1ed1700 1 -- 172.21.15.72:0/753007489 wait complete. 2024-04-15T21:02:00.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 -- 172.21.15.72:0/3676694252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90107a40 msgr2=0x7f5f90107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 --2- 172.21.15.72:0/3676694252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90107a40 0x7f5f90107e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009910 tx=0x7f5f84009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 -- 172.21.15.72:0/3676694252 shutdown_connections 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 --2- 172.21.15.72:0/3676694252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90107a40 0x7f5f90107e90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 --2- 172.21.15.72:0/3676694252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90106840 0x7f5f90106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 -- 172.21.15.72:0/3676694252 >> 172.21.15.72:0/3676694252 conn(0x7f5f90075970 msgr2=0x7f5f90077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 -- 172.21.15.72:0/3676694252 shutdown_connections 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.689+0000 7f5f94d20700 1 -- 172.21.15.72:0/3676694252 wait complete. 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 Processor -- start 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 -- start start 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90107a40 0x7f5f9019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9019cc40 con 0x7f5f90106840 2024-04-15T21:02:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f94d20700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9019cd80 con 0x7f5f90107a40 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f8e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f8e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46026/0 (socket says 172.21.15.72:46026) 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f8e59c700 1 -- 172.21.15.72:0/978679964 learned_addr learned my addr 172.21.15.72:0/978679964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.690+0000 7f5f8dd9b700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90107a40 0x7f5f9019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f8e59c700 1 -- 172.21.15.72:0/978679964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90107a40 msgr2=0x7f5f9019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f8e59c700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90107a40 0x7f5f9019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f8e59c700 1 -- 172.21.15.72:0/978679964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840095f0 con 0x7f5f90106840 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f8e59c700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e8f0 tx=0x7f5f8000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f80009790 con 0x7f5f90106840 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f901a1830 con 0x7f5f90106840 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f8000c810 con 0x7f5f90106840 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f80003d20 con 0x7f5f90106840 2024-04-15T21:02:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.691+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901a1d80 con 0x7f5f90106840 2024-04-15T21:02:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.692+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9010f390 con 0x7f5f90106840 2024-04-15T21:02:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.693+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5f800041f0 con 0x7f5f90106840 2024-04-15T21:02:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.693+0000 7f5f7f7fe700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 0x7f5f7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.693+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5f80014070 con 0x7f5f90106840 2024-04-15T21:02:00.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.693+0000 7f5f8dd9b700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 0x7f5f7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:00.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.694+0000 7f5f8dd9b700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 0x7f5f7806eb30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f84005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.697+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5f80059e00 con 0x7f5f90106840 2024-04-15T21:02:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:00 smithi072 ceph-mon[29079]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:00 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/753007489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:02:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:00 smithi149 ceph-mon[36029]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:00 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/753007489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:02:00.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.961+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f901a2420 con 0x7f5f90106840 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.961+0000 7f5f7f7fe700 1 -- 172.21.15.72:0/978679964 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f5f80059990 con 0x7f5f90106840 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:00.954 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:02:00.955 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:00.956 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:02:00.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:00.957 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:00.957 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:00.957 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 msgr2=0x7f5f7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 0x7f5f7806eb30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009fd0 tx=0x7f5f84005940 comp rx=0 tx=0).stop 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 msgr2=0x7f5f9019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e8f0 tx=0x7f5f8000ec00 comp rx=0 tx=0).stop 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 shutdown_connections 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f5f7806c680 0x7f5f7806eb30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f90106840 0x7f5f9019c0e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 --2- 172.21.15.72:0/978679964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f90107a40 0x7f5f9019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 >> 172.21.15.72:0/978679964 conn(0x7f5f90075970 msgr2=0x7f5f9010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 shutdown_connections 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:00.964+0000 7f5f94d20700 1 -- 172.21.15.72:0/978679964 wait complete. 2024-04-15T21:02:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/2060169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 msgr2=0x7fe8a40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/2060169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40ff540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe898009910 tx=0x7fe898009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/2060169142 shutdown_connections 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/2060169142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 0x7fe8a4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/2060169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40ff540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/2060169142 >> 172.21.15.72:0/2060169142 conn(0x7fe8a40fa780 msgr2=0x7fe8a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/2060169142 shutdown_connections 2024-04-15T21:02:01.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.077+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/2060169142 wait complete. 2024-04-15T21:02:01.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 Processor -- start 2024-04-15T21:02:01.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 -- start start 2024-04-15T21:02:01.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 0x7fe8a419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4196680 con 0x7fe8a40ff130 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8ab0b3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a419d150 con 0x7fe8a41003d0 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.078+0000 7fe8a8e4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46046/0 (socket says 172.21.15.72:46046) 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 -- 172.21.15.72:0/3733831227 learned_addr learned my addr 172.21.15.72:0/3733831227 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a3fff700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 0x7fe8a419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 -- 172.21.15.72:0/3733831227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 msgr2=0x7fe8a419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 0x7fe8a419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 -- 172.21.15.72:0/3733831227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980095f0 con 0x7fe8a40ff130 2024-04-15T21:02:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a8e4f700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe89800f690 tx=0x7fe89800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89801d070 con 0x7fe8a40ff130 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe898005dc0 con 0x7fe8a40ff130 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.079+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a419d3a0 con 0x7fe8a40ff130 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.080+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8980226a0 con 0x7fe8a40ff130 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.080+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a419d840 con 0x7fe8a40ff130 2024-04-15T21:02:01.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.081+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a4107c10 con 0x7fe8a40ff130 2024-04-15T21:02:01.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.081+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe8980038f0 con 0x7fe8a40ff130 2024-04-15T21:02:01.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.082+0000 7fe8a1ffb700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 0x7fe89406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.082+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe89808cd70 con 0x7fe8a40ff130 2024-04-15T21:02:01.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.082+0000 7fe8a3fff700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 0x7fe89406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.082+0000 7fe8a3fff700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 0x7fe89406eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4069620 tx=0x7fe890009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:01.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.087+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe89805ae80 con 0x7fe8a40ff130 2024-04-15T21:02:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.325+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8a4104d20 con 0x7fe89406c680 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.326+0000 7fe8a1ffb700 1 -- 172.21.15.72:0/3733831227 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe8a4104d20 con 0x7fe89406c680 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "0/23 daemons upgraded", 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mgr daemons", 2024-04-15T21:02:01.319 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:02:01.320 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:02:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 msgr2=0x7fe89406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 0x7fe89406eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4069620 tx=0x7fe890009260 comp rx=0 tx=0).stop 2024-04-15T21:02:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 msgr2=0x7fe8a40690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe89800f690 tx=0x7fe89800f6c0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 shutdown_connections 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe89406c680 0x7fe89406eb30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a40ff130 0x7fe8a40690a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 --2- 172.21.15.72:0/3733831227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8a41003d0 0x7fe8a419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 >> 172.21.15.72:0/3733831227 conn(0x7fe8a40fa780 msgr2=0x7fe8a4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 shutdown_connections 2024-04-15T21:02:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.329+0000 7fe8ab0b3700 1 -- 172.21.15.72:0/3733831227 wait complete. 2024-04-15T21:02:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- 172.21.15.72:0/1006757890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 msgr2=0x7fb228105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/1006757890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228105a60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb218009910 tx=0x7fb218009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- 172.21.15.72:0/1006757890 shutdown_connections 2024-04-15T21:02:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/1006757890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228105a60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/1006757890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 0x7fb228103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- 172.21.15.72:0/1006757890 >> 172.21.15.72:0/1006757890 conn(0x7fb2280fa780 msgr2=0x7fb2280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- 172.21.15.72:0/1006757890 shutdown_connections 2024-04-15T21:02:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- 172.21.15.72:0/1006757890 wait complete. 2024-04-15T21:02:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 Processor -- start 2024-04-15T21:02:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.445+0000 7fb22fe9f700 1 -- start start 2024-04-15T21:02:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22fe9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 0x7fb228195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22fe9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22fe9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228196640 con 0x7fb228103680 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22fe9f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228196780 con 0x7fb228100d60 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46056/0 (socket says 172.21.15.72:46056) 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 -- 172.21.15.72:0/145632059 learned_addr learned my addr 172.21.15.72:0/145632059 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22dc3b700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 0x7fb228195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 -- 172.21.15.72:0/145632059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 msgr2=0x7fb228195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 0x7fb228195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 -- 172.21.15.72:0/145632059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2180095f0 con 0x7fb228103680 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22d43a700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb21800bd70 tx=0x7fb21800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21801d070 con 0x7fb228103680 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22819b1d0 con 0x7fb228103680 2024-04-15T21:02:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb218005dc0 con 0x7fb228103680 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.446+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb218021410 con 0x7fb228103680 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.447+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22819b6c0 con 0x7fb228103680 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.448+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22818fbe0 con 0x7fb228103680 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.448+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb21800f7d0 con 0x7fb228103680 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.449+0000 7fb21effd700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 0x7fb21406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.449+0000 7fb22dc3b700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 0x7fb21406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:01.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.449+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb21808cbd0 con 0x7fb228103680 2024-04-15T21:02:01.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.449+0000 7fb22dc3b700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 0x7fb21406eb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb228069000 tx=0x7fb2240073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.454+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb21805ace0 con 0x7fb228103680 2024-04-15T21:02:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.746+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb22802cc30 con 0x7fb228103680 2024-04-15T21:02:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.747+0000 7fb21effd700 1 -- 172.21.15.72:0/145632059 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb21800f460 con 0x7fb228103680 2024-04-15T21:02:01.739 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:02:01.739 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:02:01.739 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:02:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 msgr2=0x7fb21406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 0x7fb21406eb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb228069000 tx=0x7fb2240073d0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 msgr2=0x7fb228196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb21800bd70 tx=0x7fb21800bda0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 shutdown_connections 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fb21406c680 0x7fb21406eb30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb228100d60 0x7fb228195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 --2- 172.21.15.72:0/145632059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb228103680 0x7fb228196020 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 >> 172.21.15.72:0/145632059 conn(0x7fb2280fa780 msgr2=0x7fb2280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 shutdown_connections 2024-04-15T21:02:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:01.749+0000 7fb22fe9f700 1 -- 172.21.15.72:0/145632059 wait complete. 2024-04-15T21:02:01.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:01 smithi072 ceph-mon[29079]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:01.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:01 smithi072 ceph-mon[29079]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:01.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:01 smithi072 ceph-mon[29079]: pgmap v257: 65 pgs: 65 active+clean; 119 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 167 op/s 2024-04-15T21:02:01.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:01 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/978679964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:02:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:01 smithi149 ceph-mon[36029]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:01 smithi149 ceph-mon[36029]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:01 smithi149 ceph-mon[36029]: pgmap v257: 65 pgs: 65 active+clean; 119 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 167 op/s 2024-04-15T21:02:01.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:01 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/978679964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:02:02.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:02 smithi072 ceph-mon[29079]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:02.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:02 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/145632059' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:02:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:02 smithi149 ceph-mon[36029]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:02.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:02 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/145632059' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:02:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:03 smithi072 ceph-mon[29079]: pgmap v258: 65 pgs: 65 active+clean; 136 MiB data, 629 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 225 op/s 2024-04-15T21:02:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:03 smithi149 ceph-mon[36029]: pgmap v258: 65 pgs: 65 active+clean; 136 MiB data, 629 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 225 op/s 2024-04-15T21:02:04.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:04 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:04 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:05.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:05 smithi072 ceph-mon[29079]: pgmap v259: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 165 op/s 2024-04-15T21:02:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:05 smithi149 ceph-mon[36029]: pgmap v259: 65 pgs: 65 active+clean; 142 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 165 op/s 2024-04-15T21:02:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:07 smithi072 ceph-mon[29079]: pgmap v260: 65 pgs: 65 active+clean; 149 MiB data, 676 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 224 op/s 2024-04-15T21:02:07.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:07 smithi149 ceph-mon[36029]: pgmap v260: 65 pgs: 65 active+clean; 149 MiB data, 676 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 224 op/s 2024-04-15T21:02:09.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:09 smithi072 ceph-mon[29079]: pgmap v261: 65 pgs: 65 active+clean; 154 MiB data, 704 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 240 op/s 2024-04-15T21:02:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:09 smithi149 ceph-mon[36029]: pgmap v261: 65 pgs: 65 active+clean; 154 MiB data, 704 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 240 op/s 2024-04-15T21:02:11.824 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:11 smithi149 ceph-mon[36029]: pgmap v262: 65 pgs: 65 active+clean; 159 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 223 op/s 2024-04-15T21:02:11.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:11 smithi072 ceph-mon[29079]: pgmap v262: 65 pgs: 65 active+clean; 159 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 223 op/s 2024-04-15T21:02:13.501 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:13 smithi149 ceph-mon[36029]: pgmap v263: 65 pgs: 65 active+clean; 170 MiB data, 727 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 327 op/s 2024-04-15T21:02:13.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:13.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:13.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:13 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:13 smithi072 ceph-mon[29079]: pgmap v263: 65 pgs: 65 active+clean; 170 MiB data, 727 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.3 MiB/s wr, 327 op/s 2024-04-15T21:02:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:13 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:15.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:15 smithi149 ceph-mon[36029]: pgmap v264: 65 pgs: 65 active+clean; 171 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 277 op/s 2024-04-15T21:02:15.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:15 smithi072 ceph-mon[29079]: pgmap v264: 65 pgs: 65 active+clean; 171 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 277 op/s 2024-04-15T21:02:17.519 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-15T21:02:17.525 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-15T21:02:17.525 INFO:tasks.workunit.client.1.smithi149.stderr:+ make 2024-04-15T21:02:17.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:17 smithi149 ceph-mon[36029]: pgmap v265: 65 pgs: 65 active+clean; 189 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 352 op/s 2024-04-15T21:02:17.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:17.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:17 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:17 smithi072 ceph-mon[29079]: pgmap v265: 65 pgs: 65 active+clean; 189 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.0 MiB/s wr, 352 op/s 2024-04-15T21:02:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:17 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:18.220 INFO:tasks.workunit.client.1.smithi149.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-15T21:02:19.111 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:19.111 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:19 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:19.111 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:19 smithi149 ceph-mon[36029]: pgmap v266: 65 pgs: 65 active+clean; 192 MiB data, 774 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 340 op/s 2024-04-15T21:02:19.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:19.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:19 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:19.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:19 smithi072 ceph-mon[29079]: pgmap v266: 65 pgs: 65 active+clean; 192 MiB data, 774 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 340 op/s 2024-04-15T21:02:20.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:20 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:20.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:20 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:20.910 INFO:tasks.workunit.client.1.smithi149.stderr:++ readlink -f fsstress 2024-04-15T21:02:20.912 INFO:tasks.workunit.client.1.smithi149.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-15T21:02:20.912 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-04-15T21:02:20.913 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-15T21:02:20.914 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-04-15T21:02:20.914 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-15T21:02:20.915 INFO:tasks.workunit.client.1.smithi149.stderr:++ mktemp -d -p . 2024-04-15T21:02:20.917 INFO:tasks.workunit.client.1.smithi149.stderr:+ T=./tmp.DUo23Qyueu 2024-04-15T21:02:20.917 INFO:tasks.workunit.client.1.smithi149.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.DUo23Qyueu -l 1 -n 1000 -p 10 -v 2024-04-15T21:02:20.921 INFO:tasks.workunit.client.1.smithi149.stdout:seed = 1712563619 2024-04-15T21:02:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/0: unlink - no file 2024-04-15T21:02:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/1: rename - no filename 2024-04-15T21:02:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/2: dwrite - no filename 2024-04-15T21:02:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/3: dread - no filename 2024-04-15T21:02:20.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/4: fsync - no filename 2024-04-15T21:02:20.927 INFO:tasks.workunit.client.1.smithi149.stdout:2/0: dread - no filename 2024-04-15T21:02:20.927 INFO:tasks.workunit.client.1.smithi149.stdout:2/1: rename - no filename 2024-04-15T21:02:20.927 INFO:tasks.workunit.client.1.smithi149.stdout:2/2: dread - no filename 2024-04-15T21:02:20.927 INFO:tasks.workunit.client.1.smithi149.stdout:0/0: symlink l0 0 2024-04-15T21:02:20.930 INFO:tasks.workunit.client.1.smithi149.stdout:1/5: getdents . 0 2024-04-15T21:02:20.930 INFO:tasks.workunit.client.1.smithi149.stdout:1/6: write - no filename 2024-04-15T21:02:20.930 INFO:tasks.workunit.client.1.smithi149.stdout:1/7: dread - no filename 2024-04-15T21:02:20.930 INFO:tasks.workunit.client.1.smithi149.stdout:1/8: readlink - no filename 2024-04-15T21:02:20.930 INFO:tasks.workunit.client.1.smithi149.stdout:0/1: mkdir d1 0 2024-04-15T21:02:20.931 INFO:tasks.workunit.client.1.smithi149.stdout:0/2: read - no filename 2024-04-15T21:02:20.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/0: dread - no filename 2024-04-15T21:02:20.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/1: rmdir - no directory 2024-04-15T21:02:20.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/2: chown . 13 1 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/3: rename - no filename 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/4: dread - no filename 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/5: chown . 0 1 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/6: dread - no filename 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/7: dread - no filename 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/8: dread - no filename 2024-04-15T21:02:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/9: rename - no filename 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/3: creat f0 x:0 0 0 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/4: truncate f0 883841 0 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/9: symlink l0 0 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/10: dread - no filename 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/11: rmdir - no directory 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/12: write - no filename 2024-04-15T21:02:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/13: dwrite - no filename 2024-04-15T21:02:20.936 INFO:tasks.workunit.client.1.smithi149.stdout:1/14: dwrite - no filename 2024-04-15T21:02:20.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/5: chown f0 339 1 2024-04-15T21:02:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/0: readlink - no filename 2024-04-15T21:02:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/1: write - no filename 2024-04-15T21:02:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/2: fsync - no filename 2024-04-15T21:02:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/3: rename - no filename 2024-04-15T21:02:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/0: mknod c0 0 2024-04-15T21:02:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/1: dwrite - no filename 2024-04-15T21:02:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/2: write - no filename 2024-04-15T21:02:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/3: chown c0 241817 1 2024-04-15T21:02:20.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/4: chown c0 1 1 2024-04-15T21:02:20.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/5: write - no filename 2024-04-15T21:02:20.939 INFO:tasks.workunit.client.1.smithi149.stdout:1/15: mkdir d1 0 2024-04-15T21:02:20.940 INFO:tasks.workunit.client.1.smithi149.stdout:2/6: creat f1 x:0 0 0 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/10: mknod c0 0 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/11: dwrite - no filename 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/0: unlink - no file 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/1: rename - no filename 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/2: dwrite - no filename 2024-04-15T21:02:20.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/3: readlink - no filename 2024-04-15T21:02:20.944 INFO:tasks.workunit.client.1.smithi149.stdout:6/4: chown . 0 1 2024-04-15T21:02:20.944 INFO:tasks.workunit.client.1.smithi149.stdout:6/5: chown . 31450 1 2024-04-15T21:02:20.944 INFO:tasks.workunit.client.1.smithi149.stdout:6/6: write - no filename 2024-04-15T21:02:20.944 INFO:tasks.workunit.client.1.smithi149.stdout:3/6: mkdir d1 0 2024-04-15T21:02:20.945 INFO:tasks.workunit.client.1.smithi149.stdout:3/7: dread - no filename 2024-04-15T21:02:20.945 INFO:tasks.workunit.client.1.smithi149.stdout:3/8: write - no filename 2024-04-15T21:02:20.945 INFO:tasks.workunit.client.1.smithi149.stdout:3/9: dread - no filename 2024-04-15T21:02:20.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/4: mkdir d0 0 2024-04-15T21:02:20.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/5: read - no filename 2024-04-15T21:02:20.949 INFO:tasks.workunit.client.1.smithi149.stdout:4/12: creat f1 x:0 0 0 2024-04-15T21:02:20.950 INFO:tasks.workunit.client.1.smithi149.stdout:2/7: dwrite f0 [0,4194304] 0 2024-04-15T21:02:20.950 INFO:tasks.workunit.client.1.smithi149.stdout:1/16: mknod d1/c2 0 2024-04-15T21:02:20.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/10: rename c0 to d1/c2 0 2024-04-15T21:02:20.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/11: rename d1 to d1/d3 22 2024-04-15T21:02:20.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/12: chown d1 1981034195 1 2024-04-15T21:02:20.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/13: dwrite - no filename 2024-04-15T21:02:20.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/0: dread - no filename 2024-04-15T21:02:20.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/1: link - no file 2024-04-15T21:02:20.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/2: rmdir - no directory 2024-04-15T21:02:20.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/3: write - no filename 2024-04-15T21:02:20.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/4: dread - no filename 2024-04-15T21:02:20.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/5: truncate - no filename 2024-04-15T21:02:20.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/7: mknod c0 0 2024-04-15T21:02:20.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/8: dwrite - no filename 2024-04-15T21:02:20.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/9: chown c0 1810658 1 2024-04-15T21:02:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/8: rename f1 to f2 0 2024-04-15T21:02:20.965 INFO:tasks.workunit.client.1.smithi149.stdout:1/17: creat d1/f3 x:0 0 0 2024-04-15T21:02:20.966 INFO:tasks.workunit.client.1.smithi149.stdout:1/18: write d1/f3 [940688,33379] 0 2024-04-15T21:02:20.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/6: creat d0/f1 x:0 0 0 2024-04-15T21:02:20.968 INFO:tasks.workunit.client.1.smithi149.stdout:1/19: write d1/f3 [1952355,9883] 0 2024-04-15T21:02:20.968 INFO:tasks.workunit.client.1.smithi149.stdout:3/14: creat d1/f4 x:0 0 0 2024-04-15T21:02:20.970 INFO:tasks.workunit.client.1.smithi149.stdout:7/0: symlink l0 0 2024-04-15T21:02:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:9/0: rename - no filename 2024-04-15T21:02:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:9/1: dread - no filename 2024-04-15T21:02:20.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/10: mknod c1 0 2024-04-15T21:02:20.977 INFO:tasks.workunit.client.1.smithi149.stdout:1/20: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:20.980 INFO:tasks.workunit.client.1.smithi149.stdout:5/7: rename d0/f1 to d0/f2 0 2024-04-15T21:02:21.058 INFO:tasks.workunit.client.1.smithi149.stdout:7/1: symlink l1 0 2024-04-15T21:02:21.058 INFO:tasks.workunit.client.1.smithi149.stdout:7/2: fdatasync - no filename 2024-04-15T21:02:21.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/11: symlink l2 0 2024-04-15T21:02:21.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/12: readlink l2 0 2024-04-15T21:02:21.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/13: read - no filename 2024-04-15T21:02:21.065 INFO:tasks.workunit.client.1.smithi149.stdout:5/8: creat d0/f3 x:0 0 0 2024-04-15T21:02:21.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/9: dread - d0/f2 zero size 2024-04-15T21:02:21.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/2: creat f0 x:0 0 0 2024-04-15T21:02:21.070 INFO:tasks.workunit.client.1.smithi149.stdout:7/3: rename l1 to l2 0 2024-04-15T21:02:21.070 INFO:tasks.workunit.client.1.smithi149.stdout:7/4: write - no filename 2024-04-15T21:02:21.071 INFO:tasks.workunit.client.1.smithi149.stdout:6/14: symlink l3 0 2024-04-15T21:02:21.071 INFO:tasks.workunit.client.1.smithi149.stdout:6/15: chown c0 489005457 1 2024-04-15T21:02:21.075 INFO:tasks.workunit.client.1.smithi149.stdout:9/3: symlink l1 0 2024-04-15T21:02:21.075 INFO:tasks.workunit.client.1.smithi149.stdout:9/4: stat f0 0 2024-04-15T21:02:21.076 INFO:tasks.workunit.client.1.smithi149.stdout:7/5: mkdir d3 0 2024-04-15T21:02:21.077 INFO:tasks.workunit.client.1.smithi149.stdout:6/16: rename c1 to c4 0 2024-04-15T21:02:21.077 INFO:tasks.workunit.client.1.smithi149.stdout:6/17: read - no filename 2024-04-15T21:02:21.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/18: read - no filename 2024-04-15T21:02:21.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/19: dread - no filename 2024-04-15T21:02:21.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/20: rmdir - no directory 2024-04-15T21:02:21.080 INFO:tasks.workunit.client.1.smithi149.stdout:6/21: rename l2 to l5 0 2024-04-15T21:02:21.081 INFO:tasks.workunit.client.1.smithi149.stdout:6/22: dread - no filename 2024-04-15T21:02:21.083 INFO:tasks.workunit.client.1.smithi149.stdout:7/6: creat d3/f4 x:0 0 0 2024-04-15T21:02:21.085 INFO:tasks.workunit.client.1.smithi149.stdout:6/23: creat f6 x:0 0 0 2024-04-15T21:02:21.088 INFO:tasks.workunit.client.1.smithi149.stdout:7/7: creat d3/f5 x:0 0 0 2024-04-15T21:02:21.088 INFO:tasks.workunit.client.1.smithi149.stdout:7/8: readlink l0 0 2024-04-15T21:02:21.088 INFO:tasks.workunit.client.1.smithi149.stdout:7/9: stat d3 0 2024-04-15T21:02:21.089 INFO:tasks.workunit.client.1.smithi149.stdout:6/24: mknod c7 0 2024-04-15T21:02:21.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/10: symlink d3/l6 0 2024-04-15T21:02:21.097 INFO:tasks.workunit.client.1.smithi149.stdout:6/25: dwrite f6 [0,4194304] 0 2024-04-15T21:02:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:21 smithi149 ceph-mon[36029]: pgmap v267: 65 pgs: 65 active+clean; 192 MiB data, 786 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 299 op/s 2024-04-15T21:02:21.306 INFO:tasks.workunit.client.1.smithi149.stdout:3/15: chown d1/c2 396 1 2024-04-15T21:02:21.307 INFO:tasks.workunit.client.1.smithi149.stdout:3/16: write d1/f4 [62392,50285] 0 2024-04-15T21:02:21.307 INFO:tasks.workunit.client.1.smithi149.stdout:3/17: chown d1 1 1 2024-04-15T21:02:21.308 INFO:tasks.workunit.client.1.smithi149.stdout:3/18: write d1/f4 [1057153,15672] 0 2024-04-15T21:02:21.310 INFO:tasks.workunit.client.1.smithi149.stdout:2/9: fsync f2 0 2024-04-15T21:02:21.311 INFO:tasks.workunit.client.1.smithi149.stdout:3/19: unlink d1/f4 0 2024-04-15T21:02:21.314 INFO:tasks.workunit.client.1.smithi149.stdout:2/10: creat f3 x:0 0 0 2024-04-15T21:02:21.315 INFO:tasks.workunit.client.1.smithi149.stdout:3/20: symlink d1/l5 0 2024-04-15T21:02:21.318 INFO:tasks.workunit.client.1.smithi149.stdout:2/11: mkdir d4 0 2024-04-15T21:02:21.319 INFO:tasks.workunit.client.1.smithi149.stdout:3/21: symlink d1/l6 0 2024-04-15T21:02:21.319 INFO:tasks.workunit.client.1.smithi149.stdout:3/22: truncate - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/23: dwrite - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/24: write - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/25: truncate - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/26: truncate - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/27: chown d1 3925 1 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/28: dwrite - no filename 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/29: chown d1/l6 861319804 1 2024-04-15T21:02:21.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/30: chown d1 851577302 1 2024-04-15T21:02:21.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/31: mknod d1/c7 0 2024-04-15T21:02:21.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/32: write - no filename 2024-04-15T21:02:21.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/33: dwrite - no filename 2024-04-15T21:02:21.324 INFO:tasks.workunit.client.1.smithi149.stdout:2/12: creat d4/f5 x:0 0 0 2024-04-15T21:02:21.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/34: mknod d1/c8 0 2024-04-15T21:02:21.331 INFO:tasks.workunit.client.1.smithi149.stdout:5/10: fsync d0/f3 0 2024-04-15T21:02:21.331 INFO:tasks.workunit.client.1.smithi149.stdout:5/11: readlink - no filename 2024-04-15T21:02:21.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/21: truncate d1/f3 1467096 0 2024-04-15T21:02:21.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/5: getdents . 0 2024-04-15T21:02:21.342 INFO:tasks.workunit.client.1.smithi149.stdout:5/12: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:21.347 INFO:tasks.workunit.client.1.smithi149.stdout:9/6: symlink l2 0 2024-04-15T21:02:21.354 INFO:tasks.workunit.client.1.smithi149.stdout:5/13: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:21.360 INFO:tasks.workunit.client.1.smithi149.stdout:9/7: dwrite f0 [0,4194304] 0 2024-04-15T21:02:21.360 INFO:tasks.workunit.client.1.smithi149.stdout:5/14: creat d0/f4 x:0 0 0 2024-04-15T21:02:21.366 INFO:tasks.workunit.client.1.smithi149.stdout:5/15: creat d0/f5 x:0 0 0 2024-04-15T21:02:21.369 INFO:tasks.workunit.client.1.smithi149.stdout:5/16: write d0/f3 [190055,116428] 0 2024-04-15T21:02:21.373 INFO:tasks.workunit.client.1.smithi149.stdout:9/8: dwrite f0 [0,4194304] 0 2024-04-15T21:02:21.374 INFO:tasks.workunit.client.1.smithi149.stdout:5/17: mkdir d0/d6 0 2024-04-15T21:02:21.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/9: creat f3 x:0 0 0 2024-04-15T21:02:21.382 INFO:tasks.workunit.client.1.smithi149.stdout:5/18: symlink d0/d6/l7 0 2024-04-15T21:02:21.382 INFO:tasks.workunit.client.1.smithi149.stdout:5/19: readlink d0/d6/l7 0 2024-04-15T21:02:21.390 INFO:tasks.workunit.client.1.smithi149.stdout:5/20: creat d0/f8 x:0 0 0 2024-04-15T21:02:21.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/21: fsync d0/f2 0 2024-04-15T21:02:21.399 INFO:tasks.workunit.client.1.smithi149.stdout:5/22: mkdir d0/d9 0 2024-04-15T21:02:21.404 INFO:tasks.workunit.client.1.smithi149.stdout:5/23: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:21.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/24: rename d0/f2 to d0/d6/fa 0 2024-04-15T21:02:21.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:21 smithi072 ceph-mon[29079]: pgmap v267: 65 pgs: 65 active+clean; 192 MiB data, 786 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 299 op/s 2024-04-15T21:02:21.431 INFO:tasks.workunit.client.1.smithi149.stdout:5/25: fdatasync d0/d6/fa 0 2024-04-15T21:02:21.432 INFO:tasks.workunit.client.1.smithi149.stdout:5/26: write d0/d6/fa [4093345,71000] 0 2024-04-15T21:02:21.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/35: getdents d1 0 2024-04-15T21:02:21.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/36: dwrite - no filename 2024-04-15T21:02:21.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/37: write - no filename 2024-04-15T21:02:21.449 INFO:tasks.workunit.client.1.smithi149.stdout:3/38: dread - no filename 2024-04-15T21:02:21.449 INFO:tasks.workunit.client.1.smithi149.stdout:3/39: rename d1 to d1/d9 22 2024-04-15T21:02:21.449 INFO:tasks.workunit.client.1.smithi149.stdout:3/40: write - no filename 2024-04-15T21:02:21.452 INFO:tasks.workunit.client.1.smithi149.stdout:3/41: creat d1/fa x:0 0 0 2024-04-15T21:02:21.456 INFO:tasks.workunit.client.1.smithi149.stdout:1/22: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:21.459 INFO:tasks.workunit.client.1.smithi149.stdout:3/42: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:21.471 INFO:tasks.workunit.client.1.smithi149.stdout:9/10: getdents . 0 2024-04-15T21:02:21.471 INFO:tasks.workunit.client.1.smithi149.stdout:9/11: chown f0 14211706 1 2024-04-15T21:02:21.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/12: write f3 [253921,21483] 0 2024-04-15T21:02:21.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/13: chown l2 50258560 1 2024-04-15T21:02:21.473 INFO:tasks.workunit.client.1.smithi149.stdout:9/14: truncate f3 895998 0 2024-04-15T21:02:21.478 INFO:tasks.workunit.client.1.smithi149.stdout:9/15: link f0 f4 0 2024-04-15T21:02:21.480 INFO:tasks.workunit.client.1.smithi149.stdout:9/16: write f4 [1782138,112153] 0 2024-04-15T21:02:21.483 INFO:tasks.workunit.client.1.smithi149.stdout:5/27: getdents d0/d6 0 2024-04-15T21:02:21.485 INFO:tasks.workunit.client.1.smithi149.stdout:9/17: fdatasync f0 0 2024-04-15T21:02:21.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/28: dwrite d0/d6/fa [0,4194304] 0 2024-04-15T21:02:21.498 INFO:tasks.workunit.client.1.smithi149.stdout:1/23: write d1/f3 [2269074,41933] 0 2024-04-15T21:02:21.498 INFO:tasks.workunit.client.1.smithi149.stdout:5/29: dwrite d0/d6/fa [0,4194304] 0 2024-04-15T21:02:21.501 INFO:tasks.workunit.client.1.smithi149.stdout:1/24: write d1/f3 [2052163,126233] 0 2024-04-15T21:02:21.503 INFO:tasks.workunit.client.1.smithi149.stdout:1/25: chown d1/f3 15 1 2024-04-15T21:02:21.509 INFO:tasks.workunit.client.1.smithi149.stdout:5/30: mkdir d0/d9/db 0 2024-04-15T21:02:21.510 INFO:tasks.workunit.client.1.smithi149.stdout:3/43: dwrite d1/fa [4194304,4194304] 0 2024-04-15T21:02:21.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/31: write d0/f4 [240761,13327] 0 2024-04-15T21:02:21.515 INFO:tasks.workunit.client.1.smithi149.stdout:9/18: getdents . 0 2024-04-15T21:02:21.516 INFO:tasks.workunit.client.1.smithi149.stdout:5/32: write d0/d6/fa [3026523,97852] 0 2024-04-15T21:02:21.516 INFO:tasks.workunit.client.1.smithi149.stdout:9/19: chown f3 14244939 1 2024-04-15T21:02:21.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/26: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:21.526 INFO:tasks.workunit.client.1.smithi149.stdout:9/20: symlink l5 0 2024-04-15T21:02:21.530 INFO:tasks.workunit.client.1.smithi149.stdout:1/27: symlink d1/l4 0 2024-04-15T21:02:21.530 INFO:tasks.workunit.client.1.smithi149.stdout:1/28: readlink d1/l4 0 2024-04-15T21:02:21.536 INFO:tasks.workunit.client.1.smithi149.stdout:9/21: truncate f0 1506618 0 2024-04-15T21:02:21.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/22: truncate f3 1165905 0 2024-04-15T21:02:21.540 INFO:tasks.workunit.client.1.smithi149.stdout:9/23: creat f6 x:0 0 0 2024-04-15T21:02:21.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/29: dwrite d1/f3 [0,4194304] 0 2024-04-15T21:02:21.542 INFO:tasks.workunit.client.1.smithi149.stdout:9/24: read f3 [285208,126448] 0 2024-04-15T21:02:21.542 INFO:tasks.workunit.client.1.smithi149.stdout:9/25: chown f4 1776133 1 2024-04-15T21:02:21.543 INFO:tasks.workunit.client.1.smithi149.stdout:9/26: truncate f6 766729 0 2024-04-15T21:02:21.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/27: unlink l5 0 2024-04-15T21:02:21.552 INFO:tasks.workunit.client.1.smithi149.stdout:3/44: truncate d1/fa 1012581 0 2024-04-15T21:02:21.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/28: creat f7 x:0 0 0 2024-04-15T21:02:21.556 INFO:tasks.workunit.client.1.smithi149.stdout:3/45: mkdir d1/db 0 2024-04-15T21:02:21.559 INFO:tasks.workunit.client.1.smithi149.stdout:9/29: rename l1 to l8 0 2024-04-15T21:02:21.563 INFO:tasks.workunit.client.1.smithi149.stdout:9/30: creat f9 x:0 0 0 2024-04-15T21:02:21.563 INFO:tasks.workunit.client.1.smithi149.stdout:9/31: dread - f7 zero size 2024-04-15T21:02:21.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/32: mknod ca 0 2024-04-15T21:02:21.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/33: read - f7 zero size 2024-04-15T21:02:21.565 INFO:tasks.workunit.client.1.smithi149.stdout:1/30: fdatasync d1/f3 0 2024-04-15T21:02:21.566 INFO:tasks.workunit.client.1.smithi149.stdout:1/31: readlink l0 0 2024-04-15T21:02:21.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/32: creat d1/f5 x:0 0 0 2024-04-15T21:02:21.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/33: dread - d1/f5 zero size 2024-04-15T21:02:21.569 INFO:tasks.workunit.client.1.smithi149.stdout:3/46: truncate d1/fa 1833131 0 2024-04-15T21:02:21.571 INFO:tasks.workunit.client.1.smithi149.stdout:1/34: creat d1/f6 x:0 0 0 2024-04-15T21:02:21.574 INFO:tasks.workunit.client.1.smithi149.stdout:1/35: creat d1/f7 x:0 0 0 2024-04-15T21:02:21.575 INFO:tasks.workunit.client.1.smithi149.stdout:1/36: dread - d1/f5 zero size 2024-04-15T21:02:21.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/37: write d1/f3 [3130602,106008] 0 2024-04-15T21:02:21.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/38: dread - d1/f5 zero size 2024-04-15T21:02:21.584 INFO:tasks.workunit.client.1.smithi149.stdout:1/39: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:21.584 INFO:tasks.workunit.client.1.smithi149.stdout:3/47: truncate d1/fa 1656960 0 2024-04-15T21:02:21.635 INFO:tasks.workunit.client.1.smithi149.stdout:3/48: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:21.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/49: write d1/fa [3254637,12019] 0 2024-04-15T21:02:21.746 INFO:tasks.workunit.client.1.smithi149.stdout:1/40: link d1/f6 d1/f8 0 2024-04-15T21:02:21.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/41: link d1/f3 d1/f9 0 2024-04-15T21:02:21.752 INFO:tasks.workunit.client.1.smithi149.stdout:1/42: mkdir d1/da 0 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/13: sync 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:0/3: sync 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:0/4: dread - no filename 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:0/5: fdatasync - no filename 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:0/6: readlink l0 0 2024-04-15T21:02:22.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/14: write f1 [9621,46789] 0 2024-04-15T21:02:22.422 INFO:tasks.workunit.client.1.smithi149.stdout:4/15: dread f1 [0,4194304] 0 2024-04-15T21:02:22.423 INFO:tasks.workunit.client.1.smithi149.stdout:0/7: creat d1/f2 x:0 0 0 2024-04-15T21:02:22.425 INFO:tasks.workunit.client.1.smithi149.stdout:4/16: creat f2 x:0 0 0 2024-04-15T21:02:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/8: creat d1/f3 x:0 0 0 2024-04-15T21:02:22.428 INFO:tasks.workunit.client.1.smithi149.stdout:4/17: creat f3 x:0 0 0 2024-04-15T21:02:22.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/9: creat d1/f4 x:0 0 0 2024-04-15T21:02:22.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/18: symlink l4 0 2024-04-15T21:02:22.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/19: stat f1 0 2024-04-15T21:02:22.433 INFO:tasks.workunit.client.1.smithi149.stdout:0/10: unlink d1/f3 0 2024-04-15T21:02:22.434 INFO:tasks.workunit.client.1.smithi149.stdout:0/11: truncate d1/f4 92547 0 2024-04-15T21:02:22.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/20: creat f5 x:0 0 0 2024-04-15T21:02:22.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/21: stat f2 0 2024-04-15T21:02:22.438 INFO:tasks.workunit.client.1.smithi149.stdout:4/22: write f1 [907563,81420] 0 2024-04-15T21:02:22.438 INFO:tasks.workunit.client.1.smithi149.stdout:4/23: readlink l4 0 2024-04-15T21:02:22.446 INFO:tasks.workunit.client.1.smithi149.stdout:4/24: dwrite f3 [0,4194304] 0 2024-04-15T21:02:22.451 INFO:tasks.workunit.client.1.smithi149.stdout:4/25: unlink l4 0 2024-04-15T21:02:22.460 INFO:tasks.workunit.client.1.smithi149.stdout:4/26: dwrite f2 [0,4194304] 0 2024-04-15T21:02:22.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/26: sync 2024-04-15T21:02:22.462 INFO:tasks.workunit.client.1.smithi149.stdout:8/6: sync 2024-04-15T21:02:22.462 INFO:tasks.workunit.client.1.smithi149.stdout:7/11: sync 2024-04-15T21:02:22.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/7: creat f0 x:0 0 0 2024-04-15T21:02:22.472 INFO:tasks.workunit.client.1.smithi149.stdout:8/8: symlink l1 0 2024-04-15T21:02:22.472 INFO:tasks.workunit.client.1.smithi149.stdout:8/9: chown f0 1 1 2024-04-15T21:02:22.472 INFO:tasks.workunit.client.1.smithi149.stdout:8/10: fdatasync f0 0 2024-04-15T21:02:22.473 INFO:tasks.workunit.client.1.smithi149.stdout:6/27: getdents . 0 2024-04-15T21:02:22.503 INFO:tasks.workunit.client.1.smithi149.stdout:8/11: dwrite f0 [0,4194304] 0 2024-04-15T21:02:22.505 INFO:tasks.workunit.client.1.smithi149.stdout:6/28: dwrite f6 [4194304,4194304] 0 2024-04-15T21:02:22.507 INFO:tasks.workunit.client.1.smithi149.stdout:8/12: mkdir d2 0 2024-04-15T21:02:22.516 INFO:tasks.workunit.client.1.smithi149.stdout:8/13: mknod d2/c3 0 2024-04-15T21:02:22.517 INFO:tasks.workunit.client.1.smithi149.stdout:6/29: dwrite f6 [4194304,4194304] 0 2024-04-15T21:02:22.524 INFO:tasks.workunit.client.1.smithi149.stdout:8/14: rename f0 to d2/f4 0 2024-04-15T21:02:22.524 INFO:tasks.workunit.client.1.smithi149.stdout:8/15: readlink l1 0 2024-04-15T21:02:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:8/16: chown d2/c3 46 1 2024-04-15T21:02:22.530 INFO:tasks.workunit.client.1.smithi149.stdout:8/17: mknod d2/c5 0 2024-04-15T21:02:22.534 INFO:tasks.workunit.client.1.smithi149.stdout:8/18: dread d2/f4 [0,4194304] 0 2024-04-15T21:02:22.536 INFO:tasks.workunit.client.1.smithi149.stdout:8/19: write d2/f4 [2474804,77996] 0 2024-04-15T21:02:22.540 INFO:tasks.workunit.client.1.smithi149.stdout:8/20: rename d2/c3 to d2/c6 0 2024-04-15T21:02:22.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/21: link d2/c5 d2/c7 0 2024-04-15T21:02:22.547 INFO:tasks.workunit.client.1.smithi149.stdout:8/22: rename d2 to d2/d8 22 2024-04-15T21:02:22.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/23: creat d2/f9 x:0 0 0 2024-04-15T21:02:22.550 INFO:tasks.workunit.client.1.smithi149.stdout:8/24: write d2/f4 [513313,88540] 0 2024-04-15T21:02:22.554 INFO:tasks.workunit.client.1.smithi149.stdout:8/25: rename l1 to d2/la 0 2024-04-15T21:02:22.554 INFO:tasks.workunit.client.1.smithi149.stdout:8/26: write d2/f4 [2540875,56551] 0 2024-04-15T21:02:22.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/27: read - d2/f9 zero size 2024-04-15T21:02:22.557 INFO:tasks.workunit.client.1.smithi149.stdout:8/28: symlink d2/lb 0 2024-04-15T21:02:22.560 INFO:tasks.workunit.client.1.smithi149.stdout:8/29: symlink d2/lc 0 2024-04-15T21:02:22.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/30: truncate d2/f9 43732 0 2024-04-15T21:02:22.562 INFO:tasks.workunit.client.1.smithi149.stdout:8/31: truncate d2/f9 280547 0 2024-04-15T21:02:22.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/32: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:22.569 INFO:tasks.workunit.client.1.smithi149.stdout:8/33: creat d2/fd x:0 0 0 2024-04-15T21:02:22.571 INFO:tasks.workunit.client.1.smithi149.stdout:0/12: fsync d1/f2 0 2024-04-15T21:02:22.573 INFO:tasks.workunit.client.1.smithi149.stdout:0/13: mkdir d1/d5 0 2024-04-15T21:02:22.573 INFO:tasks.workunit.client.1.smithi149.stdout:0/14: read - d1/f2 zero size 2024-04-15T21:02:22.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/15: symlink d1/l6 0 2024-04-15T21:02:22.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/16: chown d1 755653 1 2024-04-15T21:02:22.576 INFO:tasks.workunit.client.1.smithi149.stdout:0/17: dread - d1/f2 zero size 2024-04-15T21:02:22.576 INFO:tasks.workunit.client.1.smithi149.stdout:0/18: chown d1 5925192 1 2024-04-15T21:02:22.578 INFO:tasks.workunit.client.1.smithi149.stdout:0/19: creat d1/d5/f7 x:0 0 0 2024-04-15T21:02:22.579 INFO:tasks.workunit.client.1.smithi149.stdout:0/20: mknod d1/d5/c8 0 2024-04-15T21:02:22.580 INFO:tasks.workunit.client.1.smithi149.stdout:0/21: chown d1/d5/c8 234402 1 2024-04-15T21:02:22.581 INFO:tasks.workunit.client.1.smithi149.stdout:0/22: truncate d1/d5/f7 805799 0 2024-04-15T21:02:22.582 INFO:tasks.workunit.client.1.smithi149.stdout:4/27: truncate f1 442004 0 2024-04-15T21:02:22.582 INFO:tasks.workunit.client.1.smithi149.stdout:4/28: readlink - no filename 2024-04-15T21:02:22.583 INFO:tasks.workunit.client.1.smithi149.stdout:4/29: chown f5 18372021 1 2024-04-15T21:02:22.584 INFO:tasks.workunit.client.1.smithi149.stdout:0/23: unlink d1/d5/f7 0 2024-04-15T21:02:22.584 INFO:tasks.workunit.client.1.smithi149.stdout:0/24: fsync d1/f4 0 2024-04-15T21:02:22.591 INFO:tasks.workunit.client.1.smithi149.stdout:0/25: dwrite d1/f4 [0,4194304] 0 2024-04-15T21:02:22.593 INFO:tasks.workunit.client.1.smithi149.stdout:0/26: write d1/f4 [3967244,100033] 0 2024-04-15T21:02:22.603 INFO:tasks.workunit.client.1.smithi149.stdout:8/34: fsync d2/f4 0 2024-04-15T21:02:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:6/30: truncate f6 4729065 0 2024-04-15T21:02:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:9/34: sync 2024-04-15T21:02:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:3/50: sync 2024-04-15T21:02:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/13: sync 2024-04-15T21:02:22.606 INFO:tasks.workunit.client.1.smithi149.stdout:5/33: sync 2024-04-15T21:02:22.606 INFO:tasks.workunit.client.1.smithi149.stdout:1/43: sync 2024-04-15T21:02:22.609 INFO:tasks.workunit.client.1.smithi149.stdout:2/14: rename f2 to d4/f6 0 2024-04-15T21:02:22.610 INFO:tasks.workunit.client.1.smithi149.stdout:1/44: mkdir d1/db 0 2024-04-15T21:02:22.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/15: mkdir d4/d7 0 2024-04-15T21:02:22.638 INFO:tasks.workunit.client.1.smithi149.stdout:5/34: link d0/f3 d0/d6/fc 0 2024-04-15T21:02:22.639 INFO:tasks.workunit.client.1.smithi149.stdout:1/45: mkdir d1/db/dc 0 2024-04-15T21:02:22.639 INFO:tasks.workunit.client.1.smithi149.stdout:5/35: chown d0/f5 14380688 1 2024-04-15T21:02:22.639 INFO:tasks.workunit.client.1.smithi149.stdout:1/46: dread - d1/f7 zero size 2024-04-15T21:02:22.640 INFO:tasks.workunit.client.1.smithi149.stdout:1/47: fsync d1/f7 0 2024-04-15T21:02:22.643 INFO:tasks.workunit.client.1.smithi149.stdout:8/35: rmdir d2 39 2024-04-15T21:02:22.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/30: fsync f1 0 2024-04-15T21:02:22.665 INFO:tasks.workunit.client.1.smithi149.stdout:6/31: dread f6 [0,4194304] 0 2024-04-15T21:02:22.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/35: write f4 [708385,105857] 0 2024-04-15T21:02:22.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/36: rmdir - no directory 2024-04-15T21:02:22.667 INFO:tasks.workunit.client.1.smithi149.stdout:2/16: rmdir d4 39 2024-04-15T21:02:22.671 INFO:tasks.workunit.client.1.smithi149.stdout:3/51: truncate d1/fa 182603 0 2024-04-15T21:02:22.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/12: sync 2024-04-15T21:02:22.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/13: dread - d3/f4 zero size 2024-04-15T21:02:22.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/36: fsync d2/fd 0 2024-04-15T21:02:22.820 INFO:tasks.workunit.client.1.smithi149.stdout:8/37: dread - d2/fd zero size 2024-04-15T21:02:22.820 INFO:tasks.workunit.client.1.smithi149.stdout:4/31: creat f6 x:0 0 0 2024-04-15T21:02:22.821 INFO:tasks.workunit.client.1.smithi149.stdout:6/32: creat f8 x:0 0 0 2024-04-15T21:02:22.823 INFO:tasks.workunit.client.1.smithi149.stdout:9/37: unlink ca 0 2024-04-15T21:02:22.824 INFO:tasks.workunit.client.1.smithi149.stdout:9/38: write f7 [380491,32578] 0 2024-04-15T21:02:22.826 INFO:tasks.workunit.client.1.smithi149.stdout:3/52: mkdir d1/dc 0 2024-04-15T21:02:22.828 INFO:tasks.workunit.client.1.smithi149.stdout:7/14: creat d3/f7 x:0 0 0 2024-04-15T21:02:22.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/36: mknod d0/d9/db/cd 0 2024-04-15T21:02:22.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/48: creat d1/da/fd x:0 0 0 2024-04-15T21:02:22.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/49: truncate d1/f5 4288748 0 2024-04-15T21:02:22.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/50: chown l0 51 1 2024-04-15T21:02:22.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/51: read - d1/f6 zero size 2024-04-15T21:02:22.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/38: creat d2/fe x:0 0 0 2024-04-15T21:02:22.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/52: fdatasync d1/f5 0 2024-04-15T21:02:22.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/39: write d2/f4 [4277419,114901] 0 2024-04-15T21:02:22.834 INFO:tasks.workunit.client.1.smithi149.stdout:8/40: chown d2/fd 390198759 1 2024-04-15T21:02:22.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/33: symlink l9 0 2024-04-15T21:02:22.836 INFO:tasks.workunit.client.1.smithi149.stdout:9/39: unlink l2 0 2024-04-15T21:02:22.839 INFO:tasks.workunit.client.1.smithi149.stdout:7/15: creat d3/f8 x:0 0 0 2024-04-15T21:02:22.840 INFO:tasks.workunit.client.1.smithi149.stdout:5/37: creat d0/d6/fe x:0 0 0 2024-04-15T21:02:22.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/32: link f5 f7 0 2024-04-15T21:02:22.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/53: rename d1/l4 to d1/db/le 0 2024-04-15T21:02:22.850 INFO:tasks.workunit.client.1.smithi149.stdout:8/41: mkdir d2/df 0 2024-04-15T21:02:22.853 INFO:tasks.workunit.client.1.smithi149.stdout:6/34: mkdir da 0 2024-04-15T21:02:22.858 INFO:tasks.workunit.client.1.smithi149.stdout:2/17: link f0 d4/f8 0 2024-04-15T21:02:22.858 INFO:tasks.workunit.client.1.smithi149.stdout:2/18: stat d4 0 2024-04-15T21:02:22.860 INFO:tasks.workunit.client.1.smithi149.stdout:3/53: getdents d1/db 0 2024-04-15T21:02:22.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/38: mknod d0/d9/cf 0 2024-04-15T21:02:22.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/39: chown d0/d9 3810 1 2024-04-15T21:02:22.868 INFO:tasks.workunit.client.1.smithi149.stdout:9/40: unlink l8 0 2024-04-15T21:02:22.870 INFO:tasks.workunit.client.1.smithi149.stdout:2/19: rename d4/f5 to d4/d7/f9 0 2024-04-15T21:02:22.871 INFO:tasks.workunit.client.1.smithi149.stdout:2/20: chown f3 0 1 2024-04-15T21:02:22.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/40: creat d0/d9/db/f10 x:0 0 0 2024-04-15T21:02:22.876 INFO:tasks.workunit.client.1.smithi149.stdout:8/42: mkdir d2/df/d10 0 2024-04-15T21:02:22.878 INFO:tasks.workunit.client.1.smithi149.stdout:6/35: creat da/fb x:0 0 0 2024-04-15T21:02:22.879 INFO:tasks.workunit.client.1.smithi149.stdout:6/36: chown f6 48302462 1 2024-04-15T21:02:22.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/41: symlink lb 0 2024-04-15T21:02:22.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/42: readlink lb 0 2024-04-15T21:02:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/21: mkdir d4/d7/da 0 2024-04-15T21:02:22.885 INFO:tasks.workunit.client.1.smithi149.stdout:5/41: creat d0/f11 x:0 0 0 2024-04-15T21:02:22.888 INFO:tasks.workunit.client.1.smithi149.stdout:6/37: mkdir da/dc 0 2024-04-15T21:02:22.888 INFO:tasks.workunit.client.1.smithi149.stdout:6/38: readlink l9 0 2024-04-15T21:02:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:9/43: creat fc x:0 0 0 2024-04-15T21:02:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:9/44: chown fc 220346966 1 2024-04-15T21:02:22.892 INFO:tasks.workunit.client.1.smithi149.stdout:9/45: fsync f4 0 2024-04-15T21:02:22.893 INFO:tasks.workunit.client.1.smithi149.stdout:2/22: creat d4/d7/fb x:0 0 0 2024-04-15T21:02:22.895 INFO:tasks.workunit.client.1.smithi149.stdout:5/42: unlink d0/d9/db/cd 0 2024-04-15T21:02:22.895 INFO:tasks.workunit.client.1.smithi149.stdout:6/39: dwrite f8 [0,4194304] 0 2024-04-15T21:02:22.896 INFO:tasks.workunit.client.1.smithi149.stdout:5/43: truncate d0/f4 324823 0 2024-04-15T21:02:22.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/43: creat d2/df/d10/f11 x:0 0 0 2024-04-15T21:02:22.898 INFO:tasks.workunit.client.1.smithi149.stdout:8/44: fsync d2/fd 0 2024-04-15T21:02:22.900 INFO:tasks.workunit.client.1.smithi149.stdout:6/40: dread f6 [0,4194304] 0 2024-04-15T21:02:22.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/41: truncate da/fb 898394 0 2024-04-15T21:02:22.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/42: chown c0 151529 1 2024-04-15T21:02:22.905 INFO:tasks.workunit.client.1.smithi149.stdout:9/46: symlink ld 0 2024-04-15T21:02:22.909 INFO:tasks.workunit.client.1.smithi149.stdout:5/44: mkdir d0/d9/db/d12 0 2024-04-15T21:02:22.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:02:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:02:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:02:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:02:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:02:22.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:22 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:02:22.915 INFO:tasks.workunit.client.1.smithi149.stdout:9/47: mknod ce 0 2024-04-15T21:02:22.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/48: dread f7 [0,4194304] 0 2024-04-15T21:02:22.919 INFO:tasks.workunit.client.1.smithi149.stdout:5/45: symlink d0/d9/l13 0 2024-04-15T21:02:22.920 INFO:tasks.workunit.client.1.smithi149.stdout:9/49: dread f0 [0,4194304] 0 2024-04-15T21:02:22.922 INFO:tasks.workunit.client.1.smithi149.stdout:5/46: mkdir d0/d6/d14 0 2024-04-15T21:02:22.926 INFO:tasks.workunit.client.1.smithi149.stdout:9/50: rename f6 to ff 0 2024-04-15T21:02:22.929 INFO:tasks.workunit.client.1.smithi149.stdout:8/45: link d2/c7 d2/df/d10/c12 0 2024-04-15T21:02:22.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/47: dwrite d0/f5 [0,4194304] 0 2024-04-15T21:02:22.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/48: chown d0/f5 688 1 2024-04-15T21:02:22.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/49: readlink d0/d6/l7 0 2024-04-15T21:02:22.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/51: creat f10 x:0 0 0 2024-04-15T21:02:22.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/50: write d0/f5 [2362451,62086] 0 2024-04-15T21:02:22.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/51: dread - d0/f11 zero size 2024-04-15T21:02:22.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/52: rename d0 to d0/d6/d15 22 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:02:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:22 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:02:22.944 INFO:tasks.workunit.client.1.smithi149.stdout:8/46: dwrite d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:22.945 INFO:tasks.workunit.client.1.smithi149.stdout:8/47: chown d2/f4 5106769 1 2024-04-15T21:02:22.945 INFO:tasks.workunit.client.1.smithi149.stdout:8/48: fdatasync d2/f4 0 2024-04-15T21:02:22.946 INFO:tasks.workunit.client.1.smithi149.stdout:8/49: write d2/f4 [3521762,13792] 0 2024-04-15T21:02:22.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/53: mkdir d0/d9/db/d12/d16 0 2024-04-15T21:02:22.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/50: chown d2/c6 6 1 2024-04-15T21:02:22.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/51: dread - d2/fe zero size 2024-04-15T21:02:22.956 INFO:tasks.workunit.client.1.smithi149.stdout:5/54: unlink d0/d6/fc 0 2024-04-15T21:02:22.957 INFO:tasks.workunit.client.1.smithi149.stdout:8/52: mknod d2/c13 0 2024-04-15T21:02:22.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/55: creat d0/d9/f17 x:0 0 0 2024-04-15T21:02:22.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/53: rename d2/f9 to d2/df/d10/f14 0 2024-04-15T21:02:22.965 INFO:tasks.workunit.client.1.smithi149.stdout:8/54: mknod d2/c15 0 2024-04-15T21:02:22.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/56: creat d0/d9/db/d12/d16/f18 x:0 0 0 2024-04-15T21:02:22.968 INFO:tasks.workunit.client.1.smithi149.stdout:8/55: mkdir d2/d16 0 2024-04-15T21:02:22.971 INFO:tasks.workunit.client.1.smithi149.stdout:8/56: mknod d2/df/c17 0 2024-04-15T21:02:22.972 INFO:tasks.workunit.client.1.smithi149.stdout:8/57: write d2/fe [1013520,10019] 0 2024-04-15T21:02:22.976 INFO:tasks.workunit.client.1.smithi149.stdout:8/58: dread d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:22.977 INFO:tasks.workunit.client.1.smithi149.stdout:8/59: write d2/f4 [3546975,13796] 0 2024-04-15T21:02:22.986 INFO:tasks.workunit.client.1.smithi149.stdout:8/60: dwrite d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:22.987 INFO:tasks.workunit.client.1.smithi149.stdout:8/61: write d2/fd [302748,58444] 0 2024-04-15T21:02:23.006 INFO:tasks.workunit.client.1.smithi149.stdout:0/27: sync 2024-04-15T21:02:23.008 INFO:tasks.workunit.client.1.smithi149.stdout:0/28: mkdir d1/d9 0 2024-04-15T21:02:23.009 INFO:tasks.workunit.client.1.smithi149.stdout:0/29: creat d1/d5/fa x:0 0 0 2024-04-15T21:02:23.010 INFO:tasks.workunit.client.1.smithi149.stdout:0/30: write d1/f4 [4163230,96408] 0 2024-04-15T21:02:23.011 INFO:tasks.workunit.client.1.smithi149.stdout:0/31: fdatasync d1/d5/fa 0 2024-04-15T21:02:23.012 INFO:tasks.workunit.client.1.smithi149.stdout:0/32: fsync d1/f4 0 2024-04-15T21:02:23.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/43: fsync f8 0 2024-04-15T21:02:23.031 INFO:tasks.workunit.client.1.smithi149.stdout:6/44: dread da/fb [0,4194304] 0 2024-04-15T21:02:23.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/45: mknod da/dc/cd 0 2024-04-15T21:02:23.053 INFO:tasks.workunit.client.1.smithi149.stdout:6/46: rename da/fb to da/dc/fe 0 2024-04-15T21:02:23.054 INFO:tasks.workunit.client.1.smithi149.stdout:3/54: truncate d1/fa 206975 0 2024-04-15T21:02:23.055 INFO:tasks.workunit.client.1.smithi149.stdout:2/23: fsync d4/d7/f9 0 2024-04-15T21:02:23.057 INFO:tasks.workunit.client.1.smithi149.stdout:6/47: creat da/ff x:0 0 0 2024-04-15T21:02:23.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/48: truncate da/ff 941422 0 2024-04-15T21:02:23.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/49: mkdir da/dc/d10 0 2024-04-15T21:02:23.063 INFO:tasks.workunit.client.1.smithi149.stdout:2/24: creat d4/d7/da/fc x:0 0 0 2024-04-15T21:02:23.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/50: dread da/ff [0,4194304] 0 2024-04-15T21:02:23.066 INFO:tasks.workunit.client.1.smithi149.stdout:2/25: creat d4/fd x:0 0 0 2024-04-15T21:02:23.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/52: getdents . 0 2024-04-15T21:02:23.096 INFO:tasks.workunit.client.1.smithi149.stdout:5/57: truncate d0/f5 1307959 0 2024-04-15T21:02:23.098 INFO:tasks.workunit.client.1.smithi149.stdout:5/58: creat d0/d6/d14/f19 x:0 0 0 2024-04-15T21:02:23.104 INFO:tasks.workunit.client.1.smithi149.stdout:5/59: getdents d0/d6 0 2024-04-15T21:02:23.106 INFO:tasks.workunit.client.1.smithi149.stdout:5/60: creat d0/d9/db/f1a x:0 0 0 2024-04-15T21:02:23.108 INFO:tasks.workunit.client.1.smithi149.stdout:5/61: mkdir d0/d6/d14/d1b 0 2024-04-15T21:02:23.109 INFO:tasks.workunit.client.1.smithi149.stdout:5/62: chown d0/d6/fa 2088320401 1 2024-04-15T21:02:23.115 INFO:tasks.workunit.client.1.smithi149.stdout:5/63: getdents d0/d9/db/d12/d16 0 2024-04-15T21:02:23.121 INFO:tasks.workunit.client.1.smithi149.stdout:5/64: dwrite d0/f4 [0,4194304] 0 2024-04-15T21:02:23.125 INFO:tasks.workunit.client.1.smithi149.stdout:5/65: rename d0/d6/fa to d0/d9/db/f1c 0 2024-04-15T21:02:23.125 INFO:tasks.workunit.client.1.smithi149.stdout:5/66: fdatasync d0/d9/db/f1a 0 2024-04-15T21:02:23.133 INFO:tasks.workunit.client.1.smithi149.stdout:3/55: truncate d1/fa 675713 0 2024-04-15T21:02:23.133 INFO:tasks.workunit.client.1.smithi149.stdout:5/67: dwrite d0/f4 [0,4194304] 0 2024-04-15T21:02:23.134 INFO:tasks.workunit.client.1.smithi149.stdout:5/68: fsync d0/d9/db/f10 0 2024-04-15T21:02:23.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/69: dread - d0/d9/db/f1a zero size 2024-04-15T21:02:23.138 INFO:tasks.workunit.client.1.smithi149.stdout:5/70: write d0/d9/db/f1c [4966415,89727] 0 2024-04-15T21:02:23.139 INFO:tasks.workunit.client.1.smithi149.stdout:5/71: stat d0/d9 0 2024-04-15T21:02:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:5/72: chown d0/d9/db/f10 3 1 2024-04-15T21:02:23.145 INFO:tasks.workunit.client.1.smithi149.stdout:5/73: creat d0/d9/db/d12/d16/f1d x:0 0 0 2024-04-15T21:02:23.147 INFO:tasks.workunit.client.1.smithi149.stdout:2/26: dwrite f0 [0,4194304] 0 2024-04-15T21:02:23.147 INFO:tasks.workunit.client.1.smithi149.stdout:5/74: dread - d0/d6/d14/f19 zero size 2024-04-15T21:02:23.147 INFO:tasks.workunit.client.1.smithi149.stdout:2/27: readlink - no filename 2024-04-15T21:02:23.148 INFO:tasks.workunit.client.1.smithi149.stdout:2/28: write d4/fd [142869,80146] 0 2024-04-15T21:02:23.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/75: write d0/d9/db/f1c [5310343,48708] 0 2024-04-15T21:02:23.150 INFO:tasks.workunit.client.1.smithi149.stdout:5/76: chown d0/d9/db 111011 1 2024-04-15T21:02:23.150 INFO:tasks.workunit.client.1.smithi149.stdout:5/77: chown d0/f8 76 1 2024-04-15T21:02:23.157 INFO:tasks.workunit.client.1.smithi149.stdout:5/78: mknod d0/d6/c1e 0 2024-04-15T21:02:23.159 INFO:tasks.workunit.client.1.smithi149.stdout:2/29: dwrite d4/d7/f9 [0,4194304] 0 2024-04-15T21:02:23.160 INFO:tasks.workunit.client.1.smithi149.stdout:5/79: write d0/d9/db/d12/d16/f18 [335928,52341] 0 2024-04-15T21:02:23.164 INFO:tasks.workunit.client.1.smithi149.stdout:2/30: creat d4/d7/da/fe x:0 0 0 2024-04-15T21:02:23.165 INFO:tasks.workunit.client.1.smithi149.stdout:2/31: stat d4/d7 0 2024-04-15T21:02:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/80: creat d0/d6/d14/d1b/f1f x:0 0 0 2024-04-15T21:02:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/81: chown d0/d9/db/f1c 7 1 2024-04-15T21:02:23.168 INFO:tasks.workunit.client.1.smithi149.stdout:5/82: fdatasync d0/d9/db/f1c 0 2024-04-15T21:02:23.168 INFO:tasks.workunit.client.1.smithi149.stdout:5/83: chown d0/d6/c1e 28278110 1 2024-04-15T21:02:23.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/84: read - d0/d9/f17 zero size 2024-04-15T21:02:23.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/32: rename d4/f6 to d4/d7/da/ff 0 2024-04-15T21:02:23.170 INFO:tasks.workunit.client.1.smithi149.stdout:2/33: chown d4/d7/da/fc 3495 1 2024-04-15T21:02:23.171 INFO:tasks.workunit.client.1.smithi149.stdout:2/34: fdatasync d4/fd 0 2024-04-15T21:02:23.172 INFO:tasks.workunit.client.1.smithi149.stdout:5/85: creat d0/d6/d14/d1b/f20 x:0 0 0 2024-04-15T21:02:23.172 INFO:tasks.workunit.client.1.smithi149.stdout:5/86: stat d0/f4 0 2024-04-15T21:02:23.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/35: unlink d4/fd 0 2024-04-15T21:02:23.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/36: fdatasync f3 0 2024-04-15T21:02:23.176 INFO:tasks.workunit.client.1.smithi149.stdout:2/37: fdatasync d4/d7/fb 0 2024-04-15T21:02:23.177 INFO:tasks.workunit.client.1.smithi149.stdout:5/87: symlink d0/d9/db/l21 0 2024-04-15T21:02:23.178 INFO:tasks.workunit.client.1.smithi149.stdout:5/88: truncate d0/d6/fe 238974 0 2024-04-15T21:02:23.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/56: dread d1/fa [0,4194304] 0 2024-04-15T21:02:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:2/38: unlink d4/d7/fb 0 2024-04-15T21:02:23.184 INFO:tasks.workunit.client.1.smithi149.stdout:3/57: unlink d1/l5 0 2024-04-15T21:02:23.186 INFO:tasks.workunit.client.1.smithi149.stdout:2/39: mkdir d4/d7/d10 0 2024-04-15T21:02:23.187 INFO:tasks.workunit.client.1.smithi149.stdout:3/58: write d1/fa [1118043,17979] 0 2024-04-15T21:02:23.189 INFO:tasks.workunit.client.1.smithi149.stdout:5/89: fdatasync d0/f5 0 2024-04-15T21:02:23.190 INFO:tasks.workunit.client.1.smithi149.stdout:3/59: dread d1/fa [0,4194304] 0 2024-04-15T21:02:23.191 INFO:tasks.workunit.client.1.smithi149.stdout:3/60: fdatasync d1/fa 0 2024-04-15T21:02:23.196 INFO:tasks.workunit.client.1.smithi149.stdout:2/40: creat d4/d7/d10/f11 x:0 0 0 2024-04-15T21:02:23.198 INFO:tasks.workunit.client.1.smithi149.stdout:5/90: rename d0/d9/db/f1a to d0/d9/f22 0 2024-04-15T21:02:23.199 INFO:tasks.workunit.client.1.smithi149.stdout:3/61: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:23.201 INFO:tasks.workunit.client.1.smithi149.stdout:5/91: fdatasync d0/d6/d14/d1b/f1f 0 2024-04-15T21:02:23.203 INFO:tasks.workunit.client.1.smithi149.stdout:5/92: stat d0/d6/d14/d1b/f20 0 2024-04-15T21:02:23.208 INFO:tasks.workunit.client.1.smithi149.stdout:2/41: dwrite f3 [0,4194304] 0 2024-04-15T21:02:23.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/62: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:23.217 INFO:tasks.workunit.client.1.smithi149.stdout:2/42: dread d4/d7/f9 [0,4194304] 0 2024-04-15T21:02:23.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/63: dread d1/fa [0,4194304] 0 2024-04-15T21:02:23.220 INFO:tasks.workunit.client.1.smithi149.stdout:2/43: fsync d4/d7/d10/f11 0 2024-04-15T21:02:23.225 INFO:tasks.workunit.client.1.smithi149.stdout:2/44: rename d4/d7/f9 to d4/f12 0 2024-04-15T21:02:23.225 INFO:tasks.workunit.client.1.smithi149.stdout:2/45: chown d4/d7 96582380 1 2024-04-15T21:02:23.226 INFO:tasks.workunit.client.1.smithi149.stdout:2/46: dread - d4/d7/d10/f11 zero size 2024-04-15T21:02:23.226 INFO:tasks.workunit.client.1.smithi149.stdout:2/47: read f3 [1601272,43894] 0 2024-04-15T21:02:23.227 INFO:tasks.workunit.client.1.smithi149.stdout:2/48: dread - d4/d7/da/fc zero size 2024-04-15T21:02:23.229 INFO:tasks.workunit.client.1.smithi149.stdout:2/49: rename d4/d7/da to d4/d7/da/d13 22 2024-04-15T21:02:23.229 INFO:tasks.workunit.client.1.smithi149.stdout:2/50: stat f0 0 2024-04-15T21:02:23.232 INFO:tasks.workunit.client.1.smithi149.stdout:2/51: symlink d4/l14 0 2024-04-15T21:02:23.234 INFO:tasks.workunit.client.1.smithi149.stdout:3/64: fdatasync d1/fa 0 2024-04-15T21:02:23.236 INFO:tasks.workunit.client.1.smithi149.stdout:3/65: unlink d1/l6 0 2024-04-15T21:02:23.237 INFO:tasks.workunit.client.1.smithi149.stdout:3/66: fsync d1/fa 0 2024-04-15T21:02:23.237 INFO:tasks.workunit.client.1.smithi149.stdout:2/52: rmdir d4/d7 39 2024-04-15T21:02:23.237 INFO:tasks.workunit.client.1.smithi149.stdout:3/67: chown d1/c2 1650 1 2024-04-15T21:02:23.239 INFO:tasks.workunit.client.1.smithi149.stdout:3/68: creat d1/fd x:0 0 0 2024-04-15T21:02:23.241 INFO:tasks.workunit.client.1.smithi149.stdout:2/53: creat d4/d7/d10/f15 x:0 0 0 2024-04-15T21:02:23.243 INFO:tasks.workunit.client.1.smithi149.stdout:2/54: dread d4/f12 [0,4194304] 0 2024-04-15T21:02:23.244 INFO:tasks.workunit.client.1.smithi149.stdout:2/55: dread - d4/d7/d10/f11 zero size 2024-04-15T21:02:23.244 INFO:tasks.workunit.client.1.smithi149.stdout:2/56: chown d4/d7/d10 124 1 2024-04-15T21:02:23.244 INFO:tasks.workunit.client.1.smithi149.stdout:2/57: dread - d4/d7/d10/f11 zero size 2024-04-15T21:02:23.246 INFO:tasks.workunit.client.1.smithi149.stdout:2/58: creat d4/d7/d10/f16 x:0 0 0 2024-04-15T21:02:23.253 INFO:tasks.workunit.client.1.smithi149.stdout:2/59: dwrite d4/d7/da/ff [0,4194304] 0 2024-04-15T21:02:23.257 INFO:tasks.workunit.client.1.smithi149.stdout:2/60: symlink d4/d7/d10/l17 0 2024-04-15T21:02:23.260 INFO:tasks.workunit.client.1.smithi149.stdout:2/61: unlink d4/f8 0 2024-04-15T21:02:23.261 INFO:tasks.workunit.client.1.smithi149.stdout:2/62: write d4/d7/da/fe [343250,59515] 0 2024-04-15T21:02:23.266 INFO:tasks.workunit.client.1.smithi149.stdout:2/63: creat d4/f18 x:0 0 0 2024-04-15T21:02:23.268 INFO:tasks.workunit.client.1.smithi149.stdout:2/64: mkdir d4/d7/d19 0 2024-04-15T21:02:23.269 INFO:tasks.workunit.client.1.smithi149.stdout:2/65: truncate d4/f18 177062 0 2024-04-15T21:02:23.271 INFO:tasks.workunit.client.1.smithi149.stdout:2/66: creat d4/f1a x:0 0 0 2024-04-15T21:02:23.271 INFO:tasks.workunit.client.1.smithi149.stdout:2/67: dread - d4/f1a zero size 2024-04-15T21:02:23.271 INFO:tasks.workunit.client.1.smithi149.stdout:2/68: rename d4/d7 to d4/d7/d19/d1b 22 2024-04-15T21:02:23.277 INFO:tasks.workunit.client.1.smithi149.stdout:2/69: dwrite d4/d7/da/ff [0,4194304] 0 2024-04-15T21:02:23.278 INFO:tasks.workunit.client.1.smithi149.stdout:2/70: dread - d4/d7/da/fc zero size 2024-04-15T21:02:23.283 INFO:tasks.workunit.client.1.smithi149.stdout:2/71: creat d4/d7/da/f1c x:0 0 0 2024-04-15T21:02:23.285 INFO:tasks.workunit.client.1.smithi149.stdout:2/72: fsync d4/f12 0 2024-04-15T21:02:23.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/73: rename f3 to d4/d7/f1d 0 2024-04-15T21:02:23.295 INFO:tasks.workunit.client.1.smithi149.stdout:2/74: getdents d4/d7 0 2024-04-15T21:02:23.296 INFO:tasks.workunit.client.1.smithi149.stdout:2/75: write d4/d7/da/fe [1371811,1854] 0 2024-04-15T21:02:23.296 INFO:tasks.workunit.client.1.smithi149.stdout:2/76: stat d4/d7/d10/f15 0 2024-04-15T21:02:23.298 INFO:tasks.workunit.client.1.smithi149.stdout:2/77: rename d4/l14 to d4/d7/l1e 0 2024-04-15T21:02:23.300 INFO:tasks.workunit.client.1.smithi149.stdout:2/78: mknod d4/d7/d19/c1f 0 2024-04-15T21:02:23.304 INFO:tasks.workunit.client.1.smithi149.stdout:2/79: getdents d4/d7/da 0 2024-04-15T21:02:23.305 INFO:tasks.workunit.client.1.smithi149.stdout:2/80: write d4/d7/da/ff [1835410,15871] 0 2024-04-15T21:02:23.305 INFO:tasks.workunit.client.1.smithi149.stdout:2/81: chown d4/d7 6 1 2024-04-15T21:02:23.310 INFO:tasks.workunit.client.1.smithi149.stdout:2/82: unlink d4/d7/l1e 0 2024-04-15T21:02:23.312 INFO:tasks.workunit.client.1.smithi149.stdout:2/83: creat d4/d7/da/f20 x:0 0 0 2024-04-15T21:02:23.312 INFO:tasks.workunit.client.1.smithi149.stdout:2/84: read d4/d7/f1d [3971618,11402] 0 2024-04-15T21:02:23.313 INFO:tasks.workunit.client.1.smithi149.stdout:2/85: fsync d4/f12 0 2024-04-15T21:02:23.315 INFO:tasks.workunit.client.1.smithi149.stdout:2/86: mkdir d4/d7/d19/d21 0 2024-04-15T21:02:23.315 INFO:tasks.workunit.client.1.smithi149.stdout:2/87: write d4/f1a [572030,20655] 0 2024-04-15T21:02:23.323 INFO:tasks.workunit.client.1.smithi149.stdout:2/88: dwrite d4/d7/da/fc [0,4194304] 0 2024-04-15T21:02:23.325 INFO:tasks.workunit.client.1.smithi149.stdout:2/89: creat d4/d7/d10/f22 x:0 0 0 2024-04-15T21:02:23.326 INFO:tasks.workunit.client.1.smithi149.stdout:2/90: chown d4/f18 56 1 2024-04-15T21:02:23.329 INFO:tasks.workunit.client.1.smithi149.stdout:2/91: mknod d4/d7/d10/c23 0 2024-04-15T21:02:23.331 INFO:tasks.workunit.client.1.smithi149.stdout:2/92: getdents d4/d7/d19/d21 0 2024-04-15T21:02:23.334 INFO:tasks.workunit.client.1.smithi149.stdout:2/93: creat d4/d7/d19/f24 x:0 0 0 2024-04-15T21:02:23.336 INFO:tasks.workunit.client.1.smithi149.stdout:2/94: creat d4/d7/da/f25 x:0 0 0 2024-04-15T21:02:23.342 INFO:tasks.workunit.client.1.smithi149.stdout:2/95: getdents d4/d7/d10 0 2024-04-15T21:02:23.346 INFO:tasks.workunit.client.1.smithi149.stdout:2/96: rmdir d4/d7 39 2024-04-15T21:02:23.349 INFO:tasks.workunit.client.1.smithi149.stdout:2/97: rename d4 to d4/d7/d26 22 2024-04-15T21:02:23.350 INFO:tasks.workunit.client.1.smithi149.stdout:2/98: mknod d4/d7/da/c27 0 2024-04-15T21:02:23.358 INFO:tasks.workunit.client.1.smithi149.stdout:2/99: dwrite d4/d7/da/f1c [0,4194304] 0 2024-04-15T21:02:23.359 INFO:tasks.workunit.client.1.smithi149.stdout:2/100: dread - d4/d7/d10/f11 zero size 2024-04-15T21:02:23.361 INFO:tasks.workunit.client.1.smithi149.stdout:2/101: symlink d4/l28 0 2024-04-15T21:02:23.363 INFO:tasks.workunit.client.1.smithi149.stdout:2/102: mkdir d4/d7/d29 0 2024-04-15T21:02:23.366 INFO:tasks.workunit.client.1.smithi149.stdout:2/103: unlink f0 0 2024-04-15T21:02:23.366 INFO:tasks.workunit.client.1.smithi149.stdout:2/104: chown d4/d7/d10 91030008 1 2024-04-15T21:02:23.367 INFO:tasks.workunit.client.1.smithi149.stdout:2/105: readlink d4/d7/d10/l17 0 2024-04-15T21:02:23.375 INFO:tasks.workunit.client.1.smithi149.stdout:2/106: dwrite d4/d7/da/f25 [0,4194304] 0 2024-04-15T21:02:23.380 INFO:tasks.workunit.client.1.smithi149.stdout:2/107: creat d4/d7/d29/f2a x:0 0 0 2024-04-15T21:02:23.382 INFO:tasks.workunit.client.1.smithi149.stdout:2/108: symlink d4/d7/d10/l2b 0 2024-04-15T21:02:23.383 INFO:tasks.workunit.client.1.smithi149.stdout:2/109: dread - d4/d7/d19/f24 zero size 2024-04-15T21:02:23.384 INFO:tasks.workunit.client.1.smithi149.stdout:2/110: read d4/d7/da/f25 [2467809,84918] 0 2024-04-15T21:02:23.386 INFO:tasks.workunit.client.1.smithi149.stdout:2/111: mkdir d4/d7/d19/d21/d2c 0 2024-04-15T21:02:23.387 INFO:tasks.workunit.client.1.smithi149.stdout:2/112: mknod d4/d7/da/c2d 0 2024-04-15T21:02:23.389 INFO:tasks.workunit.client.1.smithi149.stdout:2/113: unlink d4/d7/d10/f15 0 2024-04-15T21:02:23.393 INFO:tasks.workunit.client.1.smithi149.stdout:2/114: rename d4/d7/da/f20 to d4/f2e 0 2024-04-15T21:02:23.396 INFO:tasks.workunit.client.1.smithi149.stdout:2/115: dread d4/f12 [0,4194304] 0 2024-04-15T21:02:23.396 INFO:tasks.workunit.client.1.smithi149.stdout:2/116: readlink d4/d7/d10/l2b 0 2024-04-15T21:02:23.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/117: unlink d4/d7/d29/f2a 0 2024-04-15T21:02:23.400 INFO:tasks.workunit.client.1.smithi149.stdout:2/118: mkdir d4/d7/d2f 0 2024-04-15T21:02:23.401 INFO:tasks.workunit.client.1.smithi149.stdout:2/119: fdatasync d4/d7/d10/f11 0 2024-04-15T21:02:23.405 INFO:tasks.workunit.client.1.smithi149.stdout:2/120: link d4/d7/f1d d4/d7/d29/f30 0 2024-04-15T21:02:23.413 INFO:tasks.workunit.client.1.smithi149.stdout:2/121: dwrite d4/f2e [0,4194304] 0 2024-04-15T21:02:23.416 INFO:tasks.workunit.client.1.smithi149.stdout:2/122: creat d4/d7/f31 x:0 0 0 2024-04-15T21:02:23.430 INFO:tasks.workunit.client.1.smithi149.stdout:7/16: sync 2024-04-15T21:02:23.431 INFO:tasks.workunit.client.1.smithi149.stdout:7/17: chown l2 48 1 2024-04-15T21:02:23.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/18: getdents d3 0 2024-04-15T21:02:23.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/19: stat d3/f8 0 2024-04-15T21:02:23.437 INFO:tasks.workunit.client.1.smithi149.stdout:7/20: rename d3/f8 to d3/f9 0 2024-04-15T21:02:23.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/21: rename l2 to d3/la 0 2024-04-15T21:02:23.441 INFO:tasks.workunit.client.1.smithi149.stdout:7/22: fdatasync d3/f7 0 2024-04-15T21:02:23.442 INFO:tasks.workunit.client.1.smithi149.stdout:7/23: rmdir d3 39 2024-04-15T21:02:23.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/24: creat d3/fb x:0 0 0 2024-04-15T21:02:23.445 INFO:tasks.workunit.client.1.smithi149.stdout:7/25: dread - d3/f4 zero size 2024-04-15T21:02:23.446 INFO:tasks.workunit.client.1.smithi149.stdout:7/26: creat d3/fc x:0 0 0 2024-04-15T21:02:23.447 INFO:tasks.workunit.client.1.smithi149.stdout:7/27: dread - d3/fc zero size 2024-04-15T21:02:23.448 INFO:tasks.workunit.client.1.smithi149.stdout:7/28: write d3/f9 [199019,45527] 0 2024-04-15T21:02:23.449 INFO:tasks.workunit.client.1.smithi149.stdout:7/29: creat d3/fd x:0 0 0 2024-04-15T21:02:23.451 INFO:tasks.workunit.client.1.smithi149.stdout:7/30: mknod d3/ce 0 2024-04-15T21:02:23.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/31: getdents d3 0 2024-04-15T21:02:23.462 INFO:tasks.workunit.client.1.smithi149.stdout:7/32: chown d3/l6 107012500 1 2024-04-15T21:02:23.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/33: dwrite d3/fc [0,4194304] 0 2024-04-15T21:02:23.473 INFO:tasks.workunit.client.1.smithi149.stdout:7/34: creat d3/ff x:0 0 0 2024-04-15T21:02:23.475 INFO:tasks.workunit.client.1.smithi149.stdout:7/35: creat d3/f10 x:0 0 0 2024-04-15T21:02:23.476 INFO:tasks.workunit.client.1.smithi149.stdout:7/36: readlink d3/la 0 2024-04-15T21:02:23.476 INFO:tasks.workunit.client.1.smithi149.stdout:7/37: write d3/f9 [750771,64845] 0 2024-04-15T21:02:23.477 INFO:tasks.workunit.client.1.smithi149.stdout:7/38: dread - d3/f10 zero size 2024-04-15T21:02:23.479 INFO:tasks.workunit.client.1.smithi149.stdout:7/39: rename d3/ce to d3/c11 0 2024-04-15T21:02:23.480 INFO:tasks.workunit.client.1.smithi149.stdout:7/40: symlink d3/l12 0 2024-04-15T21:02:23.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/33: sync 2024-04-15T21:02:23.701 INFO:tasks.workunit.client.1.smithi149.stdout:4/34: dwrite f1 [0,4194304] 0 2024-04-15T21:02:23.709 INFO:tasks.workunit.client.1.smithi149.stdout:4/35: getdents . 0 2024-04-15T21:02:23.711 INFO:tasks.workunit.client.1.smithi149.stdout:4/36: mkdir d8 0 2024-04-15T21:02:23.716 INFO:tasks.workunit.client.1.smithi149.stdout:4/37: rmdir d8 0 2024-04-15T21:02:23.717 INFO:tasks.workunit.client.1.smithi149.stdout:4/38: write f3 [4217116,116233] 0 2024-04-15T21:02:23.766 INFO:tasks.workunit.client.1.smithi149.stdout:4/39: write f7 [695345,88583] 0 2024-04-15T21:02:23.766 INFO:tasks.workunit.client.1.smithi149.stdout:4/40: chown f5 8926 1 2024-04-15T21:02:23.768 INFO:tasks.workunit.client.1.smithi149.stdout:4/41: mknod c9 0 2024-04-15T21:02:23.768 INFO:tasks.workunit.client.1.smithi149.stdout:4/42: stat f7 0 2024-04-15T21:02:23.768 INFO:tasks.workunit.client.1.smithi149.stdout:4/43: rmdir - no directory 2024-04-15T21:02:23.769 INFO:tasks.workunit.client.1.smithi149.stdout:4/44: write f3 [3373896,69303] 0 2024-04-15T21:02:23.773 INFO:tasks.workunit.client.1.smithi149.stdout:4/45: dread f5 [0,4194304] 0 2024-04-15T21:02:23.775 INFO:tasks.workunit.client.1.smithi149.stdout:4/46: creat fa x:0 0 0 2024-04-15T21:02:23.777 INFO:tasks.workunit.client.1.smithi149.stdout:4/47: symlink lb 0 2024-04-15T21:02:23.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/48: dwrite f3 [0,4194304] 0 2024-04-15T21:02:23.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/49: readlink lb 0 2024-04-15T21:02:23.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/62: sync 2024-04-15T21:02:23.793 INFO:tasks.workunit.client.1.smithi149.stdout:1/54: sync 2024-04-15T21:02:23.794 INFO:tasks.workunit.client.1.smithi149.stdout:8/63: chown d2/df/c17 19 1 2024-04-15T21:02:23.796 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:23 smithi149 ceph-mon[36029]: pgmap v268: 65 pgs: 65 active+clean; 215 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 367 op/s 2024-04-15T21:02:23.796 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:23 smithi149 ceph-mon[36029]: mgrmap e20: smithi072.wfjmmp(active, since 7m), standbys: smithi149.qgbaiy 2024-04-15T21:02:23.802 INFO:tasks.workunit.client.1.smithi149.stdout:8/64: dwrite d2/fd [0,4194304] 0 2024-04-15T21:02:23.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/55: link d1/f6 d1/da/ff 0 2024-04-15T21:02:23.808 INFO:tasks.workunit.client.1.smithi149.stdout:8/65: creat d2/df/d10/f18 x:0 0 0 2024-04-15T21:02:23.812 INFO:tasks.workunit.client.1.smithi149.stdout:8/66: readlink d2/la 0 2024-04-15T21:02:23.813 INFO:tasks.workunit.client.1.smithi149.stdout:1/56: creat d1/db/dc/f10 x:0 0 0 2024-04-15T21:02:23.814 INFO:tasks.workunit.client.1.smithi149.stdout:1/57: write d1/da/fd [350038,16982] 0 2024-04-15T21:02:23.821 INFO:tasks.workunit.client.1.smithi149.stdout:1/58: dread - d1/f8 zero size 2024-04-15T21:02:23.840 INFO:tasks.workunit.client.1.smithi149.stdout:9/53: sync 2024-04-15T21:02:23.840 INFO:tasks.workunit.client.1.smithi149.stdout:0/33: sync 2024-04-15T21:02:23.840 INFO:tasks.workunit.client.1.smithi149.stdout:6/51: sync 2024-04-15T21:02:23.840 INFO:tasks.workunit.client.1.smithi149.stdout:5/93: sync 2024-04-15T21:02:23.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/41: sync 2024-04-15T21:02:23.841 INFO:tasks.workunit.client.1.smithi149.stdout:3/69: sync 2024-04-15T21:02:23.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/123: sync 2024-04-15T21:02:23.841 INFO:tasks.workunit.client.1.smithi149.stdout:4/50: getdents . 0 2024-04-15T21:02:23.841 INFO:tasks.workunit.client.1.smithi149.stdout:9/54: fsync fc 0 2024-04-15T21:02:23.846 INFO:tasks.workunit.client.1.smithi149.stdout:9/55: dread f3 [0,4194304] 0 2024-04-15T21:02:23.847 INFO:tasks.workunit.client.1.smithi149.stdout:5/94: write d0/d9/f22 [561257,9159] 0 2024-04-15T21:02:23.848 INFO:tasks.workunit.client.1.smithi149.stdout:5/95: dread - d0/d6/d14/f19 zero size 2024-04-15T21:02:23.849 INFO:tasks.workunit.client.1.smithi149.stdout:4/51: mkdir dc 0 2024-04-15T21:02:23.849 INFO:tasks.workunit.client.1.smithi149.stdout:7/42: write d3/f4 [211433,13298] 0 2024-04-15T21:02:23.850 INFO:tasks.workunit.client.1.smithi149.stdout:4/52: write fa [456959,10743] 0 2024-04-15T21:02:23.851 INFO:tasks.workunit.client.1.smithi149.stdout:4/53: write f2 [4520589,118388] 0 2024-04-15T21:02:23.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/70: rename d1/c7 to d1/db/ce 0 2024-04-15T21:02:23.854 INFO:tasks.workunit.client.1.smithi149.stdout:4/54: dread fa [0,4194304] 0 2024-04-15T21:02:23.854 INFO:tasks.workunit.client.1.smithi149.stdout:3/71: write d1/fd [398691,113772] 0 2024-04-15T21:02:23.855 INFO:tasks.workunit.client.1.smithi149.stdout:4/55: chown f3 392 1 2024-04-15T21:02:23.855 INFO:tasks.workunit.client.1.smithi149.stdout:4/56: chown f5 17 1 2024-04-15T21:02:23.860 INFO:tasks.workunit.client.1.smithi149.stdout:9/56: creat f11 x:0 0 0 2024-04-15T21:02:23.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/96: mknod d0/d9/db/d12/c23 0 2024-04-15T21:02:23.866 INFO:tasks.workunit.client.1.smithi149.stdout:7/43: rename d3/l6 to d3/l13 0 2024-04-15T21:02:23.867 INFO:tasks.workunit.client.1.smithi149.stdout:9/57: dwrite f10 [0,4194304] 0 2024-04-15T21:02:23.872 INFO:tasks.workunit.client.1.smithi149.stdout:2/124: mkdir d4/d7/d19/d21/d2c/d32 0 2024-04-15T21:02:23.873 INFO:tasks.workunit.client.1.smithi149.stdout:2/125: stat d4/d7/da/f1c 0 2024-04-15T21:02:23.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/57: rename f7 to dc/fd 0 2024-04-15T21:02:23.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/58: chown f6 87917 1 2024-04-15T21:02:23.878 INFO:tasks.workunit.client.1.smithi149.stdout:0/34: symlink d1/d9/lb 0 2024-04-15T21:02:23.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/59: getdents d1/db/dc 0 2024-04-15T21:02:23.880 INFO:tasks.workunit.client.1.smithi149.stdout:5/97: mknod d0/d6/c24 0 2024-04-15T21:02:23.883 INFO:tasks.workunit.client.1.smithi149.stdout:8/67: truncate d2/df/d10/f11 222147 0 2024-04-15T21:02:23.891 INFO:tasks.workunit.client.1.smithi149.stdout:8/68: dwrite d2/fe [0,4194304] 0 2024-04-15T21:02:23.892 INFO:tasks.workunit.client.1.smithi149.stdout:3/72: mkdir d1/dc/df 0 2024-04-15T21:02:23.896 INFO:tasks.workunit.client.1.smithi149.stdout:4/59: creat dc/fe x:0 0 0 2024-04-15T21:02:23.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/35: unlink d1/f2 0 2024-04-15T21:02:23.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/36: chown d1 5157963 1 2024-04-15T21:02:23.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/37: fsync d1/d5/fa 0 2024-04-15T21:02:23.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/38: read d1/f4 [1401096,67037] 0 2024-04-15T21:02:23.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/39: truncate d1/d5/fa 437661 0 2024-04-15T21:02:23.902 INFO:tasks.workunit.client.1.smithi149.stdout:5/98: rename d0/d6/l7 to d0/d9/db/l25 0 2024-04-15T21:02:23.909 INFO:tasks.workunit.client.1.smithi149.stdout:4/60: write fa [782504,52999] 0 2024-04-15T21:02:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/60: truncate d1/da/ff 198069 0 2024-04-15T21:02:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/99: dwrite d0/d9/f17 [0,4194304] 0 2024-04-15T21:02:23.913 INFO:tasks.workunit.client.1.smithi149.stdout:1/61: dread - d1/f7 zero size 2024-04-15T21:02:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:23 smithi072 ceph-mon[29079]: pgmap v268: 65 pgs: 65 active+clean; 215 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.8 MiB/s wr, 367 op/s 2024-04-15T21:02:23.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:23 smithi072 ceph-mon[29079]: mgrmap e20: smithi072.wfjmmp(active, since 7m), standbys: smithi149.qgbaiy 2024-04-15T21:02:23.914 INFO:tasks.workunit.client.1.smithi149.stdout:8/69: rename d2/fd to d2/df/d10/f19 0 2024-04-15T21:02:23.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/126: creat d4/f33 x:0 0 0 2024-04-15T21:02:23.918 INFO:tasks.workunit.client.1.smithi149.stdout:2/127: truncate d4/d7/f31 457001 0 2024-04-15T21:02:23.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/61: symlink dc/lf 0 2024-04-15T21:02:23.929 INFO:tasks.workunit.client.1.smithi149.stdout:1/62: dwrite d1/da/fd [0,4194304] 0 2024-04-15T21:02:23.930 INFO:tasks.workunit.client.1.smithi149.stdout:6/52: dwrite da/ff [0,4194304] 0 2024-04-15T21:02:23.934 INFO:tasks.workunit.client.1.smithi149.stdout:3/73: link d1/c2 d1/c10 0 2024-04-15T21:02:23.934 INFO:tasks.workunit.client.1.smithi149.stdout:8/70: creat d2/f1a x:0 0 0 2024-04-15T21:02:23.937 INFO:tasks.workunit.client.1.smithi149.stdout:2/128: symlink d4/d7/d19/d21/d2c/l34 0 2024-04-15T21:02:23.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/62: mkdir dc/d10 0 2024-04-15T21:02:23.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/63: write f3 [1080679,98121] 0 2024-04-15T21:02:23.946 INFO:tasks.workunit.client.1.smithi149.stdout:6/53: mkdir da/d11 0 2024-04-15T21:02:23.946 INFO:tasks.workunit.client.1.smithi149.stdout:8/71: dwrite d2/f4 [4194304,4194304] 0 2024-04-15T21:02:23.947 INFO:tasks.workunit.client.1.smithi149.stdout:6/54: readlink l5 0 2024-04-15T21:02:23.948 INFO:tasks.workunit.client.1.smithi149.stdout:6/55: stat da/dc/fe 0 2024-04-15T21:02:23.953 INFO:tasks.workunit.client.1.smithi149.stdout:3/74: symlink d1/db/l11 0 2024-04-15T21:02:23.958 INFO:tasks.workunit.client.1.smithi149.stdout:2/129: rename d4/d7/d10/f22 to d4/d7/d19/f35 0 2024-04-15T21:02:23.960 INFO:tasks.workunit.client.1.smithi149.stdout:7/44: rename d3/l13 to d3/l14 0 2024-04-15T21:02:23.961 INFO:tasks.workunit.client.1.smithi149.stdout:4/64: mkdir dc/d11 0 2024-04-15T21:02:23.965 INFO:tasks.workunit.client.1.smithi149.stdout:3/75: symlink d1/dc/l12 0 2024-04-15T21:02:23.967 INFO:tasks.workunit.client.1.smithi149.stdout:2/130: dwrite d4/f2e [0,4194304] 0 2024-04-15T21:02:23.968 INFO:tasks.workunit.client.1.smithi149.stdout:3/76: readlink d1/db/l11 0 2024-04-15T21:02:23.970 INFO:tasks.workunit.client.1.smithi149.stdout:8/72: rename d2/df/d10/f18 to d2/f1b 0 2024-04-15T21:02:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/77: write d1/fa [3210614,77728] 0 2024-04-15T21:02:23.974 INFO:tasks.workunit.client.1.smithi149.stdout:7/45: dwrite d3/f5 [0,4194304] 0 2024-04-15T21:02:23.977 INFO:tasks.workunit.client.1.smithi149.stdout:3/78: write d1/fa [2158575,70096] 0 2024-04-15T21:02:23.977 INFO:tasks.workunit.client.1.smithi149.stdout:7/46: truncate d3/fd 791513 0 2024-04-15T21:02:23.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/131: mkdir d4/d7/d10/d36 0 2024-04-15T21:02:23.981 INFO:tasks.workunit.client.1.smithi149.stdout:9/58: write f7 [1052769,24115] 0 2024-04-15T21:02:23.983 INFO:tasks.workunit.client.1.smithi149.stdout:8/73: symlink d2/l1c 0 2024-04-15T21:02:23.986 INFO:tasks.workunit.client.1.smithi149.stdout:3/79: creat d1/dc/f13 x:0 0 0 2024-04-15T21:02:23.987 INFO:tasks.workunit.client.1.smithi149.stdout:3/80: fdatasync d1/dc/f13 0 2024-04-15T21:02:23.991 INFO:tasks.workunit.client.1.smithi149.stdout:2/132: creat d4/d7/d10/f37 x:0 0 0 2024-04-15T21:02:23.992 INFO:tasks.workunit.client.1.smithi149.stdout:9/59: dwrite f0 [0,4194304] 0 2024-04-15T21:02:23.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/60: chown f11 12945752 1 2024-04-15T21:02:23.995 INFO:tasks.workunit.client.1.smithi149.stdout:8/74: mkdir d2/df/d1d 0 2024-04-15T21:02:23.996 INFO:tasks.workunit.client.1.smithi149.stdout:8/75: chown d2/f4 47 1 2024-04-15T21:02:24.001 INFO:tasks.workunit.client.1.smithi149.stdout:3/81: symlink d1/l14 0 2024-04-15T21:02:24.002 INFO:tasks.workunit.client.1.smithi149.stdout:2/133: symlink d4/d7/da/l38 0 2024-04-15T21:02:24.002 INFO:tasks.workunit.client.1.smithi149.stdout:3/82: chown d1/fa 116472851 1 2024-04-15T21:02:24.004 INFO:tasks.workunit.client.1.smithi149.stdout:8/76: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:24.007 INFO:tasks.workunit.client.1.smithi149.stdout:9/61: unlink fc 0 2024-04-15T21:02:24.012 INFO:tasks.workunit.client.1.smithi149.stdout:3/83: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:24.013 INFO:tasks.workunit.client.1.smithi149.stdout:2/134: mkdir d4/d7/d29/d39 0 2024-04-15T21:02:24.015 INFO:tasks.workunit.client.1.smithi149.stdout:0/40: truncate d1/d5/fa 428852 0 2024-04-15T21:02:24.016 INFO:tasks.workunit.client.1.smithi149.stdout:0/41: chown d1/l6 241 1 2024-04-15T21:02:24.016 INFO:tasks.workunit.client.1.smithi149.stdout:0/42: fsync d1/f4 0 2024-04-15T21:02:24.020 INFO:tasks.workunit.client.1.smithi149.stdout:9/62: symlink l12 0 2024-04-15T21:02:24.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/43: mkdir d1/d5/dc 0 2024-04-15T21:02:24.030 INFO:tasks.workunit.client.1.smithi149.stdout:0/44: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:24.030 INFO:tasks.workunit.client.1.smithi149.stdout:3/84: link d1/dc/l12 d1/l15 0 2024-04-15T21:02:24.034 INFO:tasks.workunit.client.1.smithi149.stdout:2/135: rename d4/d7/d19/f35 to d4/d7/d19/d21/f3a 0 2024-04-15T21:02:24.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/45: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:24.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/47: rmdir d3 39 2024-04-15T21:02:24.037 INFO:tasks.workunit.client.1.smithi149.stdout:4/65: getdents dc 0 2024-04-15T21:02:24.037 INFO:tasks.workunit.client.1.smithi149.stdout:4/66: chown dc/d10 187 1 2024-04-15T21:02:24.038 INFO:tasks.workunit.client.1.smithi149.stdout:6/56: write da/dc/fe [680807,28386] 0 2024-04-15T21:02:24.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/57: dread da/dc/fe [0,4194304] 0 2024-04-15T21:02:24.044 INFO:tasks.workunit.client.1.smithi149.stdout:4/67: rename c9 to dc/c12 0 2024-04-15T21:02:24.047 INFO:tasks.workunit.client.1.smithi149.stdout:7/48: symlink d3/l15 0 2024-04-15T21:02:24.048 INFO:tasks.workunit.client.1.smithi149.stdout:7/49: chown d3/f7 88770346 1 2024-04-15T21:02:24.051 INFO:tasks.workunit.client.1.smithi149.stdout:6/58: symlink da/dc/l12 0 2024-04-15T21:02:24.052 INFO:tasks.workunit.client.1.smithi149.stdout:6/59: write f8 [688387,27126] 0 2024-04-15T21:02:24.055 INFO:tasks.workunit.client.1.smithi149.stdout:7/50: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:24.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/68: creat dc/d11/f13 x:0 0 0 2024-04-15T21:02:24.064 INFO:tasks.workunit.client.1.smithi149.stdout:7/51: mkdir d3/d16 0 2024-04-15T21:02:24.067 INFO:tasks.workunit.client.1.smithi149.stdout:4/69: fsync f5 0 2024-04-15T21:02:24.068 INFO:tasks.workunit.client.1.smithi149.stdout:7/52: mkdir d3/d17 0 2024-04-15T21:02:24.071 INFO:tasks.workunit.client.1.smithi149.stdout:0/46: write d1/d5/fa [126895,119310] 0 2024-04-15T21:02:24.072 INFO:tasks.workunit.client.1.smithi149.stdout:0/47: chown d1/d9 285 1 2024-04-15T21:02:24.075 INFO:tasks.workunit.client.1.smithi149.stdout:9/63: write f3 [282176,39067] 0 2024-04-15T21:02:24.077 INFO:tasks.workunit.client.1.smithi149.stdout:7/53: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:24.084 INFO:tasks.workunit.client.1.smithi149.stdout:7/54: creat d3/f18 x:0 0 0 2024-04-15T21:02:24.086 INFO:tasks.workunit.client.1.smithi149.stdout:7/55: write d3/fc [2347179,6162] 0 2024-04-15T21:02:24.089 INFO:tasks.workunit.client.1.smithi149.stdout:2/136: dwrite d4/d7/f1d [0,4194304] 0 2024-04-15T21:02:24.090 INFO:tasks.workunit.client.1.smithi149.stdout:2/137: write d4/d7/f1d [4357108,1829] 0 2024-04-15T21:02:24.092 INFO:tasks.workunit.client.1.smithi149.stdout:9/64: getdents . 0 2024-04-15T21:02:24.092 INFO:tasks.workunit.client.1.smithi149.stdout:2/138: dread - d4/d7/d10/f16 zero size 2024-04-15T21:02:24.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/139: write d4/d7/da/fe [1744257,70993] 0 2024-04-15T21:02:24.095 INFO:tasks.workunit.client.1.smithi149.stdout:2/140: write d4/d7/d10/f16 [556871,52195] 0 2024-04-15T21:02:24.095 INFO:tasks.workunit.client.1.smithi149.stdout:6/60: truncate da/dc/fe 1490311 0 2024-04-15T21:02:24.097 INFO:tasks.workunit.client.1.smithi149.stdout:7/56: creat d3/d17/f19 x:0 0 0 2024-04-15T21:02:24.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/65: mknod c13 0 2024-04-15T21:02:24.101 INFO:tasks.workunit.client.1.smithi149.stdout:4/70: rename dc/d11 to dc/d14 0 2024-04-15T21:02:24.107 INFO:tasks.workunit.client.1.smithi149.stdout:9/66: rename f10 to f14 0 2024-04-15T21:02:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/61: symlink da/d11/l13 0 2024-04-15T21:02:24.109 INFO:tasks.workunit.client.1.smithi149.stdout:9/67: read ff [503907,75881] 0 2024-04-15T21:02:24.109 INFO:tasks.workunit.client.1.smithi149.stdout:4/71: dwrite dc/d14/f13 [0,4194304] 0 2024-04-15T21:02:24.110 INFO:tasks.workunit.client.1.smithi149.stdout:9/68: chown lb 66112422 1 2024-04-15T21:02:24.110 INFO:tasks.workunit.client.1.smithi149.stdout:6/62: chown da/dc/l12 2732 1 2024-04-15T21:02:24.111 INFO:tasks.workunit.client.1.smithi149.stdout:6/63: stat da/dc/l12 0 2024-04-15T21:02:24.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/72: mkdir dc/d14/d15 0 2024-04-15T21:02:24.120 INFO:tasks.workunit.client.1.smithi149.stdout:9/69: creat f15 x:0 0 0 2024-04-15T21:02:24.121 INFO:tasks.workunit.client.1.smithi149.stdout:9/70: write f15 [90479,111622] 0 2024-04-15T21:02:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:7/57: getdents d3/d17 0 2024-04-15T21:02:24.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/73: rename f3 to dc/d10/f16 0 2024-04-15T21:02:24.128 INFO:tasks.workunit.client.1.smithi149.stdout:9/71: dread f4 [0,4194304] 0 2024-04-15T21:02:24.129 INFO:tasks.workunit.client.1.smithi149.stdout:7/58: dread d3/f10 [0,4194304] 0 2024-04-15T21:02:24.130 INFO:tasks.workunit.client.1.smithi149.stdout:7/59: write d3/ff [2395453,226] 0 2024-04-15T21:02:24.135 INFO:tasks.workunit.client.1.smithi149.stdout:2/141: truncate d4/d7/da/f1c 1304478 0 2024-04-15T21:02:24.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/74: mknod dc/d14/c17 0 2024-04-15T21:02:24.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/75: write dc/d14/f13 [1282505,115205] 0 2024-04-15T21:02:24.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/72: creat f16 x:0 0 0 2024-04-15T21:02:24.139 INFO:tasks.workunit.client.1.smithi149.stdout:4/76: chown f6 32210111 1 2024-04-15T21:02:24.146 INFO:tasks.workunit.client.1.smithi149.stdout:2/142: mkdir d4/d7/d19/d21/d3b 0 2024-04-15T21:02:24.150 INFO:tasks.workunit.client.1.smithi149.stdout:9/73: unlink ce 0 2024-04-15T21:02:24.151 INFO:tasks.workunit.client.1.smithi149.stdout:4/77: mkdir dc/d18 0 2024-04-15T21:02:24.153 INFO:tasks.workunit.client.1.smithi149.stdout:6/64: getdents da 0 2024-04-15T21:02:24.153 INFO:tasks.workunit.client.1.smithi149.stdout:6/65: chown da/dc/d10 127965 1 2024-04-15T21:02:24.265 INFO:tasks.workunit.client.1.smithi149.stdout:7/60: getdents d3/d16 0 2024-04-15T21:02:24.265 INFO:tasks.workunit.client.1.smithi149.stdout:2/143: fsync d4/d7/da/f25 0 2024-04-15T21:02:24.266 INFO:tasks.workunit.client.1.smithi149.stdout:4/78: mknod dc/d14/c19 0 2024-04-15T21:02:24.267 INFO:tasks.workunit.client.1.smithi149.stdout:6/66: mknod da/dc/c14 0 2024-04-15T21:02:24.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/61: creat d3/d17/f1a x:0 0 0 2024-04-15T21:02:24.269 INFO:tasks.workunit.client.1.smithi149.stdout:4/79: mkdir dc/d1a 0 2024-04-15T21:02:24.269 INFO:tasks.workunit.client.1.smithi149.stdout:7/62: read - d3/d17/f1a zero size 2024-04-15T21:02:24.339 INFO:tasks.workunit.client.1.smithi149.stdout:5/100: sync 2024-04-15T21:02:24.340 INFO:tasks.workunit.client.1.smithi149.stdout:2/144: creat d4/d7/d29/f3c x:0 0 0 2024-04-15T21:02:24.341 INFO:tasks.workunit.client.1.smithi149.stdout:6/67: rename da/dc/cd to da/d11/c15 0 2024-04-15T21:02:24.343 INFO:tasks.workunit.client.1.smithi149.stdout:7/63: mknod d3/d17/c1b 0 2024-04-15T21:02:24.344 INFO:tasks.workunit.client.1.smithi149.stdout:5/101: chown d0/d6/d14/d1b/f1f 7 1 2024-04-15T21:02:24.344 INFO:tasks.workunit.client.1.smithi149.stdout:9/74: dwrite f0 [0,4194304] 0 2024-04-15T21:02:24.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/80: dread dc/fd [0,4194304] 0 2024-04-15T21:02:24.349 INFO:tasks.workunit.client.1.smithi149.stdout:4/81: write f6 [42410,54921] 0 2024-04-15T21:02:24.351 INFO:tasks.workunit.client.1.smithi149.stdout:5/102: mknod d0/d9/db/d12/d16/c26 0 2024-04-15T21:02:24.354 INFO:tasks.workunit.client.1.smithi149.stdout:7/64: link d3/d17/c1b d3/d16/c1c 0 2024-04-15T21:02:24.359 INFO:tasks.workunit.client.1.smithi149.stdout:7/65: chown d3/ff 1 1 2024-04-15T21:02:24.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/103: write d0/d9/db/f10 [49309,42331] 0 2024-04-15T21:02:24.364 INFO:tasks.workunit.client.1.smithi149.stdout:2/145: dwrite d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:7/66: dread - d3/f7 zero size 2024-04-15T21:02:24.370 INFO:tasks.workunit.client.1.smithi149.stdout:9/75: dwrite f4 [4194304,4194304] 0 2024-04-15T21:02:24.370 INFO:tasks.workunit.client.1.smithi149.stdout:6/68: dwrite f6 [4194304,4194304] 0 2024-04-15T21:02:24.373 INFO:tasks.workunit.client.1.smithi149.stdout:9/76: read f15 [112295,10834] 0 2024-04-15T21:02:24.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/82: dread f2 [0,4194304] 0 2024-04-15T21:02:24.379 INFO:tasks.workunit.client.1.smithi149.stdout:4/83: read f2 [3416774,10146] 0 2024-04-15T21:02:24.388 INFO:tasks.workunit.client.1.smithi149.stdout:5/104: creat d0/d9/db/d12/f27 x:0 0 0 2024-04-15T21:02:24.390 INFO:tasks.workunit.client.1.smithi149.stdout:9/77: unlink f7 0 2024-04-15T21:02:24.391 INFO:tasks.workunit.client.1.smithi149.stdout:2/146: dwrite d4/d7/d29/f3c [0,4194304] 0 2024-04-15T21:02:24.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/67: mknod d3/d16/c1d 0 2024-04-15T21:02:24.392 INFO:tasks.workunit.client.1.smithi149.stdout:6/69: dread f8 [0,4194304] 0 2024-04-15T21:02:24.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/105: dread - d0/d6/d14/d1b/f20 zero size 2024-04-15T21:02:24.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/68: chown d3/d16 584213173 1 2024-04-15T21:02:24.395 INFO:tasks.workunit.client.1.smithi149.stdout:9/78: dread f3 [0,4194304] 0 2024-04-15T21:02:24.406 INFO:tasks.workunit.client.1.smithi149.stdout:9/79: dwrite f9 [0,4194304] 0 2024-04-15T21:02:24.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/80: chown f11 5781 1 2024-04-15T21:02:24.408 INFO:tasks.workunit.client.1.smithi149.stdout:2/147: rmdir d4 39 2024-04-15T21:02:24.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/69: unlink d3/l12 0 2024-04-15T21:02:24.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/70: fdatasync d3/fb 0 2024-04-15T21:02:24.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/71: stat d3/d17 0 2024-04-15T21:02:24.416 INFO:tasks.workunit.client.1.smithi149.stdout:5/106: rename d0/d6/d14 to d0/d9/db/d12/d16/d28 0 2024-04-15T21:02:24.418 INFO:tasks.workunit.client.1.smithi149.stdout:7/72: dread d3/f9 [0,4194304] 0 2024-04-15T21:02:24.419 INFO:tasks.workunit.client.1.smithi149.stdout:5/107: read d0/d9/db/f10 [45866,10677] 0 2024-04-15T21:02:24.420 INFO:tasks.workunit.client.1.smithi149.stdout:5/108: write d0/d9/db/d12/d16/d28/f19 [527824,30290] 0 2024-04-15T21:02:24.434 INFO:tasks.workunit.client.1.smithi149.stdout:1/63: sync 2024-04-15T21:02:24.434 INFO:tasks.workunit.client.1.smithi149.stdout:1/64: stat d1/f7 0 2024-04-15T21:02:24.477 INFO:tasks.workunit.client.1.smithi149.stdout:6/70: mkdir da/dc/d10/d16 0 2024-04-15T21:02:24.481 INFO:tasks.workunit.client.1.smithi149.stdout:5/109: creat d0/d9/db/d12/f29 x:0 0 0 2024-04-15T21:02:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:2/148: symlink d4/d7/d29/l3d 0 2024-04-15T21:02:24.486 INFO:tasks.workunit.client.1.smithi149.stdout:1/65: mkdir d1/db/dc/d11 0 2024-04-15T21:02:24.493 INFO:tasks.workunit.client.1.smithi149.stdout:5/110: dwrite d0/d9/db/d12/f29 [0,4194304] 0 2024-04-15T21:02:24.500 INFO:tasks.workunit.client.1.smithi149.stdout:2/149: dwrite d4/d7/d10/f16 [0,4194304] 0 2024-04-15T21:02:24.500 INFO:tasks.workunit.client.1.smithi149.stdout:1/66: dread d1/f5 [0,4194304] 0 2024-04-15T21:02:24.501 INFO:tasks.workunit.client.1.smithi149.stdout:6/71: rename da/dc/fe to da/f17 0 2024-04-15T21:02:24.502 INFO:tasks.workunit.client.1.smithi149.stdout:1/67: write d1/f7 [447677,10776] 0 2024-04-15T21:02:24.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/68: write d1/da/fd [649416,11130] 0 2024-04-15T21:02:24.508 INFO:tasks.workunit.client.1.smithi149.stdout:5/111: mknod d0/d9/db/d12/d16/c2a 0 2024-04-15T21:02:24.509 INFO:tasks.workunit.client.1.smithi149.stdout:5/112: write d0/d9/f22 [288472,83415] 0 2024-04-15T21:02:24.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/150: mkdir d4/d7/d19/d21/d2c/d3e 0 2024-04-15T21:02:24.523 INFO:tasks.workunit.client.1.smithi149.stdout:5/113: mkdir d0/d9/db/d12/d2b 0 2024-04-15T21:02:24.525 INFO:tasks.workunit.client.1.smithi149.stdout:2/151: rename d4/f1a to d4/d7/d19/d21/d3b/f3f 0 2024-04-15T21:02:24.529 INFO:tasks.workunit.client.1.smithi149.stdout:1/69: unlink d1/db/le 0 2024-04-15T21:02:24.532 INFO:tasks.workunit.client.1.smithi149.stdout:5/114: readlink d0/d9/db/l25 0 2024-04-15T21:02:24.533 INFO:tasks.workunit.client.1.smithi149.stdout:9/81: getdents . 0 2024-04-15T21:02:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:9/82: chown f16 5497225 1 2024-04-15T21:02:24.535 INFO:tasks.workunit.client.1.smithi149.stdout:2/152: unlink d4/f2e 0 2024-04-15T21:02:24.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/153: chown d4/d7/da/f25 1369397 1 2024-04-15T21:02:24.541 INFO:tasks.workunit.client.1.smithi149.stdout:9/83: creat f17 x:0 0 0 2024-04-15T21:02:24.547 INFO:tasks.workunit.client.1.smithi149.stdout:9/84: unlink f14 0 2024-04-15T21:02:24.550 INFO:tasks.workunit.client.1.smithi149.stdout:2/154: creat d4/d7/d2f/f40 x:0 0 0 2024-04-15T21:02:24.552 INFO:tasks.workunit.client.1.smithi149.stdout:4/84: truncate dc/d14/f13 2646521 0 2024-04-15T21:02:24.554 INFO:tasks.workunit.client.1.smithi149.stdout:9/85: unlink f0 0 2024-04-15T21:02:24.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/155: dwrite d4/f33 [0,4194304] 0 2024-04-15T21:02:24.567 INFO:tasks.workunit.client.1.smithi149.stdout:4/85: chown dc/d14/f13 32461 1 2024-04-15T21:02:24.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/156: creat d4/d7/d19/d21/d3b/f41 x:0 0 0 2024-04-15T21:02:24.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/157: mknod d4/d7/d19/d21/d3b/c42 0 2024-04-15T21:02:24.575 INFO:tasks.workunit.client.1.smithi149.stdout:4/86: getdents dc/d18 0 2024-04-15T21:02:24.576 INFO:tasks.workunit.client.0.smithi072.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-15T21:02:24.576 INFO:tasks.workunit.client.1.smithi149.stdout:4/87: chown fa 45799 1 2024-04-15T21:02:24.576 INFO:tasks.workunit.client.1.smithi149.stdout:4/88: chown dc/d10/f16 147357 1 2024-04-15T21:02:24.578 INFO:tasks.workunit.client.1.smithi149.stdout:2/158: link d4/f33 d4/d7/d19/d21/d3b/f43 0 2024-04-15T21:02:24.579 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T21:02:24.580 INFO:tasks.workunit.client.0.smithi072.stderr:+ make 2024-04-15T21:02:24.581 INFO:tasks.workunit.client.1.smithi149.stdout:6/72: rename da/dc to da/d18 0 2024-04-15T21:02:24.582 INFO:tasks.workunit.client.1.smithi149.stdout:6/73: fdatasync f6 0 2024-04-15T21:02:24.582 INFO:tasks.workunit.client.1.smithi149.stdout:4/89: mknod dc/d14/d15/c1b 0 2024-04-15T21:02:24.591 INFO:tasks.workunit.client.1.smithi149.stdout:4/90: dwrite f6 [0,4194304] 0 2024-04-15T21:02:24.600 INFO:tasks.workunit.client.1.smithi149.stdout:1/70: write d1/f8 [214916,7802] 0 2024-04-15T21:02:24.600 INFO:tasks.workunit.client.1.smithi149.stdout:4/91: link c0 dc/d14/d15/c1c 0 2024-04-15T21:02:24.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/71: write d1/f7 [603145,90479] 0 2024-04-15T21:02:24.603 INFO:tasks.workunit.client.1.smithi149.stdout:4/92: dread dc/fd [0,4194304] 0 2024-04-15T21:02:24.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/48: sync 2024-04-15T21:02:24.614 INFO:tasks.workunit.client.1.smithi149.stdout:8/77: sync 2024-04-15T21:02:24.614 INFO:tasks.workunit.client.1.smithi149.stdout:3/85: sync 2024-04-15T21:02:24.615 INFO:tasks.workunit.client.1.smithi149.stdout:8/78: stat d2/fe 0 2024-04-15T21:02:24.617 INFO:tasks.workunit.client.1.smithi149.stdout:3/86: fsync d1/dc/f13 0 2024-04-15T21:02:24.617 INFO:tasks.workunit.client.1.smithi149.stdout:9/86: dwrite f3 [0,4194304] 0 2024-04-15T21:02:24.620 INFO:tasks.workunit.client.1.smithi149.stdout:4/93: creat dc/d18/f1d x:0 0 0 2024-04-15T21:02:24.621 INFO:tasks.workunit.client.1.smithi149.stdout:4/94: dread - dc/d18/f1d zero size 2024-04-15T21:02:24.623 INFO:tasks.workunit.client.1.smithi149.stdout:3/87: dread d1/fa [0,4194304] 0 2024-04-15T21:02:24.624 INFO:tasks.workunit.client.1.smithi149.stdout:3/88: write d1/fd [463252,99285] 0 2024-04-15T21:02:24.634 INFO:tasks.workunit.client.1.smithi149.stdout:8/79: mknod d2/c1e 0 2024-04-15T21:02:24.636 INFO:tasks.workunit.client.1.smithi149.stdout:0/49: rename d1/d5/fa to d1/d9/fd 0 2024-04-15T21:02:24.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/72: link d1/c2 d1/db/dc/d11/c12 0 2024-04-15T21:02:24.639 INFO:tasks.workunit.client.1.smithi149.stdout:0/50: write d1/f4 [2191779,116134] 0 2024-04-15T21:02:24.640 INFO:tasks.workunit.client.1.smithi149.stdout:9/87: truncate f9 4782106 0 2024-04-15T21:02:24.642 INFO:tasks.workunit.client.1.smithi149.stdout:4/95: symlink dc/d14/d15/l1e 0 2024-04-15T21:02:24.646 INFO:tasks.workunit.client.1.smithi149.stdout:6/74: dwrite da/f17 [0,4194304] 0 2024-04-15T21:02:24.649 INFO:tasks.workunit.client.1.smithi149.stdout:8/80: dread d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:24.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/96: rename dc/d10/f16 to dc/d18/f1f 0 2024-04-15T21:02:24.657 INFO:tasks.workunit.client.1.smithi149.stdout:0/51: dwrite d1/d9/fd [0,4194304] 0 2024-04-15T21:02:24.659 INFO:tasks.workunit.client.1.smithi149.stdout:0/52: write d1/d9/fd [2472000,114506] 0 2024-04-15T21:02:24.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/53: chown d1/d9/lb 76776118 1 2024-04-15T21:02:24.668 INFO:tasks.workunit.client.0.smithi072.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-15T21:02:24.716 INFO:tasks.workunit.client.1.smithi149.stdout:1/73: mknod d1/db/dc/d11/c13 0 2024-04-15T21:02:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:9/88: symlink l18 0 2024-04-15T21:02:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:3/89: rmdir d1/dc/df 0 2024-04-15T21:02:24.718 INFO:tasks.workunit.client.1.smithi149.stdout:6/75: link da/f17 da/d18/f19 0 2024-04-15T21:02:24.718 INFO:tasks.workunit.client.1.smithi149.stdout:1/74: dread - d1/db/dc/f10 zero size 2024-04-15T21:02:24.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/90: unlink d1/dc/f13 0 2024-04-15T21:02:24.722 INFO:tasks.workunit.client.1.smithi149.stdout:6/76: creat da/d11/f1a x:0 0 0 2024-04-15T21:02:24.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/54: link l0 d1/d5/le 0 2024-04-15T21:02:24.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/91: rename d1/c8 to d1/dc/c16 0 2024-04-15T21:02:24.727 INFO:tasks.workunit.client.1.smithi149.stdout:6/77: creat da/f1b x:0 0 0 2024-04-15T21:02:24.727 INFO:tasks.workunit.client.1.smithi149.stdout:4/97: getdents dc/d18 0 2024-04-15T21:02:24.729 INFO:tasks.workunit.client.1.smithi149.stdout:0/55: mkdir d1/d9/df 0 2024-04-15T21:02:24.730 INFO:tasks.workunit.client.1.smithi149.stdout:0/56: stat d1/l6 0 2024-04-15T21:02:24.732 INFO:tasks.workunit.client.1.smithi149.stdout:9/89: rename lb to l19 0 2024-04-15T21:02:24.734 INFO:tasks.workunit.client.1.smithi149.stdout:0/57: mkdir d1/d9/d10 0 2024-04-15T21:02:24.735 INFO:tasks.workunit.client.1.smithi149.stdout:1/75: write d1/f3 [3277210,53681] 0 2024-04-15T21:02:24.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/76: chown d1/f8 5 1 2024-04-15T21:02:24.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/77: truncate d1/f8 957125 0 2024-04-15T21:02:24.738 INFO:tasks.workunit.client.1.smithi149.stdout:0/58: creat d1/f11 x:0 0 0 2024-04-15T21:02:24.739 INFO:tasks.workunit.client.1.smithi149.stdout:1/78: read d1/f9 [3554725,17349] 0 2024-04-15T21:02:24.742 INFO:tasks.workunit.client.1.smithi149.stdout:3/92: getdents d1 0 2024-04-15T21:02:24.743 INFO:tasks.workunit.client.1.smithi149.stdout:1/79: dread d1/f9 [0,4194304] 0 2024-04-15T21:02:24.744 INFO:tasks.workunit.client.1.smithi149.stdout:6/78: getdents da 0 2024-04-15T21:02:24.744 INFO:tasks.workunit.client.1.smithi149.stdout:6/79: stat da/f1b 0 2024-04-15T21:02:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:9/90: rename f15 to f1a 0 2024-04-15T21:02:24.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/93: symlink d1/l17 0 2024-04-15T21:02:24.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/80: mkdir d1/db/d14 0 2024-04-15T21:02:24.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/94: dwrite d1/fd [0,4194304] 0 2024-04-15T21:02:24.756 INFO:tasks.workunit.client.1.smithi149.stdout:3/95: truncate d1/fd 4628157 0 2024-04-15T21:02:24.757 INFO:tasks.workunit.client.1.smithi149.stdout:9/91: write f16 [574277,83747] 0 2024-04-15T21:02:24.759 INFO:tasks.workunit.client.1.smithi149.stdout:0/59: truncate d1/f4 846528 0 2024-04-15T21:02:24.763 INFO:tasks.workunit.client.1.smithi149.stdout:9/92: read f16 [218515,47439] 0 2024-04-15T21:02:24.764 INFO:tasks.workunit.client.1.smithi149.stdout:6/80: link da/d18/f19 da/d18/d10/f1c 0 2024-04-15T21:02:24.766 INFO:tasks.workunit.client.1.smithi149.stdout:3/96: symlink d1/l18 0 2024-04-15T21:02:24.768 INFO:tasks.workunit.client.1.smithi149.stdout:0/60: creat d1/d5/f12 x:0 0 0 2024-04-15T21:02:24.769 INFO:tasks.workunit.client.1.smithi149.stdout:0/61: write d1/d9/fd [2932616,100571] 0 2024-04-15T21:02:24.769 INFO:tasks.workunit.client.1.smithi149.stdout:1/81: mkdir d1/db/d14/d15 0 2024-04-15T21:02:24.771 INFO:tasks.workunit.client.1.smithi149.stdout:0/62: truncate d1/f11 554383 0 2024-04-15T21:02:24.771 INFO:tasks.workunit.client.1.smithi149.stdout:1/82: write d1/f5 [2311428,69176] 0 2024-04-15T21:02:24.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/81: creat da/d11/f1d x:0 0 0 2024-04-15T21:02:24.772 INFO:tasks.workunit.client.1.smithi149.stdout:0/63: write d1/f11 [1520949,21279] 0 2024-04-15T21:02:24.773 INFO:tasks.workunit.client.1.smithi149.stdout:0/64: chown d1 8103 1 2024-04-15T21:02:24.773 INFO:tasks.workunit.client.1.smithi149.stdout:3/97: rmdir d1 39 2024-04-15T21:02:24.773 INFO:tasks.workunit.client.1.smithi149.stdout:6/82: dread - da/d11/f1a zero size 2024-04-15T21:02:24.779 INFO:tasks.workunit.client.1.smithi149.stdout:1/83: mkdir d1/db/d16 0 2024-04-15T21:02:24.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/84: write d1/f8 [1555167,53095] 0 2024-04-15T21:02:24.783 INFO:tasks.workunit.client.1.smithi149.stdout:6/83: symlink da/l1e 0 2024-04-15T21:02:24.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/98: dread d1/fa [0,4194304] 0 2024-04-15T21:02:24.786 INFO:tasks.workunit.client.1.smithi149.stdout:1/85: dread d1/f8 [0,4194304] 0 2024-04-15T21:02:24.788 INFO:tasks.workunit.client.1.smithi149.stdout:0/65: mkdir d1/d9/d10/d13 0 2024-04-15T21:02:24.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/86: dread d1/f7 [0,4194304] 0 2024-04-15T21:02:24.790 INFO:tasks.workunit.client.1.smithi149.stdout:9/93: rename ff to f1b 0 2024-04-15T21:02:24.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/87: chown d1/db/d14 86712941 1 2024-04-15T21:02:24.791 INFO:tasks.workunit.client.1.smithi149.stdout:1/88: chown d1/db/d16 15 1 2024-04-15T21:02:24.791 INFO:tasks.workunit.client.1.smithi149.stdout:1/89: chown d1/db/dc 33959875 1 2024-04-15T21:02:24.791 INFO:tasks.workunit.client.1.smithi149.stdout:1/90: chown d1/f6 957 1 2024-04-15T21:02:24.792 INFO:tasks.workunit.client.1.smithi149.stdout:6/84: creat da/d18/f1f x:0 0 0 2024-04-15T21:02:24.798 INFO:tasks.workunit.client.1.smithi149.stdout:0/66: rmdir d1/d9/d10 39 2024-04-15T21:02:24.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/67: truncate d1/d9/fd 4362988 0 2024-04-15T21:02:24.801 INFO:tasks.workunit.client.1.smithi149.stdout:9/94: write f1b [1689374,46812] 0 2024-04-15T21:02:24.801 INFO:tasks.workunit.client.1.smithi149.stdout:1/91: stat d1/db/dc/d11/c12 0 2024-04-15T21:02:24.804 INFO:tasks.workunit.client.1.smithi149.stdout:6/85: rename da/d18/c14 to da/d18/d10/c20 0 2024-04-15T21:02:24.807 INFO:tasks.workunit.client.1.smithi149.stdout:0/68: dwrite d1/d5/f12 [0,4194304] 0 2024-04-15T21:02:24.809 INFO:tasks.workunit.client.1.smithi149.stdout:1/92: dread d1/da/fd [0,4194304] 0 2024-04-15T21:02:24.809 INFO:tasks.workunit.client.1.smithi149.stdout:9/95: fsync f11 0 2024-04-15T21:02:24.810 INFO:tasks.workunit.client.1.smithi149.stdout:1/93: write d1/da/fd [4967207,26173] 0 2024-04-15T21:02:24.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/96: chown f3 350044 1 2024-04-15T21:02:24.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/94: write d1/f6 [1746826,81314] 0 2024-04-15T21:02:24.828 INFO:tasks.workunit.client.1.smithi149.stdout:3/99: link d1/c10 d1/dc/c19 0 2024-04-15T21:02:24.837 INFO:tasks.workunit.client.1.smithi149.stdout:6/86: rmdir da/d11 39 2024-04-15T21:02:24.840 INFO:tasks.workunit.client.1.smithi149.stdout:0/69: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:24.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/100: rename d1/c2 to d1/c1a 0 2024-04-15T21:02:24.849 INFO:tasks.workunit.client.1.smithi149.stdout:3/101: creat d1/dc/f1b x:0 0 0 2024-04-15T21:02:24.851 INFO:tasks.workunit.client.1.smithi149.stdout:6/87: creat da/d18/d10/d16/f21 x:0 0 0 2024-04-15T21:02:24.852 INFO:tasks.workunit.client.1.smithi149.stdout:9/97: rename l12 to l1c 0 2024-04-15T21:02:24.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/88: dread - da/d11/f1a zero size 2024-04-15T21:02:24.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/89: dread - da/f1b zero size 2024-04-15T21:02:24.858 INFO:tasks.workunit.client.1.smithi149.stdout:6/90: fsync da/f1b 0 2024-04-15T21:02:24.865 INFO:tasks.workunit.client.1.smithi149.stdout:6/91: dwrite da/ff [0,4194304] 0 2024-04-15T21:02:24.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/95: truncate d1/f8 609237 0 2024-04-15T21:02:24.899 INFO:tasks.workunit.client.1.smithi149.stdout:1/96: mkdir d1/d17 0 2024-04-15T21:02:24.902 INFO:tasks.workunit.client.1.smithi149.stdout:9/98: readlink l1c 0 2024-04-15T21:02:24.905 INFO:tasks.workunit.client.1.smithi149.stdout:1/97: mknod d1/d17/c18 0 2024-04-15T21:02:24.906 INFO:tasks.workunit.client.1.smithi149.stdout:9/99: dread f3 [0,4194304] 0 2024-04-15T21:02:24.912 INFO:tasks.workunit.client.1.smithi149.stdout:3/102: dwrite d1/fa [4194304,4194304] 0 2024-04-15T21:02:24.915 INFO:tasks.workunit.client.1.smithi149.stdout:1/98: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:24.929 INFO:tasks.workunit.client.1.smithi149.stdout:3/103: creat d1/db/f1c x:0 0 0 2024-04-15T21:02:24.930 INFO:tasks.workunit.client.1.smithi149.stdout:3/104: dread - d1/dc/f1b zero size 2024-04-15T21:02:24.931 INFO:tasks.workunit.client.1.smithi149.stdout:6/92: dwrite da/d18/f19 [0,4194304] 0 2024-04-15T21:02:24.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/100: creat f1d x:0 0 0 2024-04-15T21:02:24.935 INFO:tasks.workunit.client.1.smithi149.stdout:6/93: rmdir da 39 2024-04-15T21:02:24.939 INFO:tasks.workunit.client.1.smithi149.stdout:1/99: fsync d1/f5 0 2024-04-15T21:02:24.939 INFO:tasks.workunit.client.1.smithi149.stdout:9/101: mknod c1e 0 2024-04-15T21:02:24.940 INFO:tasks.workunit.client.1.smithi149.stdout:1/100: chown d1/db/d16 267163216 1 2024-04-15T21:02:24.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/94: dread da/f17 [0,4194304] 0 2024-04-15T21:02:24.944 INFO:tasks.workunit.client.1.smithi149.stdout:9/102: fsync f16 0 2024-04-15T21:02:24.947 INFO:tasks.workunit.client.1.smithi149.stdout:1/101: symlink d1/d17/l19 0 2024-04-15T21:02:24.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/95: creat da/d11/f22 x:0 0 0 2024-04-15T21:02:24.955 INFO:tasks.workunit.client.1.smithi149.stdout:1/102: mkdir d1/d17/d1a 0 2024-04-15T21:02:24.957 INFO:tasks.workunit.client.1.smithi149.stdout:6/96: rename da/f17 to da/d18/f23 0 2024-04-15T21:02:24.962 INFO:tasks.workunit.client.1.smithi149.stdout:1/103: fsync d1/f3 0 2024-04-15T21:02:24.965 INFO:tasks.workunit.client.1.smithi149.stdout:6/97: unlink f6 0 2024-04-15T21:02:24.966 INFO:tasks.workunit.client.1.smithi149.stdout:6/98: dread - da/d11/f22 zero size 2024-04-15T21:02:24.966 INFO:tasks.workunit.client.1.smithi149.stdout:7/73: sync 2024-04-15T21:02:24.966 INFO:tasks.workunit.client.1.smithi149.stdout:5/115: sync 2024-04-15T21:02:24.966 INFO:tasks.workunit.client.1.smithi149.stdout:6/99: chown c7 268 1 2024-04-15T21:02:24.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/116: write d0/f11 [302223,47229] 0 2024-04-15T21:02:24.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/103: creat f1f x:0 0 0 2024-04-15T21:02:24.969 INFO:tasks.workunit.client.1.smithi149.stdout:9/104: rmdir - no directory 2024-04-15T21:02:24.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/100: write da/d18/f23 [1542156,100311] 0 2024-04-15T21:02:24.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/101: fdatasync da/d11/f1a 0 2024-04-15T21:02:24.981 INFO:tasks.workunit.client.1.smithi149.stdout:5/117: rename d0/d9/l13 to d0/d9/l2c 0 2024-04-15T21:02:24.981 INFO:tasks.workunit.client.1.smithi149.stdout:5/118: truncate d0/d6/fe 969237 0 2024-04-15T21:02:24.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/119: dread d0/d6/fe [0,4194304] 0 2024-04-15T21:02:24.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/120: chown d0/d9/db/l25 2452 1 2024-04-15T21:02:24.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/105: symlink l20 0 2024-04-15T21:02:24.991 INFO:tasks.workunit.client.1.smithi149.stdout:5/121: mkdir d0/d6/d2d 0 2024-04-15T21:02:24.992 INFO:tasks.workunit.client.1.smithi149.stdout:9/106: dwrite f1d [0,4194304] 0 2024-04-15T21:02:24.994 INFO:tasks.workunit.client.1.smithi149.stdout:6/102: creat da/f24 x:0 0 0 2024-04-15T21:02:25.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/122: rename d0/f11 to d0/d9/db/f2e 0 2024-04-15T21:02:25.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/103: rmdir da/d11 39 2024-04-15T21:02:25.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/104: stat l3 0 2024-04-15T21:02:25.007 INFO:tasks.workunit.client.1.smithi149.stdout:6/105: stat da/d18/f23 0 2024-04-15T21:02:25.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/106: write da/d18/f23 [924047,47108] 0 2024-04-15T21:02:25.015 INFO:tasks.workunit.client.1.smithi149.stdout:5/123: symlink d0/d9/db/d12/l2f 0 2024-04-15T21:02:25.017 INFO:tasks.workunit.client.1.smithi149.stdout:6/107: dwrite da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:25.023 INFO:tasks.workunit.client.1.smithi149.stdout:5/124: mknod d0/d9/db/d12/d16/d28/c30 0 2024-04-15T21:02:25.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/125: chown d0/d9/db/d12/d16/c2a 4 1 2024-04-15T21:02:25.026 INFO:tasks.workunit.client.1.smithi149.stdout:6/108: chown da/d11/f22 5 1 2024-04-15T21:02:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:7/74: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:25.037 INFO:tasks.workunit.client.1.smithi149.stdout:6/109: symlink da/d18/d10/d16/l25 0 2024-04-15T21:02:25.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/110: truncate da/f1b 759738 0 2024-04-15T21:02:25.043 INFO:tasks.workunit.client.1.smithi149.stdout:7/75: truncate d3/f9 1407473 0 2024-04-15T21:02:25.044 INFO:tasks.workunit.client.1.smithi149.stdout:7/76: write d3/fd [890408,130411] 0 2024-04-15T21:02:25.055 INFO:tasks.workunit.client.1.smithi149.stdout:6/111: creat da/f26 x:0 0 0 2024-04-15T21:02:25.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/112: dwrite da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:25.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/113: write da/d18/d10/d16/f21 [524052,118372] 0 2024-04-15T21:02:25.066 INFO:tasks.workunit.client.1.smithi149.stdout:6/114: write da/f1b [271238,4235] 0 2024-04-15T21:02:25.067 INFO:tasks.workunit.client.1.smithi149.stdout:9/107: dwrite f4 [4194304,4194304] 0 2024-04-15T21:02:25.076 INFO:tasks.workunit.client.1.smithi149.stdout:5/126: rmdir d0/d9/db/d12 39 2024-04-15T21:02:25.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/115: mknod da/d11/c27 0 2024-04-15T21:02:25.079 INFO:tasks.workunit.client.1.smithi149.stdout:6/116: rename da/d18/d10/d16 to da/d18/d10/d16/d28 22 2024-04-15T21:02:25.084 INFO:tasks.workunit.client.1.smithi149.stdout:9/108: creat f21 x:0 0 0 2024-04-15T21:02:25.086 INFO:tasks.workunit.client.1.smithi149.stdout:6/117: creat da/d18/d10/d16/f29 x:0 0 0 2024-04-15T21:02:25.086 INFO:tasks.workunit.client.1.smithi149.stdout:1/104: dwrite d1/f8 [0,4194304] 0 2024-04-15T21:02:25.090 INFO:tasks.workunit.client.1.smithi149.stdout:5/127: symlink d0/d9/db/d12/l31 0 2024-04-15T21:02:25.099 INFO:tasks.workunit.client.1.smithi149.stdout:1/105: symlink d1/db/dc/l1b 0 2024-04-15T21:02:25.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/109: creat f22 x:0 0 0 2024-04-15T21:02:25.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/106: dwrite d1/f9 [0,4194304] 0 2024-04-15T21:02:25.110 INFO:tasks.workunit.client.1.smithi149.stdout:1/107: creat d1/d17/f1c x:0 0 0 2024-04-15T21:02:25.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/118: getdents da 0 2024-04-15T21:02:25.115 INFO:tasks.workunit.client.1.smithi149.stdout:9/110: mkdir d23 0 2024-04-15T21:02:25.116 INFO:tasks.workunit.client.1.smithi149.stdout:9/111: chown l18 22594634 1 2024-04-15T21:02:25.118 INFO:tasks.workunit.client.1.smithi149.stdout:8/81: sync 2024-04-15T21:02:25.118 INFO:tasks.workunit.client.1.smithi149.stdout:2/159: sync 2024-04-15T21:02:25.119 INFO:tasks.workunit.client.1.smithi149.stdout:2/160: readlink d4/l28 0 2024-04-15T21:02:25.119 INFO:tasks.workunit.client.1.smithi149.stdout:6/119: symlink da/l2a 0 2024-04-15T21:02:25.121 INFO:tasks.workunit.client.1.smithi149.stdout:1/108: dwrite d1/d17/f1c [0,4194304] 0 2024-04-15T21:02:25.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/161: chown d4/d7/d29 50324558 1 2024-04-15T21:02:25.125 INFO:tasks.workunit.client.1.smithi149.stdout:9/112: chown f17 12 1 2024-04-15T21:02:25.132 INFO:tasks.workunit.client.1.smithi149.stdout:7/77: dwrite d3/f9 [0,4194304] 0 2024-04-15T21:02:25.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/162: creat d4/d7/d19/d21/d3b/f44 x:0 0 0 2024-04-15T21:02:25.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/82: dwrite d2/f1b [0,4194304] 0 2024-04-15T21:02:25.143 INFO:tasks.workunit.client.1.smithi149.stdout:2/163: dread - d4/d7/d19/f24 zero size 2024-04-15T21:02:25.145 INFO:tasks.workunit.client.1.smithi149.stdout:2/164: write d4/d7/da/f25 [3047581,120469] 0 2024-04-15T21:02:25.150 INFO:tasks.workunit.client.1.smithi149.stdout:2/165: write d4/d7/d19/d21/d3b/f41 [544492,77607] 0 2024-04-15T21:02:25.150 INFO:tasks.workunit.client.1.smithi149.stdout:7/78: symlink d3/l1e 0 2024-04-15T21:02:25.152 INFO:tasks.workunit.client.1.smithi149.stdout:2/166: chown d4 555314717 1 2024-04-15T21:02:25.157 INFO:tasks.workunit.client.1.smithi149.stdout:9/113: creat d23/f24 x:0 0 0 2024-04-15T21:02:25.157 INFO:tasks.workunit.client.1.smithi149.stdout:8/83: dwrite d2/f4 [4194304,4194304] 0 2024-04-15T21:02:25.159 INFO:tasks.workunit.client.1.smithi149.stdout:8/84: write d2/f1b [2940105,88641] 0 2024-04-15T21:02:25.160 INFO:tasks.workunit.client.1.smithi149.stdout:8/85: chown d2/df/d10/f11 5 1 2024-04-15T21:02:25.160 INFO:tasks.workunit.client.1.smithi149.stdout:8/86: stat d2/df/d10/f19 0 2024-04-15T21:02:25.167 INFO:tasks.workunit.client.1.smithi149.stdout:7/79: mkdir d3/d17/d1f 0 2024-04-15T21:02:25.168 INFO:tasks.workunit.client.1.smithi149.stdout:8/87: dread d2/fe [0,4194304] 0 2024-04-15T21:02:25.169 INFO:tasks.workunit.client.1.smithi149.stdout:8/88: write d2/fe [1708518,97268] 0 2024-04-15T21:02:25.174 INFO:tasks.workunit.client.1.smithi149.stdout:6/120: write da/ff [1751020,4343] 0 2024-04-15T21:02:25.174 INFO:tasks.workunit.client.1.smithi149.stdout:1/109: write d1/f7 [1525760,84647] 0 2024-04-15T21:02:25.176 INFO:tasks.workunit.client.1.smithi149.stdout:6/121: chown c0 18 1 2024-04-15T21:02:25.182 INFO:tasks.workunit.client.1.smithi149.stdout:7/80: mkdir d3/d16/d20 0 2024-04-15T21:02:25.183 INFO:tasks.workunit.client.1.smithi149.stdout:2/167: dwrite d4/f33 [0,4194304] 0 2024-04-15T21:02:25.185 INFO:tasks.workunit.client.1.smithi149.stdout:8/89: creat d2/f1f x:0 0 0 2024-04-15T21:02:25.185 INFO:tasks.workunit.client.1.smithi149.stdout:7/81: write d3/fb [131393,2143] 0 2024-04-15T21:02:25.191 INFO:tasks.workunit.client.1.smithi149.stdout:7/82: truncate d3/f7 919262 0 2024-04-15T21:02:25.192 INFO:tasks.workunit.client.1.smithi149.stdout:1/110: dwrite d1/f3 [0,4194304] 0 2024-04-15T21:02:25.200 INFO:tasks.workunit.client.1.smithi149.stdout:9/114: write f16 [1485246,105867] 0 2024-04-15T21:02:25.205 INFO:tasks.workunit.client.1.smithi149.stdout:8/90: rename d2/df/d1d to d2/df/d10/d20 0 2024-04-15T21:02:25.209 INFO:tasks.workunit.client.1.smithi149.stdout:9/115: dwrite f1f [0,4194304] 0 2024-04-15T21:02:25.212 INFO:tasks.workunit.client.1.smithi149.stdout:6/122: unlink da/d18/f1f 0 2024-04-15T21:02:25.212 INFO:tasks.workunit.client.1.smithi149.stdout:2/168: getdents d4/d7/d19/d21/d2c/d3e 0 2024-04-15T21:02:25.214 INFO:tasks.workunit.client.1.smithi149.stdout:2/169: read d4/f18 [89629,124930] 0 2024-04-15T21:02:25.216 INFO:tasks.workunit.client.1.smithi149.stdout:2/170: truncate d4/d7/d19/f24 583609 0 2024-04-15T21:02:25.217 INFO:tasks.workunit.client.1.smithi149.stdout:2/171: dread - d4/d7/d2f/f40 zero size 2024-04-15T21:02:25.219 INFO:tasks.workunit.client.1.smithi149.stdout:2/172: read d4/d7/d29/f30 [1383953,83407] 0 2024-04-15T21:02:25.219 INFO:tasks.workunit.client.1.smithi149.stdout:2/173: readlink d4/d7/d29/l3d 0 2024-04-15T21:02:25.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/116: symlink d23/l25 0 2024-04-15T21:02:25.224 INFO:tasks.workunit.client.1.smithi149.stdout:3/105: sync 2024-04-15T21:02:25.224 INFO:tasks.workunit.client.1.smithi149.stdout:4/98: sync 2024-04-15T21:02:25.225 INFO:tasks.workunit.client.1.smithi149.stdout:0/70: sync 2024-04-15T21:02:25.225 INFO:tasks.workunit.client.1.smithi149.stdout:6/123: mknod da/d18/c2b 0 2024-04-15T21:02:25.228 INFO:tasks.workunit.client.1.smithi149.stdout:9/117: dread f4 [4194304,4194304] 0 2024-04-15T21:02:25.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/118: write f11 [647758,75993] 0 2024-04-15T21:02:25.229 INFO:tasks.workunit.client.1.smithi149.stdout:1/111: truncate d1/f5 4241899 0 2024-04-15T21:02:25.230 INFO:tasks.workunit.client.1.smithi149.stdout:1/112: fdatasync d1/f3 0 2024-04-15T21:02:25.235 INFO:tasks.workunit.client.1.smithi149.stdout:9/119: dread f9 [0,4194304] 0 2024-04-15T21:02:25.237 INFO:tasks.workunit.client.1.smithi149.stdout:1/113: dwrite d1/da/fd [0,4194304] 0 2024-04-15T21:02:25.238 INFO:tasks.workunit.client.1.smithi149.stdout:4/99: symlink dc/d18/l20 0 2024-04-15T21:02:25.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/106: creat d1/db/f1d x:0 0 0 2024-04-15T21:02:25.244 INFO:tasks.workunit.client.1.smithi149.stdout:3/107: dread - d1/db/f1c zero size 2024-04-15T21:02:25.245 INFO:tasks.workunit.client.1.smithi149.stdout:6/124: symlink da/d18/l2c 0 2024-04-15T21:02:25.246 INFO:tasks.workunit.client.1.smithi149.stdout:3/108: dread - d1/db/f1c zero size 2024-04-15T21:02:25.246 INFO:tasks.workunit.client.1.smithi149.stdout:8/91: rmdir d2/df/d10 39 2024-04-15T21:02:25.249 INFO:tasks.workunit.client.1.smithi149.stdout:4/100: dwrite dc/d18/f1d [0,4194304] 0 2024-04-15T21:02:25.251 INFO:tasks.workunit.client.1.smithi149.stdout:4/101: write dc/fe [668407,48752] 0 2024-04-15T21:02:25.252 INFO:tasks.workunit.client.1.smithi149.stdout:0/71: mknod d1/d5/c14 0 2024-04-15T21:02:25.261 INFO:tasks.workunit.client.1.smithi149.stdout:3/109: dwrite d1/fd [0,4194304] 0 2024-04-15T21:02:25.266 INFO:tasks.workunit.client.1.smithi149.stdout:5/128: sync 2024-04-15T21:02:25.269 INFO:tasks.workunit.client.1.smithi149.stdout:7/83: getdents d3/d16 0 2024-04-15T21:02:25.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/84: read - d3/f18 zero size 2024-04-15T21:02:25.272 INFO:tasks.workunit.client.1.smithi149.stdout:9/120: mkdir d23/d26 0 2024-04-15T21:02:25.278 INFO:tasks.workunit.client.1.smithi149.stdout:7/85: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:25.283 INFO:tasks.workunit.client.1.smithi149.stdout:7/86: read d3/fb [38373,50241] 0 2024-04-15T21:02:25.290 INFO:tasks.workunit.client.1.smithi149.stdout:4/102: chown dc/d14/d15/c1c 11836896 1 2024-04-15T21:02:25.294 INFO:tasks.workunit.client.1.smithi149.stdout:3/110: creat d1/dc/f1e x:0 0 0 2024-04-15T21:02:25.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/129: symlink d0/d9/l32 0 2024-04-15T21:02:25.305 INFO:tasks.workunit.client.1.smithi149.stdout:9/121: dwrite f9 [4194304,4194304] 0 2024-04-15T21:02:25.306 INFO:tasks.workunit.client.1.smithi149.stdout:2/174: truncate d4/d7/f1d 3621726 0 2024-04-15T21:02:25.312 INFO:tasks.workunit.client.1.smithi149.stdout:2/175: dread d4/d7/da/fc [0,4194304] 0 2024-04-15T21:02:25.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/125: mkdir da/d11/d2d 0 2024-04-15T21:02:25.314 INFO:tasks.workunit.client.1.smithi149.stdout:2/176: fsync d4/d7/d19/f24 0 2024-04-15T21:02:25.317 INFO:tasks.workunit.client.1.smithi149.stdout:8/92: mkdir d2/df/d10/d21 0 2024-04-15T21:02:25.318 INFO:tasks.workunit.client.1.smithi149.stdout:8/93: truncate d2/f1a 145603 0 2024-04-15T21:02:25.319 INFO:tasks.workunit.client.1.smithi149.stdout:0/72: mkdir d1/d9/d10/d15 0 2024-04-15T21:02:25.320 INFO:tasks.workunit.client.1.smithi149.stdout:4/103: mkdir dc/d18/d21 0 2024-04-15T21:02:25.321 INFO:tasks.workunit.client.1.smithi149.stdout:3/111: chown d1/dc/c19 0 1 2024-04-15T21:02:25.322 INFO:tasks.workunit.client.1.smithi149.stdout:5/130: mknod d0/d9/db/d12/d16/c33 0 2024-04-15T21:02:25.325 INFO:tasks.workunit.client.1.smithi149.stdout:1/114: rmdir d1/d17/d1a 0 2024-04-15T21:02:25.325 INFO:tasks.workunit.client.1.smithi149.stdout:1/115: readlink d1/db/dc/l1b 0 2024-04-15T21:02:25.332 INFO:tasks.workunit.client.1.smithi149.stdout:2/177: rename d4/d7/da/c27 to d4/d7/d19/d21/c45 0 2024-04-15T21:02:25.333 INFO:tasks.workunit.client.1.smithi149.stdout:2/178: truncate d4/f33 4893116 0 2024-04-15T21:02:25.334 INFO:tasks.workunit.client.1.smithi149.stdout:4/104: fsync f2 0 2024-04-15T21:02:25.334 INFO:tasks.workunit.client.1.smithi149.stdout:2/179: write d4/f33 [534511,85586] 0 2024-04-15T21:02:25.335 INFO:tasks.workunit.client.1.smithi149.stdout:2/180: dread - d4/d7/d2f/f40 zero size 2024-04-15T21:02:25.336 INFO:tasks.workunit.client.1.smithi149.stdout:3/112: unlink d1/c1a 0 2024-04-15T21:02:25.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/122: link f9 d23/d26/f27 0 2024-04-15T21:02:25.343 INFO:tasks.workunit.client.1.smithi149.stdout:6/126: mkdir da/d2e 0 2024-04-15T21:02:25.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/87: getdents d3/d16 0 2024-04-15T21:02:25.345 INFO:tasks.workunit.client.1.smithi149.stdout:0/73: mknod d1/d9/df/c16 0 2024-04-15T21:02:25.347 INFO:tasks.workunit.client.1.smithi149.stdout:4/105: creat dc/d10/f22 x:0 0 0 2024-04-15T21:02:25.348 INFO:tasks.workunit.client.1.smithi149.stdout:3/113: symlink d1/l1f 0 2024-04-15T21:02:25.349 INFO:tasks.workunit.client.1.smithi149.stdout:2/181: rename d4/d7/d29/d39 to d4/d7/d46 0 2024-04-15T21:02:25.352 INFO:tasks.workunit.client.0.smithi072.stderr:++ readlink -f fsstress 2024-04-15T21:02:25.354 INFO:tasks.workunit.client.0.smithi072.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-15T21:02:25.354 INFO:tasks.workunit.client.0.smithi072.stderr:+ popd 2024-04-15T21:02:25.355 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T21:02:25.355 INFO:tasks.workunit.client.0.smithi072.stderr:+ popd 2024-04-15T21:02:25.355 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-15T21:02:25.355 INFO:tasks.workunit.client.0.smithi072.stderr:++ mktemp -d -p . 2024-04-15T21:02:25.356 INFO:tasks.workunit.client.1.smithi149.stdout:9/123: unlink d23/d26/f27 0 2024-04-15T21:02:25.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/127: dread - da/d11/f1a zero size 2024-04-15T21:02:25.357 INFO:tasks.workunit.client.1.smithi149.stdout:7/88: rmdir d3/d16 39 2024-04-15T21:02:25.358 INFO:tasks.workunit.client.1.smithi149.stdout:7/89: write d3/fd [1892811,13916] 0 2024-04-15T21:02:25.358 INFO:tasks.workunit.client.1.smithi149.stdout:0/74: write d1/f4 [1647004,95652] 0 2024-04-15T21:02:25.360 INFO:tasks.workunit.client.0.smithi072.stderr:+ T=./tmp.tOuWzzvqjV 2024-04-15T21:02:25.360 INFO:tasks.workunit.client.0.smithi072.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.tOuWzzvqjV -l 1 -n 1000 -p 10 -v 2024-04-15T21:02:25.361 INFO:tasks.workunit.client.1.smithi149.stdout:3/114: mknod d1/c20 0 2024-04-15T21:02:25.367 INFO:tasks.workunit.client.1.smithi149.stdout:5/131: link d0/d9/l32 d0/d9/db/d12/d2b/l34 0 2024-04-15T21:02:25.369 INFO:tasks.workunit.client.0.smithi072.stdout:seed = 1712869558 2024-04-15T21:02:25.370 INFO:tasks.workunit.client.1.smithi149.stdout:4/106: rename dc/d10 to dc/d14/d23 0 2024-04-15T21:02:25.371 INFO:tasks.workunit.client.1.smithi149.stdout:9/124: mknod d23/c28 0 2024-04-15T21:02:25.372 INFO:tasks.workunit.client.1.smithi149.stdout:9/125: dread - f17 zero size 2024-04-15T21:02:25.375 INFO:tasks.workunit.client.1.smithi149.stdout:6/128: fsync da/f24 0 2024-04-15T21:02:25.378 INFO:tasks.workunit.client.0.smithi072.stdout:0/0: dread - no filename 2024-04-15T21:02:25.379 INFO:tasks.workunit.client.1.smithi149.stdout:7/90: read d3/fb [16363,2607] 0 2024-04-15T21:02:25.380 INFO:tasks.workunit.client.1.smithi149.stdout:0/75: creat d1/d5/f17 x:0 0 0 2024-04-15T21:02:25.381 INFO:tasks.workunit.client.1.smithi149.stdout:3/115: creat d1/db/f21 x:0 0 0 2024-04-15T21:02:25.382 INFO:tasks.workunit.client.1.smithi149.stdout:2/182: creat d4/d7/d10/d36/f47 x:0 0 0 2024-04-15T21:02:25.386 INFO:tasks.workunit.client.0.smithi072.stdout:2/0: write - no filename 2024-04-15T21:02:25.387 INFO:tasks.workunit.client.0.smithi072.stdout:0/1: mkdir d0 0 2024-04-15T21:02:25.388 INFO:tasks.workunit.client.0.smithi072.stdout:0/2: dwrite - no filename 2024-04-15T21:02:25.388 INFO:tasks.workunit.client.0.smithi072.stdout:0/3: read - no filename 2024-04-15T21:02:25.388 INFO:tasks.workunit.client.0.smithi072.stdout:0/4: dread - no filename 2024-04-15T21:02:25.389 INFO:tasks.workunit.client.1.smithi149.stdout:5/132: symlink d0/d9/db/d12/d16/l35 0 2024-04-15T21:02:25.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/183: dwrite d4/d7/d19/d21/d3b/f41 [0,4194304] 0 2024-04-15T21:02:25.392 INFO:tasks.workunit.client.1.smithi149.stdout:1/116: getdents d1/db/dc/d11 0 2024-04-15T21:02:25.396 INFO:tasks.workunit.client.0.smithi072.stdout:3/0: chown . 54 1 2024-04-15T21:02:25.400 INFO:tasks.workunit.client.1.smithi149.stdout:9/126: mknod d23/c29 0 2024-04-15T21:02:25.402 INFO:tasks.workunit.client.1.smithi149.stdout:6/129: write da/d18/d10/d16/f29 [107936,4293] 0 2024-04-15T21:02:25.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/0: mknod c0 0 2024-04-15T21:02:25.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/1: stat c0 0 2024-04-15T21:02:25.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/2: write - no filename 2024-04-15T21:02:25.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/3: dread - no filename 2024-04-15T21:02:25.407 INFO:tasks.workunit.client.1.smithi149.stdout:7/91: unlink d3/fd 0 2024-04-15T21:02:25.409 INFO:tasks.workunit.client.0.smithi072.stdout:2/1: getdents . 0 2024-04-15T21:02:25.410 INFO:tasks.workunit.client.0.smithi072.stdout:0/5: creat d0/f1 x:0 0 0 2024-04-15T21:02:25.412 INFO:tasks.workunit.client.0.smithi072.stdout:1/4: mknod c1 0 2024-04-15T21:02:25.412 INFO:tasks.workunit.client.0.smithi072.stdout:1/5: dwrite - no filename 2024-04-15T21:02:25.412 INFO:tasks.workunit.client.0.smithi072.stdout:1/6: dread - no filename 2024-04-15T21:02:25.414 INFO:tasks.workunit.client.1.smithi149.stdout:5/133: creat d0/d6/f36 x:0 0 0 2024-04-15T21:02:25.415 INFO:tasks.workunit.client.0.smithi072.stdout:5/0: dwrite - no filename 2024-04-15T21:02:25.417 INFO:tasks.workunit.client.0.smithi072.stdout:3/1: creat f0 x:0 0 0 2024-04-15T21:02:25.418 INFO:tasks.workunit.client.1.smithi149.stdout:9/127: unlink l18 0 2024-04-15T21:02:25.419 INFO:tasks.workunit.client.0.smithi072.stdout:0/6: creat d0/f2 x:0 0 0 2024-04-15T21:02:25.419 INFO:tasks.workunit.client.1.smithi149.stdout:9/128: truncate f1a 724036 0 2024-04-15T21:02:25.419 INFO:tasks.workunit.client.0.smithi072.stdout:0/7: truncate d0/f2 160314 0 2024-04-15T21:02:25.420 INFO:tasks.workunit.client.0.smithi072.stdout:0/8: dread - d0/f1 zero size 2024-04-15T21:02:25.421 INFO:tasks.workunit.client.0.smithi072.stdout:6/0: dread - no filename 2024-04-15T21:02:25.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/0: mknod c0 0 2024-04-15T21:02:25.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/1: fdatasync - no filename 2024-04-15T21:02:25.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/2: dread - no filename 2024-04-15T21:02:25.423 INFO:tasks.workunit.client.1.smithi149.stdout:0/76: rename d1/d5/f17 to d1/d5/dc/f18 0 2024-04-15T21:02:25.424 INFO:tasks.workunit.client.0.smithi072.stdout:3/2: mkdir d1 0 2024-04-15T21:02:25.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/77: dread - d1/d5/dc/f18 zero size 2024-04-15T21:02:25.425 INFO:tasks.workunit.client.0.smithi072.stdout:2/2: mknod c0 0 2024-04-15T21:02:25.426 INFO:tasks.workunit.client.1.smithi149.stdout:5/134: mknod d0/d9/db/d12/d16/d28/c37 0 2024-04-15T21:02:25.427 INFO:tasks.workunit.client.1.smithi149.stdout:5/135: fsync d0/d9/db/d12/d16/f1d 0 2024-04-15T21:02:25.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/184: symlink d4/d7/d19/d21/d2c/d3e/l48 0 2024-04-15T21:02:25.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/78: dread d1/d5/f12 [0,4194304] 0 2024-04-15T21:02:25.428 INFO:tasks.workunit.client.0.smithi072.stdout:0/9: mkdir d0/d3 0 2024-04-15T21:02:25.430 INFO:tasks.workunit.client.0.smithi072.stdout:5/1: mkdir d0 0 2024-04-15T21:02:25.431 INFO:tasks.workunit.client.1.smithi149.stdout:2/185: dread d4/f12 [0,4194304] 0 2024-04-15T21:02:25.431 INFO:tasks.workunit.client.0.smithi072.stdout:7/0: rename - no filename 2024-04-15T21:02:25.432 INFO:tasks.workunit.client.1.smithi149.stdout:2/186: chown d4/f18 1686 1 2024-04-15T21:02:25.432 INFO:tasks.workunit.client.1.smithi149.stdout:9/129: mknod d23/c2a 0 2024-04-15T21:02:25.435 INFO:tasks.workunit.client.0.smithi072.stdout:2/3: creat f1 x:0 0 0 2024-04-15T21:02:25.435 INFO:tasks.workunit.client.0.smithi072.stdout:2/4: chown f1 190677 1 2024-04-15T21:02:25.436 INFO:tasks.workunit.client.0.smithi072.stdout:1/7: link c0 c2 0 2024-04-15T21:02:25.436 INFO:tasks.workunit.client.0.smithi072.stdout:2/5: write f1 [164662,44596] 0 2024-04-15T21:02:25.437 INFO:tasks.workunit.client.1.smithi149.stdout:2/187: dread d4/d7/d19/d21/d3b/f41 [0,4194304] 0 2024-04-15T21:02:25.441 INFO:tasks.workunit.client.1.smithi149.stdout:3/116: creat d1/dc/f22 x:0 0 0 2024-04-15T21:02:25.442 INFO:tasks.workunit.client.0.smithi072.stdout:2/6: dwrite f1 [0,4194304] 0 2024-04-15T21:02:25.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/0: chown . 34690168 1 2024-04-15T21:02:25.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/1: link - no file 2024-04-15T21:02:25.447 INFO:tasks.workunit.client.0.smithi072.stdout:2/7: dread f1 [0,4194304] 0 2024-04-15T21:02:25.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/117: link d1/c2 d1/db/d16/c1d 0 2024-04-15T21:02:25.447 INFO:tasks.workunit.client.0.smithi072.stdout:2/8: write f1 [1903282,84973] 0 2024-04-15T21:02:25.448 INFO:tasks.workunit.client.0.smithi072.stdout:6/1: mknod c0 0 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/2: fdatasync - no filename 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/3: dwrite - no filename 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/4: write - no filename 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/5: dwrite - no filename 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/6: dwrite - no filename 2024-04-15T21:02:25.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/7: truncate - no filename 2024-04-15T21:02:25.450 INFO:tasks.workunit.client.1.smithi149.stdout:4/107: getdents dc/d18 0 2024-04-15T21:02:25.451 INFO:tasks.workunit.client.0.smithi072.stdout:3/3: creat d1/f2 x:0 0 0 2024-04-15T21:02:25.452 INFO:tasks.workunit.client.1.smithi149.stdout:2/188: dread d4/d7/da/ff [0,4194304] 0 2024-04-15T21:02:25.452 INFO:tasks.workunit.client.0.smithi072.stdout:3/4: dread - f0 zero size 2024-04-15T21:02:25.452 INFO:tasks.workunit.client.0.smithi072.stdout:3/5: truncate f0 437873 0 2024-04-15T21:02:25.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/92: mknod d3/d16/d20/c21 0 2024-04-15T21:02:25.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/8: symlink l3 0 2024-04-15T21:02:25.454 INFO:tasks.workunit.client.0.smithi072.stdout:1/9: dread - no filename 2024-04-15T21:02:25.455 INFO:tasks.workunit.client.1.smithi149.stdout:0/79: unlink d1/d5/dc/f18 0 2024-04-15T21:02:25.460 INFO:tasks.workunit.client.0.smithi072.stdout:0/10: creat d0/d3/f4 x:0 0 0 2024-04-15T21:02:25.461 INFO:tasks.workunit.client.0.smithi072.stdout:5/2: mknod d0/c1 0 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/0: dread - no filename 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/1: link - no file 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/2: chown . 4343854 1 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/3: fdatasync - no filename 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/4: write - no filename 2024-04-15T21:02:25.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/5: truncate - no filename 2024-04-15T21:02:25.467 INFO:tasks.workunit.client.0.smithi072.stdout:9/6: link - no file 2024-04-15T21:02:25.470 INFO:tasks.workunit.client.1.smithi149.stdout:1/118: rename d1/da to d1/db/d14/d1e 0 2024-04-15T21:02:25.471 INFO:tasks.workunit.client.0.smithi072.stdout:7/1: creat f0 x:0 0 0 2024-04-15T21:02:25.471 INFO:tasks.workunit.client.0.smithi072.stdout:2/9: mkdir d2 0 2024-04-15T21:02:25.473 INFO:tasks.workunit.client.1.smithi149.stdout:2/189: unlink d4/d7/da/fc 0 2024-04-15T21:02:25.474 INFO:tasks.workunit.client.0.smithi072.stdout:6/8: symlink l1 0 2024-04-15T21:02:25.474 INFO:tasks.workunit.client.0.smithi072.stdout:6/9: dread - no filename 2024-04-15T21:02:25.476 INFO:tasks.workunit.client.0.smithi072.stdout:3/6: creat d1/f3 x:0 0 0 2024-04-15T21:02:25.478 INFO:tasks.workunit.client.0.smithi072.stdout:1/10: rename l3 to l4 0 2024-04-15T21:02:25.526 INFO:tasks.workunit.client.0.smithi072.stdout:5/3: creat d0/f2 x:0 0 0 2024-04-15T21:02:25.526 INFO:tasks.workunit.client.0.smithi072.stdout:5/4: stat d0/c1 0 2024-04-15T21:02:25.527 INFO:tasks.workunit.client.0.smithi072.stdout:5/5: write d0/f2 [331956,33002] 0 2024-04-15T21:02:25.528 INFO:tasks.workunit.client.1.smithi149.stdout:3/117: mkdir d1/db/d23 0 2024-04-15T21:02:25.530 INFO:tasks.workunit.client.1.smithi149.stdout:5/136: creat d0/d9/db/f38 x:0 0 0 2024-04-15T21:02:25.532 INFO:tasks.workunit.client.0.smithi072.stdout:8/2: creat f0 x:0 0 0 2024-04-15T21:02:25.534 INFO:tasks.workunit.client.0.smithi072.stdout:7/2: mknod c1 0 2024-04-15T21:02:25.537 INFO:tasks.workunit.client.0.smithi072.stdout:6/10: mkdir d2 0 2024-04-15T21:02:25.537 INFO:tasks.workunit.client.0.smithi072.stdout:6/11: dread - no filename 2024-04-15T21:02:25.538 INFO:tasks.workunit.client.0.smithi072.stdout:3/7: creat d1/f4 x:0 0 0 2024-04-15T21:02:25.540 INFO:tasks.workunit.client.1.smithi149.stdout:9/130: rmdir d23/d26 0 2024-04-15T21:02:25.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/93: dwrite d3/fb [0,4194304] 0 2024-04-15T21:02:25.542 INFO:tasks.workunit.client.1.smithi149.stdout:3/118: mkdir d1/db/d24 0 2024-04-15T21:02:25.543 INFO:tasks.workunit.client.0.smithi072.stdout:5/6: mkdir d0/d3 0 2024-04-15T21:02:25.544 INFO:tasks.workunit.client.0.smithi072.stdout:1/11: chown l4 1604 1 2024-04-15T21:02:25.548 INFO:tasks.workunit.client.1.smithi149.stdout:5/137: rmdir d0/d6 39 2024-04-15T21:02:25.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/7: creat f0 x:0 0 0 2024-04-15T21:02:25.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/8: fdatasync f0 0 2024-04-15T21:02:25.551 INFO:tasks.workunit.client.0.smithi072.stdout:9/9: dread - f0 zero size 2024-04-15T21:02:25.553 INFO:tasks.workunit.client.1.smithi149.stdout:3/119: dwrite d1/db/f21 [0,4194304] 0 2024-04-15T21:02:25.553 INFO:tasks.workunit.client.0.smithi072.stdout:8/3: rename f0 to f1 0 2024-04-15T21:02:25.553 INFO:tasks.workunit.client.0.smithi072.stdout:8/4: readlink - no filename 2024-04-15T21:02:25.555 INFO:tasks.workunit.client.0.smithi072.stdout:8/5: chown f1 51353155 1 2024-04-15T21:02:25.555 INFO:tasks.workunit.client.0.smithi072.stdout:8/6: chown f1 0 1 2024-04-15T21:02:25.557 INFO:tasks.workunit.client.0.smithi072.stdout:7/3: mkdir d2 0 2024-04-15T21:02:25.558 INFO:tasks.workunit.client.1.smithi149.stdout:4/108: link dc/d14/d15/c1c dc/c24 0 2024-04-15T21:02:25.558 INFO:tasks.workunit.client.0.smithi072.stdout:9/10: dwrite f0 [0,4194304] 0 2024-04-15T21:02:25.559 INFO:tasks.workunit.client.1.smithi149.stdout:5/138: dwrite d0/d9/db/d12/d16/f1d [0,4194304] 0 2024-04-15T21:02:25.560 INFO:tasks.workunit.client.0.smithi072.stdout:2/10: mkdir d2/d3 0 2024-04-15T21:02:25.560 INFO:tasks.workunit.client.0.smithi072.stdout:2/11: chown d2/d3 81 1 2024-04-15T21:02:25.563 INFO:tasks.workunit.client.1.smithi149.stdout:2/190: truncate d4/d7/d29/f30 2162233 0 2024-04-15T21:02:25.564 INFO:tasks.workunit.client.1.smithi149.stdout:4/109: dread f6 [0,4194304] 0 2024-04-15T21:02:25.569 INFO:tasks.workunit.client.0.smithi072.stdout:3/8: symlink d1/l5 0 2024-04-15T21:02:25.569 INFO:tasks.workunit.client.0.smithi072.stdout:3/9: fdatasync d1/f2 0 2024-04-15T21:02:25.570 INFO:tasks.workunit.client.1.smithi149.stdout:0/80: creat d1/d9/f19 x:0 0 0 2024-04-15T21:02:25.573 INFO:tasks.workunit.client.1.smithi149.stdout:9/131: mkdir d23/d2b 0 2024-04-15T21:02:25.577 INFO:tasks.workunit.client.0.smithi072.stdout:3/10: dwrite f0 [0,4194304] 0 2024-04-15T21:02:25.578 INFO:tasks.workunit.client.0.smithi072.stdout:3/11: dread - d1/f2 zero size 2024-04-15T21:02:25.578 INFO:tasks.workunit.client.0.smithi072.stdout:3/12: fsync d1/f2 0 2024-04-15T21:02:25.582 INFO:tasks.workunit.client.1.smithi149.stdout:1/119: rmdir d1/db/d14/d15 0 2024-04-15T21:02:25.583 INFO:tasks.workunit.client.0.smithi072.stdout:8/7: mknod c2 0 2024-04-15T21:02:25.585 INFO:tasks.workunit.client.0.smithi072.stdout:3/13: dwrite d1/f4 [0,4194304] 0 2024-04-15T21:02:25.587 INFO:tasks.workunit.client.0.smithi072.stdout:7/4: unlink f0 0 2024-04-15T21:02:25.594 INFO:tasks.workunit.client.0.smithi072.stdout:2/12: rmdir d2 39 2024-04-15T21:02:25.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/139: creat d0/d9/f39 x:0 0 0 2024-04-15T21:02:25.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/12: getdents d2 0 2024-04-15T21:02:25.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/13: fdatasync - no filename 2024-04-15T21:02:25.598 INFO:tasks.workunit.client.1.smithi149.stdout:0/81: symlink d1/l1a 0 2024-04-15T21:02:25.599 INFO:tasks.workunit.client.0.smithi072.stdout:0/11: getdents d0/d3 0 2024-04-15T21:02:25.602 INFO:tasks.workunit.client.1.smithi149.stdout:0/82: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:25.603 INFO:tasks.workunit.client.1.smithi149.stdout:7/94: creat d3/d17/d1f/f22 x:0 0 0 2024-04-15T21:02:25.605 INFO:tasks.workunit.client.0.smithi072.stdout:5/7: link d0/f2 d0/d3/f4 0 2024-04-15T21:02:25.607 INFO:tasks.workunit.client.1.smithi149.stdout:1/120: creat d1/db/d14/d1e/f1f x:0 0 0 2024-04-15T21:02:25.607 INFO:tasks.workunit.client.1.smithi149.stdout:0/83: write d1/f4 [1923231,105354] 0 2024-04-15T21:02:25.608 INFO:tasks.workunit.client.1.smithi149.stdout:7/95: write d3/f5 [800673,130979] 0 2024-04-15T21:02:25.611 INFO:tasks.workunit.client.1.smithi149.stdout:3/120: link d1/dc/f1e d1/dc/f25 0 2024-04-15T21:02:25.615 INFO:tasks.workunit.client.0.smithi072.stdout:3/14: creat d1/f6 x:0 0 0 2024-04-15T21:02:25.619 INFO:tasks.workunit.client.0.smithi072.stdout:8/8: dwrite f1 [0,4194304] 0 2024-04-15T21:02:25.620 INFO:tasks.workunit.client.0.smithi072.stdout:8/9: read f1 [3108517,105136] 0 2024-04-15T21:02:25.622 INFO:tasks.workunit.client.0.smithi072.stdout:9/11: unlink f0 0 2024-04-15T21:02:25.622 INFO:tasks.workunit.client.0.smithi072.stdout:9/12: write - no filename 2024-04-15T21:02:25.623 INFO:tasks.workunit.client.1.smithi149.stdout:9/132: creat d23/d2b/f2c x:0 0 0 2024-04-15T21:02:25.623 INFO:tasks.workunit.client.0.smithi072.stdout:3/15: dwrite d1/f4 [0,4194304] 0 2024-04-15T21:02:25.624 INFO:tasks.workunit.client.0.smithi072.stdout:3/16: chown d1/l5 45982 1 2024-04-15T21:02:25.629 INFO:tasks.workunit.client.0.smithi072.stdout:0/12: mkdir d0/d3/d5 0 2024-04-15T21:02:25.630 INFO:tasks.workunit.client.0.smithi072.stdout:0/13: dread d0/f2 [0,4194304] 0 2024-04-15T21:02:25.634 INFO:tasks.workunit.client.0.smithi072.stdout:5/8: rmdir d0/d3 39 2024-04-15T21:02:25.640 INFO:tasks.workunit.client.1.smithi149.stdout:4/110: truncate f1 1482855 0 2024-04-15T21:02:25.641 INFO:tasks.workunit.client.1.smithi149.stdout:4/111: write fa [1137649,113207] 0 2024-04-15T21:02:25.645 INFO:tasks.workunit.client.1.smithi149.stdout:4/112: dread dc/fd [0,4194304] 0 2024-04-15T21:02:25.651 INFO:tasks.workunit.client.0.smithi072.stdout:8/10: mkdir d3 0 2024-04-15T21:02:25.653 INFO:tasks.workunit.client.0.smithi072.stdout:9/13: mknod c1 0 2024-04-15T21:02:25.653 INFO:tasks.workunit.client.0.smithi072.stdout:9/14: rmdir - no directory 2024-04-15T21:02:25.653 INFO:tasks.workunit.client.0.smithi072.stdout:9/15: fsync - no filename 2024-04-15T21:02:25.658 INFO:tasks.workunit.client.1.smithi149.stdout:3/121: mknod d1/db/d24/c26 0 2024-04-15T21:02:25.660 INFO:tasks.workunit.client.0.smithi072.stdout:6/14: creat d2/f3 x:0 0 0 2024-04-15T21:02:25.660 INFO:tasks.workunit.client.0.smithi072.stdout:6/15: chown c0 3 1 2024-04-15T21:02:25.663 INFO:tasks.workunit.client.0.smithi072.stdout:0/14: mkdir d0/d6 0 2024-04-15T21:02:25.663 INFO:tasks.workunit.client.1.smithi149.stdout:1/121: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:25.664 INFO:tasks.workunit.client.0.smithi072.stdout:2/13: truncate f1 3958188 0 2024-04-15T21:02:25.664 INFO:tasks.workunit.client.1.smithi149.stdout:1/122: chown d1/d17 72 1 2024-04-15T21:02:25.669 INFO:tasks.workunit.client.0.smithi072.stdout:7/5: link c1 d2/c3 0 2024-04-15T21:02:25.669 INFO:tasks.workunit.client.0.smithi072.stdout:7/6: write - no filename 2024-04-15T21:02:25.669 INFO:tasks.workunit.client.0.smithi072.stdout:7/7: dwrite - no filename 2024-04-15T21:02:25.671 INFO:tasks.workunit.client.1.smithi149.stdout:0/84: creat d1/d9/f1b x:0 0 0 2024-04-15T21:02:25.673 INFO:tasks.workunit.client.0.smithi072.stdout:9/16: mknod c2 0 2024-04-15T21:02:25.673 INFO:tasks.workunit.client.0.smithi072.stdout:9/17: truncate - no filename 2024-04-15T21:02:25.673 INFO:tasks.workunit.client.0.smithi072.stdout:9/18: write - no filename 2024-04-15T21:02:25.674 INFO:tasks.workunit.client.0.smithi072.stdout:9/19: write - no filename 2024-04-15T21:02:25.674 INFO:tasks.workunit.client.0.smithi072.stdout:9/20: dwrite - no filename 2024-04-15T21:02:25.677 INFO:tasks.workunit.client.1.smithi149.stdout:1/123: unlink d1/f8 0 2024-04-15T21:02:25.678 INFO:tasks.workunit.client.1.smithi149.stdout:3/122: dread d1/fd [0,4194304] 0 2024-04-15T21:02:25.685 INFO:tasks.workunit.client.1.smithi149.stdout:7/96: link d3/d16/d20/c21 d3/c23 0 2024-04-15T21:02:25.688 INFO:tasks.workunit.client.0.smithi072.stdout:7/8: rename c1 to d2/c4 0 2024-04-15T21:02:25.688 INFO:tasks.workunit.client.0.smithi072.stdout:7/9: truncate - no filename 2024-04-15T21:02:25.690 INFO:tasks.workunit.client.0.smithi072.stdout:5/9: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:25.691 INFO:tasks.workunit.client.0.smithi072.stdout:0/15: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:25.693 INFO:tasks.workunit.client.0.smithi072.stdout:8/11: mkdir d3/d4 0 2024-04-15T21:02:25.693 INFO:tasks.workunit.client.0.smithi072.stdout:8/12: rename d3 to d3/d4/d5 22 2024-04-15T21:02:25.694 INFO:tasks.workunit.client.0.smithi072.stdout:8/13: chown c2 1 1 2024-04-15T21:02:25.695 INFO:tasks.workunit.client.1.smithi149.stdout:1/124: creat d1/db/f20 x:0 0 0 2024-04-15T21:02:25.695 INFO:tasks.workunit.client.0.smithi072.stdout:3/17: truncate f0 1791745 0 2024-04-15T21:02:25.696 INFO:tasks.workunit.client.0.smithi072.stdout:3/18: chown d1/f2 4765699 1 2024-04-15T21:02:25.697 INFO:tasks.workunit.client.0.smithi072.stdout:3/19: truncate d1/f3 407381 0 2024-04-15T21:02:25.697 INFO:tasks.workunit.client.0.smithi072.stdout:9/21: creat f3 x:0 0 0 2024-04-15T21:02:25.697 INFO:tasks.workunit.client.0.smithi072.stdout:9/22: write f3 [959051,72435] 0 2024-04-15T21:02:25.703 INFO:tasks.workunit.client.1.smithi149.stdout:5/140: link d0/f3 d0/f3a 0 2024-04-15T21:02:25.704 INFO:tasks.workunit.client.0.smithi072.stdout:9/23: dwrite f3 [0,4194304] 0 2024-04-15T21:02:25.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/24: write f3 [2482416,58097] 0 2024-04-15T21:02:25.706 INFO:tasks.workunit.client.1.smithi149.stdout:5/141: write d0/d9/db/d12/d16/f18 [823694,86629] 0 2024-04-15T21:02:25.707 INFO:tasks.workunit.client.0.smithi072.stdout:6/16: rename d2/f3 to d2/f4 0 2024-04-15T21:02:25.708 INFO:tasks.workunit.client.0.smithi072.stdout:6/17: dread - d2/f4 zero size 2024-04-15T21:02:25.708 INFO:tasks.workunit.client.0.smithi072.stdout:6/18: read - d2/f4 zero size 2024-04-15T21:02:25.711 INFO:tasks.workunit.client.1.smithi149.stdout:0/85: symlink d1/d9/d10/d15/l1c 0 2024-04-15T21:02:25.713 INFO:tasks.workunit.client.1.smithi149.stdout:7/97: unlink d3/l1e 0 2024-04-15T21:02:25.714 INFO:tasks.workunit.client.0.smithi072.stdout:2/14: mknod d2/c4 0 2024-04-15T21:02:25.716 INFO:tasks.workunit.client.1.smithi149.stdout:5/142: dwrite d0/d9/f17 [0,4194304] 0 2024-04-15T21:02:25.722 INFO:tasks.workunit.client.0.smithi072.stdout:7/10: creat d2/f5 x:0 0 0 2024-04-15T21:02:25.723 INFO:tasks.workunit.client.0.smithi072.stdout:7/11: dread - d2/f5 zero size 2024-04-15T21:02:25.724 INFO:tasks.workunit.client.1.smithi149.stdout:4/113: read f1 [1050327,24900] 0 2024-04-15T21:02:25.733 INFO:tasks.workunit.client.0.smithi072.stdout:8/14: symlink d3/l6 0 2024-04-15T21:02:25.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/15: chown f1 718622479 1 2024-04-15T21:02:25.735 INFO:tasks.workunit.client.0.smithi072.stdout:3/20: unlink d1/l5 0 2024-04-15T21:02:25.735 INFO:tasks.workunit.client.0.smithi072.stdout:3/21: write d1/f3 [1329467,64442] 0 2024-04-15T21:02:25.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/86: readlink l0 0 2024-04-15T21:02:25.737 INFO:tasks.workunit.client.1.smithi149.stdout:7/98: creat d3/d16/d20/f24 x:0 0 0 2024-04-15T21:02:25.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/25: mkdir d4 0 2024-04-15T21:02:25.741 INFO:tasks.workunit.client.1.smithi149.stdout:4/114: unlink dc/d14/c17 0 2024-04-15T21:02:25.744 INFO:tasks.workunit.client.1.smithi149.stdout:0/87: symlink d1/d9/df/l1d 0 2024-04-15T21:02:25.745 INFO:tasks.workunit.client.0.smithi072.stdout:6/19: symlink d2/l5 0 2024-04-15T21:02:25.745 INFO:tasks.workunit.client.1.smithi149.stdout:7/99: rmdir d3/d16 39 2024-04-15T21:02:25.746 INFO:tasks.workunit.client.1.smithi149.stdout:7/100: write d3/f4 [585133,87116] 0 2024-04-15T21:02:25.750 INFO:tasks.workunit.client.1.smithi149.stdout:3/123: link d1/dc/l12 d1/db/d24/l27 0 2024-04-15T21:02:25.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/124: dread - d1/dc/f1e zero size 2024-04-15T21:02:25.751 INFO:tasks.workunit.client.0.smithi072.stdout:0/16: getdents d0/d6 0 2024-04-15T21:02:25.752 INFO:tasks.workunit.client.0.smithi072.stdout:0/17: write d0/f1 [512338,127229] 0 2024-04-15T21:02:25.753 INFO:tasks.workunit.client.1.smithi149.stdout:0/88: symlink d1/d5/dc/l1e 0 2024-04-15T21:02:25.753 INFO:tasks.workunit.client.0.smithi072.stdout:8/16: mknod d3/c7 0 2024-04-15T21:02:25.753 INFO:tasks.workunit.client.0.smithi072.stdout:8/17: chown d3/d4 441450 1 2024-04-15T21:02:25.754 INFO:tasks.workunit.client.0.smithi072.stdout:8/18: readlink d3/l6 0 2024-04-15T21:02:25.755 INFO:tasks.workunit.client.0.smithi072.stdout:0/18: dread d0/f2 [0,4194304] 0 2024-04-15T21:02:25.757 INFO:tasks.workunit.client.0.smithi072.stdout:3/22: mkdir d1/d7 0 2024-04-15T21:02:25.759 INFO:tasks.workunit.client.1.smithi149.stdout:7/101: creat d3/d17/d1f/f25 x:0 0 0 2024-04-15T21:02:25.759 INFO:tasks.workunit.client.1.smithi149.stdout:7/102: write d3/f7 [878018,117598] 0 2024-04-15T21:02:25.761 INFO:tasks.workunit.client.0.smithi072.stdout:3/23: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:25.763 INFO:tasks.workunit.client.1.smithi149.stdout:1/125: write d1/db/d14/d1e/ff [5235596,104468] 0 2024-04-15T21:02:25.764 INFO:tasks.workunit.client.1.smithi149.stdout:1/126: fsync d1/f7 0 2024-04-15T21:02:25.764 INFO:tasks.workunit.client.1.smithi149.stdout:1/127: chown d1/db/dc/d11 64807188 1 2024-04-15T21:02:25.765 INFO:tasks.workunit.client.1.smithi149.stdout:3/125: mkdir d1/db/d28 0 2024-04-15T21:02:25.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/126: truncate d1/dc/f1b 330582 0 2024-04-15T21:02:25.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/127: fsync d1/dc/f1b 0 2024-04-15T21:02:25.769 INFO:tasks.workunit.client.1.smithi149.stdout:1/128: dread d1/f9 [0,4194304] 0 2024-04-15T21:02:25.772 INFO:tasks.workunit.client.0.smithi072.stdout:6/20: mknod d2/c6 0 2024-04-15T21:02:25.773 INFO:tasks.workunit.client.1.smithi149.stdout:5/143: getdents d0/d9/db 0 2024-04-15T21:02:25.773 INFO:tasks.workunit.client.0.smithi072.stdout:8/19: mknod d3/c8 0 2024-04-15T21:02:25.774 INFO:tasks.workunit.client.0.smithi072.stdout:8/20: chown d3/c8 705 1 2024-04-15T21:02:25.775 INFO:tasks.workunit.client.1.smithi149.stdout:5/144: dread d0/d9/db/f2e [0,4194304] 0 2024-04-15T21:02:25.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/103: mkdir d3/d17/d26 0 2024-04-15T21:02:25.777 INFO:tasks.workunit.client.1.smithi149.stdout:5/145: write d0/d9/db/d12/d16/d28/d1b/f20 [484879,52509] 0 2024-04-15T21:02:25.777 INFO:tasks.workunit.client.0.smithi072.stdout:3/24: dwrite d1/f4 [0,4194304] 0 2024-04-15T21:02:25.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/104: write d3/fc [192136,99901] 0 2024-04-15T21:02:25.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/26: creat d4/f5 x:0 0 0 2024-04-15T21:02:25.779 INFO:tasks.workunit.client.0.smithi072.stdout:9/27: stat c2 0 2024-04-15T21:02:25.784 INFO:tasks.workunit.client.0.smithi072.stdout:3/25: dwrite d1/f2 [0,4194304] 0 2024-04-15T21:02:25.788 INFO:tasks.workunit.client.1.smithi149.stdout:1/129: unlink d1/f7 0 2024-04-15T21:02:25.791 INFO:tasks.workunit.client.1.smithi149.stdout:1/130: write d1/db/d14/d1e/fd [3885051,96252] 0 2024-04-15T21:02:25.791 INFO:tasks.workunit.client.1.smithi149.stdout:0/89: write d1/d5/f12 [4558275,21440] 0 2024-04-15T21:02:25.793 INFO:tasks.workunit.client.1.smithi149.stdout:1/131: fdatasync d1/db/f20 0 2024-04-15T21:02:25.794 INFO:tasks.workunit.client.1.smithi149.stdout:3/128: dwrite d1/fa [4194304,4194304] 0 2024-04-15T21:02:25.795 INFO:tasks.workunit.client.1.smithi149.stdout:0/90: truncate d1/d9/f19 501792 0 2024-04-15T21:02:25.798 INFO:tasks.workunit.client.1.smithi149.stdout:3/129: read d1/db/f21 [2126616,54993] 0 2024-04-15T21:02:25.808 INFO:tasks.workunit.client.0.smithi072.stdout:2/15: write f1 [826163,83821] 0 2024-04-15T21:02:25.808 INFO:tasks.workunit.client.1.smithi149.stdout:1/132: dwrite d1/db/f20 [0,4194304] 0 2024-04-15T21:02:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/130: mknod d1/db/c29 0 2024-04-15T21:02:25.820 INFO:tasks.workunit.client.1.smithi149.stdout:5/146: rename d0/d6/c1e to d0/d9/db/d12/d2b/c3b 0 2024-04-15T21:02:25.820 INFO:tasks.workunit.client.1.smithi149.stdout:5/147: chown d0/d9/db/l21 10 1 2024-04-15T21:02:25.821 INFO:tasks.workunit.client.1.smithi149.stdout:7/105: symlink d3/l27 0 2024-04-15T21:02:25.823 INFO:tasks.workunit.client.1.smithi149.stdout:1/133: mkdir d1/db/d14/d21 0 2024-04-15T21:02:25.823 INFO:tasks.workunit.client.1.smithi149.stdout:1/134: chown d1/d17 1 1 2024-04-15T21:02:25.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/106: dread d3/f9 [0,4194304] 0 2024-04-15T21:02:25.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/135: mknod d1/db/dc/d11/c22 0 2024-04-15T21:02:25.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/136: fsync d1/d17/f1c 0 2024-04-15T21:02:25.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/137: readlink d1/d17/l19 0 2024-04-15T21:02:25.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/138: fdatasync d1/f5 0 2024-04-15T21:02:25.833 INFO:tasks.workunit.client.1.smithi149.stdout:0/91: link d1/d5/c14 d1/d5/c1f 0 2024-04-15T21:02:25.834 INFO:tasks.workunit.client.1.smithi149.stdout:1/139: write d1/f6 [3247613,91857] 0 2024-04-15T21:02:25.837 INFO:tasks.workunit.client.1.smithi149.stdout:0/92: dread d1/d9/fd [0,4194304] 0 2024-04-15T21:02:25.837 INFO:tasks.workunit.client.1.smithi149.stdout:3/131: creat d1/db/d28/f2a x:0 0 0 2024-04-15T21:02:25.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/107: symlink d3/d17/d26/l28 0 2024-04-15T21:02:25.847 INFO:tasks.workunit.client.1.smithi149.stdout:7/108: write d3/f10 [3600116,12490] 0 2024-04-15T21:02:25.850 INFO:tasks.workunit.client.1.smithi149.stdout:3/132: readlink d1/l1f 0 2024-04-15T21:02:25.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/109: dread d3/fb [0,4194304] 0 2024-04-15T21:02:25.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/110: dread - d3/d17/d1f/f25 zero size 2024-04-15T21:02:25.860 INFO:tasks.workunit.client.1.smithi149.stdout:3/133: readlink d1/db/d24/l27 0 2024-04-15T21:02:25.862 INFO:tasks.workunit.client.1.smithi149.stdout:7/111: mknod d3/d17/d26/c29 0 2024-04-15T21:02:25.863 INFO:tasks.workunit.client.1.smithi149.stdout:7/112: write d3/f7 [734997,39189] 0 2024-04-15T21:02:25.863 INFO:tasks.workunit.client.1.smithi149.stdout:7/113: write d3/d17/f1a [803076,96502] 0 2024-04-15T21:02:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:7/114: stat d3/f5 0 2024-04-15T21:02:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:0/93: rename d1/d5/c1f to d1/d9/d10/c20 0 2024-04-15T21:02:25.873 INFO:tasks.workunit.client.1.smithi149.stdout:0/94: creat d1/d9/df/f21 x:0 0 0 2024-04-15T21:02:25.875 INFO:tasks.workunit.client.1.smithi149.stdout:1/140: link d1/db/dc/d11/c12 d1/db/d14/d21/c23 0 2024-04-15T21:02:25.879 INFO:tasks.workunit.client.1.smithi149.stdout:0/95: dwrite d1/d9/f19 [0,4194304] 0 2024-04-15T21:02:25.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/141: rmdir d1/db/dc/d11 39 2024-04-15T21:02:25.880 INFO:tasks.workunit.client.1.smithi149.stdout:1/142: readlink l0 0 2024-04-15T21:02:25.880 INFO:tasks.workunit.client.1.smithi149.stdout:0/96: readlink d1/d9/df/l1d 0 2024-04-15T21:02:25.880 INFO:tasks.workunit.client.1.smithi149.stdout:1/143: stat d1/db/d14/d1e/f1f 0 2024-04-15T21:02:25.889 INFO:tasks.workunit.client.1.smithi149.stdout:0/97: link d1/f11 d1/f22 0 2024-04-15T21:02:25.892 INFO:tasks.workunit.client.1.smithi149.stdout:0/98: dread d1/d5/f12 [0,4194304] 0 2024-04-15T21:02:25.893 INFO:tasks.workunit.client.1.smithi149.stdout:0/99: chown d1/d9/f19 0 1 2024-04-15T21:02:25.894 INFO:tasks.workunit.client.1.smithi149.stdout:0/100: write d1/d9/f1b [470492,37965] 0 2024-04-15T21:02:25.907 INFO:tasks.workunit.client.1.smithi149.stdout:3/134: dwrite d1/dc/f25 [0,4194304] 0 2024-04-15T21:02:25.907 INFO:tasks.workunit.client.1.smithi149.stdout:0/101: dwrite d1/f22 [0,4194304] 0 2024-04-15T21:02:25.909 INFO:tasks.workunit.client.1.smithi149.stdout:3/135: write d1/db/f1d [16795,77363] 0 2024-04-15T21:02:25.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:25 smithi072 ceph-mon[29079]: pgmap v269: 65 pgs: 65 active+clean; 220 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 268 op/s 2024-04-15T21:02:25.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/102: rmdir d1/d9/d10/d15 39 2024-04-15T21:02:25.921 INFO:tasks.workunit.client.1.smithi149.stdout:3/136: dwrite d1/db/f1c [0,4194304] 0 2024-04-15T21:02:25.935 INFO:tasks.workunit.client.1.smithi149.stdout:8/94: sync 2024-04-15T21:02:25.936 INFO:tasks.workunit.client.1.smithi149.stdout:8/95: write d2/f1a [673397,52660] 0 2024-04-15T21:02:25.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:25 smithi149 ceph-mon[36029]: pgmap v269: 65 pgs: 65 active+clean; 220 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 268 op/s 2024-04-15T21:02:25.945 INFO:tasks.workunit.client.1.smithi149.stdout:8/96: dwrite d2/f1a [0,4194304] 0 2024-04-15T21:02:25.945 INFO:tasks.workunit.client.1.smithi149.stdout:8/97: stat d2/df/c17 0 2024-04-15T21:02:25.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/98: dwrite d2/f1b [0,4194304] 0 2024-04-15T21:02:25.964 INFO:tasks.workunit.client.1.smithi149.stdout:8/99: getdents d2 0 2024-04-15T21:02:25.966 INFO:tasks.workunit.client.1.smithi149.stdout:8/100: rmdir d2/df 39 2024-04-15T21:02:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:8/101: fsync d2/df/d10/f19 0 2024-04-15T21:02:25.971 INFO:tasks.workunit.client.1.smithi149.stdout:8/102: chown d2/f1f 38 1 2024-04-15T21:02:26.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/103: dwrite d2/f1a [4194304,4194304] 0 2024-04-15T21:02:26.020 INFO:tasks.workunit.client.1.smithi149.stdout:8/104: unlink d2/lb 0 2024-04-15T21:02:26.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/105: write d2/f4 [7103188,79935] 0 2024-04-15T21:02:26.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/106: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:26.045 INFO:tasks.workunit.client.1.smithi149.stdout:8/107: symlink d2/l22 0 2024-04-15T21:02:26.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/108: chown d2/c13 393 1 2024-04-15T21:02:26.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/109: chown d2/f1f 41827120 1 2024-04-15T21:02:26.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/110: creat d2/df/d10/f23 x:0 0 0 2024-04-15T21:02:26.115 INFO:tasks.workunit.client.1.smithi149.stdout:6/130: sync 2024-04-15T21:02:26.115 INFO:tasks.workunit.client.1.smithi149.stdout:2/191: sync 2024-04-15T21:02:26.145 INFO:tasks.workunit.client.1.smithi149.stdout:6/131: read da/ff [1312406,92847] 0 2024-04-15T21:02:26.146 INFO:tasks.workunit.client.1.smithi149.stdout:2/192: write d4/d7/d19/d21/d3b/f3f [797782,31869] 0 2024-04-15T21:02:26.146 INFO:tasks.workunit.client.1.smithi149.stdout:6/132: read da/d18/d10/d16/f21 [566711,124129] 0 2024-04-15T21:02:26.149 INFO:tasks.workunit.client.1.smithi149.stdout:6/133: dread da/d18/f19 [0,4194304] 0 2024-04-15T21:02:26.154 INFO:tasks.workunit.client.1.smithi149.stdout:6/134: dwrite da/f24 [0,4194304] 0 2024-04-15T21:02:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/111: mknod d2/df/d10/d21/c24 0 2024-04-15T21:02:26.228 INFO:tasks.workunit.client.1.smithi149.stdout:2/193: creat d4/d7/d10/d36/f49 x:0 0 0 2024-04-15T21:02:26.236 INFO:tasks.workunit.client.1.smithi149.stdout:8/112: mkdir d2/df/d10/d25 0 2024-04-15T21:02:26.237 INFO:tasks.workunit.client.1.smithi149.stdout:8/113: stat d2/df/d10/f23 0 2024-04-15T21:02:26.241 INFO:tasks.workunit.client.1.smithi149.stdout:2/194: dread d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:26.247 INFO:tasks.workunit.client.1.smithi149.stdout:2/195: dwrite d4/f33 [4194304,4194304] 0 2024-04-15T21:02:26.252 INFO:tasks.workunit.client.1.smithi149.stdout:8/114: creat d2/df/d10/d25/f26 x:0 0 0 2024-04-15T21:02:26.259 INFO:tasks.workunit.client.1.smithi149.stdout:2/196: mkdir d4/d7/d19/d21/d2c/d32/d4a 0 2024-04-15T21:02:26.260 INFO:tasks.workunit.client.1.smithi149.stdout:2/197: truncate d4/d7/d19/d21/d3b/f44 940127 0 2024-04-15T21:02:26.264 INFO:tasks.workunit.client.1.smithi149.stdout:2/198: unlink d4/d7/d29/l3d 0 2024-04-15T21:02:26.267 INFO:tasks.workunit.client.1.smithi149.stdout:2/199: creat d4/d7/d19/d21/d2c/f4b x:0 0 0 2024-04-15T21:02:26.270 INFO:tasks.workunit.client.1.smithi149.stdout:2/200: mkdir d4/d7/d19/d21/d3b/d4c 0 2024-04-15T21:02:26.271 INFO:tasks.workunit.client.1.smithi149.stdout:2/201: write d4/d7/d29/f3c [1664490,76702] 0 2024-04-15T21:02:26.277 INFO:tasks.workunit.client.1.smithi149.stdout:4/115: sync 2024-04-15T21:02:26.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/133: sync 2024-04-15T21:02:26.278 INFO:tasks.workunit.client.1.smithi149.stdout:4/116: fdatasync f2 0 2024-04-15T21:02:26.279 INFO:tasks.workunit.client.1.smithi149.stdout:2/202: dwrite d4/d7/d10/d36/f49 [0,4194304] 0 2024-04-15T21:02:26.279 INFO:tasks.workunit.client.1.smithi149.stdout:4/117: readlink dc/lf 0 2024-04-15T21:02:26.282 INFO:tasks.workunit.client.1.smithi149.stdout:9/134: mknod d23/d2b/c2d 0 2024-04-15T21:02:26.286 INFO:tasks.workunit.client.1.smithi149.stdout:2/203: dwrite d4/d7/d19/d21/d3b/f3f [0,4194304] 0 2024-04-15T21:02:26.293 INFO:tasks.workunit.client.1.smithi149.stdout:4/118: mknod dc/d1a/c25 0 2024-04-15T21:02:26.294 INFO:tasks.workunit.client.0.smithi072.stdout:5/10: getdents d0/d3 0 2024-04-15T21:02:26.296 INFO:tasks.workunit.client.1.smithi149.stdout:2/204: symlink d4/d7/l4d 0 2024-04-15T21:02:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:9/135: fsync f9 0 2024-04-15T21:02:26.298 INFO:tasks.workunit.client.0.smithi072.stdout:5/11: dread d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:26.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/119: unlink f6 0 2024-04-15T21:02:26.302 INFO:tasks.workunit.client.0.smithi072.stdout:6/21: creat d2/f7 x:0 0 0 2024-04-15T21:02:26.302 INFO:tasks.workunit.client.0.smithi072.stdout:6/22: readlink l1 0 2024-04-15T21:02:26.303 INFO:tasks.workunit.client.1.smithi149.stdout:6/135: write da/f24 [4337328,123933] 0 2024-04-15T21:02:26.303 INFO:tasks.workunit.client.1.smithi149.stdout:6/136: stat da/d2e 0 2024-04-15T21:02:26.306 INFO:tasks.workunit.client.1.smithi149.stdout:2/205: dread d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:26.307 INFO:tasks.workunit.client.1.smithi149.stdout:9/136: chown l19 0 1 2024-04-15T21:02:26.307 INFO:tasks.workunit.client.1.smithi149.stdout:9/137: chown l20 6 1 2024-04-15T21:02:26.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/120: creat dc/d1a/f26 x:0 0 0 2024-04-15T21:02:26.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/28: mknod d4/c6 0 2024-04-15T21:02:26.311 INFO:tasks.workunit.client.1.smithi149.stdout:2/206: dwrite d4/d7/da/f25 [0,4194304] 0 2024-04-15T21:02:26.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/137: creat da/d18/d10/d16/f2f x:0 0 0 2024-04-15T21:02:26.313 INFO:tasks.workunit.client.1.smithi149.stdout:6/138: read - da/d11/f1d zero size 2024-04-15T21:02:26.313 INFO:tasks.workunit.client.1.smithi149.stdout:6/139: stat da/d11/l13 0 2024-04-15T21:02:26.316 INFO:tasks.workunit.client.1.smithi149.stdout:9/138: chown c13 11933131 1 2024-04-15T21:02:26.317 INFO:tasks.workunit.client.0.smithi072.stdout:3/26: creat d1/f8 x:0 0 0 2024-04-15T21:02:26.326 INFO:tasks.workunit.client.1.smithi149.stdout:2/207: rename d4/d7/f1d to d4/d7/da/f4e 0 2024-04-15T21:02:26.327 INFO:tasks.workunit.client.1.smithi149.stdout:6/140: symlink da/d2e/l30 0 2024-04-15T21:02:26.328 INFO:tasks.workunit.client.0.smithi072.stdout:8/21: getdents d3/d4 0 2024-04-15T21:02:26.330 INFO:tasks.workunit.client.0.smithi072.stdout:9/29: creat d4/f7 x:0 0 0 2024-04-15T21:02:26.330 INFO:tasks.workunit.client.0.smithi072.stdout:6/23: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:26.331 INFO:tasks.workunit.client.0.smithi072.stdout:9/30: chown c1 3264 1 2024-04-15T21:02:26.331 INFO:tasks.workunit.client.1.smithi149.stdout:8/115: dwrite d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:26.334 INFO:tasks.workunit.client.0.smithi072.stdout:3/27: write d1/f3 [806229,57084] 0 2024-04-15T21:02:26.337 INFO:tasks.workunit.client.0.smithi072.stdout:2/16: creat d2/d3/f5 x:0 0 0 2024-04-15T21:02:26.338 INFO:tasks.workunit.client.0.smithi072.stdout:9/31: dread f3 [0,4194304] 0 2024-04-15T21:02:26.339 INFO:tasks.workunit.client.0.smithi072.stdout:6/24: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:26.340 INFO:tasks.workunit.client.0.smithi072.stdout:6/25: chown l1 49794367 1 2024-04-15T21:02:26.340 INFO:tasks.workunit.client.0.smithi072.stdout:6/26: dread - d2/f7 zero size 2024-04-15T21:02:26.346 INFO:tasks.workunit.client.0.smithi072.stdout:5/12: mknod d0/c5 0 2024-04-15T21:02:26.348 INFO:tasks.workunit.client.0.smithi072.stdout:0/19: getdents d0/d3 0 2024-04-15T21:02:26.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/116: link d2/df/d10/f11 d2/df/d10/d20/f27 0 2024-04-15T21:02:26.353 INFO:tasks.workunit.client.1.smithi149.stdout:8/117: chown d2/l22 91 1 2024-04-15T21:02:26.361 INFO:tasks.workunit.client.0.smithi072.stdout:9/32: creat d4/f8 x:0 0 0 2024-04-15T21:02:26.363 INFO:tasks.workunit.client.0.smithi072.stdout:6/27: rename l1 to d2/l8 0 2024-04-15T21:02:26.364 INFO:tasks.workunit.client.0.smithi072.stdout:5/13: write d0/d3/f4 [2219673,15365] 0 2024-04-15T21:02:26.365 INFO:tasks.workunit.client.0.smithi072.stdout:8/22: creat d3/d4/f9 x:0 0 0 2024-04-15T21:02:26.369 INFO:tasks.workunit.client.0.smithi072.stdout:5/14: fsync d0/f2 0 2024-04-15T21:02:26.369 INFO:tasks.workunit.client.0.smithi072.stdout:3/28: link d1/f3 d1/d7/f9 0 2024-04-15T21:02:26.370 INFO:tasks.workunit.client.0.smithi072.stdout:9/33: unlink d4/f8 0 2024-04-15T21:02:26.370 INFO:tasks.workunit.client.0.smithi072.stdout:6/28: symlink d2/l9 0 2024-04-15T21:02:26.372 INFO:tasks.workunit.client.0.smithi072.stdout:8/23: write f1 [2954093,2888] 0 2024-04-15T21:02:26.374 INFO:tasks.workunit.client.0.smithi072.stdout:6/29: dread d2/f4 [0,4194304] 0 2024-04-15T21:02:26.374 INFO:tasks.workunit.client.0.smithi072.stdout:6/30: stat d2/c6 0 2024-04-15T21:02:26.374 INFO:tasks.workunit.client.0.smithi072.stdout:5/15: unlink d0/c1 0 2024-04-15T21:02:26.375 INFO:tasks.workunit.client.0.smithi072.stdout:5/16: fsync d0/d3/f4 0 2024-04-15T21:02:26.376 INFO:tasks.workunit.client.0.smithi072.stdout:9/34: mkdir d4/d9 0 2024-04-15T21:02:26.376 INFO:tasks.workunit.client.0.smithi072.stdout:9/35: dread - d4/f5 zero size 2024-04-15T21:02:26.378 INFO:tasks.workunit.client.0.smithi072.stdout:8/24: unlink d3/l6 0 2024-04-15T21:02:26.378 INFO:tasks.workunit.client.0.smithi072.stdout:8/25: dread - d3/d4/f9 zero size 2024-04-15T21:02:26.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/26: write f1 [1983873,36119] 0 2024-04-15T21:02:26.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/27: readlink - no filename 2024-04-15T21:02:26.379 INFO:tasks.workunit.client.0.smithi072.stdout:5/17: mkdir d0/d3/d6 0 2024-04-15T21:02:26.380 INFO:tasks.workunit.client.0.smithi072.stdout:5/18: write d0/f2 [3604508,10133] 0 2024-04-15T21:02:26.381 INFO:tasks.workunit.client.0.smithi072.stdout:5/19: write d0/d3/f4 [954279,48861] 0 2024-04-15T21:02:26.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/121: dwrite dc/d14/f13 [0,4194304] 0 2024-04-15T21:02:26.387 INFO:tasks.workunit.client.0.smithi072.stdout:5/20: dwrite d0/d3/f4 [4194304,4194304] 0 2024-04-15T21:02:26.387 INFO:tasks.workunit.client.0.smithi072.stdout:8/28: mknod d3/d4/ca 0 2024-04-15T21:02:26.388 INFO:tasks.workunit.client.0.smithi072.stdout:2/17: fsync d2/d3/f5 0 2024-04-15T21:02:26.388 INFO:tasks.workunit.client.0.smithi072.stdout:8/29: rename d3/d4 to d3/d4/db 22 2024-04-15T21:02:26.389 INFO:tasks.workunit.client.0.smithi072.stdout:8/30: dread - d3/d4/f9 zero size 2024-04-15T21:02:26.389 INFO:tasks.workunit.client.0.smithi072.stdout:2/18: write f1 [1968051,6279] 0 2024-04-15T21:02:26.390 INFO:tasks.workunit.client.0.smithi072.stdout:2/19: dread - d2/d3/f5 zero size 2024-04-15T21:02:26.403 INFO:tasks.workunit.client.1.smithi149.stdout:6/141: dwrite da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:26.407 INFO:tasks.workunit.client.1.smithi149.stdout:4/122: dread dc/d14/f13 [0,4194304] 0 2024-04-15T21:02:26.407 INFO:tasks.workunit.client.1.smithi149.stdout:2/208: dwrite d4/f18 [0,4194304] 0 2024-04-15T21:02:26.408 INFO:tasks.workunit.client.1.smithi149.stdout:8/118: dwrite d2/df/d10/d20/f27 [4194304,4194304] 0 2024-04-15T21:02:26.409 INFO:tasks.workunit.client.0.smithi072.stdout:3/29: getdents d1 0 2024-04-15T21:02:26.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/209: chown d4/d7/f31 833370 1 2024-04-15T21:02:26.412 INFO:tasks.workunit.client.0.smithi072.stdout:5/21: unlink d0/c5 0 2024-04-15T21:02:26.412 INFO:tasks.workunit.client.1.smithi149.stdout:4/123: dread dc/fd [0,4194304] 0 2024-04-15T21:02:26.413 INFO:tasks.workunit.client.1.smithi149.stdout:2/210: write d4/f33 [8804513,108407] 0 2024-04-15T21:02:26.418 INFO:tasks.workunit.client.0.smithi072.stdout:9/36: rmdir d4/d9 0 2024-04-15T21:02:26.422 INFO:tasks.workunit.client.0.smithi072.stdout:8/31: creat d3/fc x:0 0 0 2024-04-15T21:02:26.423 INFO:tasks.workunit.client.0.smithi072.stdout:8/32: chown d3/c7 8354751 1 2024-04-15T21:02:26.423 INFO:tasks.workunit.client.0.smithi072.stdout:8/33: dread - d3/fc zero size 2024-04-15T21:02:26.426 INFO:tasks.workunit.client.0.smithi072.stdout:2/20: creat d2/d3/f6 x:0 0 0 2024-04-15T21:02:26.427 INFO:tasks.workunit.client.0.smithi072.stdout:2/21: chown f1 128 1 2024-04-15T21:02:26.428 INFO:tasks.workunit.client.1.smithi149.stdout:8/119: creat d2/df/d10/d25/f28 x:0 0 0 2024-04-15T21:02:26.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/22: write d2/d3/f5 [482478,61451] 0 2024-04-15T21:02:26.429 INFO:tasks.workunit.client.0.smithi072.stdout:6/31: getdents d2 0 2024-04-15T21:02:26.429 INFO:tasks.workunit.client.0.smithi072.stdout:6/32: stat d2/l9 0 2024-04-15T21:02:26.430 INFO:tasks.workunit.client.1.smithi149.stdout:4/124: symlink dc/d14/l27 0 2024-04-15T21:02:26.432 INFO:tasks.workunit.client.0.smithi072.stdout:3/30: creat d1/fa x:0 0 0 2024-04-15T21:02:26.432 INFO:tasks.workunit.client.0.smithi072.stdout:3/31: stat d1/f8 0 2024-04-15T21:02:26.433 INFO:tasks.workunit.client.0.smithi072.stdout:3/32: read - d1/f6 zero size 2024-04-15T21:02:26.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/142: mknod da/d11/d2d/c31 0 2024-04-15T21:02:26.433 INFO:tasks.workunit.client.0.smithi072.stdout:3/33: truncate d1/f6 581040 0 2024-04-15T21:02:26.435 INFO:tasks.workunit.client.0.smithi072.stdout:5/22: mkdir d0/d3/d7 0 2024-04-15T21:02:26.436 INFO:tasks.workunit.client.0.smithi072.stdout:5/23: chown d0/f2 107561740 1 2024-04-15T21:02:26.437 INFO:tasks.workunit.client.1.smithi149.stdout:4/125: rmdir dc/d14/d15 39 2024-04-15T21:02:26.437 INFO:tasks.workunit.client.0.smithi072.stdout:9/37: mknod d4/ca 0 2024-04-15T21:02:26.437 INFO:tasks.workunit.client.1.smithi149.stdout:4/126: chown dc/lf 750610277 1 2024-04-15T21:02:26.438 INFO:tasks.workunit.client.0.smithi072.stdout:2/23: read d2/d3/f5 [429200,75313] 0 2024-04-15T21:02:26.438 INFO:tasks.workunit.client.0.smithi072.stdout:8/34: symlink d3/ld 0 2024-04-15T21:02:26.439 INFO:tasks.workunit.client.0.smithi072.stdout:9/38: truncate d4/f5 424179 0 2024-04-15T21:02:26.440 INFO:tasks.workunit.client.0.smithi072.stdout:3/34: dwrite d1/f2 [0,4194304] 0 2024-04-15T21:02:26.441 INFO:tasks.workunit.client.1.smithi149.stdout:6/143: unlink l9 0 2024-04-15T21:02:26.441 INFO:tasks.workunit.client.0.smithi072.stdout:3/35: write d1/f6 [1157519,118765] 0 2024-04-15T21:02:26.444 INFO:tasks.workunit.client.0.smithi072.stdout:6/33: fdatasync d2/f4 0 2024-04-15T21:02:26.453 INFO:tasks.workunit.client.0.smithi072.stdout:8/35: unlink d3/c7 0 2024-04-15T21:02:26.456 INFO:tasks.workunit.client.1.smithi149.stdout:6/144: mkdir da/d32 0 2024-04-15T21:02:26.458 INFO:tasks.workunit.client.1.smithi149.stdout:8/120: getdents d2/df/d10 0 2024-04-15T21:02:26.458 INFO:tasks.workunit.client.1.smithi149.stdout:8/121: chown d2/lc 0 1 2024-04-15T21:02:26.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/145: unlink da/d18/d10/d16/f21 0 2024-04-15T21:02:26.465 INFO:tasks.workunit.client.1.smithi149.stdout:4/127: getdents dc/d14/d23 0 2024-04-15T21:02:26.465 INFO:tasks.workunit.client.1.smithi149.stdout:4/128: readlink dc/d14/l27 0 2024-04-15T21:02:26.466 INFO:tasks.workunit.client.0.smithi072.stdout:6/34: rmdir d2 39 2024-04-15T21:02:26.467 INFO:tasks.workunit.client.1.smithi149.stdout:6/146: rename da/d11/d2d to da/d18/d33 0 2024-04-15T21:02:26.468 INFO:tasks.workunit.client.0.smithi072.stdout:5/24: creat d0/d3/d6/f8 x:0 0 0 2024-04-15T21:02:26.468 INFO:tasks.workunit.client.0.smithi072.stdout:5/25: chown d0/d3/d7 1 1 2024-04-15T21:02:26.469 INFO:tasks.workunit.client.1.smithi149.stdout:6/147: write da/d11/f1a [527351,13261] 0 2024-04-15T21:02:26.469 INFO:tasks.workunit.client.1.smithi149.stdout:8/122: symlink d2/d16/l29 0 2024-04-15T21:02:26.469 INFO:tasks.workunit.client.0.smithi072.stdout:5/26: write d0/f2 [7187009,27189] 0 2024-04-15T21:02:26.469 INFO:tasks.workunit.client.1.smithi149.stdout:8/123: fsync d2/df/d10/d20/f27 0 2024-04-15T21:02:26.470 INFO:tasks.workunit.client.0.smithi072.stdout:8/36: mkdir d3/de 0 2024-04-15T21:02:26.471 INFO:tasks.workunit.client.0.smithi072.stdout:8/37: truncate d3/fc 80536 0 2024-04-15T21:02:26.471 INFO:tasks.workunit.client.0.smithi072.stdout:2/24: rename d2/d3/f6 to d2/d3/f7 0 2024-04-15T21:02:26.471 INFO:tasks.workunit.client.0.smithi072.stdout:8/38: read - d3/d4/f9 zero size 2024-04-15T21:02:26.473 INFO:tasks.workunit.client.1.smithi149.stdout:4/129: dread f1 [0,4194304] 0 2024-04-15T21:02:26.473 INFO:tasks.workunit.client.0.smithi072.stdout:5/27: dread d0/f2 [4194304,4194304] 0 2024-04-15T21:02:26.473 INFO:tasks.workunit.client.0.smithi072.stdout:5/28: chown d0/f2 10 1 2024-04-15T21:02:26.474 INFO:tasks.workunit.client.0.smithi072.stdout:5/29: read - d0/d3/d6/f8 zero size 2024-04-15T21:02:26.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/124: dread d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:26.474 INFO:tasks.workunit.client.0.smithi072.stdout:3/36: creat d1/d7/fb x:0 0 0 2024-04-15T21:02:26.476 INFO:tasks.workunit.client.1.smithi149.stdout:4/130: symlink dc/l28 0 2024-04-15T21:02:26.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/125: creat d2/d16/f2a x:0 0 0 2024-04-15T21:02:26.481 INFO:tasks.workunit.client.1.smithi149.stdout:4/131: symlink dc/d18/d21/l29 0 2024-04-15T21:02:26.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/126: dread d2/fe [0,4194304] 0 2024-04-15T21:02:26.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/132: read - dc/d14/d23/f22 zero size 2024-04-15T21:02:26.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/25: mkdir d2/d8 0 2024-04-15T21:02:26.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/26: chown d2/d3 1 1 2024-04-15T21:02:26.484 INFO:tasks.workunit.client.0.smithi072.stdout:8/39: creat d3/ff x:0 0 0 2024-04-15T21:02:26.485 INFO:tasks.workunit.client.0.smithi072.stdout:9/39: link c1 d4/cb 0 2024-04-15T21:02:26.486 INFO:tasks.workunit.client.1.smithi149.stdout:4/133: mkdir dc/d14/d23/d2a 0 2024-04-15T21:02:26.490 INFO:tasks.workunit.client.1.smithi149.stdout:4/134: creat dc/d1a/f2b x:0 0 0 2024-04-15T21:02:26.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/135: write dc/fd [901210,25848] 0 2024-04-15T21:02:26.491 INFO:tasks.workunit.client.0.smithi072.stdout:8/40: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:26.493 INFO:tasks.workunit.client.0.smithi072.stdout:6/35: creat d2/fa x:0 0 0 2024-04-15T21:02:26.493 INFO:tasks.workunit.client.0.smithi072.stdout:8/41: stat d3/d4 0 2024-04-15T21:02:26.493 INFO:tasks.workunit.client.0.smithi072.stdout:9/40: dwrite d4/f7 [0,4194304] 0 2024-04-15T21:02:26.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/127: creat d2/f2b x:0 0 0 2024-04-15T21:02:26.494 INFO:tasks.workunit.client.0.smithi072.stdout:8/42: chown d3/ld 5 1 2024-04-15T21:02:26.495 INFO:tasks.workunit.client.0.smithi072.stdout:8/43: write f1 [311486,124741] 0 2024-04-15T21:02:26.495 INFO:tasks.workunit.client.1.smithi149.stdout:4/136: fsync f1 0 2024-04-15T21:02:26.498 INFO:tasks.workunit.client.0.smithi072.stdout:3/37: rmdir d1/d7 39 2024-04-15T21:02:26.500 INFO:tasks.workunit.client.1.smithi149.stdout:8/128: dwrite d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:26.501 INFO:tasks.workunit.client.1.smithi149.stdout:8/129: dread - d2/f1f zero size 2024-04-15T21:02:26.502 INFO:tasks.workunit.client.0.smithi072.stdout:8/44: fdatasync f1 0 2024-04-15T21:02:26.502 INFO:tasks.workunit.client.0.smithi072.stdout:8/45: chown f1 8248593 1 2024-04-15T21:02:26.504 INFO:tasks.workunit.client.1.smithi149.stdout:4/137: unlink dc/fd 0 2024-04-15T21:02:26.508 INFO:tasks.workunit.client.1.smithi149.stdout:8/130: mknod d2/df/d10/d20/c2c 0 2024-04-15T21:02:26.509 INFO:tasks.workunit.client.0.smithi072.stdout:9/41: chown c1 1437365 1 2024-04-15T21:02:26.511 INFO:tasks.workunit.client.0.smithi072.stdout:6/36: read d2/f4 [3281958,27543] 0 2024-04-15T21:02:26.512 INFO:tasks.workunit.client.0.smithi072.stdout:6/37: chown d2/f4 115865 1 2024-04-15T21:02:26.513 INFO:tasks.workunit.client.1.smithi149.stdout:4/138: rename dc/d14/d23 to dc/d2c 0 2024-04-15T21:02:26.515 INFO:tasks.workunit.client.1.smithi149.stdout:8/131: mknod d2/df/d10/d21/c2d 0 2024-04-15T21:02:26.516 INFO:tasks.workunit.client.1.smithi149.stdout:8/132: chown d2/df/d10/d25/f26 40194064 1 2024-04-15T21:02:26.516 INFO:tasks.workunit.client.1.smithi149.stdout:8/133: fsync d2/d16/f2a 0 2024-04-15T21:02:26.517 INFO:tasks.workunit.client.0.smithi072.stdout:2/27: rename d2/d3/f7 to d2/f9 0 2024-04-15T21:02:26.517 INFO:tasks.workunit.client.0.smithi072.stdout:2/28: chown d2 17661 1 2024-04-15T21:02:26.521 INFO:tasks.workunit.client.0.smithi072.stdout:5/30: rename d0/f2 to d0/f9 0 2024-04-15T21:02:26.522 INFO:tasks.workunit.client.1.smithi149.stdout:8/134: dwrite d2/f1a [0,4194304] 0 2024-04-15T21:02:26.522 INFO:tasks.workunit.client.0.smithi072.stdout:8/46: symlink d3/l10 0 2024-04-15T21:02:26.523 INFO:tasks.workunit.client.0.smithi072.stdout:9/42: creat d4/fc x:0 0 0 2024-04-15T21:02:26.524 INFO:tasks.workunit.client.1.smithi149.stdout:8/135: write d2/df/d10/f23 [1002707,1414] 0 2024-04-15T21:02:26.524 INFO:tasks.workunit.client.0.smithi072.stdout:6/38: creat d2/fb x:0 0 0 2024-04-15T21:02:26.525 INFO:tasks.workunit.client.0.smithi072.stdout:2/29: creat d2/fa x:0 0 0 2024-04-15T21:02:26.526 INFO:tasks.workunit.client.0.smithi072.stdout:2/30: write f1 [2081438,100119] 0 2024-04-15T21:02:26.527 INFO:tasks.workunit.client.0.smithi072.stdout:8/47: dread d3/ff [0,4194304] 0 2024-04-15T21:02:26.527 INFO:tasks.workunit.client.1.smithi149.stdout:8/136: read d2/df/d10/f23 [880618,64339] 0 2024-04-15T21:02:26.528 INFO:tasks.workunit.client.0.smithi072.stdout:2/31: write f1 [2965372,97883] 0 2024-04-15T21:02:26.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/43: symlink d4/ld 0 2024-04-15T21:02:26.532 INFO:tasks.workunit.client.0.smithi072.stdout:8/48: dread d3/ff [0,4194304] 0 2024-04-15T21:02:26.532 INFO:tasks.workunit.client.1.smithi149.stdout:8/137: mkdir d2/df/d10/d25/d2e 0 2024-04-15T21:02:26.533 INFO:tasks.workunit.client.0.smithi072.stdout:8/49: chown d3/l10 120227362 1 2024-04-15T21:02:26.538 INFO:tasks.workunit.client.0.smithi072.stdout:2/32: mknod d2/d3/cb 0 2024-04-15T21:02:26.539 INFO:tasks.workunit.client.0.smithi072.stdout:2/33: write d2/fa [919738,113865] 0 2024-04-15T21:02:26.540 INFO:tasks.workunit.client.1.smithi149.stdout:4/139: dread dc/d18/f1f [0,4194304] 0 2024-04-15T21:02:26.541 INFO:tasks.workunit.client.0.smithi072.stdout:9/44: rename d4/ca to d4/ce 0 2024-04-15T21:02:26.542 INFO:tasks.workunit.client.0.smithi072.stdout:9/45: truncate d4/f5 1207151 0 2024-04-15T21:02:26.542 INFO:tasks.workunit.client.0.smithi072.stdout:6/39: link d2/fb d2/fc 0 2024-04-15T21:02:26.544 INFO:tasks.workunit.client.1.smithi149.stdout:8/138: rename d2/c7 to d2/c2f 0 2024-04-15T21:02:26.544 INFO:tasks.workunit.client.1.smithi149.stdout:8/139: stat d2/df 0 2024-04-15T21:02:26.545 INFO:tasks.workunit.client.0.smithi072.stdout:3/38: write f0 [1923585,85285] 0 2024-04-15T21:02:26.545 INFO:tasks.workunit.client.0.smithi072.stdout:3/39: readlink - no filename 2024-04-15T21:02:26.547 INFO:tasks.workunit.client.1.smithi149.stdout:5/148: sync 2024-04-15T21:02:26.547 INFO:tasks.workunit.client.1.smithi149.stdout:7/115: sync 2024-04-15T21:02:26.548 INFO:tasks.workunit.client.0.smithi072.stdout:5/31: creat d0/fa x:0 0 0 2024-04-15T21:02:26.549 INFO:tasks.workunit.client.0.smithi072.stdout:9/46: dwrite d4/fc [0,4194304] 0 2024-04-15T21:02:26.550 INFO:tasks.workunit.client.0.smithi072.stdout:6/40: fdatasync d2/f4 0 2024-04-15T21:02:26.550 INFO:tasks.workunit.client.0.smithi072.stdout:6/41: dread - d2/fa zero size 2024-04-15T21:02:26.552 INFO:tasks.workunit.client.1.smithi149.stdout:8/140: dwrite d2/df/d10/d25/f26 [0,4194304] 0 2024-04-15T21:02:26.552 INFO:tasks.workunit.client.0.smithi072.stdout:8/50: creat d3/de/f11 x:0 0 0 2024-04-15T21:02:26.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/34: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:26.558 INFO:tasks.workunit.client.1.smithi149.stdout:5/149: unlink d0/d9/db/d12/d16/d28/f19 0 2024-04-15T21:02:26.563 INFO:tasks.workunit.client.1.smithi149.stdout:4/140: rename dc/c24 to dc/d14/d15/c2d 0 2024-04-15T21:02:26.564 INFO:tasks.workunit.client.1.smithi149.stdout:4/141: chown dc/d18/l20 3096 1 2024-04-15T21:02:26.565 INFO:tasks.workunit.client.1.smithi149.stdout:7/116: symlink d3/d16/l2a 0 2024-04-15T21:02:26.568 INFO:tasks.workunit.client.1.smithi149.stdout:4/142: dread dc/d18/f1d [0,4194304] 0 2024-04-15T21:02:26.568 INFO:tasks.workunit.client.1.smithi149.stdout:8/141: mkdir d2/df/d10/d20/d30 0 2024-04-15T21:02:26.573 INFO:tasks.workunit.client.0.smithi072.stdout:8/51: mknod d3/d4/c12 0 2024-04-15T21:02:26.577 INFO:tasks.workunit.client.0.smithi072.stdout:3/40: mknod d1/d7/cc 0 2024-04-15T21:02:26.579 INFO:tasks.workunit.client.1.smithi149.stdout:4/143: creat dc/d14/d15/f2e x:0 0 0 2024-04-15T21:02:26.580 INFO:tasks.workunit.client.0.smithi072.stdout:5/32: truncate d0/d3/f4 177959 0 2024-04-15T21:02:26.581 INFO:tasks.workunit.client.1.smithi149.stdout:8/142: rename d2/df/d10/d21/c2d to d2/df/d10/d20/c31 0 2024-04-15T21:02:26.585 INFO:tasks.workunit.client.0.smithi072.stdout:2/35: symlink d2/d8/lc 0 2024-04-15T21:02:26.586 INFO:tasks.workunit.client.0.smithi072.stdout:6/42: dwrite d2/fc [0,4194304] 0 2024-04-15T21:02:26.586 INFO:tasks.workunit.client.0.smithi072.stdout:6/43: stat d2/f4 0 2024-04-15T21:02:26.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/144: symlink dc/d18/d21/l2f 0 2024-04-15T21:02:26.587 INFO:tasks.workunit.client.1.smithi149.stdout:8/143: dwrite d2/f1a [4194304,4194304] 0 2024-04-15T21:02:26.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/145: chown lb 23 1 2024-04-15T21:02:26.589 INFO:tasks.workunit.client.1.smithi149.stdout:5/150: link d0/d9/db/d12/d16/c26 d0/d6/c3c 0 2024-04-15T21:02:26.592 INFO:tasks.workunit.client.1.smithi149.stdout:8/144: mkdir d2/df/d10/d25/d32 0 2024-04-15T21:02:26.594 INFO:tasks.workunit.client.0.smithi072.stdout:2/36: symlink d2/d3/ld 0 2024-04-15T21:02:26.594 INFO:tasks.workunit.client.0.smithi072.stdout:2/37: read d2/fa [968577,14516] 0 2024-04-15T21:02:26.595 INFO:tasks.workunit.client.1.smithi149.stdout:4/146: creat dc/d1a/f30 x:0 0 0 2024-04-15T21:02:26.598 INFO:tasks.workunit.client.0.smithi072.stdout:5/33: symlink d0/d3/d7/lb 0 2024-04-15T21:02:26.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/151: mkdir d0/d9/db/d3d 0 2024-04-15T21:02:26.602 INFO:tasks.workunit.client.0.smithi072.stdout:6/44: mknod d2/cd 0 2024-04-15T21:02:26.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/117: getdents d3/d16 0 2024-04-15T21:02:26.607 INFO:tasks.workunit.client.0.smithi072.stdout:3/41: link d1/f4 d1/fd 0 2024-04-15T21:02:26.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/147: symlink dc/d18/l31 0 2024-04-15T21:02:26.609 INFO:tasks.workunit.client.1.smithi149.stdout:4/148: chown dc/l28 1 1 2024-04-15T21:02:26.610 INFO:tasks.workunit.client.0.smithi072.stdout:8/52: truncate d3/ff 4054976 0 2024-04-15T21:02:26.610 INFO:tasks.workunit.client.0.smithi072.stdout:8/53: read d3/fc [20510,91949] 0 2024-04-15T21:02:26.611 INFO:tasks.workunit.client.0.smithi072.stdout:2/38: truncate d2/d3/f5 794497 0 2024-04-15T21:02:26.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/149: fdatasync dc/d14/f13 0 2024-04-15T21:02:26.614 INFO:tasks.workunit.client.0.smithi072.stdout:6/45: creat d2/fe x:0 0 0 2024-04-15T21:02:26.616 INFO:tasks.workunit.client.0.smithi072.stdout:3/42: creat d1/d7/fe x:0 0 0 2024-04-15T21:02:26.619 INFO:tasks.workunit.client.1.smithi149.stdout:7/118: creat d3/f2b x:0 0 0 2024-04-15T21:02:26.622 INFO:tasks.workunit.client.0.smithi072.stdout:3/43: dwrite d1/d7/fb [0,4194304] 0 2024-04-15T21:02:26.625 INFO:tasks.workunit.client.0.smithi072.stdout:2/39: creat d2/d8/fe x:0 0 0 2024-04-15T21:02:26.626 INFO:tasks.workunit.client.0.smithi072.stdout:3/44: dread f0 [0,4194304] 0 2024-04-15T21:02:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/144: sync 2024-04-15T21:02:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:0/103: sync 2024-04-15T21:02:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:9/139: sync 2024-04-15T21:02:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:3/137: sync 2024-04-15T21:02:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:5/152: dwrite d0/d9/db/d12/f29 [0,4194304] 0 2024-04-15T21:02:26.630 INFO:tasks.workunit.client.1.smithi149.stdout:1/145: readlink d1/d17/l19 0 2024-04-15T21:02:26.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/153: fsync d0/d9/db/d12/d16/d28/d1b/f1f 0 2024-04-15T21:02:26.637 INFO:tasks.workunit.client.1.smithi149.stdout:9/140: dread f11 [0,4194304] 0 2024-04-15T21:02:26.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/119: creat d3/f2c x:0 0 0 2024-04-15T21:02:26.640 INFO:tasks.workunit.client.1.smithi149.stdout:4/150: dread f2 [0,4194304] 0 2024-04-15T21:02:26.643 INFO:tasks.workunit.client.0.smithi072.stdout:8/54: unlink d3/fc 0 2024-04-15T21:02:26.647 INFO:tasks.workunit.client.1.smithi149.stdout:3/138: truncate d1/fd 268352 0 2024-04-15T21:02:26.648 INFO:tasks.workunit.client.1.smithi149.stdout:3/139: dread - d1/dc/f22 zero size 2024-04-15T21:02:26.649 INFO:tasks.workunit.client.0.smithi072.stdout:2/40: symlink d2/lf 0 2024-04-15T21:02:26.650 INFO:tasks.workunit.client.1.smithi149.stdout:9/141: creat d23/f2e x:0 0 0 2024-04-15T21:02:26.651 INFO:tasks.workunit.client.1.smithi149.stdout:7/120: dwrite d3/f5 [4194304,4194304] 0 2024-04-15T21:02:26.653 INFO:tasks.workunit.client.0.smithi072.stdout:5/34: dread d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:26.653 INFO:tasks.workunit.client.0.smithi072.stdout:5/35: write d0/fa [621560,28809] 0 2024-04-15T21:02:26.655 INFO:tasks.workunit.client.1.smithi149.stdout:4/151: creat dc/d14/d15/f32 x:0 0 0 2024-04-15T21:02:26.660 INFO:tasks.workunit.client.1.smithi149.stdout:3/140: rename d1/dc to d1/db/d24/d2b 0 2024-04-15T21:02:26.665 INFO:tasks.workunit.client.1.smithi149.stdout:4/152: mknod dc/d1a/c33 0 2024-04-15T21:02:26.666 INFO:tasks.workunit.client.0.smithi072.stdout:2/41: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:26.668 INFO:tasks.workunit.client.0.smithi072.stdout:6/46: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:26.668 INFO:tasks.workunit.client.0.smithi072.stdout:5/36: rmdir d0/d3/d7 39 2024-04-15T21:02:26.668 INFO:tasks.workunit.client.0.smithi072.stdout:5/37: chown d0/d3/f4 395218 1 2024-04-15T21:02:26.670 INFO:tasks.workunit.client.0.smithi072.stdout:2/42: dread f1 [0,4194304] 0 2024-04-15T21:02:26.673 INFO:tasks.workunit.client.1.smithi149.stdout:7/121: creat d3/f2d x:0 0 0 2024-04-15T21:02:26.675 INFO:tasks.workunit.client.1.smithi149.stdout:4/153: dwrite dc/d1a/f2b [0,4194304] 0 2024-04-15T21:02:26.677 INFO:tasks.workunit.client.0.smithi072.stdout:8/55: dread d3/ff [0,4194304] 0 2024-04-15T21:02:26.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/104: truncate d1/f11 3505279 0 2024-04-15T21:02:26.678 INFO:tasks.workunit.client.1.smithi149.stdout:4/154: fdatasync dc/d2c/f22 0 2024-04-15T21:02:26.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/155: dread - dc/d1a/f26 zero size 2024-04-15T21:02:26.681 INFO:tasks.workunit.client.1.smithi149.stdout:9/142: dread f3 [0,4194304] 0 2024-04-15T21:02:26.681 INFO:tasks.workunit.client.1.smithi149.stdout:4/156: chown fa 1244852494 1 2024-04-15T21:02:26.682 INFO:tasks.workunit.client.1.smithi149.stdout:9/143: chown f22 0 1 2024-04-15T21:02:26.685 INFO:tasks.workunit.client.1.smithi149.stdout:9/144: write f21 [916336,79408] 0 2024-04-15T21:02:26.689 INFO:tasks.workunit.client.0.smithi072.stdout:3/45: getdents d1/d7 0 2024-04-15T21:02:26.689 INFO:tasks.workunit.client.1.smithi149.stdout:7/122: symlink d3/d17/d1f/l2e 0 2024-04-15T21:02:26.689 INFO:tasks.workunit.client.0.smithi072.stdout:3/46: read d1/f4 [3213854,11275] 0 2024-04-15T21:02:26.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/123: truncate d3/f2d 1036367 0 2024-04-15T21:02:26.690 INFO:tasks.workunit.client.0.smithi072.stdout:3/47: write d1/fa [482554,110034] 0 2024-04-15T21:02:26.694 INFO:tasks.workunit.client.1.smithi149.stdout:7/124: readlink d3/d17/d26/l28 0 2024-04-15T21:02:26.694 INFO:tasks.workunit.client.1.smithi149.stdout:7/125: truncate d3/d17/d1f/f22 976376 0 2024-04-15T21:02:26.694 INFO:tasks.workunit.client.1.smithi149.stdout:4/157: creat dc/d14/d15/f34 x:0 0 0 2024-04-15T21:02:26.698 INFO:tasks.workunit.client.1.smithi149.stdout:3/141: fsync d1/fd 0 2024-04-15T21:02:26.700 INFO:tasks.workunit.client.1.smithi149.stdout:7/126: creat d3/d17/d26/f2f x:0 0 0 2024-04-15T21:02:26.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/145: write f3 [3964744,47485] 0 2024-04-15T21:02:26.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/142: getdents d1/db/d23 0 2024-04-15T21:02:26.713 INFO:tasks.workunit.client.1.smithi149.stdout:4/158: dwrite dc/d18/f1d [4194304,4194304] 0 2024-04-15T21:02:26.715 INFO:tasks.workunit.client.0.smithi072.stdout:2/43: dwrite d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:26.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/143: fsync d1/fd 0 2024-04-15T21:02:26.723 INFO:tasks.workunit.client.1.smithi149.stdout:7/127: dwrite d3/d17/f19 [0,4194304] 0 2024-04-15T21:02:26.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/105: dwrite d1/f22 [0,4194304] 0 2024-04-15T21:02:26.725 INFO:tasks.workunit.client.0.smithi072.stdout:2/44: symlink d2/d8/l10 0 2024-04-15T21:02:26.726 INFO:tasks.workunit.client.1.smithi149.stdout:0/106: stat d1/f4 0 2024-04-15T21:02:26.726 INFO:tasks.workunit.client.1.smithi149.stdout:7/128: read d3/d17/f19 [617954,122845] 0 2024-04-15T21:02:26.730 INFO:tasks.workunit.client.1.smithi149.stdout:9/146: fdatasync f4 0 2024-04-15T21:02:26.733 INFO:tasks.workunit.client.0.smithi072.stdout:3/48: truncate d1/f6 698127 0 2024-04-15T21:02:26.737 INFO:tasks.workunit.client.0.smithi072.stdout:2/45: mknod d2/d3/c11 0 2024-04-15T21:02:26.744 INFO:tasks.workunit.client.1.smithi149.stdout:0/107: dread d1/f11 [0,4194304] 0 2024-04-15T21:02:26.746 INFO:tasks.workunit.client.0.smithi072.stdout:2/46: unlink d2/d3/c11 0 2024-04-15T21:02:26.747 INFO:tasks.workunit.client.0.smithi072.stdout:2/47: write d2/d8/fe [781344,84250] 0 2024-04-15T21:02:26.747 INFO:tasks.workunit.client.1.smithi149.stdout:7/129: creat d3/d16/f30 x:0 0 0 2024-04-15T21:02:26.748 INFO:tasks.workunit.client.1.smithi149.stdout:7/130: write d3/f5 [1184614,60322] 0 2024-04-15T21:02:26.749 INFO:tasks.workunit.client.1.smithi149.stdout:9/147: rename d23/f2e to d23/f2f 0 2024-04-15T21:02:26.750 INFO:tasks.workunit.client.1.smithi149.stdout:4/159: mkdir dc/d14/d35 0 2024-04-15T21:02:26.750 INFO:tasks.workunit.client.1.smithi149.stdout:9/148: truncate d23/f24 198462 0 2024-04-15T21:02:26.751 INFO:tasks.workunit.client.1.smithi149.stdout:4/160: dread - dc/d14/d15/f32 zero size 2024-04-15T21:02:26.752 INFO:tasks.workunit.client.0.smithi072.stdout:3/49: rename d1/d7/fe to d1/ff 0 2024-04-15T21:02:26.753 INFO:tasks.workunit.client.0.smithi072.stdout:3/50: truncate d1/f3 2441820 0 2024-04-15T21:02:26.754 INFO:tasks.workunit.client.0.smithi072.stdout:2/48: dwrite d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:26.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/144: unlink d1/l17 0 2024-04-15T21:02:26.755 INFO:tasks.workunit.client.1.smithi149.stdout:0/108: fdatasync d1/f4 0 2024-04-15T21:02:26.759 INFO:tasks.workunit.client.1.smithi149.stdout:7/131: creat d3/d17/f31 x:0 0 0 2024-04-15T21:02:26.759 INFO:tasks.workunit.client.1.smithi149.stdout:9/149: symlink d23/d2b/l30 0 2024-04-15T21:02:26.762 INFO:tasks.workunit.client.1.smithi149.stdout:4/161: mknod dc/d18/c36 0 2024-04-15T21:02:26.764 INFO:tasks.workunit.client.1.smithi149.stdout:3/145: stat d1/db/d24/d2b/c16 0 2024-04-15T21:02:26.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/109: dread d1/d5/f12 [4194304,4194304] 0 2024-04-15T21:02:26.771 INFO:tasks.workunit.client.1.smithi149.stdout:7/132: mkdir d3/d16/d32 0 2024-04-15T21:02:26.772 INFO:tasks.workunit.client.0.smithi072.stdout:2/49: getdents d2/d3 0 2024-04-15T21:02:26.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/133: creat d3/d17/f33 x:0 0 0 2024-04-15T21:02:26.783 INFO:tasks.workunit.client.1.smithi149.stdout:3/146: creat d1/db/d23/f2c x:0 0 0 2024-04-15T21:02:26.784 INFO:tasks.workunit.client.0.smithi072.stdout:2/50: creat d2/f12 x:0 0 0 2024-04-15T21:02:26.784 INFO:tasks.workunit.client.0.smithi072.stdout:3/51: write d1/f3 [380225,20909] 0 2024-04-15T21:02:26.784 INFO:tasks.workunit.client.1.smithi149.stdout:9/150: rmdir d23 39 2024-04-15T21:02:26.785 INFO:tasks.workunit.client.0.smithi072.stdout:2/51: write d2/f12 [481683,73219] 0 2024-04-15T21:02:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:7/134: dwrite d3/d16/d20/f24 [0,4194304] 0 2024-04-15T21:02:26.786 INFO:tasks.workunit.client.1.smithi149.stdout:0/110: mknod d1/d9/d10/c23 0 2024-04-15T21:02:26.790 INFO:tasks.workunit.client.0.smithi072.stdout:3/52: dwrite d1/d7/fb [0,4194304] 0 2024-04-15T21:02:26.791 INFO:tasks.workunit.client.1.smithi149.stdout:3/147: chown d1/l14 2555216 1 2024-04-15T21:02:26.792 INFO:tasks.workunit.client.1.smithi149.stdout:3/148: write d1/db/d24/d2b/f25 [3804670,105885] 0 2024-04-15T21:02:26.793 INFO:tasks.workunit.client.1.smithi149.stdout:3/149: readlink d1/l1f 0 2024-04-15T21:02:26.794 INFO:tasks.workunit.client.1.smithi149.stdout:3/150: chown d1/db 256258998 1 2024-04-15T21:02:26.798 INFO:tasks.workunit.client.1.smithi149.stdout:3/151: truncate d1/db/d28/f2a 594788 0 2024-04-15T21:02:26.801 INFO:tasks.workunit.client.1.smithi149.stdout:4/162: dwrite f5 [0,4194304] 0 2024-04-15T21:02:26.804 INFO:tasks.workunit.client.1.smithi149.stdout:9/151: symlink d23/d2b/l31 0 2024-04-15T21:02:26.804 INFO:tasks.workunit.client.1.smithi149.stdout:2/211: sync 2024-04-15T21:02:26.804 INFO:tasks.workunit.client.1.smithi149.stdout:6/148: sync 2024-04-15T21:02:26.813 INFO:tasks.workunit.client.1.smithi149.stdout:0/111: write d1/f4 [1847366,105392] 0 2024-04-15T21:02:26.816 INFO:tasks.workunit.client.1.smithi149.stdout:6/149: dwrite da/d18/f19 [0,4194304] 0 2024-04-15T21:02:26.820 INFO:tasks.workunit.client.1.smithi149.stdout:2/212: creat d4/d7/d29/f4f x:0 0 0 2024-04-15T21:02:26.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/152: mknod d1/c2d 0 2024-04-15T21:02:26.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/112: rename d1/d9/df to d1/d5/d24 0 2024-04-15T21:02:26.833 INFO:tasks.workunit.client.1.smithi149.stdout:9/152: link f1a d23/d2b/f32 0 2024-04-15T21:02:26.834 INFO:tasks.workunit.client.1.smithi149.stdout:9/153: write f22 [57373,93148] 0 2024-04-15T21:02:26.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/150: symlink da/d11/l34 0 2024-04-15T21:02:26.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/213: creat d4/d7/d2f/f50 x:0 0 0 2024-04-15T21:02:26.839 INFO:tasks.workunit.client.1.smithi149.stdout:7/135: getdents d3/d17/d26 0 2024-04-15T21:02:26.843 INFO:tasks.workunit.client.1.smithi149.stdout:7/136: dread d3/d16/d20/f24 [0,4194304] 0 2024-04-15T21:02:26.844 INFO:tasks.workunit.client.1.smithi149.stdout:4/163: creat dc/d14/f37 x:0 0 0 2024-04-15T21:02:26.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/214: creat d4/d7/d2f/f51 x:0 0 0 2024-04-15T21:02:26.854 INFO:tasks.workunit.client.1.smithi149.stdout:0/113: mknod d1/d9/c25 0 2024-04-15T21:02:26.854 INFO:tasks.workunit.client.1.smithi149.stdout:3/153: write d1/db/f21 [349676,112594] 0 2024-04-15T21:02:26.858 INFO:tasks.workunit.client.1.smithi149.stdout:9/154: write d23/d2b/f32 [1639418,52552] 0 2024-04-15T21:02:26.863 INFO:tasks.workunit.client.1.smithi149.stdout:3/154: creat d1/db/d24/d2b/f2e x:0 0 0 2024-04-15T21:02:26.864 INFO:tasks.workunit.client.1.smithi149.stdout:7/137: mkdir d3/d34 0 2024-04-15T21:02:26.866 INFO:tasks.workunit.client.1.smithi149.stdout:7/138: chown d3/d16/d20/f24 956294 1 2024-04-15T21:02:26.867 INFO:tasks.workunit.client.1.smithi149.stdout:9/155: creat d23/f33 x:0 0 0 2024-04-15T21:02:26.868 INFO:tasks.workunit.client.1.smithi149.stdout:2/215: fdatasync d4/d7/d29/f30 0 2024-04-15T21:02:26.870 INFO:tasks.workunit.client.1.smithi149.stdout:3/155: dwrite d1/db/d23/f2c [0,4194304] 0 2024-04-15T21:02:26.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/156: mknod d23/d2b/c34 0 2024-04-15T21:02:26.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/157: chown f21 688714 1 2024-04-15T21:02:26.881 INFO:tasks.workunit.client.1.smithi149.stdout:9/158: write f1d [3331841,110348] 0 2024-04-15T21:02:26.885 INFO:tasks.workunit.client.1.smithi149.stdout:2/216: symlink d4/d7/l52 0 2024-04-15T21:02:26.886 INFO:tasks.workunit.client.1.smithi149.stdout:4/164: getdents dc/d14 0 2024-04-15T21:02:26.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/114: link l0 d1/d9/d10/l26 0 2024-04-15T21:02:26.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/115: truncate d1/d9/f1b 699059 0 2024-04-15T21:02:26.897 INFO:tasks.workunit.client.1.smithi149.stdout:2/217: rmdir d4/d7/d19/d21/d2c/d32 39 2024-04-15T21:02:26.899 INFO:tasks.workunit.client.1.smithi149.stdout:4/165: mknod dc/d18/d21/c38 0 2024-04-15T21:02:26.902 INFO:tasks.workunit.client.1.smithi149.stdout:7/139: link d3/d16/l2a d3/d17/d26/l35 0 2024-04-15T21:02:26.905 INFO:tasks.workunit.client.1.smithi149.stdout:0/116: unlink d1/d5/dc/l1e 0 2024-04-15T21:02:26.907 INFO:tasks.workunit.client.1.smithi149.stdout:2/218: fsync d4/d7/d19/d21/f3a 0 2024-04-15T21:02:26.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/156: creat d1/f2f x:0 0 0 2024-04-15T21:02:26.913 INFO:tasks.workunit.client.1.smithi149.stdout:7/140: rename d3/d17/d26 to d3/d16/d20/d36 0 2024-04-15T21:02:26.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/159: write f9 [2854471,104201] 0 2024-04-15T21:02:26.917 INFO:tasks.workunit.client.1.smithi149.stdout:4/166: link f2 dc/d2c/f39 0 2024-04-15T21:02:26.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/219: rename d4/l28 to d4/d7/d19/d21/d3b/d4c/l53 0 2024-04-15T21:02:26.923 INFO:tasks.workunit.client.1.smithi149.stdout:7/141: dwrite d3/f2b [0,4194304] 0 2024-04-15T21:02:26.923 INFO:tasks.workunit.client.1.smithi149.stdout:0/117: symlink d1/d9/d10/l27 0 2024-04-15T21:02:26.924 INFO:tasks.workunit.client.1.smithi149.stdout:7/142: chown d3/d16 19011 1 2024-04-15T21:02:26.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/167: dread dc/fe [0,4194304] 0 2024-04-15T21:02:26.927 INFO:tasks.workunit.client.1.smithi149.stdout:2/220: chown d4/d7/d10/l17 116638327 1 2024-04-15T21:02:26.929 INFO:tasks.workunit.client.1.smithi149.stdout:9/160: dwrite d23/d2b/f2c [0,4194304] 0 2024-04-15T21:02:26.929 INFO:tasks.workunit.client.1.smithi149.stdout:0/118: write d1/d9/f1b [729591,34347] 0 2024-04-15T21:02:26.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/161: write d23/f33 [581447,36186] 0 2024-04-15T21:02:26.937 INFO:tasks.workunit.client.1.smithi149.stdout:3/157: dread d1/fa [0,4194304] 0 2024-04-15T21:02:26.943 INFO:tasks.workunit.client.1.smithi149.stdout:7/143: dwrite d3/d16/f30 [0,4194304] 0 2024-04-15T21:02:26.949 INFO:tasks.workunit.client.1.smithi149.stdout:9/162: dwrite d23/d2b/f32 [0,4194304] 0 2024-04-15T21:02:26.952 INFO:tasks.workunit.client.1.smithi149.stdout:3/158: fsync d1/f2f 0 2024-04-15T21:02:26.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/159: stat d1/db/d24/d2b/f1b 0 2024-04-15T21:02:26.961 INFO:tasks.workunit.client.1.smithi149.stdout:4/168: mkdir dc/d14/d35/d3a 0 2024-04-15T21:02:26.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/144: rename d3/l15 to d3/d17/d1f/l37 0 2024-04-15T21:02:26.967 INFO:tasks.workunit.client.1.smithi149.stdout:9/163: mknod d23/d2b/c35 0 2024-04-15T21:02:26.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/164: read - d23/f2f zero size 2024-04-15T21:02:26.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/165: chown f22 6264299 1 2024-04-15T21:02:26.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/166: read - f17 zero size 2024-04-15T21:02:26.973 INFO:tasks.workunit.client.1.smithi149.stdout:7/145: creat d3/d17/d1f/f38 x:0 0 0 2024-04-15T21:02:26.974 INFO:tasks.workunit.client.1.smithi149.stdout:7/146: write d3/f18 [817503,89384] 0 2024-04-15T21:02:26.975 INFO:tasks.workunit.client.1.smithi149.stdout:9/167: symlink d23/l36 0 2024-04-15T21:02:26.975 INFO:tasks.workunit.client.1.smithi149.stdout:7/147: chown d3/d17/f1a 431468274 1 2024-04-15T21:02:26.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/221: link d4/d7/da/ff d4/d7/d46/f54 0 2024-04-15T21:02:26.978 INFO:tasks.workunit.client.1.smithi149.stdout:2/222: dread - d4/d7/d29/f4f zero size 2024-04-15T21:02:26.979 INFO:tasks.workunit.client.1.smithi149.stdout:0/119: write d1/d5/f12 [4091086,104842] 0 2024-04-15T21:02:26.982 INFO:tasks.workunit.client.1.smithi149.stdout:2/223: dread d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:26.984 INFO:tasks.workunit.client.1.smithi149.stdout:2/224: write d4/d7/d10/d36/f49 [2475088,111795] 0 2024-04-15T21:02:26.989 INFO:tasks.workunit.client.1.smithi149.stdout:3/160: link d1/db/d28/f2a d1/f30 0 2024-04-15T21:02:26.989 INFO:tasks.workunit.client.1.smithi149.stdout:9/168: dwrite f11 [0,4194304] 0 2024-04-15T21:02:26.992 INFO:tasks.workunit.client.1.smithi149.stdout:4/169: link dc/d18/d21/l29 dc/d14/d15/l3b 0 2024-04-15T21:02:26.996 INFO:tasks.workunit.client.1.smithi149.stdout:8/145: sync 2024-04-15T21:02:26.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/146: sync 2024-04-15T21:02:26.996 INFO:tasks.workunit.client.1.smithi149.stdout:6/151: sync 2024-04-15T21:02:26.996 INFO:tasks.workunit.client.1.smithi149.stdout:5/154: sync 2024-04-15T21:02:27.002 INFO:tasks.workunit.client.1.smithi149.stdout:2/225: mkdir d4/d7/d19/d21/d55 0 2024-04-15T21:02:27.007 INFO:tasks.workunit.client.1.smithi149.stdout:3/161: readlink d1/l15 0 2024-04-15T21:02:27.009 INFO:tasks.workunit.client.1.smithi149.stdout:2/226: dwrite d4/d7/f31 [0,4194304] 0 2024-04-15T21:02:27.010 INFO:tasks.workunit.client.1.smithi149.stdout:2/227: write d4/d7/d29/f4f [586454,13716] 0 2024-04-15T21:02:27.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/169: mkdir d23/d2b/d37 0 2024-04-15T21:02:27.015 INFO:tasks.workunit.client.1.smithi149.stdout:0/120: symlink d1/d9/d10/l28 0 2024-04-15T21:02:27.015 INFO:tasks.workunit.client.1.smithi149.stdout:9/170: write d23/d2b/f32 [2793709,95034] 0 2024-04-15T21:02:27.018 INFO:tasks.workunit.client.1.smithi149.stdout:9/171: write f1d [395760,117928] 0 2024-04-15T21:02:27.018 INFO:tasks.workunit.client.1.smithi149.stdout:4/170: symlink dc/d14/d35/l3c 0 2024-04-15T21:02:27.021 INFO:tasks.workunit.client.1.smithi149.stdout:6/152: creat da/d11/f35 x:0 0 0 2024-04-15T21:02:27.022 INFO:tasks.workunit.client.1.smithi149.stdout:2/228: dwrite d4/d7/d19/d21/d3b/f44 [0,4194304] 0 2024-04-15T21:02:27.024 INFO:tasks.workunit.client.1.smithi149.stdout:8/146: creat d2/df/d10/d25/f33 x:0 0 0 2024-04-15T21:02:27.031 INFO:tasks.workunit.client.1.smithi149.stdout:7/148: truncate d3/d17/d1f/f22 643109 0 2024-04-15T21:02:27.031 INFO:tasks.workunit.client.1.smithi149.stdout:8/147: read d2/f4 [3642113,51031] 0 2024-04-15T21:02:27.032 INFO:tasks.workunit.client.1.smithi149.stdout:7/149: write d3/f5 [2239349,121979] 0 2024-04-15T21:02:27.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/162: creat d1/db/d28/f31 x:0 0 0 2024-04-15T21:02:27.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/121: mkdir d1/d29 0 2024-04-15T21:02:27.044 INFO:tasks.workunit.client.1.smithi149.stdout:9/172: unlink d23/d2b/c2d 0 2024-04-15T21:02:27.046 INFO:tasks.workunit.client.1.smithi149.stdout:4/171: rename dc/l28 to dc/d18/l3d 0 2024-04-15T21:02:27.054 INFO:tasks.workunit.client.1.smithi149.stdout:1/147: link d1/d17/f1c d1/db/d16/f24 0 2024-04-15T21:02:27.055 INFO:tasks.workunit.client.1.smithi149.stdout:1/148: stat d1/f5 0 2024-04-15T21:02:27.056 INFO:tasks.workunit.client.1.smithi149.stdout:1/149: write d1/f9 [4661836,50571] 0 2024-04-15T21:02:27.058 INFO:tasks.workunit.client.1.smithi149.stdout:8/148: mkdir d2/df/d10/d34 0 2024-04-15T21:02:27.059 INFO:tasks.workunit.client.1.smithi149.stdout:8/149: dread - d2/df/d10/d25/f28 zero size 2024-04-15T21:02:27.060 INFO:tasks.workunit.client.1.smithi149.stdout:8/150: chown d2/df/d10/f11 47 1 2024-04-15T21:02:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:9/173: symlink d23/l38 0 2024-04-15T21:02:27.065 INFO:tasks.workunit.client.1.smithi149.stdout:4/172: rename dc/d14 to dc/d2c/d3e 0 2024-04-15T21:02:27.069 INFO:tasks.workunit.client.1.smithi149.stdout:2/229: link d4/d7/d19/d21/f3a d4/d7/d19/f56 0 2024-04-15T21:02:27.070 INFO:tasks.workunit.client.1.smithi149.stdout:2/230: readlink d4/d7/d19/d21/d2c/l34 0 2024-04-15T21:02:27.076 INFO:tasks.workunit.client.1.smithi149.stdout:7/150: mkdir d3/d39 0 2024-04-15T21:02:27.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/174: mknod d23/c39 0 2024-04-15T21:02:27.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/175: write f21 [8535,46393] 0 2024-04-15T21:02:27.084 INFO:tasks.workunit.client.1.smithi149.stdout:6/153: creat da/f36 x:0 0 0 2024-04-15T21:02:27.091 INFO:tasks.workunit.client.1.smithi149.stdout:7/151: creat d3/d16/d20/d36/f3a x:0 0 0 2024-04-15T21:02:27.091 INFO:tasks.workunit.client.1.smithi149.stdout:7/152: stat d3/fc 0 2024-04-15T21:02:27.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/153: fsync d3/d16/f30 0 2024-04-15T21:02:27.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/154: readlink d3/d17/d1f/l2e 0 2024-04-15T21:02:27.093 INFO:tasks.workunit.client.1.smithi149.stdout:8/151: mkdir d2/df/d10/d20/d30/d35 0 2024-04-15T21:02:27.093 INFO:tasks.workunit.client.1.smithi149.stdout:7/155: write d3/f2c [141520,77398] 0 2024-04-15T21:02:27.094 INFO:tasks.workunit.client.1.smithi149.stdout:8/152: stat d2/d16/f2a 0 2024-04-15T21:02:27.094 INFO:tasks.workunit.client.1.smithi149.stdout:7/156: stat d3/d16/d20/d36/f3a 0 2024-04-15T21:02:27.096 INFO:tasks.workunit.client.1.smithi149.stdout:8/153: truncate d2/df/d10/d25/f28 929983 0 2024-04-15T21:02:27.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/122: creat d1/d9/d10/f2a x:0 0 0 2024-04-15T21:02:27.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/176: creat d23/f3a x:0 0 0 2024-04-15T21:02:27.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/154: mknod da/d18/d10/d16/c37 0 2024-04-15T21:02:27.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/231: write d4/d7/da/f4e [1865533,6914] 0 2024-04-15T21:02:27.107 INFO:tasks.workunit.client.1.smithi149.stdout:1/150: truncate d1/db/d16/f24 1360617 0 2024-04-15T21:02:27.108 INFO:tasks.workunit.client.1.smithi149.stdout:2/232: fsync d4/d7/d29/f30 0 2024-04-15T21:02:27.109 INFO:tasks.workunit.client.1.smithi149.stdout:2/233: stat d4/d7/f31 0 2024-04-15T21:02:27.110 INFO:tasks.workunit.client.1.smithi149.stdout:2/234: chown d4/d7/d19/d21/f3a 3813 1 2024-04-15T21:02:27.111 INFO:tasks.workunit.client.1.smithi149.stdout:9/177: rename f11 to d23/f3b 0 2024-04-15T21:02:27.111 INFO:tasks.workunit.client.1.smithi149.stdout:2/235: write d4/d7/d10/f11 [1037257,67378] 0 2024-04-15T21:02:27.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/155: write f8 [954513,81598] 0 2024-04-15T21:02:27.115 INFO:tasks.workunit.client.1.smithi149.stdout:7/157: mknod d3/d34/c3b 0 2024-04-15T21:02:27.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/154: creat d2/df/d10/d34/f36 x:0 0 0 2024-04-15T21:02:27.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/155: dread - d2/d16/f2a zero size 2024-04-15T21:02:27.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/123: rename d1/d5/c14 to d1/d5/c2b 0 2024-04-15T21:02:27.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/124: dread d1/d9/f19 [0,4194304] 0 2024-04-15T21:02:27.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/236: creat d4/d7/d46/f57 x:0 0 0 2024-04-15T21:02:27.134 INFO:tasks.workunit.client.1.smithi149.stdout:8/156: rename d2/df/d10/d25/d2e to d2/df/d10/d25/d37 0 2024-04-15T21:02:27.135 INFO:tasks.workunit.client.1.smithi149.stdout:7/158: dwrite d3/d17/f19 [0,4194304] 0 2024-04-15T21:02:27.136 INFO:tasks.workunit.client.1.smithi149.stdout:1/151: symlink d1/db/d14/d21/l25 0 2024-04-15T21:02:27.137 INFO:tasks.workunit.client.1.smithi149.stdout:7/159: fsync d3/d16/d20/d36/f3a 0 2024-04-15T21:02:27.137 INFO:tasks.workunit.client.1.smithi149.stdout:7/160: fsync d3/d17/f1a 0 2024-04-15T21:02:27.148 INFO:tasks.workunit.client.1.smithi149.stdout:6/156: mknod da/c38 0 2024-04-15T21:02:27.154 INFO:tasks.workunit.client.1.smithi149.stdout:9/178: dwrite f4 [4194304,4194304] 0 2024-04-15T21:02:27.154 INFO:tasks.workunit.client.1.smithi149.stdout:8/157: write d2/fe [2119327,13666] 0 2024-04-15T21:02:27.156 INFO:tasks.workunit.client.1.smithi149.stdout:1/152: unlink d1/f9 0 2024-04-15T21:02:27.164 INFO:tasks.workunit.client.1.smithi149.stdout:7/161: symlink d3/d34/l3c 0 2024-04-15T21:02:27.166 INFO:tasks.workunit.client.1.smithi149.stdout:1/153: dwrite d1/db/d14/d1e/f1f [0,4194304] 0 2024-04-15T21:02:27.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/237: mkdir d4/d7/d19/d21/d2c/d58 0 2024-04-15T21:02:27.168 INFO:tasks.workunit.client.1.smithi149.stdout:1/154: chown d1/d17/l19 47 1 2024-04-15T21:02:27.172 INFO:tasks.workunit.client.1.smithi149.stdout:2/238: dread - d4/d7/d19/d21/d2c/f4b zero size 2024-04-15T21:02:27.175 INFO:tasks.workunit.client.1.smithi149.stdout:7/162: dread d3/f4 [0,4194304] 0 2024-04-15T21:02:27.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/239: stat d4/d7/d19/c1f 0 2024-04-15T21:02:27.176 INFO:tasks.workunit.client.1.smithi149.stdout:0/125: dwrite d1/d9/fd [0,4194304] 0 2024-04-15T21:02:27.176 INFO:tasks.workunit.client.1.smithi149.stdout:8/158: mkdir d2/df/d10/d20/d38 0 2024-04-15T21:02:27.180 INFO:tasks.workunit.client.1.smithi149.stdout:8/159: read d2/df/d10/d20/f27 [4536222,70212] 0 2024-04-15T21:02:27.183 INFO:tasks.workunit.client.1.smithi149.stdout:1/155: dwrite d1/f5 [4194304,4194304] 0 2024-04-15T21:02:27.187 INFO:tasks.workunit.client.1.smithi149.stdout:7/163: mkdir d3/d16/d20/d36/d3d 0 2024-04-15T21:02:27.189 INFO:tasks.workunit.client.1.smithi149.stdout:7/164: chown d3/d16/d20/d36/l28 265479205 1 2024-04-15T21:02:27.197 INFO:tasks.workunit.client.1.smithi149.stdout:7/165: dwrite d3/d17/d1f/f38 [0,4194304] 0 2024-04-15T21:02:27.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/157: link l5 da/d18/l39 0 2024-04-15T21:02:27.201 INFO:tasks.workunit.client.1.smithi149.stdout:6/158: write da/f24 [4626489,129988] 0 2024-04-15T21:02:27.202 INFO:tasks.workunit.client.1.smithi149.stdout:8/160: rmdir d2/df/d10/d20/d30 39 2024-04-15T21:02:27.204 INFO:tasks.workunit.client.1.smithi149.stdout:6/159: chown da/d18/d10/d16/l25 7361114 1 2024-04-15T21:02:27.219 INFO:tasks.workunit.client.1.smithi149.stdout:2/240: creat d4/d7/d19/d21/d55/f59 x:0 0 0 2024-04-15T21:02:27.219 INFO:tasks.workunit.client.1.smithi149.stdout:0/126: mkdir d1/d29/d2c 0 2024-04-15T21:02:27.219 INFO:tasks.workunit.client.1.smithi149.stdout:7/166: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:27.221 INFO:tasks.workunit.client.1.smithi149.stdout:1/156: mknod d1/db/d16/c26 0 2024-04-15T21:02:27.222 INFO:tasks.workunit.client.1.smithi149.stdout:9/179: truncate f16 414074 0 2024-04-15T21:02:27.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/180: stat d23/d2b/c34 0 2024-04-15T21:02:27.226 INFO:tasks.workunit.client.1.smithi149.stdout:9/181: write d23/f3a [282344,100710] 0 2024-04-15T21:02:27.227 INFO:tasks.workunit.client.1.smithi149.stdout:9/182: chown d23/f24 1459619 1 2024-04-15T21:02:27.227 INFO:tasks.workunit.client.1.smithi149.stdout:6/160: stat da/d11/c15 0 2024-04-15T21:02:27.230 INFO:tasks.workunit.client.1.smithi149.stdout:0/127: rename d1/l1a to d1/l2d 0 2024-04-15T21:02:27.232 INFO:tasks.workunit.client.1.smithi149.stdout:7/167: mknod d3/d16/c3e 0 2024-04-15T21:02:27.235 INFO:tasks.workunit.client.1.smithi149.stdout:8/161: creat d2/df/d10/d25/d32/f39 x:0 0 0 2024-04-15T21:02:27.236 INFO:tasks.workunit.client.1.smithi149.stdout:2/241: dread d4/d7/d29/f30 [0,4194304] 0 2024-04-15T21:02:27.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/168: dwrite d3/ff [4194304,4194304] 0 2024-04-15T21:02:27.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/161: rename c7 to da/d18/d10/c3a 0 2024-04-15T21:02:27.252 INFO:tasks.workunit.client.1.smithi149.stdout:2/242: symlink d4/d7/d19/d21/d3b/l5a 0 2024-04-15T21:02:27.253 INFO:tasks.workunit.client.1.smithi149.stdout:2/243: dread - d4/d7/d10/d36/f47 zero size 2024-04-15T21:02:27.254 INFO:tasks.workunit.client.1.smithi149.stdout:9/183: dread f9 [4194304,4194304] 0 2024-04-15T21:02:27.255 INFO:tasks.workunit.client.1.smithi149.stdout:2/244: write d4/d7/d46/f57 [554517,86784] 0 2024-04-15T21:02:27.256 INFO:tasks.workunit.client.1.smithi149.stdout:7/169: unlink d3/f4 0 2024-04-15T21:02:27.257 INFO:tasks.workunit.client.1.smithi149.stdout:6/162: dread f8 [0,4194304] 0 2024-04-15T21:02:27.260 INFO:tasks.workunit.client.1.smithi149.stdout:0/128: unlink l0 0 2024-04-15T21:02:27.263 INFO:tasks.workunit.client.1.smithi149.stdout:9/184: mkdir d23/d3c 0 2024-04-15T21:02:27.264 INFO:tasks.workunit.client.1.smithi149.stdout:9/185: stat d23/f3a 0 2024-04-15T21:02:27.265 INFO:tasks.workunit.client.1.smithi149.stdout:7/170: fdatasync d3/fb 0 2024-04-15T21:02:27.266 INFO:tasks.workunit.client.1.smithi149.stdout:0/129: dwrite d1/d9/fd [0,4194304] 0 2024-04-15T21:02:27.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/171: truncate d3/d17/d1f/f25 304946 0 2024-04-15T21:02:27.268 INFO:tasks.workunit.client.1.smithi149.stdout:6/163: mknod da/d18/c3b 0 2024-04-15T21:02:27.274 INFO:tasks.workunit.client.1.smithi149.stdout:8/162: rmdir d2/df/d10/d20/d38 0 2024-04-15T21:02:27.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/186: symlink d23/l3d 0 2024-04-15T21:02:27.280 INFO:tasks.workunit.client.0.smithi072.stdout:2/52: creat d2/d8/f13 x:0 0 0 2024-04-15T21:02:27.281 INFO:tasks.workunit.client.1.smithi149.stdout:0/130: unlink d1/l6 0 2024-04-15T21:02:27.283 INFO:tasks.workunit.client.1.smithi149.stdout:6/164: fdatasync f8 0 2024-04-15T21:02:27.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/165: chown da/d11/f22 1 1 2024-04-15T21:02:27.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/166: write f8 [1397017,76370] 0 2024-04-15T21:02:27.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/163: rename d2/c15 to d2/df/d10/d25/d32/c3a 0 2024-04-15T21:02:27.290 INFO:tasks.workunit.client.1.smithi149.stdout:9/187: creat d23/f3e x:0 0 0 2024-04-15T21:02:27.294 INFO:tasks.workunit.client.1.smithi149.stdout:0/131: rename d1/d9/fd to d1/d5/f2e 0 2024-04-15T21:02:27.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/188: unlink d23/f3e 0 2024-04-15T21:02:27.297 INFO:tasks.workunit.client.1.smithi149.stdout:9/189: write f1f [1652856,86744] 0 2024-04-15T21:02:27.301 INFO:tasks.workunit.client.1.smithi149.stdout:0/132: chown d1/d9/d10/d15/l1c 10418670 1 2024-04-15T21:02:27.302 INFO:tasks.workunit.client.1.smithi149.stdout:8/164: unlink d2/df/d10/d20/c31 0 2024-04-15T21:02:27.309 INFO:tasks.workunit.client.1.smithi149.stdout:9/190: mknod d23/d3c/c3f 0 2024-04-15T21:02:27.310 INFO:tasks.workunit.client.1.smithi149.stdout:6/167: getdents da/d18/d10/d16 0 2024-04-15T21:02:27.310 INFO:tasks.workunit.client.1.smithi149.stdout:9/191: dread d23/f24 [0,4194304] 0 2024-04-15T21:02:27.311 INFO:tasks.workunit.client.1.smithi149.stdout:8/165: symlink d2/df/d10/d20/d30/l3b 0 2024-04-15T21:02:27.314 INFO:tasks.workunit.client.1.smithi149.stdout:6/168: rename da/f24 to da/d18/d10/d16/f3c 0 2024-04-15T21:02:27.315 INFO:tasks.workunit.client.1.smithi149.stdout:6/169: write da/d18/f23 [3665114,20912] 0 2024-04-15T21:02:27.316 INFO:tasks.workunit.client.1.smithi149.stdout:6/170: truncate da/d11/f1a 1577864 0 2024-04-15T21:02:27.319 INFO:tasks.workunit.client.1.smithi149.stdout:9/192: rename d23/l3d to d23/d3c/l40 0 2024-04-15T21:02:27.320 INFO:tasks.workunit.client.1.smithi149.stdout:9/193: truncate d23/f2f 801652 0 2024-04-15T21:02:27.322 INFO:tasks.workunit.client.1.smithi149.stdout:6/171: rename da/d18/l2c to da/d11/l3d 0 2024-04-15T21:02:27.323 INFO:tasks.workunit.client.1.smithi149.stdout:6/172: chown da/d18/d10/d16 520107383 1 2024-04-15T21:02:27.324 INFO:tasks.workunit.client.1.smithi149.stdout:9/194: creat d23/d2b/f41 x:0 0 0 2024-04-15T21:02:27.338 INFO:tasks.workunit.client.1.smithi149.stdout:6/173: mkdir da/d18/d3e 0 2024-04-15T21:02:27.339 INFO:tasks.workunit.client.1.smithi149.stdout:6/174: truncate da/d18/d10/d16/f2f 804614 0 2024-04-15T21:02:27.359 INFO:tasks.workunit.client.1.smithi149.stdout:6/175: truncate da/f1b 1456361 0 2024-04-15T21:02:27.360 INFO:tasks.workunit.client.1.smithi149.stdout:7/172: truncate d3/f2c 101230 0 2024-04-15T21:02:27.360 INFO:tasks.workunit.client.1.smithi149.stdout:7/173: fsync d3/f7 0 2024-04-15T21:02:27.361 INFO:tasks.workunit.client.0.smithi072.stdout:2/53: dwrite d2/f9 [0,4194304] 0 2024-04-15T21:02:27.362 INFO:tasks.workunit.client.1.smithi149.stdout:7/174: stat d3/d16/d20/d36/c29 0 2024-04-15T21:02:27.364 INFO:tasks.workunit.client.1.smithi149.stdout:7/175: chown d3/d17/d1f/l2e 781362498 1 2024-04-15T21:02:27.369 INFO:tasks.workunit.client.1.smithi149.stdout:6/176: dwrite da/d11/f22 [0,4194304] 0 2024-04-15T21:02:27.376 INFO:tasks.workunit.client.1.smithi149.stdout:7/176: dwrite d3/d17/f33 [0,4194304] 0 2024-04-15T21:02:27.377 INFO:tasks.workunit.client.1.smithi149.stdout:7/177: readlink d3/l27 0 2024-04-15T21:02:27.385 INFO:tasks.workunit.client.1.smithi149.stdout:6/177: rename da/d18/d3e to da/d18/d10/d3f 0 2024-04-15T21:02:27.386 INFO:tasks.workunit.client.1.smithi149.stdout:6/178: chown da/c38 165799 1 2024-04-15T21:02:27.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/178: mkdir d3/d16/d32/d3f 0 2024-04-15T21:02:27.389 INFO:tasks.workunit.client.1.smithi149.stdout:8/166: write d2/df/d10/f11 [7765902,76836] 0 2024-04-15T21:02:27.394 INFO:tasks.workunit.client.1.smithi149.stdout:7/179: mknod d3/d16/d32/d3f/c40 0 2024-04-15T21:02:27.417 INFO:tasks.workunit.client.0.smithi072.stdout:2/54: write f1 [1105068,51318] 0 2024-04-15T21:02:27.418 INFO:tasks.workunit.client.1.smithi149.stdout:7/180: dwrite d3/f2c [0,4194304] 0 2024-04-15T21:02:27.421 INFO:tasks.workunit.client.1.smithi149.stdout:0/133: truncate d1/d5/d24/f21 81321 0 2024-04-15T21:02:27.424 INFO:tasks.workunit.client.0.smithi072.stdout:2/55: mknod d2/d8/c14 0 2024-04-15T21:02:27.425 INFO:tasks.workunit.client.1.smithi149.stdout:7/181: creat d3/d16/d20/f41 x:0 0 0 2024-04-15T21:02:27.426 INFO:tasks.workunit.client.1.smithi149.stdout:7/182: chown d3/d34/l3c 13999897 1 2024-04-15T21:02:27.431 INFO:tasks.workunit.client.1.smithi149.stdout:8/167: dwrite d2/df/d10/f23 [0,4194304] 0 2024-04-15T21:02:27.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/183: fsync d3/d17/d1f/f22 0 2024-04-15T21:02:27.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/134: getdents d1/d9 0 2024-04-15T21:02:27.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/184: creat d3/d17/f42 x:0 0 0 2024-04-15T21:02:27.441 INFO:tasks.workunit.client.1.smithi149.stdout:7/185: write d3/f2b [391073,57934] 0 2024-04-15T21:02:27.441 INFO:tasks.workunit.client.1.smithi149.stdout:7/186: fsync d3/f7 0 2024-04-15T21:02:27.442 INFO:tasks.workunit.client.1.smithi149.stdout:8/168: mknod d2/df/c3c 0 2024-04-15T21:02:27.444 INFO:tasks.workunit.client.0.smithi072.stdout:2/56: write d2/fa [1512800,59131] 0 2024-04-15T21:02:27.450 INFO:tasks.workunit.client.0.smithi072.stdout:2/57: creat d2/d3/f15 x:0 0 0 2024-04-15T21:02:27.451 INFO:tasks.workunit.client.1.smithi149.stdout:0/135: creat d1/d5/f2f x:0 0 0 2024-04-15T21:02:27.454 INFO:tasks.workunit.client.1.smithi149.stdout:8/169: write d2/f4 [4107912,35941] 0 2024-04-15T21:02:27.455 INFO:tasks.workunit.client.0.smithi072.stdout:2/58: rmdir d2/d3 39 2024-04-15T21:02:27.455 INFO:tasks.workunit.client.0.smithi072.stdout:2/59: readlink d2/d8/l10 0 2024-04-15T21:02:27.455 INFO:tasks.workunit.client.0.smithi072.stdout:2/60: fsync d2/fa 0 2024-04-15T21:02:27.456 INFO:tasks.workunit.client.1.smithi149.stdout:8/170: write d2/f1b [4589108,90707] 0 2024-04-15T21:02:27.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/187: dwrite d3/fb [0,4194304] 0 2024-04-15T21:02:27.461 INFO:tasks.workunit.client.1.smithi149.stdout:8/171: rmdir d2/df/d10/d20 39 2024-04-15T21:02:27.468 INFO:tasks.workunit.client.1.smithi149.stdout:7/188: fsync d3/f9 0 2024-04-15T21:02:27.471 INFO:tasks.workunit.client.1.smithi149.stdout:0/136: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-15T21:02:27.477 INFO:tasks.workunit.client.1.smithi149.stdout:0/137: truncate d1/d9/d10/f2a 992111 0 2024-04-15T21:02:27.480 INFO:tasks.workunit.client.1.smithi149.stdout:8/172: dwrite d2/df/d10/f23 [0,4194304] 0 2024-04-15T21:02:27.483 INFO:tasks.workunit.client.1.smithi149.stdout:8/173: symlink d2/df/d10/d21/l3d 0 2024-04-15T21:02:27.485 INFO:tasks.workunit.client.1.smithi149.stdout:8/174: stat d2/df 0 2024-04-15T21:02:27.486 INFO:tasks.workunit.client.1.smithi149.stdout:8/175: fsync d2/f1a 0 2024-04-15T21:02:27.486 INFO:tasks.workunit.client.1.smithi149.stdout:7/189: dwrite d3/f9 [0,4194304] 0 2024-04-15T21:02:27.489 INFO:tasks.workunit.client.1.smithi149.stdout:8/176: write d2/f1a [2566601,52634] 0 2024-04-15T21:02:27.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/138: dwrite d1/f22 [4194304,4194304] 0 2024-04-15T21:02:27.497 INFO:tasks.workunit.client.1.smithi149.stdout:8/177: creat d2/df/d10/d25/d37/f3e x:0 0 0 2024-04-15T21:02:27.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/139: mkdir d1/d5/d24/d30 0 2024-04-15T21:02:27.506 INFO:tasks.workunit.client.1.smithi149.stdout:7/190: dwrite d3/d17/f1a [0,4194304] 0 2024-04-15T21:02:27.506 INFO:tasks.workunit.client.1.smithi149.stdout:8/178: mknod d2/df/d10/c3f 0 2024-04-15T21:02:27.523 INFO:tasks.workunit.client.1.smithi149.stdout:0/140: dwrite d1/d5/f12 [0,4194304] 0 2024-04-15T21:02:27.524 INFO:tasks.workunit.client.1.smithi149.stdout:8/179: dwrite d2/df/d10/d25/f33 [0,4194304] 0 2024-04-15T21:02:27.525 INFO:tasks.workunit.client.1.smithi149.stdout:8/180: chown d2/f2b 147 1 2024-04-15T21:02:27.525 INFO:tasks.workunit.client.1.smithi149.stdout:0/141: mknod d1/d5/d24/c31 0 2024-04-15T21:02:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/191: write d3/d17/d1f/f22 [1586984,9866] 0 2024-04-15T21:02:27.542 INFO:tasks.workunit.client.1.smithi149.stdout:0/142: dwrite d1/f4 [0,4194304] 0 2024-04-15T21:02:27.542 INFO:tasks.workunit.client.1.smithi149.stdout:7/192: mknod d3/d17/c43 0 2024-04-15T21:02:27.542 INFO:tasks.workunit.client.1.smithi149.stdout:7/193: stat d3/d17/d1f/l2e 0 2024-04-15T21:02:27.546 INFO:tasks.workunit.client.1.smithi149.stdout:0/143: mkdir d1/d5/d24/d30/d32 0 2024-04-15T21:02:27.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/181: dwrite d2/df/d10/d25/f28 [0,4194304] 0 2024-04-15T21:02:27.551 INFO:tasks.workunit.client.1.smithi149.stdout:8/182: readlink d2/la 0 2024-04-15T21:02:27.553 INFO:tasks.workunit.client.1.smithi149.stdout:8/183: write d2/df/d10/f19 [4523460,29194] 0 2024-04-15T21:02:27.553 INFO:tasks.workunit.client.1.smithi149.stdout:0/144: stat d1/d5/c2b 0 2024-04-15T21:02:27.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/145: read - d1/d5/f2f zero size 2024-04-15T21:02:27.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/146: unlink d1/d9/d10/c20 0 2024-04-15T21:02:27.563 INFO:tasks.workunit.client.1.smithi149.stdout:8/184: creat d2/df/f40 x:0 0 0 2024-04-15T21:02:27.564 INFO:tasks.workunit.client.1.smithi149.stdout:7/194: dwrite d3/f18 [0,4194304] 0 2024-04-15T21:02:27.565 INFO:tasks.workunit.client.1.smithi149.stdout:8/185: stat d2/df/d10/d25/d37/f3e 0 2024-04-15T21:02:27.572 INFO:tasks.workunit.client.1.smithi149.stdout:7/195: mkdir d3/d16/d20/d36/d44 0 2024-04-15T21:02:27.573 INFO:tasks.workunit.client.1.smithi149.stdout:7/196: fdatasync d3/d17/f33 0 2024-04-15T21:02:27.574 INFO:tasks.workunit.client.1.smithi149.stdout:8/186: creat d2/df/d10/d21/f41 x:0 0 0 2024-04-15T21:02:27.578 INFO:tasks.workunit.client.1.smithi149.stdout:8/187: creat d2/df/d10/d25/d32/f42 x:0 0 0 2024-04-15T21:02:27.580 INFO:tasks.workunit.client.1.smithi149.stdout:7/197: symlink d3/d16/d20/d36/d3d/l45 0 2024-04-15T21:02:27.580 INFO:tasks.workunit.client.1.smithi149.stdout:7/198: chown l0 12380519 1 2024-04-15T21:02:27.582 INFO:tasks.workunit.client.1.smithi149.stdout:8/188: unlink d2/df/d10/d34/f36 0 2024-04-15T21:02:27.582 INFO:tasks.workunit.client.1.smithi149.stdout:8/189: readlink d2/la 0 2024-04-15T21:02:27.584 INFO:tasks.workunit.client.1.smithi149.stdout:7/199: getdents d3/d39 0 2024-04-15T21:02:27.587 INFO:tasks.workunit.client.1.smithi149.stdout:7/200: chown d3/d16/d20/d36/l28 18 1 2024-04-15T21:02:27.591 INFO:tasks.workunit.client.1.smithi149.stdout:8/190: dwrite d2/df/d10/f23 [4194304,4194304] 0 2024-04-15T21:02:27.593 INFO:tasks.workunit.client.1.smithi149.stdout:0/147: truncate d1/d5/f2e 16080 0 2024-04-15T21:02:27.594 INFO:tasks.workunit.client.1.smithi149.stdout:8/191: stat d2/df/d10/d25/d37 0 2024-04-15T21:02:27.597 INFO:tasks.workunit.client.1.smithi149.stdout:0/148: write d1/d5/d24/f21 [504753,49793] 0 2024-04-15T21:02:27.599 INFO:tasks.workunit.client.1.smithi149.stdout:7/201: dwrite d3/f2b [0,4194304] 0 2024-04-15T21:02:27.602 INFO:tasks.workunit.client.1.smithi149.stdout:8/192: creat d2/df/d10/d20/d30/d35/f43 x:0 0 0 2024-04-15T21:02:27.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/202: creat d3/d16/d20/d36/d3d/f46 x:0 0 0 2024-04-15T21:02:27.604 INFO:tasks.workunit.client.1.smithi149.stdout:0/149: getdents d1/d5/d24 0 2024-04-15T21:02:27.605 INFO:tasks.workunit.client.1.smithi149.stdout:7/203: readlink d3/l27 0 2024-04-15T21:02:27.606 INFO:tasks.workunit.client.1.smithi149.stdout:8/193: creat d2/df/d10/d25/d32/f44 x:0 0 0 2024-04-15T21:02:27.606 INFO:tasks.workunit.client.1.smithi149.stdout:8/194: chown d2/l22 216765294 1 2024-04-15T21:02:27.609 INFO:tasks.workunit.client.1.smithi149.stdout:7/204: creat d3/f47 x:0 0 0 2024-04-15T21:02:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/150: link d1/l2d d1/l33 0 2024-04-15T21:02:27.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/205: link d3/fc d3/d16/d20/f48 0 2024-04-15T21:02:27.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/151: mknod d1/d5/dc/c34 0 2024-04-15T21:02:27.615 INFO:tasks.workunit.client.1.smithi149.stdout:7/206: write d3/d17/f31 [160916,53631] 0 2024-04-15T21:02:27.616 INFO:tasks.workunit.client.1.smithi149.stdout:0/152: write d1/d9/f1b [290147,72779] 0 2024-04-15T21:02:27.617 INFO:tasks.workunit.client.1.smithi149.stdout:0/153: chown d1/d9/f1b 9589804 1 2024-04-15T21:02:27.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/154: unlink d1/f11 0 2024-04-15T21:02:27.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/155: chown d1/d5/d24/d30 27055 1 2024-04-15T21:02:27.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/156: stat d1/d5/d24/d30/d32 0 2024-04-15T21:02:27.623 INFO:tasks.workunit.client.1.smithi149.stdout:7/207: rename d3/c23 to d3/c49 0 2024-04-15T21:02:27.626 INFO:tasks.workunit.client.1.smithi149.stdout:0/157: unlink d1/d5/d24/f21 0 2024-04-15T21:02:27.630 INFO:tasks.workunit.client.1.smithi149.stdout:7/208: link d3/d34/c3b d3/d16/d20/d36/d3d/c4a 0 2024-04-15T21:02:27.631 INFO:tasks.workunit.client.1.smithi149.stdout:7/209: write d3/d17/d1f/f22 [2047212,70551] 0 2024-04-15T21:02:27.632 INFO:tasks.workunit.client.1.smithi149.stdout:7/210: write d3/d17/d1f/f22 [135954,70952] 0 2024-04-15T21:02:27.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/211: fsync d3/f9 0 2024-04-15T21:02:27.648 INFO:tasks.workunit.client.1.smithi149.stdout:0/158: truncate d1/d9/f1b 166031 0 2024-04-15T21:02:27.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/212: truncate d3/d17/d1f/f25 127888 0 2024-04-15T21:02:27.651 INFO:tasks.workunit.client.1.smithi149.stdout:7/213: write d3/d16/d20/f41 [292814,38454] 0 2024-04-15T21:02:27.655 INFO:tasks.workunit.client.1.smithi149.stdout:0/159: chown d1/l2d 98545758 1 2024-04-15T21:02:27.660 INFO:tasks.workunit.client.1.smithi149.stdout:7/214: dwrite d3/d16/d20/d36/d3d/f46 [0,4194304] 0 2024-04-15T21:02:27.661 INFO:tasks.workunit.client.1.smithi149.stdout:7/215: write d3/d17/d1f/f38 [3750250,91226] 0 2024-04-15T21:02:27.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/216: write d3/d17/f31 [894335,10116] 0 2024-04-15T21:02:27.666 INFO:tasks.workunit.client.1.smithi149.stdout:0/160: creat d1/d9/f35 x:0 0 0 2024-04-15T21:02:27.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/217: unlink d3/l27 0 2024-04-15T21:02:27.677 INFO:tasks.workunit.client.1.smithi149.stdout:7/218: write d3/f18 [4373874,116760] 0 2024-04-15T21:02:27.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/161: chown d1/d9/d10/d13 20161 1 2024-04-15T21:02:27.681 INFO:tasks.workunit.client.1.smithi149.stdout:7/219: symlink d3/l4b 0 2024-04-15T21:02:27.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/162: dread d1/d9/f1b [0,4194304] 0 2024-04-15T21:02:27.685 INFO:tasks.workunit.client.1.smithi149.stdout:7/220: rename d3/d16/c1d to d3/d16/d20/d36/d3d/c4c 0 2024-04-15T21:02:27.687 INFO:tasks.workunit.client.1.smithi149.stdout:7/221: creat d3/d34/f4d x:0 0 0 2024-04-15T21:02:27.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/222: rmdir d3/d16/d20/d36/d44 0 2024-04-15T21:02:27.693 INFO:tasks.workunit.client.1.smithi149.stdout:7/223: link d3/d16/d20/d36/f2f d3/d34/f4e 0 2024-04-15T21:02:27.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/224: creat d3/d16/d20/d36/d3d/f4f x:0 0 0 2024-04-15T21:02:27.696 INFO:tasks.workunit.client.1.smithi149.stdout:7/225: write d3/f5 [6958276,3369] 0 2024-04-15T21:02:27.704 INFO:tasks.workunit.client.1.smithi149.stdout:0/163: dwrite d1/d5/f2e [0,4194304] 0 2024-04-15T21:02:27.705 INFO:tasks.workunit.client.1.smithi149.stdout:7/226: dwrite d3/d34/f4d [0,4194304] 0 2024-04-15T21:02:27.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:27 smithi149 ceph-mon[36029]: pgmap v270: 65 pgs: 65 active+clean; 384 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 516 KiB/s rd, 25 MiB/s wr, 321 op/s 2024-04-15T21:02:27.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/227: write d3/d17/d1f/f22 [1822714,48169] 0 2024-04-15T21:02:27.709 INFO:tasks.workunit.client.1.smithi149.stdout:0/164: mknod d1/d5/dc/c36 0 2024-04-15T21:02:27.710 INFO:tasks.workunit.client.1.smithi149.stdout:0/165: truncate d1/d9/f35 945680 0 2024-04-15T21:02:27.710 INFO:tasks.workunit.client.1.smithi149.stdout:7/228: symlink d3/d34/l50 0 2024-04-15T21:02:27.710 INFO:tasks.workunit.client.1.smithi149.stdout:7/229: stat d3/f5 0 2024-04-15T21:02:27.711 INFO:tasks.workunit.client.1.smithi149.stdout:0/166: chown d1/d9/f1b 16330854 1 2024-04-15T21:02:27.712 INFO:tasks.workunit.client.1.smithi149.stdout:0/167: dread d1/d9/d10/f2a [0,4194304] 0 2024-04-15T21:02:27.713 INFO:tasks.workunit.client.1.smithi149.stdout:7/230: symlink d3/l51 0 2024-04-15T21:02:27.714 INFO:tasks.workunit.client.1.smithi149.stdout:7/231: write d3/d17/f31 [495406,65851] 0 2024-04-15T21:02:27.719 INFO:tasks.workunit.client.1.smithi149.stdout:0/168: dread d1/d5/f12 [4194304,4194304] 0 2024-04-15T21:02:27.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/169: link d1/d5/c8 d1/d5/d24/c37 0 2024-04-15T21:02:27.725 INFO:tasks.workunit.client.1.smithi149.stdout:0/170: write d1/d5/f2f [63272,127581] 0 2024-04-15T21:02:27.726 INFO:tasks.workunit.client.1.smithi149.stdout:7/232: write d3/d34/f4e [64311,36593] 0 2024-04-15T21:02:27.728 INFO:tasks.workunit.client.1.smithi149.stdout:7/233: mknod d3/d16/d20/d36/d3d/c52 0 2024-04-15T21:02:27.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/234: creat d3/d16/d32/f53 x:0 0 0 2024-04-15T21:02:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/235: mkdir d3/d17/d54 0 2024-04-15T21:02:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:0/171: truncate d1/d9/d10/f2a 1485447 0 2024-04-15T21:02:27.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/172: mkdir d1/d9/d10/d13/d38 0 2024-04-15T21:02:27.737 INFO:tasks.workunit.client.1.smithi149.stdout:7/236: dread d3/d17/f33 [0,4194304] 0 2024-04-15T21:02:27.737 INFO:tasks.workunit.client.1.smithi149.stdout:5/155: sync 2024-04-15T21:02:27.737 INFO:tasks.workunit.client.1.smithi149.stdout:7/237: dread - d3/f47 zero size 2024-04-15T21:02:27.739 INFO:tasks.workunit.client.1.smithi149.stdout:0/173: fdatasync d1/d9/f19 0 2024-04-15T21:02:27.739 INFO:tasks.workunit.client.1.smithi149.stdout:7/238: write d3/d17/f1a [765171,116352] 0 2024-04-15T21:02:27.741 INFO:tasks.workunit.client.1.smithi149.stdout:5/156: truncate d0/f3 522288 0 2024-04-15T21:02:27.742 INFO:tasks.workunit.client.1.smithi149.stdout:0/174: dread d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:27.745 INFO:tasks.workunit.client.1.smithi149.stdout:7/239: dread d3/d17/f31 [0,4194304] 0 2024-04-15T21:02:27.746 INFO:tasks.workunit.client.1.smithi149.stdout:7/240: chown d3/d34/l3c 73621 1 2024-04-15T21:02:27.748 INFO:tasks.workunit.client.1.smithi149.stdout:0/175: dread d1/d9/f19 [0,4194304] 0 2024-04-15T21:02:27.749 INFO:tasks.workunit.client.1.smithi149.stdout:7/241: creat d3/d16/d32/d3f/f55 x:0 0 0 2024-04-15T21:02:27.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/157: link d0/d9/l32 d0/d9/db/d12/d16/d28/l3e 0 2024-04-15T21:02:27.754 INFO:tasks.workunit.client.1.smithi149.stdout:0/176: mknod d1/d5/c39 0 2024-04-15T21:02:27.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/158: dread - d0/f8 zero size 2024-04-15T21:02:27.755 INFO:tasks.workunit.client.1.smithi149.stdout:7/242: dwrite d3/fb [4194304,4194304] 0 2024-04-15T21:02:27.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/159: chown d0/f8 466298 1 2024-04-15T21:02:27.757 INFO:tasks.workunit.client.1.smithi149.stdout:5/160: write d0/d9/db/d12/f29 [1316740,63237] 0 2024-04-15T21:02:27.763 INFO:tasks.workunit.client.1.smithi149.stdout:0/177: unlink d1/f4 0 2024-04-15T21:02:27.763 INFO:tasks.workunit.client.1.smithi149.stdout:7/243: rmdir d3/d17/d1f 39 2024-04-15T21:02:27.764 INFO:tasks.workunit.client.1.smithi149.stdout:7/244: stat d3/d16/d32/d3f/f55 0 2024-04-15T21:02:27.764 INFO:tasks.workunit.client.1.smithi149.stdout:5/161: chown d0/d9/db/f2e 259 1 2024-04-15T21:02:27.766 INFO:tasks.workunit.client.1.smithi149.stdout:7/245: mkdir d3/d16/d20/d36/d3d/d56 0 2024-04-15T21:02:27.768 INFO:tasks.workunit.client.1.smithi149.stdout:0/178: rename d1/d9/c25 to d1/d5/d24/d30/d32/c3a 0 2024-04-15T21:02:27.769 INFO:tasks.workunit.client.1.smithi149.stdout:7/246: chown d3/d16/l2a 66773716 1 2024-04-15T21:02:27.769 INFO:tasks.workunit.client.1.smithi149.stdout:5/162: read d0/d9/db/d12/d16/d28/d1b/f20 [482497,29318] 0 2024-04-15T21:02:27.771 INFO:tasks.workunit.client.1.smithi149.stdout:0/179: creat d1/d5/d24/d30/d32/f3b x:0 0 0 2024-04-15T21:02:27.772 INFO:tasks.workunit.client.1.smithi149.stdout:5/163: mkdir d0/d9/d3f 0 2024-04-15T21:02:27.776 INFO:tasks.workunit.client.1.smithi149.stdout:5/164: truncate d0/d9/db/d12/f27 952743 0 2024-04-15T21:02:27.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/247: dwrite d3/d17/f42 [0,4194304] 0 2024-04-15T21:02:27.780 INFO:tasks.workunit.client.1.smithi149.stdout:5/165: fdatasync d0/d9/db/f2e 0 2024-04-15T21:02:27.783 INFO:tasks.workunit.client.1.smithi149.stdout:7/248: rmdir d3/d16/d20/d36/d3d 39 2024-04-15T21:02:27.784 INFO:tasks.workunit.client.1.smithi149.stdout:0/180: link d1/d5/d24/c16 d1/d5/d24/d30/d32/c3c 0 2024-04-15T21:02:27.785 INFO:tasks.workunit.client.1.smithi149.stdout:0/181: chown d1/d5/dc/c34 13 1 2024-04-15T21:02:27.787 INFO:tasks.workunit.client.1.smithi149.stdout:5/166: truncate d0/f8 634004 0 2024-04-15T21:02:27.788 INFO:tasks.workunit.client.1.smithi149.stdout:5/167: write d0/d9/db/d12/d16/f1d [4292295,26110] 0 2024-04-15T21:02:27.792 INFO:tasks.workunit.client.1.smithi149.stdout:5/168: dread d0/d9/db/d12/d16/d28/d1b/f20 [0,4194304] 0 2024-04-15T21:02:27.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/182: chown d1/d9/d10/d13 0 1 2024-04-15T21:02:27.799 INFO:tasks.workunit.client.1.smithi149.stdout:7/249: rmdir d3/d17/d54 0 2024-04-15T21:02:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:0/183: chown d1/d9/f1b 0 1 2024-04-15T21:02:27.802 INFO:tasks.workunit.client.1.smithi149.stdout:7/250: mknod d3/d16/d20/c57 0 2024-04-15T21:02:27.802 INFO:tasks.workunit.client.1.smithi149.stdout:5/169: dwrite d0/d9/db/f38 [0,4194304] 0 2024-04-15T21:02:27.803 INFO:tasks.workunit.client.1.smithi149.stdout:7/251: fsync d3/d17/f42 0 2024-04-15T21:02:27.803 INFO:tasks.workunit.client.1.smithi149.stdout:0/184: dread - d1/d5/d24/d30/d32/f3b zero size 2024-04-15T21:02:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:0/185: chown d1/d9/d10/d15/l1c 38531806 1 2024-04-15T21:02:27.806 INFO:tasks.workunit.client.1.smithi149.stdout:7/252: write d3/d16/d20/f41 [298359,78875] 0 2024-04-15T21:02:27.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/170: unlink d0/d9/db/d12/d16/d28/c37 0 2024-04-15T21:02:27.813 INFO:tasks.workunit.client.1.smithi149.stdout:5/171: write d0/d9/db/d12/f29 [5038432,24448] 0 2024-04-15T21:02:27.816 INFO:tasks.workunit.client.1.smithi149.stdout:5/172: fdatasync d0/d9/db/d12/d16/d28/d1b/f20 0 2024-04-15T21:02:27.817 INFO:tasks.workunit.client.1.smithi149.stdout:7/253: mknod d3/d16/d20/d36/d3d/d56/c58 0 2024-04-15T21:02:27.820 INFO:tasks.workunit.client.1.smithi149.stdout:5/173: creat d0/d9/db/d12/d16/d28/f40 x:0 0 0 2024-04-15T21:02:27.828 INFO:tasks.workunit.client.1.smithi149.stdout:5/174: mknod d0/d9/db/d3d/c41 0 2024-04-15T21:02:27.828 INFO:tasks.workunit.client.1.smithi149.stdout:5/175: stat d0/d9/f39 0 2024-04-15T21:02:27.829 INFO:tasks.workunit.client.1.smithi149.stdout:7/254: dread d3/ff [0,4194304] 0 2024-04-15T21:02:27.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/176: fdatasync d0/d9/db/d12/f29 0 2024-04-15T21:02:27.834 INFO:tasks.workunit.client.1.smithi149.stdout:5/177: creat d0/d9/db/d12/d16/d28/f42 x:0 0 0 2024-04-15T21:02:27.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/255: dwrite d3/d17/f33 [0,4194304] 0 2024-04-15T21:02:27.836 INFO:tasks.workunit.client.1.smithi149.stdout:7/256: write d3/d16/d20/f41 [612548,28639] 0 2024-04-15T21:02:27.839 INFO:tasks.workunit.client.1.smithi149.stdout:5/178: unlink d0/d9/f17 0 2024-04-15T21:02:27.841 INFO:tasks.workunit.client.1.smithi149.stdout:5/179: truncate d0/d9/db/d12/d16/d28/f42 485868 0 2024-04-15T21:02:27.841 INFO:tasks.workunit.client.1.smithi149.stdout:5/180: stat d0/f4 0 2024-04-15T21:02:27.848 INFO:tasks.workunit.client.1.smithi149.stdout:5/181: mkdir d0/d6/d43 0 2024-04-15T21:02:27.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/257: rename d3/d17/c1b to d3/d34/c59 0 2024-04-15T21:02:27.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/258: chown d3/d17/f42 4065223 1 2024-04-15T21:02:27.854 INFO:tasks.workunit.client.1.smithi149.stdout:7/259: unlink d3/la 0 2024-04-15T21:02:27.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/260: dread d3/fb [4194304,4194304] 0 2024-04-15T21:02:27.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/261: chown d3/f47 705653 1 2024-04-15T21:02:27.863 INFO:tasks.workunit.client.1.smithi149.stdout:7/262: link d3/d16/f30 d3/d16/f5a 0 2024-04-15T21:02:27.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/263: truncate d3/d34/f4d 3455091 0 2024-04-15T21:02:27.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/264: readlink d3/l51 0 2024-04-15T21:02:27.892 INFO:tasks.workunit.client.1.smithi149.stdout:7/265: symlink d3/l5b 0 2024-04-15T21:02:27.893 INFO:tasks.workunit.client.1.smithi149.stdout:7/266: fdatasync d3/f2d 0 2024-04-15T21:02:27.896 INFO:tasks.workunit.client.1.smithi149.stdout:7/267: dread d3/f10 [0,4194304] 0 2024-04-15T21:02:27.898 INFO:tasks.workunit.client.1.smithi149.stdout:7/268: chown d3/d16/c1c 515116562 1 2024-04-15T21:02:27.904 INFO:tasks.workunit.client.1.smithi149.stdout:7/269: dwrite d3/f18 [0,4194304] 0 2024-04-15T21:02:27.906 INFO:tasks.workunit.client.1.smithi149.stdout:7/270: write d3/d16/d20/f41 [1435917,22651] 0 2024-04-15T21:02:27.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:27 smithi072 ceph-mon[29079]: pgmap v270: 65 pgs: 65 active+clean; 384 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 516 KiB/s rd, 25 MiB/s wr, 321 op/s 2024-04-15T21:02:28.089 INFO:tasks.workunit.client.1.smithi149.stdout:3/163: sync 2024-04-15T21:02:28.089 INFO:tasks.workunit.client.1.smithi149.stdout:3/164: dread - d1/db/d24/d2b/f22 zero size 2024-04-15T21:02:28.092 INFO:tasks.workunit.client.1.smithi149.stdout:3/165: creat d1/db/d28/f32 x:0 0 0 2024-04-15T21:02:28.093 INFO:tasks.workunit.client.1.smithi149.stdout:3/166: truncate d1/db/d24/d2b/f2e 826088 0 2024-04-15T21:02:28.093 INFO:tasks.workunit.client.1.smithi149.stdout:3/167: readlink d1/db/d24/l27 0 2024-04-15T21:02:28.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/168: dread d1/db/d24/d2b/f25 [0,4194304] 0 2024-04-15T21:02:28.109 INFO:tasks.workunit.client.1.smithi149.stdout:3/169: stat d1/f2f 0 2024-04-15T21:02:28.109 INFO:tasks.workunit.client.1.smithi149.stdout:3/170: dread - d1/db/d24/d2b/f22 zero size 2024-04-15T21:02:28.125 INFO:tasks.workunit.client.1.smithi149.stdout:3/171: dread d1/db/f1c [0,4194304] 0 2024-04-15T21:02:28.128 INFO:tasks.workunit.client.1.smithi149.stdout:3/172: dread d1/db/d24/d2b/f1e [0,4194304] 0 2024-04-15T21:02:28.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/173: creat d1/db/d24/f33 x:0 0 0 2024-04-15T21:02:28.160 INFO:tasks.workunit.client.1.smithi149.stdout:3/174: dread - d1/db/d24/f33 zero size 2024-04-15T21:02:28.161 INFO:tasks.workunit.client.1.smithi149.stdout:3/175: mknod d1/db/c34 0 2024-04-15T21:02:28.166 INFO:tasks.workunit.client.1.smithi149.stdout:3/176: dwrite d1/fa [8388608,4194304] 0 2024-04-15T21:02:28.228 INFO:tasks.workunit.client.1.smithi149.stdout:4/173: sync 2024-04-15T21:02:28.228 INFO:tasks.workunit.client.1.smithi149.stdout:1/157: sync 2024-04-15T21:02:28.231 INFO:tasks.workunit.client.1.smithi149.stdout:3/177: symlink d1/db/l35 0 2024-04-15T21:02:28.233 INFO:tasks.workunit.client.1.smithi149.stdout:4/174: unlink dc/d2c/d3e/f13 0 2024-04-15T21:02:28.237 INFO:tasks.workunit.client.1.smithi149.stdout:3/178: dwrite d1/db/d24/d2b/f22 [0,4194304] 0 2024-04-15T21:02:28.240 INFO:tasks.workunit.client.1.smithi149.stdout:3/179: rmdir d1/db/d23 39 2024-04-15T21:02:28.241 INFO:tasks.workunit.client.1.smithi149.stdout:4/175: mkdir dc/d2c/d3e/d15/d3f 0 2024-04-15T21:02:28.243 INFO:tasks.workunit.client.1.smithi149.stdout:3/180: write d1/db/d24/d2b/f1e [2327654,15530] 0 2024-04-15T21:02:28.247 INFO:tasks.workunit.client.1.smithi149.stdout:4/176: link dc/d18/f1d dc/d2c/d3e/d35/d3a/f40 0 2024-04-15T21:02:28.248 INFO:tasks.workunit.client.1.smithi149.stdout:4/177: write dc/d2c/d3e/d15/f2e [498074,19012] 0 2024-04-15T21:02:28.251 INFO:tasks.workunit.client.1.smithi149.stdout:4/178: creat dc/f41 x:0 0 0 2024-04-15T21:02:28.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/179: rmdir dc/d2c/d2a 0 2024-04-15T21:02:28.256 INFO:tasks.workunit.client.1.smithi149.stdout:4/180: mknod dc/d2c/d3e/c42 0 2024-04-15T21:02:28.257 INFO:tasks.workunit.client.1.smithi149.stdout:4/181: chown dc/d2c/d3e 45898856 1 2024-04-15T21:02:28.290 INFO:tasks.workunit.client.1.smithi149.stdout:1/158: truncate d1/f5 151426 0 2024-04-15T21:02:28.295 INFO:tasks.workunit.client.1.smithi149.stdout:4/182: write f2 [2712280,104665] 0 2024-04-15T21:02:28.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/183: rename dc/d2c/f39 to dc/d2c/d3e/d15/d3f/f43 0 2024-04-15T21:02:28.301 INFO:tasks.workunit.client.1.smithi149.stdout:1/159: dwrite d1/f3 [0,4194304] 0 2024-04-15T21:02:28.302 INFO:tasks.workunit.client.1.smithi149.stdout:4/184: symlink dc/d2c/d3e/d15/l44 0 2024-04-15T21:02:28.302 INFO:tasks.workunit.client.1.smithi149.stdout:4/185: dread - dc/d2c/f22 zero size 2024-04-15T21:02:28.304 INFO:tasks.workunit.client.1.smithi149.stdout:4/186: read dc/fe [34047,129425] 0 2024-04-15T21:02:28.308 INFO:tasks.workunit.client.1.smithi149.stdout:1/160: rename d1/db/dc/d11/c13 to d1/db/dc/c27 0 2024-04-15T21:02:28.312 INFO:tasks.workunit.client.1.smithi149.stdout:4/187: dread fa [0,4194304] 0 2024-04-15T21:02:28.312 INFO:tasks.workunit.client.1.smithi149.stdout:1/161: link d1/db/d14/d21/l25 d1/db/dc/d11/l28 0 2024-04-15T21:02:28.315 INFO:tasks.workunit.client.1.smithi149.stdout:1/162: rename l0 to d1/l29 0 2024-04-15T21:02:28.317 INFO:tasks.workunit.client.1.smithi149.stdout:1/163: rmdir d1/db/dc/d11 39 2024-04-15T21:02:28.317 INFO:tasks.workunit.client.1.smithi149.stdout:4/188: link dc/d18/c36 dc/d18/d21/c45 0 2024-04-15T21:02:28.326 INFO:tasks.workunit.client.1.smithi149.stdout:1/164: dread d1/d17/f1c [0,4194304] 0 2024-04-15T21:02:28.331 INFO:tasks.workunit.client.1.smithi149.stdout:4/189: dwrite f1 [0,4194304] 0 2024-04-15T21:02:28.333 INFO:tasks.workunit.client.1.smithi149.stdout:1/165: dwrite d1/db/f20 [0,4194304] 0 2024-04-15T21:02:28.334 INFO:tasks.workunit.client.1.smithi149.stdout:4/190: unlink lb 0 2024-04-15T21:02:28.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/191: dread - dc/d2c/f22 zero size 2024-04-15T21:02:28.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/192: mknod dc/d2c/d3e/d35/c46 0 2024-04-15T21:02:28.342 INFO:tasks.workunit.client.1.smithi149.stdout:4/193: read - dc/f41 zero size 2024-04-15T21:02:28.344 INFO:tasks.workunit.client.1.smithi149.stdout:4/194: chown dc/d1a/f30 3668167 1 2024-04-15T21:02:28.345 INFO:tasks.workunit.client.1.smithi149.stdout:1/166: dwrite d1/db/d14/d1e/ff [4194304,4194304] 0 2024-04-15T21:02:28.347 INFO:tasks.workunit.client.1.smithi149.stdout:4/195: write dc/d2c/d3e/d15/d3f/f43 [5559643,28571] 0 2024-04-15T21:02:28.349 INFO:tasks.workunit.client.1.smithi149.stdout:4/196: chown dc/d18/d21/l2f 0 1 2024-04-15T21:02:28.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/167: readlink d1/db/dc/d11/l28 0 2024-04-15T21:02:28.350 INFO:tasks.workunit.client.1.smithi149.stdout:4/197: write dc/d1a/f30 [872384,35600] 0 2024-04-15T21:02:28.351 INFO:tasks.workunit.client.1.smithi149.stdout:4/198: read - dc/d1a/f26 zero size 2024-04-15T21:02:28.352 INFO:tasks.workunit.client.1.smithi149.stdout:4/199: dread - dc/d1a/f26 zero size 2024-04-15T21:02:28.353 INFO:tasks.workunit.client.1.smithi149.stdout:1/168: creat d1/db/d14/d21/f2a x:0 0 0 2024-04-15T21:02:28.354 INFO:tasks.workunit.client.1.smithi149.stdout:4/200: dread dc/fe [0,4194304] 0 2024-04-15T21:02:28.361 INFO:tasks.workunit.client.1.smithi149.stdout:1/169: dwrite d1/db/d14/d21/f2a [0,4194304] 0 2024-04-15T21:02:28.363 INFO:tasks.workunit.client.1.smithi149.stdout:1/170: write d1/db/d14/d1e/ff [3610155,42185] 0 2024-04-15T21:02:28.364 INFO:tasks.workunit.client.1.smithi149.stdout:1/171: chown d1 4399 1 2024-04-15T21:02:28.370 INFO:tasks.workunit.client.1.smithi149.stdout:1/172: truncate d1/f6 3226051 0 2024-04-15T21:02:28.372 INFO:tasks.workunit.client.1.smithi149.stdout:1/173: creat d1/db/f2b x:0 0 0 2024-04-15T21:02:28.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/174: creat d1/db/f2c x:0 0 0 2024-04-15T21:02:28.376 INFO:tasks.workunit.client.1.smithi149.stdout:1/175: fsync d1/d17/f1c 0 2024-04-15T21:02:28.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/176: mknod d1/db/dc/d11/c2d 0 2024-04-15T21:02:28.381 INFO:tasks.workunit.client.1.smithi149.stdout:2/245: sync 2024-04-15T21:02:28.381 INFO:tasks.workunit.client.1.smithi149.stdout:9/195: sync 2024-04-15T21:02:28.381 INFO:tasks.workunit.client.1.smithi149.stdout:6/179: sync 2024-04-15T21:02:28.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/201: dread f5 [0,4194304] 0 2024-04-15T21:02:28.384 INFO:tasks.workunit.client.1.smithi149.stdout:9/196: symlink d23/l42 0 2024-04-15T21:02:28.385 INFO:tasks.workunit.client.1.smithi149.stdout:9/197: stat d23/d2b/c34 0 2024-04-15T21:02:28.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/202: dread - dc/d2c/f22 zero size 2024-04-15T21:02:28.385 INFO:tasks.workunit.client.1.smithi149.stdout:9/198: readlink d23/l38 0 2024-04-15T21:02:28.386 INFO:tasks.workunit.client.1.smithi149.stdout:2/246: symlink d4/d7/d10/l5b 0 2024-04-15T21:02:28.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/177: write d1/d17/f1c [111256,123738] 0 2024-04-15T21:02:28.389 INFO:tasks.workunit.client.1.smithi149.stdout:2/247: mknod d4/d7/d46/c5c 0 2024-04-15T21:02:28.392 INFO:tasks.workunit.client.1.smithi149.stdout:1/178: symlink d1/db/d14/d1e/l2e 0 2024-04-15T21:02:28.395 INFO:tasks.workunit.client.1.smithi149.stdout:1/179: dread d1/db/d16/f24 [0,4194304] 0 2024-04-15T21:02:28.396 INFO:tasks.workunit.client.1.smithi149.stdout:4/203: getdents dc/d1a 0 2024-04-15T21:02:28.397 INFO:tasks.workunit.client.1.smithi149.stdout:9/199: getdents d23/d2b 0 2024-04-15T21:02:28.398 INFO:tasks.workunit.client.1.smithi149.stdout:9/200: stat d23/l38 0 2024-04-15T21:02:28.399 INFO:tasks.workunit.client.1.smithi149.stdout:6/180: dread da/d18/d10/d16/f3c [0,4194304] 0 2024-04-15T21:02:28.400 INFO:tasks.workunit.client.1.smithi149.stdout:9/201: read f21 [583984,122564] 0 2024-04-15T21:02:28.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/248: link d4/d7/f31 d4/f5d 0 2024-04-15T21:02:28.403 INFO:tasks.workunit.client.1.smithi149.stdout:1/180: dwrite d1/db/d16/f24 [0,4194304] 0 2024-04-15T21:02:28.405 INFO:tasks.workunit.client.1.smithi149.stdout:6/181: creat da/d18/d10/d16/f40 x:0 0 0 2024-04-15T21:02:28.408 INFO:tasks.workunit.client.1.smithi149.stdout:6/182: chown da/d18/d10/d16 506183 1 2024-04-15T21:02:28.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/204: creat dc/d2c/d3e/f47 x:0 0 0 2024-04-15T21:02:28.410 INFO:tasks.workunit.client.1.smithi149.stdout:2/249: rename d4/d7/d2f to d4/d7/d19/d21/d5e 0 2024-04-15T21:02:28.411 INFO:tasks.workunit.client.1.smithi149.stdout:1/181: mknod d1/db/dc/d11/c2f 0 2024-04-15T21:02:28.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/183: creat da/d18/d10/d3f/f41 x:0 0 0 2024-04-15T21:02:28.414 INFO:tasks.workunit.client.1.smithi149.stdout:4/205: mknod dc/d1a/c48 0 2024-04-15T21:02:28.415 INFO:tasks.workunit.client.1.smithi149.stdout:2/250: creat d4/d7/d19/d21/f5f x:0 0 0 2024-04-15T21:02:28.416 INFO:tasks.workunit.client.1.smithi149.stdout:4/206: write dc/d2c/d3e/d15/f2e [401656,10103] 0 2024-04-15T21:02:28.417 INFO:tasks.workunit.client.1.smithi149.stdout:5/182: sync 2024-04-15T21:02:28.417 INFO:tasks.workunit.client.1.smithi149.stdout:7/271: sync 2024-04-15T21:02:28.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/186: sync 2024-04-15T21:02:28.417 INFO:tasks.workunit.client.1.smithi149.stdout:8/195: sync 2024-04-15T21:02:28.417 INFO:tasks.workunit.client.1.smithi149.stdout:3/181: sync 2024-04-15T21:02:28.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/207: write dc/d2c/d3e/d15/f2e [1018637,97377] 0 2024-04-15T21:02:28.419 INFO:tasks.workunit.client.1.smithi149.stdout:1/182: rmdir d1/db/dc/d11 39 2024-04-15T21:02:28.420 INFO:tasks.workunit.client.1.smithi149.stdout:7/272: chown d3/d16/d20/d36/l35 139302 1 2024-04-15T21:02:28.421 INFO:tasks.workunit.client.1.smithi149.stdout:6/184: creat da/d18/d10/f42 x:0 0 0 2024-04-15T21:02:28.421 INFO:tasks.workunit.client.1.smithi149.stdout:1/183: read d1/db/d14/d1e/ff [719844,58954] 0 2024-04-15T21:02:28.422 INFO:tasks.workunit.client.1.smithi149.stdout:6/185: stat da/d18/d10/d16 0 2024-04-15T21:02:28.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/202: getdents d23 0 2024-04-15T21:02:28.424 INFO:tasks.workunit.client.1.smithi149.stdout:2/251: mknod d4/d7/d19/c60 0 2024-04-15T21:02:28.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/208: dwrite dc/d2c/d3e/d15/f2e [0,4194304] 0 2024-04-15T21:02:28.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/187: dread d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:28.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/196: mkdir d2/df/d10/d25/d32/d45 0 2024-04-15T21:02:28.436 INFO:tasks.workunit.client.1.smithi149.stdout:1/184: creat d1/db/f30 x:0 0 0 2024-04-15T21:02:28.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/185: truncate d1/db/f30 189959 0 2024-04-15T21:02:28.440 INFO:tasks.workunit.client.1.smithi149.stdout:5/183: creat d0/d6/d2d/f44 x:0 0 0 2024-04-15T21:02:28.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/209: dread dc/d18/f1f [0,4194304] 0 2024-04-15T21:02:28.442 INFO:tasks.workunit.client.1.smithi149.stdout:7/273: mknod d3/d17/d1f/c5c 0 2024-04-15T21:02:28.445 INFO:tasks.workunit.client.1.smithi149.stdout:6/186: creat da/d32/f43 x:0 0 0 2024-04-15T21:02:28.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/186: mknod d1/db/d14/d21/c31 0 2024-04-15T21:02:28.448 INFO:tasks.workunit.client.1.smithi149.stdout:0/188: symlink d1/d9/l3d 0 2024-04-15T21:02:28.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/182: dwrite d1/f30 [0,4194304] 0 2024-04-15T21:02:28.450 INFO:tasks.workunit.client.1.smithi149.stdout:0/189: write d1/d5/f2f [154005,48676] 0 2024-04-15T21:02:28.451 INFO:tasks.workunit.client.1.smithi149.stdout:3/183: stat d1/db/d24/d2b/f25 0 2024-04-15T21:02:28.452 INFO:tasks.workunit.client.1.smithi149.stdout:3/184: dread - d1/db/d24/f33 zero size 2024-04-15T21:02:28.457 INFO:tasks.workunit.client.1.smithi149.stdout:4/210: fdatasync dc/d18/f1d 0 2024-04-15T21:02:28.459 INFO:tasks.workunit.client.1.smithi149.stdout:2/252: creat d4/d7/d19/d21/d2c/d32/d4a/f61 x:0 0 0 2024-04-15T21:02:28.459 INFO:tasks.workunit.client.1.smithi149.stdout:7/274: rmdir d3/d16/d20 39 2024-04-15T21:02:28.459 INFO:tasks.workunit.client.1.smithi149.stdout:6/187: rename da/d18/d10/d16/c37 to da/d11/c44 0 2024-04-15T21:02:28.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/187: rmdir d1/db/dc/d11 39 2024-04-15T21:02:28.468 INFO:tasks.workunit.client.1.smithi149.stdout:4/211: dread fa [0,4194304] 0 2024-04-15T21:02:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:3/185: dwrite d1/f2f [0,4194304] 0 2024-04-15T21:02:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:5/184: dread d0/f4 [0,4194304] 0 2024-04-15T21:02:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:8/197: dread d2/f1b [0,4194304] 0 2024-04-15T21:02:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:0/190: symlink d1/d5/l3e 0 2024-04-15T21:02:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:2/253: creat d4/d7/d10/d36/f62 x:0 0 0 2024-04-15T21:02:28.471 INFO:tasks.workunit.client.1.smithi149.stdout:4/212: chown fa 320834221 1 2024-04-15T21:02:28.475 INFO:tasks.workunit.client.1.smithi149.stdout:1/188: creat d1/db/f32 x:0 0 0 2024-04-15T21:02:28.478 INFO:tasks.workunit.client.1.smithi149.stdout:0/191: readlink d1/d9/d10/d15/l1c 0 2024-04-15T21:02:28.480 INFO:tasks.workunit.client.1.smithi149.stdout:7/275: creat d3/d39/f5d x:0 0 0 2024-04-15T21:02:28.481 INFO:tasks.workunit.client.1.smithi149.stdout:1/189: write d1/db/f20 [2464295,4586] 0 2024-04-15T21:02:28.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/213: chown dc/c12 10951578 1 2024-04-15T21:02:28.483 INFO:tasks.workunit.client.1.smithi149.stdout:3/186: rename d1/db/d28/f31 to d1/db/d24/f36 0 2024-04-15T21:02:28.484 INFO:tasks.workunit.client.1.smithi149.stdout:6/188: dwrite da/d18/d10/d16/f29 [0,4194304] 0 2024-04-15T21:02:28.488 INFO:tasks.workunit.client.1.smithi149.stdout:4/214: chown dc/d1a/c25 477 1 2024-04-15T21:02:28.491 INFO:tasks.workunit.client.1.smithi149.stdout:8/198: dwrite d2/df/d10/d25/f28 [0,4194304] 0 2024-04-15T21:02:28.491 INFO:tasks.workunit.client.1.smithi149.stdout:3/187: chown d1/db/d24/d2b/c19 6 1 2024-04-15T21:02:28.496 INFO:tasks.workunit.client.1.smithi149.stdout:6/189: mkdir da/d2e/d45 0 2024-04-15T21:02:28.497 INFO:tasks.workunit.client.1.smithi149.stdout:6/190: write da/d32/f43 [632738,62955] 0 2024-04-15T21:02:28.498 INFO:tasks.workunit.client.1.smithi149.stdout:7/276: mknod d3/c5e 0 2024-04-15T21:02:28.500 INFO:tasks.workunit.client.1.smithi149.stdout:3/188: dread d1/db/d28/f2a [0,4194304] 0 2024-04-15T21:02:28.501 INFO:tasks.workunit.client.1.smithi149.stdout:6/191: chown da/d18/d10/d3f/f41 0 1 2024-04-15T21:02:28.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/185: rename d0/d9/db/d12/d2b/l34 to d0/d9/db/d12/d16/d28/l45 0 2024-04-15T21:02:28.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/192: write da/d11/f1d [811958,60333] 0 2024-04-15T21:02:28.508 INFO:tasks.workunit.client.1.smithi149.stdout:8/199: mkdir d2/df/d10/d21/d46 0 2024-04-15T21:02:28.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/190: link d1/d17/f1c d1/db/f33 0 2024-04-15T21:02:28.516 INFO:tasks.workunit.client.1.smithi149.stdout:4/215: dwrite dc/d2c/d3e/f37 [0,4194304] 0 2024-04-15T21:02:28.517 INFO:tasks.workunit.client.1.smithi149.stdout:3/189: dwrite d1/db/f21 [4194304,4194304] 0 2024-04-15T21:02:28.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/216: write f2 [4511063,31910] 0 2024-04-15T21:02:28.525 INFO:tasks.workunit.client.1.smithi149.stdout:4/217: readlink dc/d2c/d3e/d35/l3c 0 2024-04-15T21:02:28.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/192: link d1/d9/d10/f2a d1/d5/d24/f3f 0 2024-04-15T21:02:28.529 INFO:tasks.workunit.client.1.smithi149.stdout:2/254: dwrite d4/d7/da/f1c [0,4194304] 0 2024-04-15T21:02:28.531 INFO:tasks.workunit.client.1.smithi149.stdout:2/255: chown d4/d7/d10/l17 8774 1 2024-04-15T21:02:28.532 INFO:tasks.workunit.client.1.smithi149.stdout:7/277: creat d3/d16/d20/d36/d3d/d56/f5f x:0 0 0 2024-04-15T21:02:28.534 INFO:tasks.workunit.client.1.smithi149.stdout:3/190: dwrite d1/db/f1d [0,4194304] 0 2024-04-15T21:02:28.534 INFO:tasks.workunit.client.1.smithi149.stdout:2/256: chown d4/d7/d19/d21/d3b/d4c 115575922 1 2024-04-15T21:02:28.535 INFO:tasks.workunit.client.1.smithi149.stdout:3/191: chown d1/db/l11 335056 1 2024-04-15T21:02:28.535 INFO:tasks.workunit.client.1.smithi149.stdout:3/192: fsync d1/db/d28/f32 0 2024-04-15T21:02:28.538 INFO:tasks.workunit.client.1.smithi149.stdout:5/186: link d0/d9/db/f38 d0/d9/db/d12/d16/d28/f46 0 2024-04-15T21:02:28.539 INFO:tasks.workunit.client.1.smithi149.stdout:4/218: symlink dc/l49 0 2024-04-15T21:02:28.542 INFO:tasks.workunit.client.1.smithi149.stdout:5/187: dread d0/d9/db/d12/f27 [0,4194304] 0 2024-04-15T21:02:28.542 INFO:tasks.workunit.client.1.smithi149.stdout:8/200: creat d2/df/d10/d21/d46/f47 x:0 0 0 2024-04-15T21:02:28.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/191: dwrite d1/d17/f1c [0,4194304] 0 2024-04-15T21:02:28.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/193: rmdir d1/d9/d10/d15 39 2024-04-15T21:02:28.546 INFO:tasks.workunit.client.1.smithi149.stdout:5/188: write d0/d9/f22 [1584514,41575] 0 2024-04-15T21:02:28.546 INFO:tasks.workunit.client.1.smithi149.stdout:1/192: stat d1/f6 0 2024-04-15T21:02:28.550 INFO:tasks.workunit.client.1.smithi149.stdout:7/278: mkdir d3/d16/d20/d60 0 2024-04-15T21:02:28.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/193: link da/l2a da/d18/d10/d3f/l46 0 2024-04-15T21:02:28.554 INFO:tasks.workunit.client.1.smithi149.stdout:4/219: creat dc/d2c/d3e/d15/f4a x:0 0 0 2024-04-15T21:02:28.555 INFO:tasks.workunit.client.1.smithi149.stdout:6/194: dread - da/d11/f35 zero size 2024-04-15T21:02:28.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/195: read da/d18/d10/d16/f3c [938182,19290] 0 2024-04-15T21:02:28.557 INFO:tasks.workunit.client.1.smithi149.stdout:8/201: unlink d2/df/d10/d21/d46/f47 0 2024-04-15T21:02:28.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/193: creat d1/db/d14/d21/f34 x:0 0 0 2024-04-15T21:02:28.558 INFO:tasks.workunit.client.1.smithi149.stdout:2/257: mkdir d4/d7/d19/d21/d2c/d63 0 2024-04-15T21:02:28.559 INFO:tasks.workunit.client.1.smithi149.stdout:7/279: symlink d3/d16/d32/l61 0 2024-04-15T21:02:28.560 INFO:tasks.workunit.client.1.smithi149.stdout:6/196: chown da/d18/d10/d16/l25 139 1 2024-04-15T21:02:28.561 INFO:tasks.workunit.client.1.smithi149.stdout:6/197: fsync da/d11/f35 0 2024-04-15T21:02:28.562 INFO:tasks.workunit.client.1.smithi149.stdout:3/193: mkdir d1/db/d23/d37 0 2024-04-15T21:02:28.563 INFO:tasks.workunit.client.1.smithi149.stdout:0/194: symlink d1/d9/l40 0 2024-04-15T21:02:28.566 INFO:tasks.workunit.client.1.smithi149.stdout:5/189: mkdir d0/d9/d3f/d47 0 2024-04-15T21:02:28.569 INFO:tasks.workunit.client.1.smithi149.stdout:5/190: chown d0/d9/db/d12/d16/d28/d1b/f1f 220479504 1 2024-04-15T21:02:28.571 INFO:tasks.workunit.client.1.smithi149.stdout:5/191: chown d0/f5 385 1 2024-04-15T21:02:28.571 INFO:tasks.workunit.client.1.smithi149.stdout:8/202: rename d2/l22 to d2/df/d10/d25/l48 0 2024-04-15T21:02:28.572 INFO:tasks.workunit.client.1.smithi149.stdout:1/194: mkdir d1/db/d16/d35 0 2024-04-15T21:02:28.572 INFO:tasks.workunit.client.1.smithi149.stdout:2/258: dwrite d4/d7/d19/d21/d5e/f50 [0,4194304] 0 2024-04-15T21:02:28.573 INFO:tasks.workunit.client.1.smithi149.stdout:7/280: creat d3/d16/d20/d36/d3d/d56/f62 x:0 0 0 2024-04-15T21:02:28.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/281: fdatasync d3/d39/f5d 0 2024-04-15T21:02:28.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/192: dread - d0/d9/db/d12/d16/d28/d1b/f1f zero size 2024-04-15T21:02:28.575 INFO:tasks.workunit.client.1.smithi149.stdout:2/259: dread - d4/d7/d19/d21/f5f zero size 2024-04-15T21:02:28.576 INFO:tasks.workunit.client.1.smithi149.stdout:2/260: write d4/f33 [9639453,88842] 0 2024-04-15T21:02:28.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/282: chown d3/d16/d20/d36/d3d 15791 1 2024-04-15T21:02:28.579 INFO:tasks.workunit.client.1.smithi149.stdout:5/193: readlink d0/d9/db/d12/d16/l35 0 2024-04-15T21:02:28.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/261: readlink d4/d7/da/l38 0 2024-04-15T21:02:28.583 INFO:tasks.workunit.client.1.smithi149.stdout:8/203: mknod d2/df/d10/d21/c49 0 2024-04-15T21:02:28.587 INFO:tasks.workunit.client.1.smithi149.stdout:5/194: stat d0/d9/db/d12/d16 0 2024-04-15T21:02:28.589 INFO:tasks.workunit.client.1.smithi149.stdout:1/195: dwrite d1/db/dc/f10 [0,4194304] 0 2024-04-15T21:02:28.591 INFO:tasks.workunit.client.1.smithi149.stdout:8/204: unlink d2/c13 0 2024-04-15T21:02:28.591 INFO:tasks.workunit.client.1.smithi149.stdout:1/196: write d1/db/f20 [589770,74076] 0 2024-04-15T21:02:28.593 INFO:tasks.workunit.client.1.smithi149.stdout:5/195: mknod d0/d6/c48 0 2024-04-15T21:02:28.593 INFO:tasks.workunit.client.1.smithi149.stdout:7/283: dread d3/f18 [0,4194304] 0 2024-04-15T21:02:28.596 INFO:tasks.workunit.client.1.smithi149.stdout:1/197: write d1/db/f2b [109019,10015] 0 2024-04-15T21:02:28.598 INFO:tasks.workunit.client.1.smithi149.stdout:5/196: mkdir d0/d9/db/d12/d49 0 2024-04-15T21:02:28.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/197: creat d0/d6/d2d/f4a x:0 0 0 2024-04-15T21:02:28.606 INFO:tasks.workunit.client.1.smithi149.stdout:1/198: dwrite d1/d17/f1c [0,4194304] 0 2024-04-15T21:02:28.609 INFO:tasks.workunit.client.1.smithi149.stdout:8/205: link d2/df/d10/f14 d2/df/d10/d25/f4a 0 2024-04-15T21:02:28.610 INFO:tasks.workunit.client.1.smithi149.stdout:7/284: mknod d3/d16/d20/d60/c63 0 2024-04-15T21:02:28.614 INFO:tasks.workunit.client.1.smithi149.stdout:5/198: mknod d0/d6/d2d/c4b 0 2024-04-15T21:02:28.615 INFO:tasks.workunit.client.1.smithi149.stdout:1/199: mkdir d1/d17/d36 0 2024-04-15T21:02:28.620 INFO:tasks.workunit.client.1.smithi149.stdout:4/220: getdents dc/d2c/d3e/d15 0 2024-04-15T21:02:28.620 INFO:tasks.workunit.client.1.smithi149.stdout:4/221: fdatasync f2 0 2024-04-15T21:02:28.620 INFO:tasks.workunit.client.1.smithi149.stdout:2/262: dread d4/d7/d19/d21/d3b/f44 [0,4194304] 0 2024-04-15T21:02:28.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/200: creat d1/db/f37 x:0 0 0 2024-04-15T21:02:28.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/222: mkdir dc/d2c/d3e/d35/d4b 0 2024-04-15T21:02:28.624 INFO:tasks.workunit.client.1.smithi149.stdout:7/285: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:28.627 INFO:tasks.workunit.client.1.smithi149.stdout:1/201: write d1/f6 [3926945,9789] 0 2024-04-15T21:02:28.628 INFO:tasks.workunit.client.1.smithi149.stdout:8/206: creat d2/df/d10/d20/f4b x:0 0 0 2024-04-15T21:02:28.630 INFO:tasks.workunit.client.1.smithi149.stdout:1/202: dread - d1/db/f37 zero size 2024-04-15T21:02:28.632 INFO:tasks.workunit.client.1.smithi149.stdout:8/207: dread - d2/df/d10/d20/f4b zero size 2024-04-15T21:02:28.632 INFO:tasks.workunit.client.1.smithi149.stdout:2/263: creat d4/d7/d19/d21/d2c/d58/f64 x:0 0 0 2024-04-15T21:02:28.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/194: truncate d1/fa 606399 0 2024-04-15T21:02:28.634 INFO:tasks.workunit.client.1.smithi149.stdout:3/195: readlink d1/db/l11 0 2024-04-15T21:02:28.635 INFO:tasks.workunit.client.1.smithi149.stdout:4/223: symlink dc/d2c/d3e/d35/d4b/l4c 0 2024-04-15T21:02:28.638 INFO:tasks.workunit.client.1.smithi149.stdout:4/224: chown dc/d2c/d3e/d15/d3f 146639569 1 2024-04-15T21:02:28.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/286: rename d3/d16/d20/d36/d3d/c4a to d3/d17/d1f/c64 0 2024-04-15T21:02:28.640 INFO:tasks.workunit.client.1.smithi149.stdout:1/203: dwrite d1/db/f32 [0,4194304] 0 2024-04-15T21:02:28.641 INFO:tasks.workunit.client.1.smithi149.stdout:8/208: getdents d2/df/d10/d25/d32/d45 0 2024-04-15T21:02:28.643 INFO:tasks.workunit.client.1.smithi149.stdout:8/209: dread - d2/df/d10/d21/f41 zero size 2024-04-15T21:02:28.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/264: creat d4/f65 x:0 0 0 2024-04-15T21:02:28.644 INFO:tasks.workunit.client.1.smithi149.stdout:8/210: chown d2/df/d10/d25/f26 697482 1 2024-04-15T21:02:28.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/211: chown d2/df/d10/d25/d32/f42 1055253 1 2024-04-15T21:02:28.646 INFO:tasks.workunit.client.1.smithi149.stdout:4/225: creat dc/d18/d21/f4d x:0 0 0 2024-04-15T21:02:28.652 INFO:tasks.workunit.client.1.smithi149.stdout:3/196: link d1/db/d24/d2b/f1b d1/db/d24/f38 0 2024-04-15T21:02:28.653 INFO:tasks.workunit.client.1.smithi149.stdout:2/265: mknod d4/d7/d19/d21/d3b/d4c/c66 0 2024-04-15T21:02:28.654 INFO:tasks.workunit.client.1.smithi149.stdout:8/212: chown d2/c5 408 1 2024-04-15T21:02:28.655 INFO:tasks.workunit.client.1.smithi149.stdout:8/213: chown d2/f2b 3176 1 2024-04-15T21:02:28.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/226: creat dc/d1a/f4e x:0 0 0 2024-04-15T21:02:28.656 INFO:tasks.workunit.client.1.smithi149.stdout:7/287: truncate d3/d17/d1f/f25 347637 0 2024-04-15T21:02:28.658 INFO:tasks.workunit.client.1.smithi149.stdout:8/214: fsync d2/df/d10/d25/f26 0 2024-04-15T21:02:28.658 INFO:tasks.workunit.client.1.smithi149.stdout:1/204: mkdir d1/db/dc/d38 0 2024-04-15T21:02:28.662 INFO:tasks.workunit.client.1.smithi149.stdout:5/199: dwrite d0/d9/db/f38 [0,4194304] 0 2024-04-15T21:02:28.665 INFO:tasks.workunit.client.1.smithi149.stdout:2/266: symlink d4/d7/d19/d21/d3b/d4c/l67 0 2024-04-15T21:02:28.672 INFO:tasks.workunit.client.1.smithi149.stdout:1/205: dwrite d1/f6 [4194304,4194304] 0 2024-04-15T21:02:28.672 INFO:tasks.workunit.client.1.smithi149.stdout:7/288: creat d3/d16/d20/f65 x:0 0 0 2024-04-15T21:02:28.673 INFO:tasks.workunit.client.1.smithi149.stdout:3/197: dread d1/f30 [0,4194304] 0 2024-04-15T21:02:28.676 INFO:tasks.workunit.client.1.smithi149.stdout:7/289: dread d3/ff [4194304,4194304] 0 2024-04-15T21:02:28.676 INFO:tasks.workunit.client.1.smithi149.stdout:5/200: mknod d0/d6/d2d/c4c 0 2024-04-15T21:02:28.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/201: chown d0/d9/db/d12/d16/d28/f46 9 1 2024-04-15T21:02:28.678 INFO:tasks.workunit.client.1.smithi149.stdout:8/215: rename d2/df/d10/d21/l3d to d2/df/d10/d25/d32/d45/l4c 0 2024-04-15T21:02:28.679 INFO:tasks.workunit.client.1.smithi149.stdout:8/216: stat d2/df/d10/d20/d30 0 2024-04-15T21:02:28.679 INFO:tasks.workunit.client.1.smithi149.stdout:8/217: stat d2/f1a 0 2024-04-15T21:02:28.680 INFO:tasks.workunit.client.1.smithi149.stdout:2/267: mknod d4/d7/d19/d21/d3b/c68 0 2024-04-15T21:02:28.681 INFO:tasks.workunit.client.1.smithi149.stdout:2/268: readlink d4/d7/d19/d21/d3b/d4c/l67 0 2024-04-15T21:02:28.682 INFO:tasks.workunit.client.1.smithi149.stdout:3/198: stat d1/c10 0 2024-04-15T21:02:28.683 INFO:tasks.workunit.client.1.smithi149.stdout:7/290: write d3/fb [5170803,47592] 0 2024-04-15T21:02:28.686 INFO:tasks.workunit.client.1.smithi149.stdout:5/202: symlink d0/d9/d3f/l4d 0 2024-04-15T21:02:28.689 INFO:tasks.workunit.client.1.smithi149.stdout:2/269: fdatasync d4/d7/d19/d21/d3b/f44 0 2024-04-15T21:02:28.692 INFO:tasks.workunit.client.1.smithi149.stdout:3/199: mkdir d1/db/d24/d39 0 2024-04-15T21:02:28.694 INFO:tasks.workunit.client.1.smithi149.stdout:5/203: truncate d0/d6/fe 2014494 0 2024-04-15T21:02:28.697 INFO:tasks.workunit.client.1.smithi149.stdout:8/218: link d2/df/d10/d20/d30/d35/f43 d2/df/d10/d34/f4d 0 2024-04-15T21:02:28.698 INFO:tasks.workunit.client.1.smithi149.stdout:4/227: getdents dc/d18/d21 0 2024-04-15T21:02:28.698 INFO:tasks.workunit.client.1.smithi149.stdout:8/219: read d2/f1b [2251709,11607] 0 2024-04-15T21:02:28.701 INFO:tasks.workunit.client.1.smithi149.stdout:2/270: rename d4/d7/d10/f16 to d4/d7/d46/f69 0 2024-04-15T21:02:28.701 INFO:tasks.workunit.client.1.smithi149.stdout:3/200: dwrite d1/f2f [0,4194304] 0 2024-04-15T21:02:28.708 INFO:tasks.workunit.client.1.smithi149.stdout:8/220: dread d2/df/d10/d25/f33 [0,4194304] 0 2024-04-15T21:02:28.713 INFO:tasks.workunit.client.1.smithi149.stdout:5/204: rename d0/d9/db/d12/f29 to d0/d9/db/d12/d16/f4e 0 2024-04-15T21:02:28.715 INFO:tasks.workunit.client.1.smithi149.stdout:3/201: dread d1/db/f1d [0,4194304] 0 2024-04-15T21:02:28.716 INFO:tasks.workunit.client.1.smithi149.stdout:2/271: mknod d4/d7/d19/d21/d2c/d3e/c6a 0 2024-04-15T21:02:28.719 INFO:tasks.workunit.client.1.smithi149.stdout:3/202: read - d1/db/d28/f32 zero size 2024-04-15T21:02:28.720 INFO:tasks.workunit.client.1.smithi149.stdout:4/228: dwrite dc/d2c/d3e/f37 [0,4194304] 0 2024-04-15T21:02:28.722 INFO:tasks.workunit.client.1.smithi149.stdout:8/221: mkdir d2/df/d10/d4e 0 2024-04-15T21:02:28.724 INFO:tasks.workunit.client.1.smithi149.stdout:2/272: truncate d4/d7/d19/d21/d3b/f41 5137747 0 2024-04-15T21:02:28.725 INFO:tasks.workunit.client.1.smithi149.stdout:4/229: read dc/d18/f1d [3765201,30721] 0 2024-04-15T21:02:28.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/291: dread d3/fc [0,4194304] 0 2024-04-15T21:02:28.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/203: rename d1/db/d24/d2b/f1e to d1/db/d23/f3a 0 2024-04-15T21:02:28.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/230: read - dc/f41 zero size 2024-04-15T21:02:28.729 INFO:tasks.workunit.client.1.smithi149.stdout:3/204: chown d1/db/c34 3 1 2024-04-15T21:02:28.729 INFO:tasks.workunit.client.1.smithi149.stdout:8/222: mknod d2/df/d10/d21/c4f 0 2024-04-15T21:02:28.734 INFO:tasks.workunit.client.1.smithi149.stdout:5/205: dwrite d0/d9/db/d12/d16/d28/f46 [4194304,4194304] 0 2024-04-15T21:02:28.741 INFO:tasks.workunit.client.1.smithi149.stdout:7/292: mknod d3/d16/d32/d3f/c66 0 2024-04-15T21:02:28.742 INFO:tasks.workunit.client.1.smithi149.stdout:5/206: dread d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:28.743 INFO:tasks.workunit.client.1.smithi149.stdout:8/223: mkdir d2/df/d10/d21/d50 0 2024-04-15T21:02:28.749 INFO:tasks.workunit.client.1.smithi149.stdout:3/205: mkdir d1/d3b 0 2024-04-15T21:02:28.749 INFO:tasks.workunit.client.1.smithi149.stdout:7/293: dwrite d3/d17/f19 [0,4194304] 0 2024-04-15T21:02:28.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/207: unlink d0/d9/db/d12/d16/f4e 0 2024-04-15T21:02:28.753 INFO:tasks.workunit.client.1.smithi149.stdout:8/224: mkdir d2/df/d10/d4e/d51 0 2024-04-15T21:02:28.758 INFO:tasks.workunit.client.1.smithi149.stdout:8/225: symlink d2/df/d10/d20/l52 0 2024-04-15T21:02:28.759 INFO:tasks.workunit.client.1.smithi149.stdout:8/226: fsync d2/f1a 0 2024-04-15T21:02:28.759 INFO:tasks.workunit.client.1.smithi149.stdout:3/206: rmdir d1/db/d23/d37 0 2024-04-15T21:02:28.761 INFO:tasks.workunit.client.1.smithi149.stdout:5/208: creat d0/f4f x:0 0 0 2024-04-15T21:02:28.761 INFO:tasks.workunit.client.1.smithi149.stdout:5/209: dread - d0/d6/f36 zero size 2024-04-15T21:02:28.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/227: mkdir d2/df/d10/d25/d37/d53 0 2024-04-15T21:02:28.763 INFO:tasks.workunit.client.1.smithi149.stdout:3/207: fdatasync d1/db/f1c 0 2024-04-15T21:02:28.764 INFO:tasks.workunit.client.1.smithi149.stdout:2/273: rename d4/d7/d19 to d4/d7/d10/d6b 0 2024-04-15T21:02:28.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/274: readlink d4/d7/l52 0 2024-04-15T21:02:28.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/208: read d1/db/d24/d2b/f2e [54629,21914] 0 2024-04-15T21:02:28.771 INFO:tasks.workunit.client.1.smithi149.stdout:5/210: dwrite d0/d6/d2d/f44 [0,4194304] 0 2024-04-15T21:02:28.772 INFO:tasks.workunit.client.1.smithi149.stdout:3/209: readlink d1/l18 0 2024-04-15T21:02:28.773 INFO:tasks.workunit.client.1.smithi149.stdout:3/210: read d1/db/f1d [21630,114759] 0 2024-04-15T21:02:28.779 INFO:tasks.workunit.client.1.smithi149.stdout:2/275: dread d4/d7/d10/f11 [0,4194304] 0 2024-04-15T21:02:28.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/211: creat d0/f50 x:0 0 0 2024-04-15T21:02:28.783 INFO:tasks.workunit.client.1.smithi149.stdout:3/211: link d1/l18 d1/db/d24/d2b/l3c 0 2024-04-15T21:02:28.783 INFO:tasks.workunit.client.1.smithi149.stdout:4/231: dwrite dc/d2c/d3e/d35/d3a/f40 [4194304,4194304] 0 2024-04-15T21:02:28.784 INFO:tasks.workunit.client.1.smithi149.stdout:5/212: write d0/d9/f39 [1033353,79701] 0 2024-04-15T21:02:28.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/232: stat dc/d2c/f22 0 2024-04-15T21:02:28.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/276: mkdir d4/d7/d10/d6b/d21/d3b/d4c/d6c 0 2024-04-15T21:02:28.789 INFO:tasks.workunit.client.1.smithi149.stdout:9/203: sync 2024-04-15T21:02:28.789 INFO:tasks.workunit.client.1.smithi149.stdout:5/213: write d0/d9/db/d12/d16/d28/d1b/f20 [1341726,127408] 0 2024-04-15T21:02:28.791 INFO:tasks.workunit.client.1.smithi149.stdout:9/204: truncate d23/d2b/f41 823575 0 2024-04-15T21:02:28.791 INFO:tasks.workunit.client.1.smithi149.stdout:3/212: mknod d1/db/d23/c3d 0 2024-04-15T21:02:28.791 INFO:tasks.workunit.client.1.smithi149.stdout:5/214: fdatasync d0/d9/db/d12/d16/d28/f40 0 2024-04-15T21:02:28.792 INFO:tasks.workunit.client.1.smithi149.stdout:4/233: rename f5 to dc/d1a/f4f 0 2024-04-15T21:02:28.792 INFO:tasks.workunit.client.1.smithi149.stdout:8/228: truncate d2/f1a 4534824 0 2024-04-15T21:02:28.794 INFO:tasks.workunit.client.1.smithi149.stdout:3/213: truncate d1/db/d24/f36 227639 0 2024-04-15T21:02:28.802 INFO:tasks.workunit.client.1.smithi149.stdout:5/215: symlink d0/d9/db/d12/d16/d28/l51 0 2024-04-15T21:02:28.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/277: dread d4/d7/d46/f54 [0,4194304] 0 2024-04-15T21:02:28.803 INFO:tasks.workunit.client.1.smithi149.stdout:5/216: readlink d0/d9/db/d12/d16/l35 0 2024-04-15T21:02:28.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/229: symlink d2/df/d10/d25/d32/d45/l54 0 2024-04-15T21:02:28.807 INFO:tasks.workunit.client.1.smithi149.stdout:4/234: mknod dc/d2c/d3e/c50 0 2024-04-15T21:02:28.813 INFO:tasks.workunit.client.1.smithi149.stdout:5/217: dwrite d0/d9/f39 [0,4194304] 0 2024-04-15T21:02:28.814 INFO:tasks.workunit.client.1.smithi149.stdout:9/205: dread f1a [0,4194304] 0 2024-04-15T21:02:28.823 INFO:tasks.workunit.client.1.smithi149.stdout:8/230: symlink d2/l55 0 2024-04-15T21:02:28.825 INFO:tasks.workunit.client.1.smithi149.stdout:5/218: symlink d0/d9/d3f/l52 0 2024-04-15T21:02:28.827 INFO:tasks.workunit.client.1.smithi149.stdout:4/235: dread f2 [0,4194304] 0 2024-04-15T21:02:28.829 INFO:tasks.workunit.client.1.smithi149.stdout:3/214: write d1/db/d28/f2a [2448921,5320] 0 2024-04-15T21:02:28.831 INFO:tasks.workunit.client.1.smithi149.stdout:8/231: readlink d2/df/d10/d25/l48 0 2024-04-15T21:02:28.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/232: chown d2/df/d10/d21/f41 24962 1 2024-04-15T21:02:28.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/219: stat d0/d9/db/l21 0 2024-04-15T21:02:28.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/233: chown d2/df/d10/d20/d30/l3b 401598605 1 2024-04-15T21:02:28.834 INFO:tasks.workunit.client.1.smithi149.stdout:8/234: chown d2/la 11034 1 2024-04-15T21:02:28.836 INFO:tasks.workunit.client.1.smithi149.stdout:4/236: chown dc/d18/d21/l29 81976293 1 2024-04-15T21:02:28.838 INFO:tasks.workunit.client.1.smithi149.stdout:2/278: dwrite d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:28.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/235: symlink d2/df/d10/d25/d37/l56 0 2024-04-15T21:02:28.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/279: mkdir d4/d7/d10/d6b/d21/d6d 0 2024-04-15T21:02:28.926 INFO:tasks.workunit.client.1.smithi149.stdout:8/236: unlink d2/df/d10/d34/f4d 0 2024-04-15T21:02:28.927 INFO:tasks.workunit.client.1.smithi149.stdout:8/237: chown d2/df/d10/c3f 2 1 2024-04-15T21:02:28.931 INFO:tasks.workunit.client.1.smithi149.stdout:9/206: truncate f3 4034228 0 2024-04-15T21:02:28.933 INFO:tasks.workunit.client.1.smithi149.stdout:8/238: mkdir d2/df/d10/d25/d57 0 2024-04-15T21:02:28.934 INFO:tasks.workunit.client.1.smithi149.stdout:2/280: symlink d4/l6e 0 2024-04-15T21:02:28.938 INFO:tasks.workunit.client.1.smithi149.stdout:9/207: creat d23/f43 x:0 0 0 2024-04-15T21:02:28.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/220: write d0/d9/db/f1c [2306199,102551] 0 2024-04-15T21:02:28.941 INFO:tasks.workunit.client.1.smithi149.stdout:2/281: dwrite d4/d7/d10/d6b/d21/f5f [0,4194304] 0 2024-04-15T21:02:28.943 INFO:tasks.workunit.client.1.smithi149.stdout:9/208: mkdir d23/d2b/d44 0 2024-04-15T21:02:28.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/221: dread d0/f3a [0,4194304] 0 2024-04-15T21:02:28.946 INFO:tasks.workunit.client.1.smithi149.stdout:4/237: truncate dc/d1a/f2b 365794 0 2024-04-15T21:02:28.950 INFO:tasks.workunit.client.1.smithi149.stdout:9/209: symlink d23/d3c/l45 0 2024-04-15T21:02:28.951 INFO:tasks.workunit.client.1.smithi149.stdout:2/282: dwrite d4/d7/d10/d6b/f24 [0,4194304] 0 2024-04-15T21:02:28.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/283: dread - d4/d7/d10/d36/f47 zero size 2024-04-15T21:02:28.959 INFO:tasks.workunit.client.1.smithi149.stdout:4/238: symlink dc/d2c/d3e/d15/d3f/l51 0 2024-04-15T21:02:28.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/239: read dc/d1a/f30 [460242,26562] 0 2024-04-15T21:02:28.961 INFO:tasks.workunit.client.1.smithi149.stdout:6/198: sync 2024-04-15T21:02:28.964 INFO:tasks.workunit.client.1.smithi149.stdout:9/210: mkdir d23/d46 0 2024-04-15T21:02:28.968 INFO:tasks.workunit.client.1.smithi149.stdout:4/240: dwrite dc/f41 [0,4194304] 0 2024-04-15T21:02:28.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/199: mknod da/d18/d10/c47 0 2024-04-15T21:02:28.977 INFO:tasks.workunit.client.1.smithi149.stdout:9/211: creat d23/f47 x:0 0 0 2024-04-15T21:02:28.978 INFO:tasks.workunit.client.1.smithi149.stdout:9/212: write d23/f3a [409072,7965] 0 2024-04-15T21:02:28.980 INFO:tasks.workunit.client.1.smithi149.stdout:8/239: link d2/df/d10/d25/d32/c3a d2/c58 0 2024-04-15T21:02:28.980 INFO:tasks.workunit.client.1.smithi149.stdout:6/200: dread da/d18/d10/d16/f29 [0,4194304] 0 2024-04-15T21:02:28.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/201: fdatasync da/d18/d10/d3f/f41 0 2024-04-15T21:02:28.982 INFO:tasks.workunit.client.1.smithi149.stdout:8/240: write d2/df/d10/d25/f28 [697391,124519] 0 2024-04-15T21:02:28.989 INFO:tasks.workunit.client.1.smithi149.stdout:8/241: dwrite d2/f4 [0,4194304] 0 2024-04-15T21:02:28.993 INFO:tasks.workunit.client.1.smithi149.stdout:5/222: link d0/d9/db/d12/f27 d0/d9/db/d12/d2b/f53 0 2024-04-15T21:02:28.993 INFO:tasks.workunit.client.1.smithi149.stdout:5/223: chown d0/d9/db/d12 22301 1 2024-04-15T21:02:28.994 INFO:tasks.workunit.client.1.smithi149.stdout:5/224: read d0/d9/db/d12/d16/d28/f46 [1587525,78725] 0 2024-04-15T21:02:28.999 INFO:tasks.workunit.client.1.smithi149.stdout:9/213: creat d23/f48 x:0 0 0 2024-04-15T21:02:28.999 INFO:tasks.workunit.client.1.smithi149.stdout:9/214: readlink d23/l25 0 2024-04-15T21:02:29.003 INFO:tasks.workunit.client.1.smithi149.stdout:6/202: creat da/d32/f48 x:0 0 0 2024-04-15T21:02:29.004 INFO:tasks.workunit.client.1.smithi149.stdout:6/203: write da/d18/d10/f42 [567011,83671] 0 2024-04-15T21:02:29.004 INFO:tasks.workunit.client.1.smithi149.stdout:6/204: fdatasync da/f1b 0 2024-04-15T21:02:29.011 INFO:tasks.workunit.client.1.smithi149.stdout:4/241: dwrite dc/f41 [4194304,4194304] 0 2024-04-15T21:02:29.013 INFO:tasks.workunit.client.1.smithi149.stdout:2/284: truncate d4/d7/d46/f69 4129230 0 2024-04-15T21:02:29.019 INFO:tasks.workunit.client.1.smithi149.stdout:6/205: unlink l3 0 2024-04-15T21:02:29.020 INFO:tasks.workunit.client.1.smithi149.stdout:6/206: fdatasync da/d32/f43 0 2024-04-15T21:02:29.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/242: dread d2/df/d10/d25/f4a [0,4194304] 0 2024-04-15T21:02:29.027 INFO:tasks.workunit.client.1.smithi149.stdout:5/225: fdatasync d0/d9/db/d12/f27 0 2024-04-15T21:02:29.029 INFO:tasks.workunit.client.1.smithi149.stdout:2/285: symlink d4/d7/da/l6f 0 2024-04-15T21:02:29.031 INFO:tasks.workunit.client.1.smithi149.stdout:9/215: link f9 d23/d46/f49 0 2024-04-15T21:02:29.039 INFO:tasks.workunit.client.1.smithi149.stdout:8/243: creat d2/df/d10/d25/d32/d45/f59 x:0 0 0 2024-04-15T21:02:29.043 INFO:tasks.workunit.client.1.smithi149.stdout:2/286: dread d4/f12 [0,4194304] 0 2024-04-15T21:02:29.045 INFO:tasks.workunit.client.1.smithi149.stdout:2/287: truncate d4/d7/d10/d6b/d21/d5e/f51 882556 0 2024-04-15T21:02:29.047 INFO:tasks.workunit.client.1.smithi149.stdout:6/207: mkdir da/d49 0 2024-04-15T21:02:29.049 INFO:tasks.workunit.client.1.smithi149.stdout:1/206: sync 2024-04-15T21:02:29.050 INFO:tasks.workunit.client.1.smithi149.stdout:0/195: sync 2024-04-15T21:02:29.051 INFO:tasks.workunit.client.1.smithi149.stdout:0/196: chown d1/d5/l3e 137 1 2024-04-15T21:02:29.051 INFO:tasks.workunit.client.1.smithi149.stdout:1/207: write d1/db/d14/d1e/fd [1080997,117739] 0 2024-04-15T21:02:29.061 INFO:tasks.workunit.client.1.smithi149.stdout:4/242: getdents dc/d1a 0 2024-04-15T21:02:29.063 INFO:tasks.workunit.client.1.smithi149.stdout:0/197: write d1/d5/f12 [6983746,91188] 0 2024-04-15T21:02:29.065 INFO:tasks.workunit.client.1.smithi149.stdout:5/226: truncate d0/d9/db/f2e 226552 0 2024-04-15T21:02:29.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/227: chown d0/d6/d2d 0 1 2024-04-15T21:02:29.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/228: dread - d0/d6/d2d/f4a zero size 2024-04-15T21:02:29.069 INFO:tasks.workunit.client.1.smithi149.stdout:2/288: creat d4/d7/d10/d6b/d21/d3b/d4c/d6c/f70 x:0 0 0 2024-04-15T21:02:29.069 INFO:tasks.workunit.client.1.smithi149.stdout:9/216: truncate f1f 556802 0 2024-04-15T21:02:29.071 INFO:tasks.workunit.client.1.smithi149.stdout:9/217: write d23/d2b/f41 [364061,100622] 0 2024-04-15T21:02:29.072 INFO:tasks.workunit.client.1.smithi149.stdout:6/208: symlink da/d49/l4a 0 2024-04-15T21:02:29.075 INFO:tasks.workunit.client.1.smithi149.stdout:5/229: dwrite d0/d9/db/d12/d16/d28/d1b/f20 [0,4194304] 0 2024-04-15T21:02:29.075 INFO:tasks.workunit.client.1.smithi149.stdout:6/209: write da/d18/d10/f42 [919135,91368] 0 2024-04-15T21:02:29.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/210: dread da/d18/d10/d16/f2f [0,4194304] 0 2024-04-15T21:02:29.080 INFO:tasks.workunit.client.1.smithi149.stdout:6/211: truncate da/d32/f43 1673097 0 2024-04-15T21:02:29.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/218: rmdir d23/d46 39 2024-04-15T21:02:29.089 INFO:tasks.workunit.client.1.smithi149.stdout:8/244: getdents d2/df/d10/d25/d32 0 2024-04-15T21:02:29.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/198: write d1/d9/f1b [884053,44506] 0 2024-04-15T21:02:29.098 INFO:tasks.workunit.client.1.smithi149.stdout:5/230: dread d0/d9/db/f38 [4194304,4194304] 0 2024-04-15T21:02:29.099 INFO:tasks.workunit.client.1.smithi149.stdout:1/208: truncate d1/db/d14/d21/f2a 2312518 0 2024-04-15T21:02:29.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/212: mknod da/d18/d33/c4b 0 2024-04-15T21:02:29.104 INFO:tasks.workunit.client.1.smithi149.stdout:9/219: creat d23/d2b/f4a x:0 0 0 2024-04-15T21:02:29.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/215: sync 2024-04-15T21:02:29.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/294: sync 2024-04-15T21:02:29.109 INFO:tasks.workunit.client.1.smithi149.stdout:0/199: readlink d1/d5/le 0 2024-04-15T21:02:29.115 INFO:tasks.workunit.client.1.smithi149.stdout:2/289: link d4/d7/d10/d6b/d21/d2c/l34 d4/d7/d10/d6b/d21/d3b/l71 0 2024-04-15T21:02:29.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/243: getdents dc/d2c/d3e/d15/d3f 0 2024-04-15T21:02:29.117 INFO:tasks.workunit.client.1.smithi149.stdout:4/244: truncate dc/d2c/f22 329565 0 2024-04-15T21:02:29.118 INFO:tasks.workunit.client.1.smithi149.stdout:3/216: rmdir d1/db/d28 39 2024-04-15T21:02:29.119 INFO:tasks.workunit.client.1.smithi149.stdout:9/220: dread d23/f3b [0,4194304] 0 2024-04-15T21:02:29.127 INFO:tasks.workunit.client.1.smithi149.stdout:6/213: mknod da/d2e/d45/c4c 0 2024-04-15T21:02:29.131 INFO:tasks.workunit.client.1.smithi149.stdout:4/245: rmdir dc/d2c/d3e/d15/d3f 39 2024-04-15T21:02:29.132 INFO:tasks.workunit.client.1.smithi149.stdout:4/246: chown dc/d2c/d3e/d35/l3c 1 1 2024-04-15T21:02:29.137 INFO:tasks.workunit.client.1.smithi149.stdout:7/295: rename d3/d17/d1f/l37 to d3/d16/d20/d36/d3d/d56/l67 0 2024-04-15T21:02:29.142 INFO:tasks.workunit.client.1.smithi149.stdout:1/209: dwrite d1/db/d14/d21/f2a [0,4194304] 0 2024-04-15T21:02:29.142 INFO:tasks.workunit.client.1.smithi149.stdout:3/217: dwrite d1/db/d24/d2b/f25 [0,4194304] 0 2024-04-15T21:02:29.142 INFO:tasks.workunit.client.1.smithi149.stdout:3/218: readlink d1/l1f 0 2024-04-15T21:02:29.142 INFO:tasks.workunit.client.1.smithi149.stdout:3/219: truncate d1/db/d24/f38 1194748 0 2024-04-15T21:02:29.143 INFO:tasks.workunit.client.1.smithi149.stdout:6/214: unlink da/d18/d10/d16/f2f 0 2024-04-15T21:02:29.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/245: link d2/c1e d2/c5a 0 2024-04-15T21:02:29.147 INFO:tasks.workunit.client.1.smithi149.stdout:2/290: stat d4/d7/d10/d6b/d21/d2c/l34 0 2024-04-15T21:02:29.149 INFO:tasks.workunit.client.1.smithi149.stdout:4/247: symlink dc/l52 0 2024-04-15T21:02:29.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/221: creat d23/d2b/d37/f4b x:0 0 0 2024-04-15T21:02:29.152 INFO:tasks.workunit.client.1.smithi149.stdout:9/222: truncate d23/f48 617486 0 2024-04-15T21:02:29.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/220: mknod d1/db/d24/d2b/c3e 0 2024-04-15T21:02:29.163 INFO:tasks.workunit.client.1.smithi149.stdout:6/215: dread da/f1b [0,4194304] 0 2024-04-15T21:02:29.163 INFO:tasks.workunit.client.1.smithi149.stdout:2/291: unlink d4/d7/d10/d6b/d21/d2c/d58/f64 0 2024-04-15T21:02:29.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/231: dwrite d0/d9/db/f2e [0,4194304] 0 2024-04-15T21:02:29.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/232: write d0/d9/db/d12/d16/d28/d1b/f1f [812064,48905] 0 2024-04-15T21:02:29.176 INFO:tasks.workunit.client.1.smithi149.stdout:7/296: symlink d3/d17/l68 0 2024-04-15T21:02:29.177 INFO:tasks.workunit.client.1.smithi149.stdout:5/233: dread d0/d9/db/d12/d16/d28/d1b/f20 [0,4194304] 0 2024-04-15T21:02:29.179 INFO:tasks.workunit.client.1.smithi149.stdout:0/200: getdents d1/d5 0 2024-04-15T21:02:29.184 INFO:tasks.workunit.client.1.smithi149.stdout:8/246: mkdir d2/d5b 0 2024-04-15T21:02:29.185 INFO:tasks.workunit.client.1.smithi149.stdout:8/247: read - d2/df/f40 zero size 2024-04-15T21:02:29.185 INFO:tasks.workunit.client.1.smithi149.stdout:5/234: dwrite d0/d9/db/d12/d16/f1d [4194304,4194304] 0 2024-04-15T21:02:29.188 INFO:tasks.workunit.client.1.smithi149.stdout:3/221: truncate d1/db/d24/d2b/f2e 125838 0 2024-04-15T21:02:29.192 INFO:tasks.workunit.client.1.smithi149.stdout:3/222: chown d1/db/d24/f38 13362 1 2024-04-15T21:02:29.194 INFO:tasks.workunit.client.1.smithi149.stdout:6/216: mknod da/d18/d10/c4d 0 2024-04-15T21:02:29.196 INFO:tasks.workunit.client.1.smithi149.stdout:2/292: symlink d4/d7/da/l72 0 2024-04-15T21:02:29.196 INFO:tasks.workunit.client.1.smithi149.stdout:2/293: fsync d4/d7/d10/f37 0 2024-04-15T21:02:29.197 INFO:tasks.workunit.client.1.smithi149.stdout:4/248: creat dc/d2c/d3e/d35/d3a/f53 x:0 0 0 2024-04-15T21:02:29.206 INFO:tasks.workunit.client.1.smithi149.stdout:7/297: mknod d3/d16/d20/d60/c69 0 2024-04-15T21:02:29.208 INFO:tasks.workunit.client.1.smithi149.stdout:7/298: dread d3/d34/f4e [0,4194304] 0 2024-04-15T21:02:29.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/248: mknod d2/d16/c5c 0 2024-04-15T21:02:29.218 INFO:tasks.workunit.client.1.smithi149.stdout:1/210: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:29.228 INFO:tasks.workunit.client.1.smithi149.stdout:2/294: rename d4/d7/d10/d6b/d21/d3b/c42 to d4/d7/d10/d6b/d21/d2c/d3e/c73 0 2024-04-15T21:02:29.229 INFO:tasks.workunit.client.1.smithi149.stdout:2/295: dread - d4/f65 zero size 2024-04-15T21:02:29.229 INFO:tasks.workunit.client.1.smithi149.stdout:2/296: readlink d4/d7/d10/l2b 0 2024-04-15T21:02:29.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/223: dwrite f3 [0,4194304] 0 2024-04-15T21:02:29.237 INFO:tasks.workunit.client.1.smithi149.stdout:9/224: chown d23/d3c/l45 25388657 1 2024-04-15T21:02:29.238 INFO:tasks.workunit.client.1.smithi149.stdout:0/201: truncate d1/d9/d10/f2a 2474924 0 2024-04-15T21:02:29.242 INFO:tasks.workunit.client.1.smithi149.stdout:8/249: rmdir d2/df/d10/d25 39 2024-04-15T21:02:29.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/235: getdents d0/d9/db/d12/d49 0 2024-04-15T21:02:29.250 INFO:tasks.workunit.client.1.smithi149.stdout:3/223: mknod d1/c3f 0 2024-04-15T21:02:29.251 INFO:tasks.workunit.client.1.smithi149.stdout:6/217: mknod da/c4e 0 2024-04-15T21:02:29.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/249: write dc/d1a/f2b [774510,124033] 0 2024-04-15T21:02:29.254 INFO:tasks.workunit.client.1.smithi149.stdout:1/211: chown d1/db/dc/c27 1465306 1 2024-04-15T21:02:29.260 INFO:tasks.workunit.client.1.smithi149.stdout:6/218: dwrite da/d32/f48 [0,4194304] 0 2024-04-15T21:02:29.262 INFO:tasks.workunit.client.1.smithi149.stdout:7/299: mknod d3/d16/c6a 0 2024-04-15T21:02:29.263 INFO:tasks.workunit.client.1.smithi149.stdout:7/300: chown d3/f18 3983 1 2024-04-15T21:02:29.272 INFO:tasks.workunit.client.1.smithi149.stdout:7/301: dwrite d3/f47 [0,4194304] 0 2024-04-15T21:02:29.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/250: rename dc/d2c/d3e/d15/l3b to dc/d2c/d3e/d35/d4b/l54 0 2024-04-15T21:02:29.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/297: dwrite d4/d7/d46/f54 [0,4194304] 0 2024-04-15T21:02:29.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/298: readlink d4/d7/l4d 0 2024-04-15T21:02:29.298 INFO:tasks.workunit.client.1.smithi149.stdout:9/225: dwrite d23/f24 [0,4194304] 0 2024-04-15T21:02:29.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/250: mkdir d2/df/d10/d21/d50/d5d 0 2024-04-15T21:02:29.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/251: chown d2/fe 62 1 2024-04-15T21:02:29.303 INFO:tasks.workunit.client.1.smithi149.stdout:3/224: write d1/db/d24/f38 [2174594,38109] 0 2024-04-15T21:02:29.304 INFO:tasks.workunit.client.1.smithi149.stdout:8/252: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:29.306 INFO:tasks.workunit.client.1.smithi149.stdout:8/253: write d2/f2b [935450,67741] 0 2024-04-15T21:02:29.311 INFO:tasks.workunit.client.1.smithi149.stdout:4/251: unlink dc/d2c/d3e/f37 0 2024-04-15T21:02:29.313 INFO:tasks.workunit.client.1.smithi149.stdout:2/299: mkdir d4/d7/d46/d74 0 2024-04-15T21:02:29.317 INFO:tasks.workunit.client.1.smithi149.stdout:0/202: creat d1/f41 x:0 0 0 2024-04-15T21:02:29.318 INFO:tasks.workunit.client.1.smithi149.stdout:0/203: stat d1/d5/le 0 2024-04-15T21:02:29.323 INFO:tasks.workunit.client.1.smithi149.stdout:5/236: rmdir d0/d9/db/d12/d49 0 2024-04-15T21:02:29.325 INFO:tasks.workunit.client.1.smithi149.stdout:1/212: truncate d1/db/d14/d1e/fd 4305805 0 2024-04-15T21:02:29.329 INFO:tasks.workunit.client.1.smithi149.stdout:8/254: write d2/df/d10/d25/d32/f44 [948313,7815] 0 2024-04-15T21:02:29.330 INFO:tasks.workunit.client.1.smithi149.stdout:1/213: dread d1/db/dc/f10 [0,4194304] 0 2024-04-15T21:02:29.336 INFO:tasks.workunit.client.1.smithi149.stdout:4/252: symlink dc/d1a/l55 0 2024-04-15T21:02:29.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/255: dwrite d2/df/d10/d20/f27 [8388608,4194304] 0 2024-04-15T21:02:29.339 INFO:tasks.workunit.client.1.smithi149.stdout:8/256: dread - d2/df/d10/d25/d37/f3e zero size 2024-04-15T21:02:29.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/226: symlink d23/l4c 0 2024-04-15T21:02:29.341 INFO:tasks.workunit.client.1.smithi149.stdout:9/227: dread - d23/d2b/d37/f4b zero size 2024-04-15T21:02:29.342 INFO:tasks.workunit.client.1.smithi149.stdout:5/237: creat d0/d9/db/d12/d16/f54 x:0 0 0 2024-04-15T21:02:29.346 INFO:tasks.workunit.client.1.smithi149.stdout:3/225: mkdir d1/db/d40 0 2024-04-15T21:02:29.346 INFO:tasks.workunit.client.1.smithi149.stdout:3/226: fdatasync d1/db/f1c 0 2024-04-15T21:02:29.348 INFO:tasks.workunit.client.1.smithi149.stdout:7/302: rename d3/d16/d20/c57 to d3/d17/c6b 0 2024-04-15T21:02:29.351 INFO:tasks.workunit.client.1.smithi149.stdout:9/228: dwrite d23/d2b/d37/f4b [0,4194304] 0 2024-04-15T21:02:29.363 INFO:tasks.workunit.client.1.smithi149.stdout:4/253: symlink dc/d18/d21/l56 0 2024-04-15T21:02:29.364 INFO:tasks.workunit.client.1.smithi149.stdout:6/219: link da/d2e/l30 da/l4f 0 2024-04-15T21:02:29.368 INFO:tasks.workunit.client.1.smithi149.stdout:8/257: creat d2/df/d10/d25/d32/d45/f5e x:0 0 0 2024-04-15T21:02:29.370 INFO:tasks.workunit.client.1.smithi149.stdout:8/258: write d2/df/d10/d25/f28 [3753205,96978] 0 2024-04-15T21:02:29.371 INFO:tasks.workunit.client.1.smithi149.stdout:5/238: unlink d0/d9/db/d12/d16/d28/l51 0 2024-04-15T21:02:29.374 INFO:tasks.workunit.client.1.smithi149.stdout:8/259: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:29.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/229: chown ld 381782 1 2024-04-15T21:02:29.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/230: truncate d23/f3a 418082 0 2024-04-15T21:02:29.381 INFO:tasks.workunit.client.1.smithi149.stdout:1/214: mkdir d1/db/dc/d38/d39 0 2024-04-15T21:02:29.385 INFO:tasks.workunit.client.1.smithi149.stdout:2/300: truncate d4/d7/d29/f30 498360 0 2024-04-15T21:02:29.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/215: dwrite d1/db/f32 [0,4194304] 0 2024-04-15T21:02:29.388 INFO:tasks.workunit.client.1.smithi149.stdout:1/216: fdatasync d1/db/f2c 0 2024-04-15T21:02:29.389 INFO:tasks.workunit.client.1.smithi149.stdout:1/217: chown d1/db/d14/d21 13048 1 2024-04-15T21:02:29.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/204: creat d1/d9/d10/f42 x:0 0 0 2024-04-15T21:02:29.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/254: dwrite fa [0,4194304] 0 2024-04-15T21:02:29.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/260: creat d2/df/d10/d25/d37/f5f x:0 0 0 2024-04-15T21:02:29.401 INFO:tasks.workunit.client.1.smithi149.stdout:8/261: write d2/df/d10/d25/d32/f44 [1456440,34062] 0 2024-04-15T21:02:29.403 INFO:tasks.workunit.client.1.smithi149.stdout:8/262: dread - d2/df/d10/d25/d32/d45/f59 zero size 2024-04-15T21:02:29.407 INFO:tasks.workunit.client.1.smithi149.stdout:6/220: link da/d18/d10/f1c da/d2e/f50 0 2024-04-15T21:02:29.410 INFO:tasks.workunit.client.1.smithi149.stdout:0/205: mkdir d1/d5/d24/d30/d43 0 2024-04-15T21:02:29.411 INFO:tasks.workunit.client.1.smithi149.stdout:5/239: mkdir d0/d9/d3f/d47/d55 0 2024-04-15T21:02:29.412 INFO:tasks.workunit.client.1.smithi149.stdout:0/206: dread d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:29.414 INFO:tasks.workunit.client.1.smithi149.stdout:3/227: rename d1/f30 to d1/db/f41 0 2024-04-15T21:02:29.415 INFO:tasks.workunit.client.1.smithi149.stdout:3/228: write d1/db/d24/d2b/f22 [5183665,53547] 0 2024-04-15T21:02:29.416 INFO:tasks.workunit.client.1.smithi149.stdout:3/229: stat d1/c10 0 2024-04-15T21:02:29.417 INFO:tasks.workunit.client.1.smithi149.stdout:8/263: mknod d2/df/d10/d21/d50/c60 0 2024-04-15T21:02:29.418 INFO:tasks.workunit.client.1.smithi149.stdout:6/221: mknod da/d11/c51 0 2024-04-15T21:02:29.418 INFO:tasks.workunit.client.1.smithi149.stdout:3/230: truncate d1/db/d24/f36 593094 0 2024-04-15T21:02:29.420 INFO:tasks.workunit.client.1.smithi149.stdout:3/231: write d1/db/f21 [5232288,125721] 0 2024-04-15T21:02:29.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/255: link f1 dc/d2c/d3e/d35/d4b/f57 0 2024-04-15T21:02:29.422 INFO:tasks.workunit.client.1.smithi149.stdout:4/256: readlink dc/lf 0 2024-04-15T21:02:29.423 INFO:tasks.workunit.client.1.smithi149.stdout:4/257: readlink dc/d2c/d3e/d15/l44 0 2024-04-15T21:02:29.425 INFO:tasks.workunit.client.1.smithi149.stdout:0/207: unlink d1/d9/d10/f42 0 2024-04-15T21:02:29.425 INFO:tasks.workunit.client.1.smithi149.stdout:4/258: stat dc/d2c/d3e/d15/c1b 0 2024-04-15T21:02:29.427 INFO:tasks.workunit.client.1.smithi149.stdout:8/264: dwrite d2/df/d10/d20/f4b [0,4194304] 0 2024-04-15T21:02:29.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/208: fsync d1/d5/d24/d30/d32/f3b 0 2024-04-15T21:02:29.429 INFO:tasks.workunit.client.1.smithi149.stdout:8/265: fsync d2/df/d10/d25/d32/d45/f5e 0 2024-04-15T21:02:29.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/222: rename da/d18/d10/d16/f40 to da/d2e/f52 0 2024-04-15T21:02:29.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/223: write da/d32/f43 [1061958,101789] 0 2024-04-15T21:02:29.435 INFO:tasks.workunit.client.1.smithi149.stdout:6/224: chown da/d18/l12 1821493 1 2024-04-15T21:02:29.446 INFO:tasks.workunit.client.1.smithi149.stdout:4/259: dwrite f1 [0,4194304] 0 2024-04-15T21:02:29.446 INFO:tasks.workunit.client.1.smithi149.stdout:0/209: rename d1/d5/d24/d30/d32 to d1/d9/d10/d13/d38/d44 0 2024-04-15T21:02:29.452 INFO:tasks.workunit.client.1.smithi149.stdout:6/225: mknod da/d32/c53 0 2024-04-15T21:02:29.453 INFO:tasks.workunit.client.1.smithi149.stdout:6/226: chown da/d11/c51 504705 1 2024-04-15T21:02:29.458 INFO:tasks.workunit.client.1.smithi149.stdout:4/260: dwrite dc/d2c/f22 [0,4194304] 0 2024-04-15T21:02:29.460 INFO:tasks.workunit.client.1.smithi149.stdout:0/210: rename d1/d5/d24/c31 to d1/d5/d24/d30/d43/c45 0 2024-04-15T21:02:29.462 INFO:tasks.workunit.client.1.smithi149.stdout:3/232: rmdir d1/d3b 0 2024-04-15T21:02:29.463 INFO:tasks.workunit.client.1.smithi149.stdout:0/211: write d1/d5/f2e [2404892,130693] 0 2024-04-15T21:02:29.465 INFO:tasks.workunit.client.1.smithi149.stdout:8/266: link d2/lc d2/df/d10/d21/l61 0 2024-04-15T21:02:29.467 INFO:tasks.workunit.client.1.smithi149.stdout:6/227: dwrite da/d11/f35 [0,4194304] 0 2024-04-15T21:02:29.468 INFO:tasks.workunit.client.1.smithi149.stdout:4/261: mknod dc/d2c/d3e/d35/d3a/c58 0 2024-04-15T21:02:29.469 INFO:tasks.workunit.client.1.smithi149.stdout:8/267: fsync d2/df/d10/d25/d32/f39 0 2024-04-15T21:02:29.470 INFO:tasks.workunit.client.1.smithi149.stdout:4/262: write dc/d1a/f26 [490978,50923] 0 2024-04-15T21:02:29.474 INFO:tasks.workunit.client.1.smithi149.stdout:0/212: creat d1/d5/dc/f46 x:0 0 0 2024-04-15T21:02:29.475 INFO:tasks.workunit.client.1.smithi149.stdout:9/231: truncate f3 3165896 0 2024-04-15T21:02:29.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/263: mknod dc/d2c/d3e/d35/c59 0 2024-04-15T21:02:29.480 INFO:tasks.workunit.client.1.smithi149.stdout:3/233: symlink d1/db/d40/l42 0 2024-04-15T21:02:29.489 INFO:tasks.workunit.client.1.smithi149.stdout:3/234: rename d1/db/d24/c26 to d1/db/d24/c43 0 2024-04-15T21:02:29.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/240: write d0/d9/db/f10 [725747,118060] 0 2024-04-15T21:02:29.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/264: creat dc/d2c/d3e/d15/d3f/f5a x:0 0 0 2024-04-15T21:02:29.494 INFO:tasks.workunit.client.1.smithi149.stdout:8/268: dread d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:29.498 INFO:tasks.workunit.client.1.smithi149.stdout:4/265: dread dc/d2c/d3e/d15/d3f/f43 [0,4194304] 0 2024-04-15T21:02:29.502 INFO:tasks.workunit.client.1.smithi149.stdout:3/235: creat d1/db/d28/f44 x:0 0 0 2024-04-15T21:02:29.503 INFO:tasks.workunit.client.1.smithi149.stdout:0/213: link d1/d9/d10/f2a d1/d9/d10/d13/d38/d44/f47 0 2024-04-15T21:02:29.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/241: creat d0/f56 x:0 0 0 2024-04-15T21:02:29.508 INFO:tasks.workunit.client.1.smithi149.stdout:3/236: rename d1/c3f to d1/db/d40/c45 0 2024-04-15T21:02:29.509 INFO:tasks.workunit.client.1.smithi149.stdout:3/237: fsync d1/db/f1c 0 2024-04-15T21:02:29.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/266: mkdir dc/d2c/d3e/d15/d5b 0 2024-04-15T21:02:29.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/242: dwrite d0/d9/db/d12/d16/d28/f42 [0,4194304] 0 2024-04-15T21:02:29.513 INFO:tasks.workunit.client.1.smithi149.stdout:4/267: fsync dc/d2c/d3e/d15/f34 0 2024-04-15T21:02:29.515 INFO:tasks.workunit.client.1.smithi149.stdout:5/243: write d0/d6/d2d/f44 [4239109,35339] 0 2024-04-15T21:02:29.522 INFO:tasks.workunit.client.1.smithi149.stdout:3/238: readlink d1/l18 0 2024-04-15T21:02:29.524 INFO:tasks.workunit.client.1.smithi149.stdout:5/244: creat d0/d9/f57 x:0 0 0 2024-04-15T21:02:29.525 INFO:tasks.workunit.client.1.smithi149.stdout:6/228: dwrite da/d18/f23 [0,4194304] 0 2024-04-15T21:02:29.526 INFO:tasks.workunit.client.1.smithi149.stdout:3/239: mknod d1/db/d24/c46 0 2024-04-15T21:02:29.526 INFO:tasks.workunit.client.1.smithi149.stdout:4/268: write dc/d18/f1f [5245504,105368] 0 2024-04-15T21:02:29.530 INFO:tasks.workunit.client.1.smithi149.stdout:0/214: dread d1/d9/d10/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:29.531 INFO:tasks.workunit.client.1.smithi149.stdout:5/245: creat d0/d9/db/d12/d16/f58 x:0 0 0 2024-04-15T21:02:29.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/232: dwrite f1f [0,4194304] 0 2024-04-15T21:02:29.602 INFO:tasks.workunit.client.1.smithi149.stdout:3/240: creat d1/db/d24/d39/f47 x:0 0 0 2024-04-15T21:02:29.604 INFO:tasks.workunit.client.1.smithi149.stdout:6/229: dwrite da/d11/f1d [0,4194304] 0 2024-04-15T21:02:29.605 INFO:tasks.workunit.client.1.smithi149.stdout:5/246: creat d0/d9/db/d12/d16/d28/d1b/f59 x:0 0 0 2024-04-15T21:02:29.607 INFO:tasks.workunit.client.1.smithi149.stdout:0/215: dread d1/d9/d10/f2a [0,4194304] 0 2024-04-15T21:02:29.608 INFO:tasks.workunit.client.1.smithi149.stdout:6/230: stat da/d18/d10/c4d 0 2024-04-15T21:02:29.610 INFO:tasks.workunit.client.1.smithi149.stdout:3/241: stat d1/db/d24/d2b/c19 0 2024-04-15T21:02:29.614 INFO:tasks.workunit.client.1.smithi149.stdout:4/269: dread dc/d2c/f22 [0,4194304] 0 2024-04-15T21:02:29.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/216: rename d1/d9/d10/d13/d38/d44/f3b to d1/d5/d24/d30/d43/f48 0 2024-04-15T21:02:29.624 INFO:tasks.workunit.client.1.smithi149.stdout:5/247: rmdir d0/d9/d3f/d47/d55 0 2024-04-15T21:02:29.625 INFO:tasks.workunit.client.1.smithi149.stdout:6/231: dwrite da/f1b [0,4194304] 0 2024-04-15T21:02:29.627 INFO:tasks.workunit.client.1.smithi149.stdout:9/233: getdents d23/d2b/d37 0 2024-04-15T21:02:29.628 INFO:tasks.workunit.client.1.smithi149.stdout:9/234: chown d23/d3c 5479793 1 2024-04-15T21:02:29.629 INFO:tasks.workunit.client.1.smithi149.stdout:3/242: getdents d1/db/d28 0 2024-04-15T21:02:29.631 INFO:tasks.workunit.client.1.smithi149.stdout:3/243: stat d1/db/d28 0 2024-04-15T21:02:29.632 INFO:tasks.workunit.client.1.smithi149.stdout:0/217: creat d1/d9/d10/d15/f49 x:0 0 0 2024-04-15T21:02:29.633 INFO:tasks.workunit.client.1.smithi149.stdout:3/244: stat d1/l1f 0 2024-04-15T21:02:29.635 INFO:tasks.workunit.client.1.smithi149.stdout:6/232: dread da/d11/f1d [0,4194304] 0 2024-04-15T21:02:29.635 INFO:tasks.workunit.client.1.smithi149.stdout:9/235: symlink d23/d2b/d44/l4d 0 2024-04-15T21:02:29.637 INFO:tasks.workunit.client.1.smithi149.stdout:0/218: creat d1/d5/f4a x:0 0 0 2024-04-15T21:02:29.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/236: truncate f22 1084786 0 2024-04-15T21:02:29.642 INFO:tasks.workunit.client.1.smithi149.stdout:0/219: stat d1/d9/d10/d15 0 2024-04-15T21:02:29.643 INFO:tasks.workunit.client.1.smithi149.stdout:5/248: dwrite d0/f4 [0,4194304] 0 2024-04-15T21:02:29.645 INFO:tasks.workunit.client.1.smithi149.stdout:9/237: creat d23/d3c/f4e x:0 0 0 2024-04-15T21:02:29.648 INFO:tasks.workunit.client.1.smithi149.stdout:6/233: getdents da/d2e/d45 0 2024-04-15T21:02:29.648 INFO:tasks.workunit.client.1.smithi149.stdout:0/220: rmdir d1/d9/d10/d13/d38 39 2024-04-15T21:02:29.649 INFO:tasks.workunit.client.1.smithi149.stdout:5/249: readlink d0/d9/db/l25 0 2024-04-15T21:02:29.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/270: dwrite dc/fe [0,4194304] 0 2024-04-15T21:02:29.650 INFO:tasks.workunit.client.1.smithi149.stdout:9/238: rmdir d23/d46 39 2024-04-15T21:02:29.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/245: dread d1/db/d23/f3a [0,4194304] 0 2024-04-15T21:02:29.657 INFO:tasks.workunit.client.1.smithi149.stdout:3/246: stat d1/db/d23 0 2024-04-15T21:02:29.662 INFO:tasks.workunit.client.1.smithi149.stdout:3/247: fsync d1/db/d28/f2a 0 2024-04-15T21:02:29.665 INFO:tasks.workunit.client.1.smithi149.stdout:4/271: rename dc/d1a/l55 to dc/d2c/l5c 0 2024-04-15T21:02:29.665 INFO:tasks.workunit.client.1.smithi149.stdout:4/272: dread - dc/d2c/d3e/d35/d3a/f53 zero size 2024-04-15T21:02:29.666 INFO:tasks.workunit.client.1.smithi149.stdout:6/234: unlink da/d11/c44 0 2024-04-15T21:02:29.669 INFO:tasks.workunit.client.1.smithi149.stdout:3/248: rmdir d1 39 2024-04-15T21:02:29.673 INFO:tasks.workunit.client.1.smithi149.stdout:9/239: link d23/d2b/f2c d23/d2b/f4f 0 2024-04-15T21:02:29.674 INFO:tasks.workunit.client.1.smithi149.stdout:9/240: stat d23/d2b/d37/f4b 0 2024-04-15T21:02:29.678 INFO:tasks.workunit.client.1.smithi149.stdout:6/235: chown da/d18/d10/d3f/l46 458018644 1 2024-04-15T21:02:29.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/236: chown da/d11/c51 654320929 1 2024-04-15T21:02:29.680 INFO:tasks.workunit.client.1.smithi149.stdout:3/249: chown d1/db/d24/l27 939017132 1 2024-04-15T21:02:29.682 INFO:tasks.workunit.client.1.smithi149.stdout:9/241: mkdir d23/d2b/d37/d50 0 2024-04-15T21:02:29.685 INFO:tasks.workunit.client.1.smithi149.stdout:4/273: dread dc/d18/f1f [0,4194304] 0 2024-04-15T21:02:29.686 INFO:tasks.workunit.client.1.smithi149.stdout:5/250: getdents d0/d6/d2d 0 2024-04-15T21:02:29.686 INFO:tasks.workunit.client.1.smithi149.stdout:9/242: dread d23/f3a [0,4194304] 0 2024-04-15T21:02:29.686 INFO:tasks.workunit.client.1.smithi149.stdout:4/274: chown dc/d18/d21 5300284 1 2024-04-15T21:02:29.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/275: readlink dc/d2c/d3e/d35/l3c 0 2024-04-15T21:02:29.691 INFO:tasks.workunit.client.1.smithi149.stdout:0/221: link d1/d5/d24/d30/d43/c45 d1/d5/d24/d30/d43/c4b 0 2024-04-15T21:02:29.691 INFO:tasks.workunit.client.1.smithi149.stdout:4/276: fsync dc/d1a/f26 0 2024-04-15T21:02:29.694 INFO:tasks.workunit.client.1.smithi149.stdout:6/237: mknod da/c54 0 2024-04-15T21:02:29.695 INFO:tasks.workunit.client.1.smithi149.stdout:6/238: write da/d18/d10/f1c [554820,82852] 0 2024-04-15T21:02:29.696 INFO:tasks.workunit.client.1.smithi149.stdout:0/222: dread d1/d5/d24/f3f [0,4194304] 0 2024-04-15T21:02:29.696 INFO:tasks.workunit.client.1.smithi149.stdout:4/277: mknod dc/d2c/d3e/d35/d4b/c5d 0 2024-04-15T21:02:29.697 INFO:tasks.workunit.client.1.smithi149.stdout:0/223: dread - d1/d5/d24/d30/d43/f48 zero size 2024-04-15T21:02:29.698 INFO:tasks.workunit.client.1.smithi149.stdout:4/278: read dc/d1a/f30 [121407,55918] 0 2024-04-15T21:02:29.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/224: dread d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:29.701 INFO:tasks.workunit.client.1.smithi149.stdout:3/250: link d1/c10 d1/c48 0 2024-04-15T21:02:29.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/251: write d1/db/f41 [2592661,26629] 0 2024-04-15T21:02:29.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/252: write d1/f2f [2439128,29867] 0 2024-04-15T21:02:29.704 INFO:tasks.workunit.client.1.smithi149.stdout:3/253: chown d1/db/d24/d2b/l3c 29 1 2024-04-15T21:02:29.704 INFO:tasks.workunit.client.1.smithi149.stdout:5/251: rename d0/d9/db/d12/d2b/c3b to d0/c5a 0 2024-04-15T21:02:29.707 INFO:tasks.workunit.client.1.smithi149.stdout:5/252: read d0/d9/db/f10 [424751,94256] 0 2024-04-15T21:02:29.708 INFO:tasks.workunit.client.1.smithi149.stdout:4/279: rename dc/d2c/d3e/d15/f32 to dc/d2c/d3e/d35/f5e 0 2024-04-15T21:02:29.712 INFO:tasks.workunit.client.1.smithi149.stdout:3/254: unlink d1/db/d24/d2b/c19 0 2024-04-15T21:02:29.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/255: readlink d1/db/d24/d2b/l12 0 2024-04-15T21:02:29.715 INFO:tasks.workunit.client.1.smithi149.stdout:9/243: truncate d23/d2b/f32 3364988 0 2024-04-15T21:02:29.717 INFO:tasks.workunit.client.1.smithi149.stdout:3/256: creat d1/db/d23/f49 x:0 0 0 2024-04-15T21:02:29.719 INFO:tasks.workunit.client.1.smithi149.stdout:5/253: rename d0/d9/db/l21 to d0/l5b 0 2024-04-15T21:02:29.721 INFO:tasks.workunit.client.1.smithi149.stdout:0/225: getdents d1/d9/d10/d13/d38 0 2024-04-15T21:02:29.722 INFO:tasks.workunit.client.1.smithi149.stdout:3/257: symlink d1/db/d23/l4a 0 2024-04-15T21:02:29.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/254: symlink d0/d9/d3f/l5c 0 2024-04-15T21:02:29.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/258: chown d1/l14 3075 1 2024-04-15T21:02:29.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/226: truncate d1/d5/d24/d30/d43/f48 455428 0 2024-04-15T21:02:29.725 INFO:tasks.workunit.client.1.smithi149.stdout:3/259: stat d1/c20 0 2024-04-15T21:02:29.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/260: write d1/db/d24/d39/f47 [872552,62655] 0 2024-04-15T21:02:29.727 INFO:tasks.workunit.client.1.smithi149.stdout:5/255: unlink d0/d9/d3f/l4d 0 2024-04-15T21:02:29.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/261: stat d1/db/d40 0 2024-04-15T21:02:29.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/262: readlink d1/l18 0 2024-04-15T21:02:29.733 INFO:tasks.workunit.client.1.smithi149.stdout:0/227: dwrite d1/d9/d10/d15/f49 [0,4194304] 0 2024-04-15T21:02:29.735 INFO:tasks.workunit.client.1.smithi149.stdout:3/263: creat d1/db/d24/f4b x:0 0 0 2024-04-15T21:02:29.738 INFO:tasks.workunit.client.1.smithi149.stdout:0/228: mknod d1/d9/d10/d15/c4c 0 2024-04-15T21:02:29.739 INFO:tasks.workunit.client.1.smithi149.stdout:5/256: symlink d0/d9/db/d12/d2b/l5d 0 2024-04-15T21:02:29.745 INFO:tasks.workunit.client.1.smithi149.stdout:9/244: dwrite d23/f3a [0,4194304] 0 2024-04-15T21:02:29.748 INFO:tasks.workunit.client.1.smithi149.stdout:0/229: dread d1/d5/d24/f3f [0,4194304] 0 2024-04-15T21:02:29.749 INFO:tasks.workunit.client.1.smithi149.stdout:0/230: chown d1/d9/d10/d15/c4c 27855 1 2024-04-15T21:02:29.754 INFO:tasks.workunit.client.1.smithi149.stdout:5/257: rmdir d0/d6/d43 0 2024-04-15T21:02:29.754 INFO:tasks.workunit.client.1.smithi149.stdout:0/231: fdatasync d1/d9/f35 0 2024-04-15T21:02:29.756 INFO:tasks.workunit.client.1.smithi149.stdout:9/245: write f21 [345483,10691] 0 2024-04-15T21:02:29.759 INFO:tasks.workunit.client.1.smithi149.stdout:0/232: mknod d1/d29/c4d 0 2024-04-15T21:02:29.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/258: dwrite d0/d9/db/d12/d16/d28/d1b/f59 [0,4194304] 0 2024-04-15T21:02:29.762 INFO:tasks.workunit.client.1.smithi149.stdout:9/246: symlink d23/d2b/d37/d50/l51 0 2024-04-15T21:02:29.772 INFO:tasks.workunit.client.1.smithi149.stdout:0/233: getdents d1/d5/d24/d30 0 2024-04-15T21:02:29.774 INFO:tasks.workunit.client.1.smithi149.stdout:9/247: getdents d23/d2b 0 2024-04-15T21:02:29.775 INFO:tasks.workunit.client.1.smithi149.stdout:0/234: truncate d1/d5/f2f 708285 0 2024-04-15T21:02:29.775 INFO:tasks.workunit.client.1.smithi149.stdout:9/248: readlink d23/l25 0 2024-04-15T21:02:29.776 INFO:tasks.workunit.client.1.smithi149.stdout:5/259: dwrite d0/d9/db/f2e [0,4194304] 0 2024-04-15T21:02:29.778 INFO:tasks.workunit.client.1.smithi149.stdout:9/249: mkdir d23/d3c/d52 0 2024-04-15T21:02:29.780 INFO:tasks.workunit.client.1.smithi149.stdout:0/235: mknod d1/d5/d24/d30/d43/c4e 0 2024-04-15T21:02:29.785 INFO:tasks.workunit.client.1.smithi149.stdout:9/250: creat d23/d46/f53 x:0 0 0 2024-04-15T21:02:29.787 INFO:tasks.workunit.client.1.smithi149.stdout:9/251: symlink d23/d3c/d52/l54 0 2024-04-15T21:02:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:9/252: symlink d23/d46/l55 0 2024-04-15T21:02:29.793 INFO:tasks.workunit.client.1.smithi149.stdout:0/236: dwrite d1/d5/d24/d30/d43/f48 [0,4194304] 0 2024-04-15T21:02:29.795 INFO:tasks.workunit.client.1.smithi149.stdout:5/260: write d0/d9/db/f38 [9341450,66742] 0 2024-04-15T21:02:29.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/237: chown d1/d9/d10/d15/f49 9779 1 2024-04-15T21:02:29.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/238: mkdir d1/d29/d2c/d4f 0 2024-04-15T21:02:29.804 INFO:tasks.workunit.client.1.smithi149.stdout:5/261: creat d0/d9/db/f5e x:0 0 0 2024-04-15T21:02:29.806 INFO:tasks.workunit.client.1.smithi149.stdout:9/253: dwrite d23/d2b/f2c [0,4194304] 0 2024-04-15T21:02:29.858 INFO:tasks.workunit.client.1.smithi149.stdout:9/254: dread f3 [0,4194304] 0 2024-04-15T21:02:29.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/262: truncate d0/d9/db/f10 381457 0 2024-04-15T21:02:29.862 INFO:tasks.workunit.client.1.smithi149.stdout:0/239: dwrite d1/d9/d10/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:29.865 INFO:tasks.workunit.client.1.smithi149.stdout:9/255: dread d23/f3a [0,4194304] 0 2024-04-15T21:02:29.866 INFO:tasks.workunit.client.1.smithi149.stdout:9/256: read d23/f3a [3087523,128933] 0 2024-04-15T21:02:29.867 INFO:tasks.workunit.client.1.smithi149.stdout:9/257: chown d23/d46/f49 0 1 2024-04-15T21:02:29.868 INFO:tasks.workunit.client.1.smithi149.stdout:9/258: readlink d23/l4c 0 2024-04-15T21:02:29.869 INFO:tasks.workunit.client.1.smithi149.stdout:5/263: mknod d0/d9/db/c5f 0 2024-04-15T21:02:29.870 INFO:tasks.workunit.client.1.smithi149.stdout:9/259: write d23/f33 [522816,127018] 0 2024-04-15T21:02:29.872 INFO:tasks.workunit.client.1.smithi149.stdout:9/260: fsync d23/f48 0 2024-04-15T21:02:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:0/240: rename d1/d9/d10 to d1/d5/d24/d50 0 2024-04-15T21:02:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:0/241: chown d1/d5/d24/d50/d13 62075 1 2024-04-15T21:02:29.875 INFO:tasks.workunit.client.1.smithi149.stdout:0/242: write d1/d5/f2f [9672,59873] 0 2024-04-15T21:02:29.879 INFO:tasks.workunit.client.1.smithi149.stdout:5/264: write d0/d9/db/d12/d16/d28/d1b/f59 [4424893,1541] 0 2024-04-15T21:02:29.890 INFO:tasks.workunit.client.1.smithi149.stdout:5/265: mkdir d0/d9/db/d12/d16/d28/d1b/d60 0 2024-04-15T21:02:29.891 INFO:tasks.workunit.client.1.smithi149.stdout:5/266: stat d0/d9/db/d3d 0 2024-04-15T21:02:29.893 INFO:tasks.workunit.client.1.smithi149.stdout:5/267: truncate d0/d9/db/d12/d16/d28/d1b/f1f 1481289 0 2024-04-15T21:02:29.896 INFO:tasks.workunit.client.1.smithi149.stdout:5/268: write d0/d9/db/d12/d16/d28/f46 [3622888,112040] 0 2024-04-15T21:02:29.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/269: write d0/f50 [493224,65102] 0 2024-04-15T21:02:29.904 INFO:tasks.workunit.client.1.smithi149.stdout:5/270: dwrite d0/d9/db/d12/d16/d28/f40 [0,4194304] 0 2024-04-15T21:02:29.905 INFO:tasks.workunit.client.1.smithi149.stdout:5/271: chown d0/d9/db/d12/d16 1045270 1 2024-04-15T21:02:29.908 INFO:tasks.workunit.client.1.smithi149.stdout:9/261: getdents d23 0 2024-04-15T21:02:29.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:29 smithi072 ceph-mon[29079]: pgmap v271: 65 pgs: 65 active+clean; 524 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 43 MiB/s wr, 268 op/s 2024-04-15T21:02:29.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/243: dwrite d1/f22 [8388608,4194304] 0 2024-04-15T21:02:29.919 INFO:tasks.workunit.client.1.smithi149.stdout:9/262: dwrite f22 [0,4194304] 0 2024-04-15T21:02:29.927 INFO:tasks.workunit.client.1.smithi149.stdout:5/272: dread d0/f5 [0,4194304] 0 2024-04-15T21:02:29.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/273: write d0/d9/db/d12/d16/d28/d1b/f1f [297843,21339] 0 2024-04-15T21:02:29.932 INFO:tasks.workunit.client.1.smithi149.stdout:0/244: unlink d1/d9/lb 0 2024-04-15T21:02:29.936 INFO:tasks.workunit.client.1.smithi149.stdout:5/274: fdatasync d0/d9/db/d12/d16/d28/d1b/f20 0 2024-04-15T21:02:29.937 INFO:tasks.workunit.client.1.smithi149.stdout:0/245: rmdir d1/d5/d24/d30 39 2024-04-15T21:02:29.939 INFO:tasks.workunit.client.1.smithi149.stdout:0/246: read d1/d5/d24/f3f [2055693,4579] 0 2024-04-15T21:02:29.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:29 smithi149 ceph-mon[36029]: pgmap v271: 65 pgs: 65 active+clean; 524 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 43 MiB/s wr, 268 op/s 2024-04-15T21:02:29.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/275: dread d0/d6/fe [0,4194304] 0 2024-04-15T21:02:29.951 INFO:tasks.workunit.client.1.smithi149.stdout:0/247: mknod d1/c51 0 2024-04-15T21:02:29.958 INFO:tasks.workunit.client.1.smithi149.stdout:0/248: mknod d1/d5/d24/d30/d43/c52 0 2024-04-15T21:02:29.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/249: mknod d1/d5/d24/d50/d13/d38/d44/c53 0 2024-04-15T21:02:29.961 INFO:tasks.workunit.client.1.smithi149.stdout:0/250: read - d1/d5/f4a zero size 2024-04-15T21:02:29.961 INFO:tasks.workunit.client.1.smithi149.stdout:0/251: chown d1/d9/l3d 0 1 2024-04-15T21:02:29.974 INFO:tasks.workunit.client.1.smithi149.stdout:5/276: dwrite d0/d9/db/d12/d2b/f53 [0,4194304] 0 2024-04-15T21:02:29.982 INFO:tasks.workunit.client.1.smithi149.stdout:5/277: mkdir d0/d9/db/d12/d16/d28/d1b/d61 0 2024-04-15T21:02:29.988 INFO:tasks.workunit.client.1.smithi149.stdout:0/252: truncate d1/d5/d24/d50/d15/f49 2069017 0 2024-04-15T21:02:29.992 INFO:tasks.workunit.client.1.smithi149.stdout:0/253: mkdir d1/d5/d24/d30/d54 0 2024-04-15T21:02:29.994 INFO:tasks.workunit.client.1.smithi149.stdout:5/278: link d0/f3a d0/d9/db/d3d/f62 0 2024-04-15T21:02:29.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/279: mkdir d0/d6/d2d/d63 0 2024-04-15T21:02:30.019 INFO:tasks.workunit.client.1.smithi149.stdout:0/254: truncate d1/d5/d24/d30/d43/f48 625317 0 2024-04-15T21:02:30.020 INFO:tasks.workunit.client.1.smithi149.stdout:0/255: dread - d1/d5/f4a zero size 2024-04-15T21:02:30.023 INFO:tasks.workunit.client.1.smithi149.stdout:0/256: creat d1/d5/d24/d50/d13/d38/f55 x:0 0 0 2024-04-15T21:02:30.027 INFO:tasks.workunit.client.1.smithi149.stdout:5/280: dwrite d0/d9/db/f10 [0,4194304] 0 2024-04-15T21:02:30.030 INFO:tasks.workunit.client.1.smithi149.stdout:5/281: fdatasync d0/d9/db/d12/f27 0 2024-04-15T21:02:30.037 INFO:tasks.workunit.client.1.smithi149.stdout:5/282: rename d0/d6/f36 to d0/d9/db/d12/f64 0 2024-04-15T21:02:30.044 INFO:tasks.workunit.client.1.smithi149.stdout:5/283: dread d0/d9/db/f38 [0,4194304] 0 2024-04-15T21:02:30.050 INFO:tasks.workunit.client.1.smithi149.stdout:5/284: dread d0/d9/db/d12/f27 [0,4194304] 0 2024-04-15T21:02:30.052 INFO:tasks.workunit.client.1.smithi149.stdout:5/285: write d0/d9/db/d12/d16/d28/d1b/f1f [739525,32190] 0 2024-04-15T21:02:30.133 INFO:tasks.workunit.client.1.smithi149.stdout:5/286: creat d0/d6/f65 x:0 0 0 2024-04-15T21:02:30.137 INFO:tasks.workunit.client.1.smithi149.stdout:0/257: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:30.139 INFO:tasks.workunit.client.1.smithi149.stdout:5/287: rename d0/l5b to d0/l66 0 2024-04-15T21:02:30.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/258: symlink d1/d9/l56 0 2024-04-15T21:02:30.144 INFO:tasks.workunit.client.1.smithi149.stdout:0/259: dread - d1/d5/d24/d50/d13/d38/f55 zero size 2024-04-15T21:02:30.144 INFO:tasks.workunit.client.1.smithi149.stdout:5/288: creat d0/d6/d2d/f67 x:0 0 0 2024-04-15T21:02:30.147 INFO:tasks.workunit.client.1.smithi149.stdout:5/289: creat d0/d6/d2d/f68 x:0 0 0 2024-04-15T21:02:30.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/260: rename d1/d5/d24/d50/d15/f49 to d1/d5/d24/d50/d15/f57 0 2024-04-15T21:02:30.150 INFO:tasks.workunit.client.1.smithi149.stdout:5/290: write d0/d9/db/f2e [934215,65025] 0 2024-04-15T21:02:30.150 INFO:tasks.workunit.client.1.smithi149.stdout:5/291: dread - d0/d6/d2d/f68 zero size 2024-04-15T21:02:30.153 INFO:tasks.workunit.client.1.smithi149.stdout:5/292: symlink d0/d9/db/d12/d16/d28/d1b/l69 0 2024-04-15T21:02:30.157 INFO:tasks.workunit.client.1.smithi149.stdout:5/293: truncate d0/d9/db/d3d/f62 976645 0 2024-04-15T21:02:30.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/294: rename d0/d9/db/d12/d16/d28/l3e to d0/d9/db/d12/d16/d28/d1b/l6a 0 2024-04-15T21:02:30.163 INFO:tasks.workunit.client.1.smithi149.stdout:5/295: mknod d0/d9/db/d3d/c6b 0 2024-04-15T21:02:30.165 INFO:tasks.workunit.client.1.smithi149.stdout:0/261: rmdir d1/d5/d24 39 2024-04-15T21:02:30.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/296: truncate d0/d9/db/d12/d16/f58 1025987 0 2024-04-15T21:02:30.166 INFO:tasks.workunit.client.1.smithi149.stdout:5/297: truncate d0/d9/f57 518178 0 2024-04-15T21:02:30.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/298: chown d0/d9/db/d12/f64 218185974 1 2024-04-15T21:02:30.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/299: mkdir d0/d9/d6c 0 2024-04-15T21:02:30.170 INFO:tasks.workunit.client.1.smithi149.stdout:5/300: write d0/d9/db/f2e [3243508,37893] 0 2024-04-15T21:02:30.172 INFO:tasks.workunit.client.1.smithi149.stdout:0/262: dwrite d1/d5/f2e [0,4194304] 0 2024-04-15T21:02:30.173 INFO:tasks.workunit.client.1.smithi149.stdout:5/301: write d0/d9/db/d12/d16/f58 [1294005,11240] 0 2024-04-15T21:02:30.177 INFO:tasks.workunit.client.1.smithi149.stdout:0/263: rename d1/d5/d24/f3f to d1/d29/d2c/f58 0 2024-04-15T21:02:30.178 INFO:tasks.workunit.client.1.smithi149.stdout:5/302: getdents d0/d9/db/d12/d16/d28/d1b/d60 0 2024-04-15T21:02:30.179 INFO:tasks.workunit.client.1.smithi149.stdout:5/303: stat d0/d9/db/d12/f64 0 2024-04-15T21:02:30.179 INFO:tasks.workunit.client.1.smithi149.stdout:0/264: mkdir d1/d5/d24/d50/d13/d59 0 2024-04-15T21:02:30.180 INFO:tasks.workunit.client.1.smithi149.stdout:0/265: chown d1/d29/d2c/f58 821 1 2024-04-15T21:02:30.181 INFO:tasks.workunit.client.1.smithi149.stdout:0/266: stat d1/d5/d24/d30/d43/f48 0 2024-04-15T21:02:30.184 INFO:tasks.workunit.client.1.smithi149.stdout:0/267: truncate d1/d5/d24/d50/d15/f57 2301188 0 2024-04-15T21:02:30.242 INFO:tasks.workunit.client.1.smithi149.stdout:0/268: rename d1/d5/f2e to d1/d5/d24/d30/f5a 0 2024-04-15T21:02:30.248 INFO:tasks.workunit.client.1.smithi149.stdout:0/269: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:30.251 INFO:tasks.workunit.client.1.smithi149.stdout:0/270: dread - d1/d5/dc/f46 zero size 2024-04-15T21:02:30.252 INFO:tasks.workunit.client.1.smithi149.stdout:0/271: readlink d1/d5/d24/d50/l26 0 2024-04-15T21:02:30.255 INFO:tasks.workunit.client.1.smithi149.stdout:0/272: mknod d1/d5/d24/d30/d54/c5b 0 2024-04-15T21:02:30.259 INFO:tasks.workunit.client.1.smithi149.stdout:0/273: creat d1/d5/d24/d50/f5c x:0 0 0 2024-04-15T21:02:30.259 INFO:tasks.workunit.client.1.smithi149.stdout:0/274: dread - d1/d5/d24/d50/f5c zero size 2024-04-15T21:02:30.261 INFO:tasks.workunit.client.1.smithi149.stdout:0/275: creat d1/d5/d24/d50/d15/f5d x:0 0 0 2024-04-15T21:02:30.263 INFO:tasks.workunit.client.1.smithi149.stdout:0/276: creat d1/d5/dc/f5e x:0 0 0 2024-04-15T21:02:30.267 INFO:tasks.workunit.client.1.smithi149.stdout:0/277: rename d1/d5/f12 to d1/d29/d2c/d4f/f5f 0 2024-04-15T21:02:30.270 INFO:tasks.workunit.client.1.smithi149.stdout:0/278: creat d1/d5/d24/d50/d13/d38/d44/f60 x:0 0 0 2024-04-15T21:02:30.271 INFO:tasks.workunit.client.1.smithi149.stdout:0/279: mkdir d1/d5/d24/d50/d13/d38/d44/d61 0 2024-04-15T21:02:30.273 INFO:tasks.workunit.client.1.smithi149.stdout:0/280: creat d1/d5/d24/d30/d43/f62 x:0 0 0 2024-04-15T21:02:30.276 INFO:tasks.workunit.client.1.smithi149.stdout:0/281: dread d1/d5/d24/d30/f5a [0,4194304] 0 2024-04-15T21:02:30.277 INFO:tasks.workunit.client.1.smithi149.stdout:0/282: chown d1/d5/d24/d50/d15/c4c 49 1 2024-04-15T21:02:30.279 INFO:tasks.workunit.client.1.smithi149.stdout:0/283: creat d1/d5/d24/d50/d13/d59/f63 x:0 0 0 2024-04-15T21:02:30.279 INFO:tasks.workunit.client.1.smithi149.stdout:0/284: dread - d1/d5/dc/f5e zero size 2024-04-15T21:02:30.280 INFO:tasks.workunit.client.1.smithi149.stdout:0/285: chown d1/d29/d2c 12 1 2024-04-15T21:02:30.280 INFO:tasks.workunit.client.1.smithi149.stdout:0/286: chown d1/d5/d24/d30/d43/c52 27434 1 2024-04-15T21:02:30.281 INFO:tasks.workunit.client.1.smithi149.stdout:0/287: readlink d1/d9/l56 0 2024-04-15T21:02:30.282 INFO:tasks.workunit.client.1.smithi149.stdout:0/288: mkdir d1/d9/d64 0 2024-04-15T21:02:30.283 INFO:tasks.workunit.client.1.smithi149.stdout:0/289: dread - d1/d5/d24/d50/d15/f5d zero size 2024-04-15T21:02:30.284 INFO:tasks.workunit.client.1.smithi149.stdout:0/290: mkdir d1/d9/d64/d65 0 2024-04-15T21:02:30.287 INFO:tasks.workunit.client.1.smithi149.stdout:0/291: rename d1/f41 to d1/d5/d24/d50/d13/d59/f66 0 2024-04-15T21:02:30.288 INFO:tasks.workunit.client.1.smithi149.stdout:0/292: write d1/d5/d24/d50/d13/d38/d44/f60 [863801,12153] 0 2024-04-15T21:02:30.289 INFO:tasks.workunit.client.1.smithi149.stdout:0/293: read - d1/d5/f4a zero size 2024-04-15T21:02:30.309 INFO:tasks.workunit.client.1.smithi149.stdout:0/294: truncate d1/d5/f2f 113051 0 2024-04-15T21:02:30.310 INFO:tasks.workunit.client.1.smithi149.stdout:0/295: symlink d1/d5/dc/l67 0 2024-04-15T21:02:30.310 INFO:tasks.workunit.client.1.smithi149.stdout:0/296: chown d1/d5/d24/d30/f5a 30 1 2024-04-15T21:02:30.311 INFO:tasks.workunit.client.1.smithi149.stdout:0/297: write d1/d5/dc/f5e [292397,125376] 0 2024-04-15T21:02:30.312 INFO:tasks.workunit.client.1.smithi149.stdout:0/298: fdatasync d1/d5/d24/d50/d13/d38/f55 0 2024-04-15T21:02:30.314 INFO:tasks.workunit.client.1.smithi149.stdout:0/299: truncate d1/d5/d24/d50/d13/d59/f63 212648 0 2024-04-15T21:02:30.319 INFO:tasks.workunit.client.1.smithi149.stdout:0/300: dwrite d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:30.320 INFO:tasks.workunit.client.1.smithi149.stdout:0/301: chown d1/d5/d24/d30/d54 1058112585 1 2024-04-15T21:02:30.328 INFO:tasks.workunit.client.1.smithi149.stdout:0/302: dwrite d1/d5/d24/d30/f5a [0,4194304] 0 2024-04-15T21:02:30.330 INFO:tasks.workunit.client.1.smithi149.stdout:0/303: creat d1/d5/d24/d50/d13/d38/f68 x:0 0 0 2024-04-15T21:02:30.331 INFO:tasks.workunit.client.1.smithi149.stdout:0/304: write d1/d5/d24/d50/f2a [167210,89] 0 2024-04-15T21:02:30.333 INFO:tasks.workunit.client.1.smithi149.stdout:0/305: mknod d1/d5/d24/d30/d43/c69 0 2024-04-15T21:02:30.335 INFO:tasks.workunit.client.1.smithi149.stdout:0/306: creat d1/d5/d24/d30/d43/f6a x:0 0 0 2024-04-15T21:02:30.341 INFO:tasks.workunit.client.1.smithi149.stdout:0/307: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:30.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/308: creat d1/d9/f6b x:0 0 0 2024-04-15T21:02:30.351 INFO:tasks.workunit.client.1.smithi149.stdout:0/309: mknod d1/d5/d24/d30/d43/c6c 0 2024-04-15T21:02:30.352 INFO:tasks.workunit.client.1.smithi149.stdout:0/310: dread - d1/d5/d24/d30/d43/f6a zero size 2024-04-15T21:02:30.355 INFO:tasks.workunit.client.1.smithi149.stdout:0/311: getdents d1 0 2024-04-15T21:02:30.356 INFO:tasks.workunit.client.1.smithi149.stdout:0/312: truncate d1/d5/d24/d50/f5c 463319 0 2024-04-15T21:02:30.359 INFO:tasks.workunit.client.1.smithi149.stdout:0/313: link d1/c51 d1/c6d 0 2024-04-15T21:02:30.371 INFO:tasks.workunit.client.1.smithi149.stdout:0/314: dwrite d1/d5/dc/f5e [0,4194304] 0 2024-04-15T21:02:30.375 INFO:tasks.workunit.client.1.smithi149.stdout:0/315: symlink d1/d5/d24/d50/d13/d38/l6e 0 2024-04-15T21:02:30.376 INFO:tasks.workunit.client.1.smithi149.stdout:0/316: stat d1/d9/f35 0 2024-04-15T21:02:30.377 INFO:tasks.workunit.client.1.smithi149.stdout:0/317: fdatasync d1/d5/d24/d50/d13/d38/f55 0 2024-04-15T21:02:30.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/318: write d1/d5/d24/d50/d13/d38/d44/f47 [1309189,126950] 0 2024-04-15T21:02:30.381 INFO:tasks.workunit.client.1.smithi149.stdout:0/319: creat d1/d9/f6f x:0 0 0 2024-04-15T21:02:30.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/320: symlink d1/d9/l70 0 2024-04-15T21:02:30.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/321: dread d1/d5/d24/d50/f2a [0,4194304] 0 2024-04-15T21:02:30.388 INFO:tasks.workunit.client.1.smithi149.stdout:0/322: mkdir d1/d5/d24/d50/d13/d38/d71 0 2024-04-15T21:02:30.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/323: link d1/d9/f6f d1/d5/d24/d50/f72 0 2024-04-15T21:02:30.393 INFO:tasks.workunit.client.1.smithi149.stdout:0/324: mkdir d1/d9/d64/d73 0 2024-04-15T21:02:30.398 INFO:tasks.workunit.client.1.smithi149.stdout:0/325: dwrite d1/d5/dc/f46 [0,4194304] 0 2024-04-15T21:02:30.400 INFO:tasks.workunit.client.1.smithi149.stdout:0/326: truncate d1/d5/d24/d50/f72 559895 0 2024-04-15T21:02:30.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/327: chown d1/d5/c2b 5039 1 2024-04-15T21:02:30.408 INFO:tasks.workunit.client.1.smithi149.stdout:0/328: creat d1/d29/f74 x:0 0 0 2024-04-15T21:02:30.418 INFO:tasks.workunit.client.1.smithi149.stdout:0/329: write d1/d9/f19 [2587495,106637] 0 2024-04-15T21:02:30.419 INFO:tasks.workunit.client.1.smithi149.stdout:0/330: write d1/d9/f6b [177800,50961] 0 2024-04-15T21:02:30.423 INFO:tasks.workunit.client.1.smithi149.stdout:0/331: rename d1/d5/f2f to d1/d5/d24/d30/d43/f75 0 2024-04-15T21:02:30.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/332: dwrite d1/d5/d24/d30/d43/f62 [0,4194304] 0 2024-04-15T21:02:30.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/333: readlink d1/d5/dc/l67 0 2024-04-15T21:02:30.431 INFO:tasks.workunit.client.1.smithi149.stdout:0/334: stat d1/d5/d24/c16 0 2024-04-15T21:02:30.432 INFO:tasks.workunit.client.1.smithi149.stdout:0/335: truncate d1/d5/d24/d50/d13/d59/f63 324563 0 2024-04-15T21:02:30.434 INFO:tasks.workunit.client.1.smithi149.stdout:0/336: write d1/d29/d2c/f58 [3286046,75746] 0 2024-04-15T21:02:30.441 INFO:tasks.workunit.client.1.smithi149.stdout:0/337: dwrite d1/d29/d2c/d4f/f5f [0,4194304] 0 2024-04-15T21:02:30.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/338: truncate d1/d5/d24/d30/d43/f48 868511 0 2024-04-15T21:02:30.446 INFO:tasks.workunit.client.1.smithi149.stdout:0/339: write d1/d5/d24/d30/d43/f6a [54202,84152] 0 2024-04-15T21:02:30.447 INFO:tasks.workunit.client.1.smithi149.stdout:0/340: read - d1/d5/d24/d50/d15/f5d zero size 2024-04-15T21:02:30.449 INFO:tasks.workunit.client.1.smithi149.stdout:7/303: sync 2024-04-15T21:02:30.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/304: mkdir d3/d16/d20/d6c 0 2024-04-15T21:02:30.453 INFO:tasks.workunit.client.1.smithi149.stdout:0/341: dread d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:30.454 INFO:tasks.workunit.client.1.smithi149.stdout:0/342: write d1/d5/f4a [1856433,61434] 0 2024-04-15T21:02:30.457 INFO:tasks.workunit.client.1.smithi149.stdout:7/305: rename d3/fc to d3/d34/f6d 0 2024-04-15T21:02:30.460 INFO:tasks.workunit.client.1.smithi149.stdout:7/306: fdatasync d3/d16/d20/f48 0 2024-04-15T21:02:30.464 INFO:tasks.workunit.client.1.smithi149.stdout:0/343: dwrite d1/d5/dc/f46 [0,4194304] 0 2024-04-15T21:02:30.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/307: mkdir d3/d16/d6e 0 2024-04-15T21:02:30.472 INFO:tasks.workunit.client.1.smithi149.stdout:0/344: creat d1/d5/d24/d50/d13/d59/f76 x:0 0 0 2024-04-15T21:02:30.475 INFO:tasks.workunit.client.1.smithi149.stdout:7/308: dwrite d3/d16/d20/f48 [4194304,4194304] 0 2024-04-15T21:02:30.476 INFO:tasks.workunit.client.1.smithi149.stdout:0/345: mknod d1/d9/d64/d73/c77 0 2024-04-15T21:02:30.484 INFO:tasks.workunit.client.1.smithi149.stdout:7/309: read d3/f10 [361949,77592] 0 2024-04-15T21:02:30.495 INFO:tasks.workunit.client.1.smithi149.stdout:0/346: truncate d1/d5/d24/d50/d13/d38/d44/f60 384821 0 2024-04-15T21:02:30.495 INFO:tasks.workunit.client.1.smithi149.stdout:0/347: chown d1/d9/f35 57254 1 2024-04-15T21:02:30.500 INFO:tasks.workunit.client.1.smithi149.stdout:0/348: link d1/f22 d1/d5/d24/d50/d13/d59/f78 0 2024-04-15T21:02:30.504 INFO:tasks.workunit.client.1.smithi149.stdout:7/310: dread d3/d16/f5a [0,4194304] 0 2024-04-15T21:02:30.508 INFO:tasks.workunit.client.1.smithi149.stdout:0/349: truncate d1/d5/d24/d30/f5a 911693 0 2024-04-15T21:02:30.508 INFO:tasks.workunit.client.1.smithi149.stdout:7/311: read d3/d16/d20/f24 [3239474,55272] 0 2024-04-15T21:02:30.512 INFO:tasks.workunit.client.1.smithi149.stdout:0/350: getdents d1/d5/d24/d30/d54 0 2024-04-15T21:02:30.512 INFO:tasks.workunit.client.1.smithi149.stdout:7/312: link d3/d16/d20/d36/f2f d3/d16/d20/d36/d3d/d56/f6f 0 2024-04-15T21:02:30.513 INFO:tasks.workunit.client.1.smithi149.stdout:0/351: dread d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:30.519 INFO:tasks.workunit.client.1.smithi149.stdout:7/313: dwrite d3/d16/d32/d3f/f55 [0,4194304] 0 2024-04-15T21:02:30.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/314: chown d3/f7 4029218 1 2024-04-15T21:02:30.521 INFO:tasks.workunit.client.1.smithi149.stdout:0/352: dwrite d1/d29/d2c/d4f/f5f [8388608,4194304] 0 2024-04-15T21:02:30.524 INFO:tasks.workunit.client.1.smithi149.stdout:0/353: chown d1/d5/c39 255107 1 2024-04-15T21:02:30.529 INFO:tasks.workunit.client.1.smithi149.stdout:7/315: dwrite d3/d17/f31 [0,4194304] 0 2024-04-15T21:02:30.535 INFO:tasks.workunit.client.1.smithi149.stdout:1/218: sync 2024-04-15T21:02:30.535 INFO:tasks.workunit.client.1.smithi149.stdout:2/301: sync 2024-04-15T21:02:30.537 INFO:tasks.workunit.client.1.smithi149.stdout:7/316: rename d3/d17/c6b to d3/c70 0 2024-04-15T21:02:30.538 INFO:tasks.workunit.client.1.smithi149.stdout:2/302: chown d4/d7/d10/f37 10 1 2024-04-15T21:02:30.539 INFO:tasks.workunit.client.1.smithi149.stdout:0/354: truncate d1/d5/dc/f5e 957711 0 2024-04-15T21:02:30.542 INFO:tasks.workunit.client.1.smithi149.stdout:0/355: dread d1/d5/d24/d50/d13/d59/f63 [0,4194304] 0 2024-04-15T21:02:30.543 INFO:tasks.workunit.client.1.smithi149.stdout:1/219: symlink d1/d17/d36/l3a 0 2024-04-15T21:02:30.543 INFO:tasks.workunit.client.1.smithi149.stdout:7/317: dread d3/d17/d1f/f25 [0,4194304] 0 2024-04-15T21:02:30.546 INFO:tasks.workunit.client.1.smithi149.stdout:1/220: truncate d1/db/f30 192035 0 2024-04-15T21:02:30.546 INFO:tasks.workunit.client.1.smithi149.stdout:7/318: dread - d3/d16/d20/d36/d3d/f4f zero size 2024-04-15T21:02:30.547 INFO:tasks.workunit.client.1.smithi149.stdout:0/356: creat d1/d9/d64/d65/f79 x:0 0 0 2024-04-15T21:02:30.548 INFO:tasks.workunit.client.1.smithi149.stdout:1/221: fsync d1/db/f32 0 2024-04-15T21:02:30.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/303: dwrite d4/d7/d10/d6b/d21/d5e/f50 [0,4194304] 0 2024-04-15T21:02:30.550 INFO:tasks.workunit.client.1.smithi149.stdout:1/222: write d1/db/d14/d21/f2a [582116,130570] 0 2024-04-15T21:02:30.556 INFO:tasks.workunit.client.1.smithi149.stdout:2/304: symlink d4/d7/d10/d6b/l75 0 2024-04-15T21:02:30.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/305: write d4/d7/da/f1c [67940,27767] 0 2024-04-15T21:02:30.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/357: rename d1/d5/d24/d50/d13/d38/f55 to d1/d29/f7a 0 2024-04-15T21:02:30.563 INFO:tasks.workunit.client.1.smithi149.stdout:1/223: dwrite d1/f5 [4194304,4194304] 0 2024-04-15T21:02:30.563 INFO:tasks.workunit.client.1.smithi149.stdout:0/358: dread - d1/d9/d64/d65/f79 zero size 2024-04-15T21:02:30.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/224: chown d1/db/d16/d35 984162 1 2024-04-15T21:02:30.568 INFO:tasks.workunit.client.1.smithi149.stdout:2/306: creat d4/d7/d10/d6b/d21/d55/f76 x:0 0 0 2024-04-15T21:02:30.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/319: truncate d3/f2b 1569907 0 2024-04-15T21:02:30.576 INFO:tasks.workunit.client.1.smithi149.stdout:7/320: chown d3/l4b 0 1 2024-04-15T21:02:30.577 INFO:tasks.workunit.client.1.smithi149.stdout:0/359: dwrite d1/d5/d24/d50/d13/d59/f76 [0,4194304] 0 2024-04-15T21:02:30.580 INFO:tasks.workunit.client.1.smithi149.stdout:2/307: dwrite d4/d7/d10/d36/f49 [0,4194304] 0 2024-04-15T21:02:30.589 INFO:tasks.workunit.client.1.smithi149.stdout:2/308: mknod d4/d7/d10/d6b/d21/d2c/d32/d4a/c77 0 2024-04-15T21:02:30.590 INFO:tasks.workunit.client.1.smithi149.stdout:2/309: readlink d4/d7/d10/l17 0 2024-04-15T21:02:30.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/321: dwrite d3/d16/d20/f41 [0,4194304] 0 2024-04-15T21:02:30.594 INFO:tasks.workunit.client.1.smithi149.stdout:0/360: creat d1/f7b x:0 0 0 2024-04-15T21:02:30.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/239: sync 2024-04-15T21:02:30.598 INFO:tasks.workunit.client.1.smithi149.stdout:8/269: sync 2024-04-15T21:02:30.598 INFO:tasks.workunit.client.1.smithi149.stdout:4/280: sync 2024-04-15T21:02:30.598 INFO:tasks.workunit.client.1.smithi149.stdout:5/304: sync 2024-04-15T21:02:30.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/264: sync 2024-04-15T21:02:30.599 INFO:tasks.workunit.client.1.smithi149.stdout:9/263: sync 2024-04-15T21:02:30.600 INFO:tasks.workunit.client.1.smithi149.stdout:2/310: unlink d4/d7/da/ff 0 2024-04-15T21:02:30.603 INFO:tasks.workunit.client.1.smithi149.stdout:2/311: fdatasync d4/f12 0 2024-04-15T21:02:30.605 INFO:tasks.workunit.client.1.smithi149.stdout:8/270: dread - d2/df/d10/d25/d32/d45/f5e zero size 2024-04-15T21:02:30.605 INFO:tasks.workunit.client.1.smithi149.stdout:9/264: unlink d23/f2f 0 2024-04-15T21:02:30.608 INFO:tasks.workunit.client.1.smithi149.stdout:7/322: dwrite d3/d17/f31 [0,4194304] 0 2024-04-15T21:02:30.608 INFO:tasks.workunit.client.1.smithi149.stdout:0/361: symlink d1/d29/l7c 0 2024-04-15T21:02:30.608 INFO:tasks.workunit.client.1.smithi149.stdout:8/271: write d2/f1f [315680,121074] 0 2024-04-15T21:02:30.609 INFO:tasks.workunit.client.1.smithi149.stdout:9/265: chown f1b 501427044 1 2024-04-15T21:02:30.610 INFO:tasks.workunit.client.1.smithi149.stdout:4/281: mknod dc/d18/d21/c5f 0 2024-04-15T21:02:30.610 INFO:tasks.workunit.client.1.smithi149.stdout:6/240: mkdir da/d49/d55 0 2024-04-15T21:02:30.612 INFO:tasks.workunit.client.1.smithi149.stdout:3/265: creat d1/db/d24/f4c x:0 0 0 2024-04-15T21:02:30.613 INFO:tasks.workunit.client.1.smithi149.stdout:3/266: fdatasync d1/db/d23/f49 0 2024-04-15T21:02:30.614 INFO:tasks.workunit.client.1.smithi149.stdout:3/267: readlink d1/l14 0 2024-04-15T21:02:30.615 INFO:tasks.workunit.client.1.smithi149.stdout:1/225: dread d1/f5 [0,4194304] 0 2024-04-15T21:02:30.615 INFO:tasks.workunit.client.1.smithi149.stdout:3/268: chown d1/db/d28 291 1 2024-04-15T21:02:30.616 INFO:tasks.workunit.client.1.smithi149.stdout:2/312: symlink d4/d7/d10/d6b/d21/d3b/d4c/d6c/l78 0 2024-04-15T21:02:30.616 INFO:tasks.workunit.client.1.smithi149.stdout:3/269: fdatasync d1/db/f1c 0 2024-04-15T21:02:30.619 INFO:tasks.workunit.client.1.smithi149.stdout:4/282: fsync dc/d2c/d3e/d15/d3f/f43 0 2024-04-15T21:02:30.619 INFO:tasks.workunit.client.1.smithi149.stdout:3/270: readlink d1/db/d40/l42 0 2024-04-15T21:02:30.621 INFO:tasks.workunit.client.1.smithi149.stdout:4/283: fsync dc/d2c/d3e/d15/f4a 0 2024-04-15T21:02:30.621 INFO:tasks.workunit.client.1.smithi149.stdout:6/241: mknod da/d18/c56 0 2024-04-15T21:02:30.622 INFO:tasks.workunit.client.1.smithi149.stdout:0/362: dread - d1/d5/d24/d50/d13/d59/f66 zero size 2024-04-15T21:02:30.623 INFO:tasks.workunit.client.1.smithi149.stdout:1/226: mknod d1/db/d16/d35/c3b 0 2024-04-15T21:02:30.626 INFO:tasks.workunit.client.1.smithi149.stdout:2/313: creat d4/d7/d10/d6b/d21/d2c/d32/d4a/f79 x:0 0 0 2024-04-15T21:02:30.630 INFO:tasks.workunit.client.1.smithi149.stdout:0/363: truncate d1/d5/d24/d50/d15/f5d 999153 0 2024-04-15T21:02:30.630 INFO:tasks.workunit.client.1.smithi149.stdout:7/323: creat d3/d17/f71 x:0 0 0 2024-04-15T21:02:30.631 INFO:tasks.workunit.client.1.smithi149.stdout:3/271: dwrite d1/db/d23/f49 [0,4194304] 0 2024-04-15T21:02:30.632 INFO:tasks.workunit.client.1.smithi149.stdout:1/227: creat d1/d17/f3c x:0 0 0 2024-04-15T21:02:30.632 INFO:tasks.workunit.client.1.smithi149.stdout:2/314: fsync d4/d7/d10/d6b/d21/d55/f59 0 2024-04-15T21:02:30.635 INFO:tasks.workunit.client.1.smithi149.stdout:4/284: dwrite dc/d2c/d3e/d15/d3f/f43 [0,4194304] 0 2024-04-15T21:02:30.639 INFO:tasks.workunit.client.1.smithi149.stdout:4/285: stat dc/d2c 0 2024-04-15T21:02:30.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/272: read - d1/db/d24/f4b zero size 2024-04-15T21:02:30.644 INFO:tasks.workunit.client.1.smithi149.stdout:5/305: dread d0/d9/db/f1c [0,4194304] 0 2024-04-15T21:02:30.644 INFO:tasks.workunit.client.1.smithi149.stdout:1/228: dread d1/db/f32 [0,4194304] 0 2024-04-15T21:02:30.648 INFO:tasks.workunit.client.1.smithi149.stdout:2/315: unlink d4/d7/d10/d6b/d21/d2c/d3e/c6a 0 2024-04-15T21:02:30.648 INFO:tasks.workunit.client.1.smithi149.stdout:2/316: fdatasync d4/f12 0 2024-04-15T21:02:30.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/286: creat dc/d2c/d3e/d35/d3a/f60 x:0 0 0 2024-04-15T21:02:30.651 INFO:tasks.workunit.client.1.smithi149.stdout:2/317: truncate d4/d7/d10/d6b/d21/d5e/f50 5149239 0 2024-04-15T21:02:30.651 INFO:tasks.workunit.client.1.smithi149.stdout:2/318: stat d4/d7/d10/d36 0 2024-04-15T21:02:30.652 INFO:tasks.workunit.client.1.smithi149.stdout:2/319: stat d4/d7/d10/d6b/d21/d3b/d4c/d6c/f70 0 2024-04-15T21:02:30.654 INFO:tasks.workunit.client.1.smithi149.stdout:3/273: mkdir d1/db/d24/d4d 0 2024-04-15T21:02:30.655 INFO:tasks.workunit.client.1.smithi149.stdout:7/324: mknod d3/d16/d6e/c72 0 2024-04-15T21:02:30.656 INFO:tasks.workunit.client.1.smithi149.stdout:7/325: write d3/d16/d20/d36/f3a [159549,103607] 0 2024-04-15T21:02:30.660 INFO:tasks.workunit.client.1.smithi149.stdout:5/306: rename d0/d9/db/c5f to d0/d9/c6d 0 2024-04-15T21:02:30.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/229: fsync d1/f5 0 2024-04-15T21:02:30.662 INFO:tasks.workunit.client.1.smithi149.stdout:1/230: chown d1/db/f30 30708 1 2024-04-15T21:02:30.664 INFO:tasks.workunit.client.1.smithi149.stdout:3/274: rmdir d1/db/d40 39 2024-04-15T21:02:30.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/287: symlink dc/d2c/d3e/d15/l61 0 2024-04-15T21:02:30.671 INFO:tasks.workunit.client.1.smithi149.stdout:5/307: dread d0/f8 [0,4194304] 0 2024-04-15T21:02:30.673 INFO:tasks.workunit.client.1.smithi149.stdout:0/364: dwrite d1/d5/d24/d50/d13/d38/d44/f60 [0,4194304] 0 2024-04-15T21:02:30.673 INFO:tasks.workunit.client.1.smithi149.stdout:2/320: creat d4/f7a x:0 0 0 2024-04-15T21:02:30.675 INFO:tasks.workunit.client.1.smithi149.stdout:1/231: dwrite d1/db/f30 [0,4194304] 0 2024-04-15T21:02:30.677 INFO:tasks.workunit.client.1.smithi149.stdout:2/321: truncate d4/d7/d10/f37 4395056 0 2024-04-15T21:02:30.679 INFO:tasks.workunit.client.1.smithi149.stdout:9/266: getdents d23/d3c/d52 0 2024-04-15T21:02:30.679 INFO:tasks.workunit.client.1.smithi149.stdout:3/275: mknod d1/c4e 0 2024-04-15T21:02:30.681 INFO:tasks.workunit.client.1.smithi149.stdout:7/326: dread d3/f18 [0,4194304] 0 2024-04-15T21:02:30.685 INFO:tasks.workunit.client.1.smithi149.stdout:5/308: creat d0/d9/db/d12/f6e x:0 0 0 2024-04-15T21:02:30.686 INFO:tasks.workunit.client.1.smithi149.stdout:1/232: mknod d1/db/d14/c3d 0 2024-04-15T21:02:30.688 INFO:tasks.workunit.client.1.smithi149.stdout:2/322: symlink d4/d7/d10/l7b 0 2024-04-15T21:02:30.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/267: truncate d23/f43 742361 0 2024-04-15T21:02:30.691 INFO:tasks.workunit.client.1.smithi149.stdout:3/276: symlink d1/db/d24/d2b/l4f 0 2024-04-15T21:02:30.691 INFO:tasks.workunit.client.1.smithi149.stdout:2/323: write d4/d7/da/f25 [2172641,94945] 0 2024-04-15T21:02:30.693 INFO:tasks.workunit.client.1.smithi149.stdout:9/268: fdatasync d23/d3c/f4e 0 2024-04-15T21:02:30.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/327: rename d3/d16/d20/f48 to d3/d16/d20/d36/d3d/f73 0 2024-04-15T21:02:30.697 INFO:tasks.workunit.client.1.smithi149.stdout:0/365: creat d1/d5/f7d x:0 0 0 2024-04-15T21:02:30.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/324: mknod d4/d7/d10/d6b/c7c 0 2024-04-15T21:02:30.702 INFO:tasks.workunit.client.1.smithi149.stdout:1/233: mkdir d1/db/dc/d11/d3e 0 2024-04-15T21:02:30.704 INFO:tasks.workunit.client.1.smithi149.stdout:7/328: rename d3/c5e to d3/d16/d20/d6c/c74 0 2024-04-15T21:02:30.705 INFO:tasks.workunit.client.1.smithi149.stdout:0/366: dwrite d1/d29/d2c/d4f/f5f [8388608,4194304] 0 2024-04-15T21:02:30.708 INFO:tasks.workunit.client.1.smithi149.stdout:2/325: mknod d4/d7/d10/d6b/d21/d5e/c7d 0 2024-04-15T21:02:30.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/269: creat d23/d2b/d37/d50/f56 x:0 0 0 2024-04-15T21:02:30.711 INFO:tasks.workunit.client.1.smithi149.stdout:7/329: rmdir d3/d16/d20/d36/d3d/d56 39 2024-04-15T21:02:30.713 INFO:tasks.workunit.client.1.smithi149.stdout:0/367: creat d1/d29/d2c/d4f/f7e x:0 0 0 2024-04-15T21:02:30.714 INFO:tasks.workunit.client.1.smithi149.stdout:0/368: dread - d1/f7b zero size 2024-04-15T21:02:30.716 INFO:tasks.workunit.client.1.smithi149.stdout:9/270: creat d23/d2b/d37/d50/f57 x:0 0 0 2024-04-15T21:02:30.718 INFO:tasks.workunit.client.1.smithi149.stdout:7/330: symlink d3/d16/d6e/l75 0 2024-04-15T21:02:30.720 INFO:tasks.workunit.client.1.smithi149.stdout:2/326: symlink d4/d7/d10/d6b/d21/d2c/d63/l7e 0 2024-04-15T21:02:30.720 INFO:tasks.workunit.client.1.smithi149.stdout:7/331: write d3/d17/f1a [4356777,68151] 0 2024-04-15T21:02:30.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/288: truncate dc/d2c/d3e/d15/d3f/f43 1993187 0 2024-04-15T21:02:30.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/369: creat d1/d5/d24/d50/d13/d38/f7f x:0 0 0 2024-04-15T21:02:30.726 INFO:tasks.workunit.client.1.smithi149.stdout:5/309: dwrite d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:30.728 INFO:tasks.workunit.client.1.smithi149.stdout:2/327: creat d4/d7/d10/d6b/d21/d3b/f7f x:0 0 0 2024-04-15T21:02:30.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/289: chown dc/d18/l3d 476 1 2024-04-15T21:02:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:4/290: dread - dc/d2c/d3e/f47 zero size 2024-04-15T21:02:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/370: dread d1/d5/d24/d50/d13/d59/f76 [0,4194304] 0 2024-04-15T21:02:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:7/332: symlink d3/d16/d20/d36/l76 0 2024-04-15T21:02:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:3/277: write d1/db/d24/d2b/f2e [1026418,116272] 0 2024-04-15T21:02:30.737 INFO:tasks.workunit.client.1.smithi149.stdout:0/371: dread - d1/d5/d24/d50/d13/d59/f66 zero size 2024-04-15T21:02:30.740 INFO:tasks.workunit.client.1.smithi149.stdout:2/328: rmdir d4/d7/d10/d6b/d21/d2c/d32/d4a 39 2024-04-15T21:02:30.740 INFO:tasks.workunit.client.1.smithi149.stdout:4/291: dread dc/d18/f1f [0,4194304] 0 2024-04-15T21:02:30.741 INFO:tasks.workunit.client.1.smithi149.stdout:1/234: truncate d1/f3 3959312 0 2024-04-15T21:02:30.741 INFO:tasks.workunit.client.1.smithi149.stdout:2/329: chown d4/d7/d10/d6b/d21/d2c/l34 97646729 1 2024-04-15T21:02:30.742 INFO:tasks.workunit.client.1.smithi149.stdout:4/292: dread - dc/d2c/d3e/f47 zero size 2024-04-15T21:02:30.742 INFO:tasks.workunit.client.1.smithi149.stdout:5/310: dread d0/f3 [0,4194304] 0 2024-04-15T21:02:30.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/278: creat d1/db/d24/d2b/f50 x:0 0 0 2024-04-15T21:02:30.751 INFO:tasks.workunit.client.1.smithi149.stdout:0/372: rename d1/d5/d24/d50/f5c to d1/d5/d24/d50/d13/d38/d71/f80 0 2024-04-15T21:02:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/311: dread d0/f4 [0,4194304] 0 2024-04-15T21:02:30.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/333: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:30.757 INFO:tasks.workunit.client.1.smithi149.stdout:9/271: dread d23/d2b/f32 [0,4194304] 0 2024-04-15T21:02:30.762 INFO:tasks.workunit.client.1.smithi149.stdout:4/293: dwrite dc/f41 [0,4194304] 0 2024-04-15T21:02:30.765 INFO:tasks.workunit.client.1.smithi149.stdout:5/312: creat d0/d6/f6f x:0 0 0 2024-04-15T21:02:30.767 INFO:tasks.workunit.client.1.smithi149.stdout:3/279: dwrite d1/db/d28/f32 [0,4194304] 0 2024-04-15T21:02:30.768 INFO:tasks.workunit.client.1.smithi149.stdout:9/272: readlink d23/l38 0 2024-04-15T21:02:30.770 INFO:tasks.workunit.client.1.smithi149.stdout:3/280: chown d1/db/f41 68 1 2024-04-15T21:02:30.771 INFO:tasks.workunit.client.1.smithi149.stdout:0/373: unlink d1/d5/d24/d50/d13/d38/f7f 0 2024-04-15T21:02:30.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/334: rename d3/d17/f71 to d3/d16/d20/d60/f77 0 2024-04-15T21:02:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/335: readlink d3/l4b 0 2024-04-15T21:02:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/313: mknod d0/d9/db/d12/d16/c70 0 2024-04-15T21:02:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/314: write d0/d9/db/d12/d2b/f53 [466490,15131] 0 2024-04-15T21:02:30.782 INFO:tasks.workunit.client.1.smithi149.stdout:3/281: rename d1/db/d28/f2a to d1/db/d28/f51 0 2024-04-15T21:02:30.782 INFO:tasks.workunit.client.1.smithi149.stdout:2/330: getdents d4/d7/d10/d6b 0 2024-04-15T21:02:30.783 INFO:tasks.workunit.client.1.smithi149.stdout:9/273: dread f16 [0,4194304] 0 2024-04-15T21:02:30.784 INFO:tasks.workunit.client.1.smithi149.stdout:7/336: chown d3/d34/f4d 168359 1 2024-04-15T21:02:30.785 INFO:tasks.workunit.client.1.smithi149.stdout:2/331: read d4/d7/d10/d6b/d21/d3b/f41 [4727982,27095] 0 2024-04-15T21:02:30.785 INFO:tasks.workunit.client.1.smithi149.stdout:7/337: chown d3/d16/d20/d36/l76 328854306 1 2024-04-15T21:02:30.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/315: mkdir d0/d9/d71 0 2024-04-15T21:02:30.789 INFO:tasks.workunit.client.1.smithi149.stdout:5/316: dread d0/f3 [0,4194304] 0 2024-04-15T21:02:30.792 INFO:tasks.workunit.client.1.smithi149.stdout:1/235: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:30.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/332: dread d4/d7/d10/d6b/d21/d5e/f50 [0,4194304] 0 2024-04-15T21:02:30.797 INFO:tasks.workunit.client.1.smithi149.stdout:5/317: rename d0/f4 to d0/d9/db/d12/d2b/f72 0 2024-04-15T21:02:30.798 INFO:tasks.workunit.client.1.smithi149.stdout:4/294: truncate dc/d18/f1f 4243479 0 2024-04-15T21:02:30.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/374: getdents d1/d5/d24/d30/d43 0 2024-04-15T21:02:30.800 INFO:tasks.workunit.client.1.smithi149.stdout:0/375: chown d1/d5/d24/d50/f2a 183405 1 2024-04-15T21:02:30.802 INFO:tasks.workunit.client.1.smithi149.stdout:3/282: link d1/db/d24/d2b/f25 d1/db/f52 0 2024-04-15T21:02:30.803 INFO:tasks.workunit.client.1.smithi149.stdout:9/274: write f9 [4692416,6186] 0 2024-04-15T21:02:30.805 INFO:tasks.workunit.client.1.smithi149.stdout:9/275: fdatasync d23/d2b/d37/f4b 0 2024-04-15T21:02:30.805 INFO:tasks.workunit.client.1.smithi149.stdout:2/333: dread d4/d7/da/f25 [0,4194304] 0 2024-04-15T21:02:30.807 INFO:tasks.workunit.client.1.smithi149.stdout:5/318: mknod d0/d9/db/d12/d16/c73 0 2024-04-15T21:02:30.807 INFO:tasks.workunit.client.1.smithi149.stdout:2/334: write d4/d7/d29/f4f [480234,2590] 0 2024-04-15T21:02:30.810 INFO:tasks.workunit.client.1.smithi149.stdout:3/283: write d1/db/f41 [316329,2790] 0 2024-04-15T21:02:30.812 INFO:tasks.workunit.client.1.smithi149.stdout:1/236: write d1/db/dc/f10 [4656910,16221] 0 2024-04-15T21:02:30.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/284: dwrite d1/db/d24/d2b/f2e [0,4194304] 0 2024-04-15T21:02:30.818 INFO:tasks.workunit.client.1.smithi149.stdout:7/338: getdents d3/d16/d20/d6c 0 2024-04-15T21:02:30.821 INFO:tasks.workunit.client.1.smithi149.stdout:9/276: creat d23/d3c/d52/f58 x:0 0 0 2024-04-15T21:02:30.823 INFO:tasks.workunit.client.1.smithi149.stdout:5/319: fdatasync d0/f3a 0 2024-04-15T21:02:30.830 INFO:tasks.workunit.client.1.smithi149.stdout:5/320: dwrite d0/d9/db/d12/d16/f1d [4194304,4194304] 0 2024-04-15T21:02:30.832 INFO:tasks.workunit.client.1.smithi149.stdout:3/285: symlink d1/l53 0 2024-04-15T21:02:30.832 INFO:tasks.workunit.client.1.smithi149.stdout:3/286: chown d1/l18 62777197 1 2024-04-15T21:02:30.836 INFO:tasks.workunit.client.1.smithi149.stdout:0/376: link d1/d5/dc/c36 d1/d5/c81 0 2024-04-15T21:02:30.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/339: link d3/d17/f19 d3/f78 0 2024-04-15T21:02:30.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/335: link d4/d7/d10/d6b/d21/d5e/f40 d4/d7/d10/d6b/d21/d2c/f80 0 2024-04-15T21:02:30.842 INFO:tasks.workunit.client.1.smithi149.stdout:3/287: mknod d1/c54 0 2024-04-15T21:02:30.843 INFO:tasks.workunit.client.1.smithi149.stdout:3/288: chown d1/db/l11 23333830 1 2024-04-15T21:02:30.843 INFO:tasks.workunit.client.1.smithi149.stdout:7/340: creat d3/d39/f79 x:0 0 0 2024-04-15T21:02:30.844 INFO:tasks.workunit.client.1.smithi149.stdout:3/289: chown d1/db/d24/c46 115221 1 2024-04-15T21:02:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:5/321: rename d0/d9/db/d12/d16/c73 to d0/c74 0 2024-04-15T21:02:30.847 INFO:tasks.workunit.client.1.smithi149.stdout:2/336: unlink d4/d7/d29/f3c 0 2024-04-15T21:02:30.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/341: mknod d3/d17/d1f/c7a 0 2024-04-15T21:02:30.851 INFO:tasks.workunit.client.1.smithi149.stdout:2/337: fsync d4/d7/da/f25 0 2024-04-15T21:02:30.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/290: symlink d1/db/d24/d4d/l55 0 2024-04-15T21:02:30.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/291: chown d1/db/d23/f2c 658494231 1 2024-04-15T21:02:30.854 INFO:tasks.workunit.client.1.smithi149.stdout:0/377: fsync d1/d5/d24/d50/f72 0 2024-04-15T21:02:30.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/322: link d0/d6/c48 d0/d6/d2d/c75 0 2024-04-15T21:02:30.855 INFO:tasks.workunit.client.1.smithi149.stdout:2/338: creat d4/d7/d10/f81 x:0 0 0 2024-04-15T21:02:30.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/323: creat d0/d6/d2d/f76 x:0 0 0 2024-04-15T21:02:30.859 INFO:tasks.workunit.client.1.smithi149.stdout:7/342: dwrite d3/f18 [0,4194304] 0 2024-04-15T21:02:30.859 INFO:tasks.workunit.client.1.smithi149.stdout:0/378: creat d1/f82 x:0 0 0 2024-04-15T21:02:30.868 INFO:tasks.workunit.client.1.smithi149.stdout:2/339: dwrite d4/d7/d10/d36/f62 [0,4194304] 0 2024-04-15T21:02:30.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/292: truncate d1/db/d23/f2c 1626208 0 2024-04-15T21:02:30.873 INFO:tasks.workunit.client.1.smithi149.stdout:5/324: mknod d0/c77 0 2024-04-15T21:02:30.876 INFO:tasks.workunit.client.1.smithi149.stdout:2/340: unlink d4/d7/l52 0 2024-04-15T21:02:30.877 INFO:tasks.workunit.client.1.smithi149.stdout:7/343: truncate d3/d17/f19 2226246 0 2024-04-15T21:02:30.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/344: read - d3/d39/f79 zero size 2024-04-15T21:02:30.880 INFO:tasks.workunit.client.1.smithi149.stdout:5/325: rename d0/d9/db/d12/d16/d28/f42 to d0/d9/db/d12/d2b/f78 0 2024-04-15T21:02:30.881 INFO:tasks.workunit.client.1.smithi149.stdout:0/379: getdents d1/d5/d24/d50/d13 0 2024-04-15T21:02:30.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/326: chown d0/d9/d3f 0 1 2024-04-15T21:02:30.882 INFO:tasks.workunit.client.1.smithi149.stdout:3/293: mkdir d1/db/d40/d56 0 2024-04-15T21:02:30.885 INFO:tasks.workunit.client.1.smithi149.stdout:7/345: unlink d3/d17/f42 0 2024-04-15T21:02:30.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/327: mkdir d0/d6/d79 0 2024-04-15T21:02:30.890 INFO:tasks.workunit.client.1.smithi149.stdout:5/328: chown d0/d9/f39 63386 1 2024-04-15T21:02:30.900 INFO:tasks.workunit.client.1.smithi149.stdout:2/341: rename d4/d7/d10/d6b/c1f to d4/d7/d10/d6b/d21/d2c/d32/c82 0 2024-04-15T21:02:30.904 INFO:tasks.workunit.client.1.smithi149.stdout:3/294: dwrite d1/db/d23/f3a [0,4194304] 0 2024-04-15T21:02:30.905 INFO:tasks.workunit.client.1.smithi149.stdout:7/346: dread d3/fb [4194304,4194304] 0 2024-04-15T21:02:30.906 INFO:tasks.workunit.client.1.smithi149.stdout:7/347: fdatasync d3/f18 0 2024-04-15T21:02:30.906 INFO:tasks.workunit.client.1.smithi149.stdout:0/380: link d1/d9/l70 d1/d5/d24/d50/d13/d38/d44/l83 0 2024-04-15T21:02:30.907 INFO:tasks.workunit.client.1.smithi149.stdout:7/348: dread - d3/d16/d32/f53 zero size 2024-04-15T21:02:30.907 INFO:tasks.workunit.client.1.smithi149.stdout:2/342: dread d4/d7/d10/d36/f49 [0,4194304] 0 2024-04-15T21:02:30.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/343: chown d4/d7/d10/d6b/d21/d2c/d63 56271 1 2024-04-15T21:02:30.909 INFO:tasks.workunit.client.1.smithi149.stdout:3/295: creat d1/f57 x:0 0 0 2024-04-15T21:02:30.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/296: write d1/db/d23/f3a [3501416,129688] 0 2024-04-15T21:02:30.911 INFO:tasks.workunit.client.1.smithi149.stdout:0/381: rename d1/d5/d24/d50/d13/d59/f63 to d1/d5/dc/f84 0 2024-04-15T21:02:30.913 INFO:tasks.workunit.client.1.smithi149.stdout:0/382: read - d1/d9/d64/d65/f79 zero size 2024-04-15T21:02:30.914 INFO:tasks.workunit.client.1.smithi149.stdout:5/329: truncate d0/d9/f57 345676 0 2024-04-15T21:02:30.915 INFO:tasks.workunit.client.1.smithi149.stdout:0/383: chown d1/d5/f7d 119900462 1 2024-04-15T21:02:30.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/344: read d4/d7/d29/f30 [201346,54678] 0 2024-04-15T21:02:30.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/297: dwrite d1/db/d24/d2b/f50 [0,4194304] 0 2024-04-15T21:02:30.920 INFO:tasks.workunit.client.1.smithi149.stdout:0/384: dread d1/d5/d24/d30/d43/f48 [0,4194304] 0 2024-04-15T21:02:30.922 INFO:tasks.workunit.client.1.smithi149.stdout:3/298: rmdir d1/db/d24/d4d 39 2024-04-15T21:02:30.925 INFO:tasks.workunit.client.1.smithi149.stdout:2/345: rename d4/d7/d10/d6b/d21/d5e/f50 to d4/d7/d10/d36/f83 0 2024-04-15T21:02:30.927 INFO:tasks.workunit.client.1.smithi149.stdout:0/385: mkdir d1/d5/d24/d50/d85 0 2024-04-15T21:02:30.928 INFO:tasks.workunit.client.1.smithi149.stdout:0/386: chown d1/d5/d24/d50/l27 177 1 2024-04-15T21:02:30.929 INFO:tasks.workunit.client.1.smithi149.stdout:3/299: dwrite d1/f57 [0,4194304] 0 2024-04-15T21:02:30.933 INFO:tasks.workunit.client.1.smithi149.stdout:0/387: mkdir d1/d5/d24/d50/d15/d86 0 2024-04-15T21:02:30.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/330: dwrite d0/d9/db/d3d/f62 [0,4194304] 0 2024-04-15T21:02:30.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/388: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:30.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/331: dwrite d0/d6/d2d/f68 [0,4194304] 0 2024-04-15T21:02:30.948 INFO:tasks.workunit.client.1.smithi149.stdout:5/332: fsync d0/d9/db/d12/d16/f58 0 2024-04-15T21:02:30.949 INFO:tasks.workunit.client.1.smithi149.stdout:0/389: creat d1/d5/d24/d50/d13/d38/d71/f87 x:0 0 0 2024-04-15T21:02:30.953 INFO:tasks.workunit.client.1.smithi149.stdout:3/300: fdatasync d1/f57 0 2024-04-15T21:02:30.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/333: creat d0/d9/d3f/d47/f7a x:0 0 0 2024-04-15T21:02:30.958 INFO:tasks.workunit.client.1.smithi149.stdout:3/301: creat d1/db/d40/f58 x:0 0 0 2024-04-15T21:02:30.961 INFO:tasks.workunit.client.1.smithi149.stdout:5/334: fsync d0/f8 0 2024-04-15T21:02:30.964 INFO:tasks.workunit.client.1.smithi149.stdout:0/390: dwrite d1/d29/f7a [0,4194304] 0 2024-04-15T21:02:30.966 INFO:tasks.workunit.client.1.smithi149.stdout:0/391: chown d1/d5/dc/c36 5540 1 2024-04-15T21:02:30.973 INFO:tasks.workunit.client.1.smithi149.stdout:0/392: dwrite d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:30.982 INFO:tasks.workunit.client.1.smithi149.stdout:0/393: dread d1/d5/d24/d50/f2a [0,4194304] 0 2024-04-15T21:02:30.982 INFO:tasks.workunit.client.1.smithi149.stdout:0/394: mknod d1/d5/d24/d30/c88 0 2024-04-15T21:02:30.983 INFO:tasks.workunit.client.1.smithi149.stdout:0/395: unlink d1/d29/f7a 0 2024-04-15T21:02:30.985 INFO:tasks.workunit.client.1.smithi149.stdout:0/396: creat d1/d5/d24/d50/d15/f89 x:0 0 0 2024-04-15T21:02:30.986 INFO:tasks.workunit.client.1.smithi149.stdout:0/397: read d1/d9/f1b [641973,91353] 0 2024-04-15T21:02:30.988 INFO:tasks.workunit.client.1.smithi149.stdout:0/398: mkdir d1/d5/d24/d8a 0 2024-04-15T21:02:30.989 INFO:tasks.workunit.client.1.smithi149.stdout:0/399: fsync d1/d5/d24/d50/d13/d38/d71/f80 0 2024-04-15T21:02:30.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/400: dwrite d1/d5/d24/d50/f72 [0,4194304] 0 2024-04-15T21:02:30.997 INFO:tasks.workunit.client.1.smithi149.stdout:3/302: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:30.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/401: write d1/d5/f7d [220572,118930] 0 2024-04-15T21:02:31.000 INFO:tasks.workunit.client.1.smithi149.stdout:0/402: symlink d1/d5/d24/d30/d43/l8b 0 2024-04-15T21:02:31.001 INFO:tasks.workunit.client.1.smithi149.stdout:3/303: symlink d1/db/d24/l59 0 2024-04-15T21:02:31.004 INFO:tasks.workunit.client.1.smithi149.stdout:3/304: mknod d1/db/d40/c5a 0 2024-04-15T21:02:31.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/305: stat d1/c48 0 2024-04-15T21:02:31.008 INFO:tasks.workunit.client.1.smithi149.stdout:0/403: dwrite d1/d9/f6b [0,4194304] 0 2024-04-15T21:02:31.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/306: read d1/db/f21 [7397077,71573] 0 2024-04-15T21:02:31.016 INFO:tasks.workunit.client.1.smithi149.stdout:0/404: creat d1/d5/d24/d30/d54/f8c x:0 0 0 2024-04-15T21:02:31.016 INFO:tasks.workunit.client.1.smithi149.stdout:3/307: unlink d1/c20 0 2024-04-15T21:02:31.020 INFO:tasks.workunit.client.1.smithi149.stdout:0/405: creat d1/d5/d24/d50/d13/d59/f8d x:0 0 0 2024-04-15T21:02:31.023 INFO:tasks.workunit.client.1.smithi149.stdout:0/406: symlink d1/d9/l8e 0 2024-04-15T21:02:31.024 INFO:tasks.workunit.client.1.smithi149.stdout:0/407: chown d1/d5/dc/c34 107404253 1 2024-04-15T21:02:31.024 INFO:tasks.workunit.client.1.smithi149.stdout:0/408: fdatasync d1/d9/f19 0 2024-04-15T21:02:31.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/409: rmdir d1/d9 39 2024-04-15T21:02:31.036 INFO:tasks.workunit.client.1.smithi149.stdout:0/410: creat d1/d5/d24/d50/d13/d38/d44/d61/f8f x:0 0 0 2024-04-15T21:02:31.036 INFO:tasks.workunit.client.1.smithi149.stdout:0/411: fsync d1/d29/f74 0 2024-04-15T21:02:31.037 INFO:tasks.workunit.client.1.smithi149.stdout:0/412: write d1/f7b [897898,85952] 0 2024-04-15T21:02:31.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/413: link d1/d5/d24/d50/d15/f5d d1/d29/f90 0 2024-04-15T21:02:31.044 INFO:tasks.workunit.client.1.smithi149.stdout:0/414: creat d1/d9/d64/d73/f91 x:0 0 0 2024-04-15T21:02:31.044 INFO:tasks.workunit.client.1.smithi149.stdout:0/415: dread - d1/d29/d2c/d4f/f7e zero size 2024-04-15T21:02:31.046 INFO:tasks.workunit.client.1.smithi149.stdout:3/308: dread d1/db/d28/f51 [0,4194304] 0 2024-04-15T21:02:31.046 INFO:tasks.workunit.client.1.smithi149.stdout:0/416: mkdir d1/d5/d24/d30/d92 0 2024-04-15T21:02:31.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/309: truncate d1/db/d24/f4b 945108 0 2024-04-15T21:02:31.049 INFO:tasks.workunit.client.1.smithi149.stdout:3/310: creat d1/db/d40/f5b x:0 0 0 2024-04-15T21:02:31.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/311: getdents d1/db/d28 0 2024-04-15T21:02:31.053 INFO:tasks.workunit.client.1.smithi149.stdout:0/417: write d1/f22 [12193794,32078] 0 2024-04-15T21:02:31.054 INFO:tasks.workunit.client.1.smithi149.stdout:3/312: write d1/db/d24/f36 [1094386,79500] 0 2024-04-15T21:02:31.055 INFO:tasks.workunit.client.1.smithi149.stdout:0/418: dread - d1/d5/d24/d50/d13/d59/f66 zero size 2024-04-15T21:02:31.057 INFO:tasks.workunit.client.1.smithi149.stdout:3/313: mkdir d1/db/d24/d2b/d5c 0 2024-04-15T21:02:31.058 INFO:tasks.workunit.client.1.smithi149.stdout:0/419: creat d1/d5/d24/d30/f93 x:0 0 0 2024-04-15T21:02:31.060 INFO:tasks.workunit.client.1.smithi149.stdout:3/314: creat d1/db/d24/f5d x:0 0 0 2024-04-15T21:02:31.062 INFO:tasks.workunit.client.1.smithi149.stdout:3/315: mkdir d1/db/d23/d5e 0 2024-04-15T21:02:31.064 INFO:tasks.workunit.client.1.smithi149.stdout:0/420: dwrite d1/d5/d24/d50/f2a [0,4194304] 0 2024-04-15T21:02:31.065 INFO:tasks.workunit.client.1.smithi149.stdout:0/421: write d1/d5/d24/d50/d15/f89 [362038,52446] 0 2024-04-15T21:02:31.069 INFO:tasks.workunit.client.1.smithi149.stdout:0/422: rmdir d1/d5/d24/d30/d54 39 2024-04-15T21:02:31.075 INFO:tasks.workunit.client.1.smithi149.stdout:0/423: dwrite d1/d29/d2c/d4f/f5f [8388608,4194304] 0 2024-04-15T21:02:31.078 INFO:tasks.workunit.client.1.smithi149.stdout:0/424: mknod d1/d5/d24/d8a/c94 0 2024-04-15T21:02:31.086 INFO:tasks.workunit.client.1.smithi149.stdout:0/425: write d1/d5/d24/d30/f5a [57967,17778] 0 2024-04-15T21:02:31.088 INFO:tasks.workunit.client.1.smithi149.stdout:0/426: mkdir d1/d29/d2c/d4f/d95 0 2024-04-15T21:02:31.093 INFO:tasks.workunit.client.1.smithi149.stdout:0/427: rmdir d1 39 2024-04-15T21:02:31.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/428: symlink d1/d5/d24/d30/d92/l96 0 2024-04-15T21:02:31.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/429: creat d1/d5/d24/d30/d43/f97 x:0 0 0 2024-04-15T21:02:31.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/430: chown d1/d5/d24/d30/d54 5854258 1 2024-04-15T21:02:31.123 INFO:tasks.workunit.client.1.smithi149.stdout:0/431: truncate d1/d5/d24/d50/d15/f5d 1115970 0 2024-04-15T21:02:31.127 INFO:tasks.workunit.client.1.smithi149.stdout:0/432: dread d1/d29/f90 [0,4194304] 0 2024-04-15T21:02:31.127 INFO:tasks.workunit.client.1.smithi149.stdout:0/433: stat d1 0 2024-04-15T21:02:31.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/434: rmdir d1/d5/d24/d8a 39 2024-04-15T21:02:31.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/435: creat d1/d29/d2c/d4f/f98 x:0 0 0 2024-04-15T21:02:31.135 INFO:tasks.workunit.client.1.smithi149.stdout:0/436: symlink d1/d5/d24/d50/l99 0 2024-04-15T21:02:31.135 INFO:tasks.workunit.client.1.smithi149.stdout:0/437: write d1/d5/d24/d30/d43/f97 [767709,120869] 0 2024-04-15T21:02:31.135 INFO:tasks.workunit.client.1.smithi149.stdout:0/438: fdatasync d1/d5/d24/d30/f5a 0 2024-04-15T21:02:31.202 INFO:tasks.workunit.client.1.smithi149.stdout:8/272: sync 2024-04-15T21:02:31.204 INFO:tasks.workunit.client.1.smithi149.stdout:0/439: chown d1/d29/d2c 306 1 2024-04-15T21:02:31.205 INFO:tasks.workunit.client.1.smithi149.stdout:0/440: write d1/d29/d2c/d4f/f98 [264433,347] 0 2024-04-15T21:02:31.206 INFO:tasks.workunit.client.1.smithi149.stdout:8/273: mknod d2/df/d10/d4e/c62 0 2024-04-15T21:02:31.208 INFO:tasks.workunit.client.1.smithi149.stdout:8/274: mknod d2/df/d10/d25/d32/c63 0 2024-04-15T21:02:31.210 INFO:tasks.workunit.client.1.smithi149.stdout:8/275: write d2/df/d10/f11 [5936013,47397] 0 2024-04-15T21:02:31.211 INFO:tasks.workunit.client.1.smithi149.stdout:0/441: dwrite d1/d9/f6f [0,4194304] 0 2024-04-15T21:02:31.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/276: dwrite d2/df/d10/d20/f4b [0,4194304] 0 2024-04-15T21:02:31.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/277: symlink d2/df/d10/d25/d37/d53/l64 0 2024-04-15T21:02:31.224 INFO:tasks.workunit.client.1.smithi149.stdout:8/278: creat d2/d16/f65 x:0 0 0 2024-04-15T21:02:31.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/279: dread - d2/d16/f2a zero size 2024-04-15T21:02:31.228 INFO:tasks.workunit.client.1.smithi149.stdout:8/280: symlink d2/df/d10/d4e/d51/l66 0 2024-04-15T21:02:31.230 INFO:tasks.workunit.client.1.smithi149.stdout:8/281: symlink d2/df/d10/d21/d50/l67 0 2024-04-15T21:02:31.232 INFO:tasks.workunit.client.1.smithi149.stdout:8/282: symlink d2/df/d10/d25/d57/l68 0 2024-04-15T21:02:31.233 INFO:tasks.workunit.client.1.smithi149.stdout:8/283: chown d2/df/d10/d25/d32 0 1 2024-04-15T21:02:31.234 INFO:tasks.workunit.client.1.smithi149.stdout:8/284: fdatasync d2/df/d10/d25/d32/f44 0 2024-04-15T21:02:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:8/285: truncate d2/df/d10/d25/d37/f3e 822694 0 2024-04-15T21:02:31.238 INFO:tasks.workunit.client.1.smithi149.stdout:8/286: creat d2/f69 x:0 0 0 2024-04-15T21:02:31.238 INFO:tasks.workunit.client.1.smithi149.stdout:8/287: stat d2/c5 0 2024-04-15T21:02:31.240 INFO:tasks.workunit.client.1.smithi149.stdout:8/288: mknod d2/df/d10/d4e/d51/c6a 0 2024-04-15T21:02:31.242 INFO:tasks.workunit.client.1.smithi149.stdout:8/289: mkdir d2/df/d10/d20/d6b 0 2024-04-15T21:02:31.244 INFO:tasks.workunit.client.1.smithi149.stdout:8/290: rename d2/df/d10/d25/d32/c63 to d2/df/d10/d25/d57/c6c 0 2024-04-15T21:02:31.249 INFO:tasks.workunit.client.1.smithi149.stdout:8/291: dwrite d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:31.254 INFO:tasks.workunit.client.1.smithi149.stdout:8/292: dwrite d2/f1f [0,4194304] 0 2024-04-15T21:02:31.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/293: unlink d2/df/f40 0 2024-04-15T21:02:31.260 INFO:tasks.workunit.client.1.smithi149.stdout:8/294: mkdir d2/df/d10/d21/d50/d5d/d6d 0 2024-04-15T21:02:31.260 INFO:tasks.workunit.client.1.smithi149.stdout:8/295: write d2/f69 [961275,12274] 0 2024-04-15T21:02:31.261 INFO:tasks.workunit.client.1.smithi149.stdout:6/242: sync 2024-04-15T21:02:31.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/296: write d2/df/d10/d25/d37/f5f [67570,15752] 0 2024-04-15T21:02:31.264 INFO:tasks.workunit.client.1.smithi149.stdout:8/297: write d2/f4 [3182880,54535] 0 2024-04-15T21:02:31.265 INFO:tasks.workunit.client.1.smithi149.stdout:8/298: dread - d2/d16/f2a zero size 2024-04-15T21:02:31.266 INFO:tasks.workunit.client.1.smithi149.stdout:6/243: creat da/d2e/d45/f57 x:0 0 0 2024-04-15T21:02:31.266 INFO:tasks.workunit.client.1.smithi149.stdout:8/299: dread - d2/df/d10/d21/f41 zero size 2024-04-15T21:02:31.271 INFO:tasks.workunit.client.1.smithi149.stdout:8/300: fsync d2/df/d10/d25/d37/f5f 0 2024-04-15T21:02:31.274 INFO:tasks.workunit.client.1.smithi149.stdout:8/301: link d2/df/d10/d4e/d51/l66 d2/df/d10/d4e/d51/l6e 0 2024-04-15T21:02:31.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/302: dwrite d2/fe [4194304,4194304] 0 2024-04-15T21:02:31.290 INFO:tasks.workunit.client.1.smithi149.stdout:8/303: dwrite d2/df/d10/f11 [8388608,4194304] 0 2024-04-15T21:02:31.293 INFO:tasks.workunit.client.1.smithi149.stdout:8/304: symlink d2/df/d10/d34/l6f 0 2024-04-15T21:02:31.294 INFO:tasks.workunit.client.1.smithi149.stdout:6/244: dread da/d11/f35 [0,4194304] 0 2024-04-15T21:02:31.294 INFO:tasks.workunit.client.1.smithi149.stdout:8/305: read - d2/df/d10/d25/d32/d45/f59 zero size 2024-04-15T21:02:31.295 INFO:tasks.workunit.client.1.smithi149.stdout:8/306: fsync d2/df/d10/d25/f26 0 2024-04-15T21:02:31.300 INFO:tasks.workunit.client.1.smithi149.stdout:6/245: dwrite da/d11/f1d [0,4194304] 0 2024-04-15T21:02:31.301 INFO:tasks.workunit.client.1.smithi149.stdout:8/307: link d2/df/d10/d20/l52 d2/df/d10/d4e/d51/l70 0 2024-04-15T21:02:31.301 INFO:tasks.workunit.client.1.smithi149.stdout:6/246: stat da/d18/c2b 0 2024-04-15T21:02:31.303 INFO:tasks.workunit.client.1.smithi149.stdout:8/308: write d2/df/d10/d25/f26 [1840600,104551] 0 2024-04-15T21:02:31.303 INFO:tasks.workunit.client.1.smithi149.stdout:6/247: fdatasync da/d2e/f52 0 2024-04-15T21:02:31.304 INFO:tasks.workunit.client.1.smithi149.stdout:8/309: read - d2/df/d10/d25/d32/d45/f5e zero size 2024-04-15T21:02:31.305 INFO:tasks.workunit.client.1.smithi149.stdout:6/248: write da/d18/f19 [1894212,53860] 0 2024-04-15T21:02:31.310 INFO:tasks.workunit.client.1.smithi149.stdout:6/249: symlink da/d49/d55/l58 0 2024-04-15T21:02:31.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/250: mkdir da/d2e/d45/d59 0 2024-04-15T21:02:31.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/251: fdatasync da/d11/f22 0 2024-04-15T21:02:31.314 INFO:tasks.workunit.client.1.smithi149.stdout:6/252: symlink da/d2e/d45/l5a 0 2024-04-15T21:02:31.316 INFO:tasks.workunit.client.1.smithi149.stdout:6/253: unlink da/d18/d10/d16/l25 0 2024-04-15T21:02:31.319 INFO:tasks.workunit.client.1.smithi149.stdout:6/254: fdatasync da/d11/f1d 0 2024-04-15T21:02:31.324 INFO:tasks.workunit.client.1.smithi149.stdout:6/255: write da/d18/d10/d16/f29 [1708190,97072] 0 2024-04-15T21:02:31.327 INFO:tasks.workunit.client.1.smithi149.stdout:6/256: rename da/d18/l12 to da/d18/d10/l5b 0 2024-04-15T21:02:31.327 INFO:tasks.workunit.client.1.smithi149.stdout:6/257: fsync da/d18/d10/d16/f29 0 2024-04-15T21:02:31.329 INFO:tasks.workunit.client.1.smithi149.stdout:8/310: dread d2/df/d10/d25/f28 [0,4194304] 0 2024-04-15T21:02:31.330 INFO:tasks.workunit.client.1.smithi149.stdout:6/258: creat da/d18/d10/d3f/f5c x:0 0 0 2024-04-15T21:02:31.331 INFO:tasks.workunit.client.1.smithi149.stdout:8/311: symlink d2/df/d10/d4e/l71 0 2024-04-15T21:02:31.333 INFO:tasks.workunit.client.1.smithi149.stdout:6/259: dread da/d11/f35 [0,4194304] 0 2024-04-15T21:02:31.333 INFO:tasks.workunit.client.1.smithi149.stdout:8/312: creat d2/df/d10/d25/d57/f72 x:0 0 0 2024-04-15T21:02:31.334 INFO:tasks.workunit.client.1.smithi149.stdout:6/260: creat da/d2e/d45/f5d x:0 0 0 2024-04-15T21:02:31.335 INFO:tasks.workunit.client.1.smithi149.stdout:8/313: write d2/df/d10/d25/f33 [847319,105119] 0 2024-04-15T21:02:31.336 INFO:tasks.workunit.client.1.smithi149.stdout:6/261: unlink da/d11/l13 0 2024-04-15T21:02:31.338 INFO:tasks.workunit.client.1.smithi149.stdout:6/262: write da/d18/f19 [835599,112272] 0 2024-04-15T21:02:31.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/314: symlink d2/df/d10/d25/d57/l73 0 2024-04-15T21:02:31.349 INFO:tasks.workunit.client.1.smithi149.stdout:6/263: dwrite da/f26 [0,4194304] 0 2024-04-15T21:02:31.350 INFO:tasks.workunit.client.1.smithi149.stdout:6/264: fsync da/f1b 0 2024-04-15T21:02:31.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/265: fdatasync da/d11/f1a 0 2024-04-15T21:02:31.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/315: dread d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:31.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/266: unlink da/f26 0 2024-04-15T21:02:31.361 INFO:tasks.workunit.client.1.smithi149.stdout:8/316: dwrite d2/f2b [0,4194304] 0 2024-04-15T21:02:31.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/317: dread d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:31.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/318: read - d2/d16/f2a zero size 2024-04-15T21:02:31.368 INFO:tasks.workunit.client.1.smithi149.stdout:8/319: dread - d2/df/d10/d21/f41 zero size 2024-04-15T21:02:31.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/295: sync 2024-04-15T21:02:31.397 INFO:tasks.workunit.client.1.smithi149.stdout:4/296: fdatasync dc/d2c/d3e/d35/d3a/f40 0 2024-04-15T21:02:31.398 INFO:tasks.workunit.client.1.smithi149.stdout:8/320: mkdir d2/df/d10/d21/d46/d74 0 2024-04-15T21:02:31.399 INFO:tasks.workunit.client.1.smithi149.stdout:4/297: creat dc/d18/f62 x:0 0 0 2024-04-15T21:02:31.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/321: creat d2/df/d10/d21/d50/d5d/d6d/f75 x:0 0 0 2024-04-15T21:02:31.401 INFO:tasks.workunit.client.1.smithi149.stdout:4/298: creat dc/d18/d21/f63 x:0 0 0 2024-04-15T21:02:31.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/299: fsync dc/d2c/d3e/d15/f34 0 2024-04-15T21:02:31.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/322: unlink d2/df/d10/d4e/l71 0 2024-04-15T21:02:31.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/323: mkdir d2/df/d10/d25/d37/d53/d76 0 2024-04-15T21:02:31.407 INFO:tasks.workunit.client.1.smithi149.stdout:8/324: truncate d2/df/d10/d21/d50/d5d/d6d/f75 798109 0 2024-04-15T21:02:31.407 INFO:tasks.workunit.client.1.smithi149.stdout:4/300: dread dc/d1a/f2b [0,4194304] 0 2024-04-15T21:02:31.408 INFO:tasks.workunit.client.1.smithi149.stdout:4/301: dread - dc/d18/d21/f63 zero size 2024-04-15T21:02:31.409 INFO:tasks.workunit.client.1.smithi149.stdout:8/325: dread d2/df/d10/d21/d50/d5d/d6d/f75 [0,4194304] 0 2024-04-15T21:02:31.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/302: truncate dc/d1a/f26 1577396 0 2024-04-15T21:02:31.410 INFO:tasks.workunit.client.1.smithi149.stdout:8/326: truncate d2/df/d10/d25/f4a 5186037 0 2024-04-15T21:02:31.410 INFO:tasks.workunit.client.1.smithi149.stdout:4/303: creat dc/d18/d21/f64 x:0 0 0 2024-04-15T21:02:31.411 INFO:tasks.workunit.client.1.smithi149.stdout:4/304: stat dc/d18/f1d 0 2024-04-15T21:02:31.412 INFO:tasks.workunit.client.1.smithi149.stdout:4/305: creat dc/d2c/d3e/d35/d3a/f65 x:0 0 0 2024-04-15T21:02:31.414 INFO:tasks.workunit.client.1.smithi149.stdout:4/306: mknod dc/d18/d21/c66 0 2024-04-15T21:02:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:4/307: truncate dc/d2c/d3e/d35/d3a/f40 1736529 0 2024-04-15T21:02:31.421 INFO:tasks.workunit.client.1.smithi149.stdout:8/327: getdents d2/df/d10/d25/d37/d53 0 2024-04-15T21:02:31.421 INFO:tasks.workunit.client.1.smithi149.stdout:8/328: dread - d2/d16/f65 zero size 2024-04-15T21:02:31.424 INFO:tasks.workunit.client.1.smithi149.stdout:8/329: chown d2/df/d10/d25/d32/c3a 1690481 1 2024-04-15T21:02:31.426 INFO:tasks.workunit.client.1.smithi149.stdout:8/330: mkdir d2/df/d10/d25/d32/d45/d77 0 2024-04-15T21:02:31.429 INFO:tasks.workunit.client.1.smithi149.stdout:8/331: mknod d2/df/d10/d25/d57/c78 0 2024-04-15T21:02:31.430 INFO:tasks.workunit.client.1.smithi149.stdout:4/308: dwrite dc/d2c/d3e/d15/d3f/f43 [0,4194304] 0 2024-04-15T21:02:31.432 INFO:tasks.workunit.client.1.smithi149.stdout:4/309: chown dc/d2c/d3e/d15/f34 2921532 1 2024-04-15T21:02:31.433 INFO:tasks.workunit.client.1.smithi149.stdout:4/310: stat dc/d18/l31 0 2024-04-15T21:02:31.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/311: creat dc/d18/d21/f67 x:0 0 0 2024-04-15T21:02:31.436 INFO:tasks.workunit.client.1.smithi149.stdout:4/312: chown dc/d18/f62 8245478 1 2024-04-15T21:02:31.436 INFO:tasks.workunit.client.1.smithi149.stdout:4/313: read - dc/d18/d21/f64 zero size 2024-04-15T21:02:31.437 INFO:tasks.workunit.client.1.smithi149.stdout:8/332: rename d2/df/d10/d25/d32/d45/l4c to d2/df/d10/l79 0 2024-04-15T21:02:31.440 INFO:tasks.workunit.client.1.smithi149.stdout:8/333: fdatasync d2/df/d10/d20/d30/d35/f43 0 2024-04-15T21:02:31.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/314: dwrite dc/d2c/d3e/d35/d3a/f60 [0,4194304] 0 2024-04-15T21:02:31.444 INFO:tasks.workunit.client.1.smithi149.stdout:4/315: truncate dc/d18/f62 51254 0 2024-04-15T21:02:31.450 INFO:tasks.workunit.client.1.smithi149.stdout:8/334: getdents d2/df/d10/d34 0 2024-04-15T21:02:31.450 INFO:tasks.workunit.client.1.smithi149.stdout:4/316: link dc/d1a/c33 dc/d2c/c68 0 2024-04-15T21:02:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:8/335: mknod d2/d16/c7a 0 2024-04-15T21:02:31.452 INFO:tasks.workunit.client.1.smithi149.stdout:4/317: symlink dc/d2c/d3e/d15/d3f/l69 0 2024-04-15T21:02:31.453 INFO:tasks.workunit.client.1.smithi149.stdout:4/318: chown dc/d18/d21/f63 900735 1 2024-04-15T21:02:31.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/319: write dc/d1a/f26 [548838,111599] 0 2024-04-15T21:02:31.456 INFO:tasks.workunit.client.1.smithi149.stdout:8/336: rename d2/df/d10/d4e/d51/l66 to d2/d16/l7b 0 2024-04-15T21:02:31.457 INFO:tasks.workunit.client.1.smithi149.stdout:8/337: truncate d2/d16/f65 660115 0 2024-04-15T21:02:31.458 INFO:tasks.workunit.client.1.smithi149.stdout:4/320: rename dc/d18/l31 to dc/d2c/d3e/d15/d5b/l6a 0 2024-04-15T21:02:31.459 INFO:tasks.workunit.client.1.smithi149.stdout:4/321: write dc/d18/d21/f4d [1014380,74094] 0 2024-04-15T21:02:31.464 INFO:tasks.workunit.client.1.smithi149.stdout:8/338: dwrite d2/df/d10/d25/d32/d45/f5e [0,4194304] 0 2024-04-15T21:02:31.464 INFO:tasks.workunit.client.1.smithi149.stdout:4/322: rename dc/d2c/d3e/d15/f2e to dc/d18/d21/f6b 0 2024-04-15T21:02:31.465 INFO:tasks.workunit.client.1.smithi149.stdout:4/323: chown dc/d2c 186570536 1 2024-04-15T21:02:31.466 INFO:tasks.workunit.client.0.smithi072.stdout:4/3: sync 2024-04-15T21:02:31.466 INFO:tasks.workunit.client.0.smithi072.stdout:4/4: dwrite - no filename 2024-04-15T21:02:31.466 INFO:tasks.workunit.client.0.smithi072.stdout:4/5: chown c0 4354721 1 2024-04-15T21:02:31.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/339: symlink d2/df/d10/d21/d46/l7c 0 2024-04-15T21:02:31.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/340: chown d2/la 10792 1 2024-04-15T21:02:31.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/341: chown d2/df/d10/f14 0 1 2024-04-15T21:02:31.469 INFO:tasks.workunit.client.1.smithi149.stdout:4/324: mkdir dc/d2c/d3e/d35/d4b/d6c 0 2024-04-15T21:02:31.470 INFO:tasks.workunit.client.1.smithi149.stdout:8/342: write d2/d16/f2a [416421,10839] 0 2024-04-15T21:02:31.470 INFO:tasks.workunit.client.1.smithi149.stdout:4/325: stat dc/d1a/f4e 0 2024-04-15T21:02:31.474 INFO:tasks.workunit.client.0.smithi072.stdout:4/6: link c0 c1 0 2024-04-15T21:02:31.475 INFO:tasks.workunit.client.0.smithi072.stdout:4/7: write - no filename 2024-04-15T21:02:31.475 INFO:tasks.workunit.client.0.smithi072.stdout:4/8: read - no filename 2024-04-15T21:02:31.475 INFO:tasks.workunit.client.1.smithi149.stdout:8/343: symlink d2/df/d10/d20/d6b/l7d 0 2024-04-15T21:02:31.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/326: dwrite dc/d2c/d3e/d15/d3f/f43 [0,4194304] 0 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/9: symlink l2 0 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/10: fdatasync - no filename 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/11: dread - no filename 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/12: rmdir - no directory 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/13: dread - no filename 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/14: dwrite - no filename 2024-04-15T21:02:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:4/15: dwrite - no filename 2024-04-15T21:02:31.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/344: creat d2/df/d10/d4e/d51/f7e x:0 0 0 2024-04-15T21:02:31.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/327: creat dc/d2c/d3e/d15/d5b/f6d x:0 0 0 2024-04-15T21:02:31.480 INFO:tasks.workunit.client.0.smithi072.stdout:4/16: unlink l2 0 2024-04-15T21:02:31.480 INFO:tasks.workunit.client.0.smithi072.stdout:4/17: write - no filename 2024-04-15T21:02:31.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/345: mknod d2/df/d10/d25/d37/c7f 0 2024-04-15T21:02:31.482 INFO:tasks.workunit.client.1.smithi149.stdout:8/346: chown d2/d5b 46 1 2024-04-15T21:02:31.482 INFO:tasks.workunit.client.0.smithi072.stdout:4/18: creat f3 x:0 0 0 2024-04-15T21:02:31.484 INFO:tasks.workunit.client.1.smithi149.stdout:8/347: read d2/df/d10/d20/f27 [9642273,78894] 0 2024-04-15T21:02:31.485 INFO:tasks.workunit.client.1.smithi149.stdout:4/328: dwrite dc/d2c/d3e/f47 [0,4194304] 0 2024-04-15T21:02:31.490 INFO:tasks.workunit.client.1.smithi149.stdout:4/329: unlink dc/d2c/d3e/d15/d3f/f5a 0 2024-04-15T21:02:31.493 INFO:tasks.workunit.client.1.smithi149.stdout:4/330: creat dc/d2c/d3e/d15/d3f/f6e x:0 0 0 2024-04-15T21:02:31.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/348: dwrite d2/df/d10/d21/f41 [0,4194304] 0 2024-04-15T21:02:31.501 INFO:tasks.workunit.client.1.smithi149.stdout:8/349: rename d2/df/d10/d4e/d51/f7e to d2/df/d10/d25/d57/f80 0 2024-04-15T21:02:31.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/331: link dc/d1a/f2b dc/d2c/d3e/d15/f6f 0 2024-04-15T21:02:31.509 INFO:tasks.workunit.client.1.smithi149.stdout:1/237: sync 2024-04-15T21:02:31.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/277: sync 2024-04-15T21:02:31.509 INFO:tasks.workunit.client.0.smithi072.stdout:4/19: getdents . 0 2024-04-15T21:02:31.510 INFO:tasks.workunit.client.1.smithi149.stdout:1/238: chown d1/db/dc/d11/d3e 196298 1 2024-04-15T21:02:31.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/278: write d23/d2b/d37/d50/f57 [709664,82521] 0 2024-04-15T21:02:31.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/332: mkdir dc/d2c/d3e/d35/d4b/d6c/d70 0 2024-04-15T21:02:31.513 INFO:tasks.workunit.client.0.smithi072.stdout:4/20: symlink l4 0 2024-04-15T21:02:31.513 INFO:tasks.workunit.client.0.smithi072.stdout:4/21: dread - f3 zero size 2024-04-15T21:02:31.514 INFO:tasks.workunit.client.1.smithi149.stdout:1/239: rmdir d1/db/d14/d1e 39 2024-04-15T21:02:31.517 INFO:tasks.workunit.client.1.smithi149.stdout:8/350: getdents d2/d16 0 2024-04-15T21:02:31.518 INFO:tasks.workunit.client.1.smithi149.stdout:4/333: creat dc/d2c/d3e/d15/d5b/f71 x:0 0 0 2024-04-15T21:02:31.520 INFO:tasks.workunit.client.0.smithi072.stdout:4/22: rename c0 to c5 0 2024-04-15T21:02:31.521 INFO:tasks.workunit.client.1.smithi149.stdout:1/240: fsync d1/db/d14/d1e/ff 0 2024-04-15T21:02:31.522 INFO:tasks.workunit.client.1.smithi149.stdout:9/279: fsync d23/f3a 0 2024-04-15T21:02:31.523 INFO:tasks.workunit.client.0.smithi072.stdout:4/23: creat f6 x:0 0 0 2024-04-15T21:02:31.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/24: dread - f3 zero size 2024-04-15T21:02:31.524 INFO:tasks.workunit.client.1.smithi149.stdout:4/334: rmdir dc/d2c/d3e/d35/d4b/d6c 39 2024-04-15T21:02:31.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/241: mkdir d1/db/dc/d11/d3f 0 2024-04-15T21:02:31.526 INFO:tasks.workunit.client.0.smithi072.stdout:4/25: mkdir d7 0 2024-04-15T21:02:31.527 INFO:tasks.workunit.client.1.smithi149.stdout:9/280: creat d23/d2b/d37/d50/f59 x:0 0 0 2024-04-15T21:02:31.528 INFO:tasks.workunit.client.1.smithi149.stdout:4/335: mknod dc/d1a/c72 0 2024-04-15T21:02:31.530 INFO:tasks.workunit.client.1.smithi149.stdout:1/242: rename d1/db/d14/d1e/ff to d1/db/d14/d21/f40 0 2024-04-15T21:02:31.531 INFO:tasks.workunit.client.1.smithi149.stdout:9/281: chown d23/d46/f53 962049229 1 2024-04-15T21:02:31.532 INFO:tasks.workunit.client.1.smithi149.stdout:8/351: link d2/df/d10/d25/l48 d2/df/d10/d34/l81 0 2024-04-15T21:02:31.535 INFO:tasks.workunit.client.0.smithi072.stdout:4/26: unlink c5 0 2024-04-15T21:02:31.540 INFO:tasks.workunit.client.0.smithi072.stdout:4/27: creat d7/f8 x:0 0 0 2024-04-15T21:02:31.540 INFO:tasks.workunit.client.1.smithi149.stdout:8/352: stat d2/df/d10/d21/l61 0 2024-04-15T21:02:31.540 INFO:tasks.workunit.client.0.smithi072.stdout:4/28: write d7/f8 [430450,51320] 0 2024-04-15T21:02:31.541 INFO:tasks.workunit.client.1.smithi149.stdout:8/353: chown d2/df/d10/d21/d46/l7c 15888 1 2024-04-15T21:02:31.543 INFO:tasks.workunit.client.0.smithi072.stdout:4/29: creat d7/f9 x:0 0 0 2024-04-15T21:02:31.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/282: truncate d23/d2b/d37/f4b 3581548 0 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:1/12: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:5/38: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:9/47: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:6/47: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:0/20: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:7/12: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:8/56: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:3/53: sync 2024-04-15T21:02:31.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/61: sync 2024-04-15T21:02:31.548 INFO:tasks.workunit.client.1.smithi149.stdout:8/354: dwrite d2/df/d10/d25/f26 [0,4194304] 0 2024-04-15T21:02:31.549 INFO:tasks.workunit.client.1.smithi149.stdout:4/336: getdents dc/d2c/d3e/d15/d3f 0 2024-04-15T21:02:31.549 INFO:tasks.workunit.client.0.smithi072.stdout:9/48: fsync d4/f7 0 2024-04-15T21:02:31.549 INFO:tasks.workunit.client.0.smithi072.stdout:3/54: chown d1/f8 4073 1 2024-04-15T21:02:31.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/49: write d4/fc [723373,101575] 0 2024-04-15T21:02:31.551 INFO:tasks.workunit.client.1.smithi149.stdout:1/243: truncate d1/db/d14/d21/f2a 508701 0 2024-04-15T21:02:31.554 INFO:tasks.workunit.client.0.smithi072.stdout:1/13: chown c0 56740 1 2024-04-15T21:02:31.555 INFO:tasks.workunit.client.0.smithi072.stdout:4/30: rmdir d7 39 2024-04-15T21:02:31.555 INFO:tasks.workunit.client.0.smithi072.stdout:8/57: dread d3/ff [0,4194304] 0 2024-04-15T21:02:31.557 INFO:tasks.workunit.client.0.smithi072.stdout:2/62: dwrite f1 [0,4194304] 0 2024-04-15T21:02:31.557 INFO:tasks.workunit.client.0.smithi072.stdout:2/63: chown d2/d8 4878 1 2024-04-15T21:02:31.558 INFO:tasks.workunit.client.1.smithi149.stdout:4/337: creat dc/d18/d21/f73 x:0 0 0 2024-04-15T21:02:31.558 INFO:tasks.workunit.client.0.smithi072.stdout:2/64: write d2/f12 [57467,26899] 0 2024-04-15T21:02:31.561 INFO:tasks.workunit.client.0.smithi072.stdout:6/48: rmdir d2 39 2024-04-15T21:02:31.562 INFO:tasks.workunit.client.1.smithi149.stdout:1/244: creat d1/d17/f41 x:0 0 0 2024-04-15T21:02:31.563 INFO:tasks.workunit.client.0.smithi072.stdout:7/13: dread - d2/f5 zero size 2024-04-15T21:02:31.563 INFO:tasks.workunit.client.1.smithi149.stdout:8/355: mknod d2/d5b/c82 0 2024-04-15T21:02:31.565 INFO:tasks.workunit.client.1.smithi149.stdout:1/245: truncate d1/db/f37 570565 0 2024-04-15T21:02:31.567 INFO:tasks.workunit.client.1.smithi149.stdout:4/338: dwrite dc/d2c/d3e/d15/d5b/f71 [0,4194304] 0 2024-04-15T21:02:31.568 INFO:tasks.workunit.client.1.smithi149.stdout:4/339: dread - dc/d18/d21/f63 zero size 2024-04-15T21:02:31.571 INFO:tasks.workunit.client.1.smithi149.stdout:8/356: creat d2/d16/f83 x:0 0 0 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:7/349: sync 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:2/346: sync 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:6/267: sync 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:5/335: sync 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:3/316: sync 2024-04-15T21:02:31.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/442: sync 2024-04-15T21:02:31.576 INFO:tasks.workunit.client.0.smithi072.stdout:1/14: mkdir d5 0 2024-04-15T21:02:31.576 INFO:tasks.workunit.client.0.smithi072.stdout:1/15: fdatasync - no filename 2024-04-15T21:02:31.576 INFO:tasks.workunit.client.0.smithi072.stdout:1/16: dread - no filename 2024-04-15T21:02:31.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/246: mkdir d1/db/d14/d21/d42 0 2024-04-15T21:02:31.578 INFO:tasks.workunit.client.1.smithi149.stdout:3/317: chown d1/db/c29 2323804 1 2024-04-15T21:02:31.578 INFO:tasks.workunit.client.0.smithi072.stdout:4/31: write d7/f8 [185097,130890] 0 2024-04-15T21:02:31.579 INFO:tasks.workunit.client.1.smithi149.stdout:1/247: fsync d1/db/f37 0 2024-04-15T21:02:31.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/350: dread - d3/d16/d20/d36/d3d/f4f zero size 2024-04-15T21:02:31.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/283: getdents d23/d2b/d37 0 2024-04-15T21:02:31.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/318: write d1/db/f1c [1477745,73719] 0 2024-04-15T21:02:31.582 INFO:tasks.workunit.client.1.smithi149.stdout:9/284: write f21 [1179424,78823] 0 2024-04-15T21:02:31.583 INFO:tasks.workunit.client.1.smithi149.stdout:3/319: write d1/db/d24/f5d [575331,70408] 0 2024-04-15T21:02:31.583 INFO:tasks.workunit.client.0.smithi072.stdout:5/39: mkdir d0/d3/d7/dc 0 2024-04-15T21:02:31.583 INFO:tasks.workunit.client.0.smithi072.stdout:0/21: dwrite d0/f1 [0,4194304] 0 2024-04-15T21:02:31.585 INFO:tasks.workunit.client.1.smithi149.stdout:3/320: truncate d1/db/d24/f5d 1177701 0 2024-04-15T21:02:31.585 INFO:tasks.workunit.client.0.smithi072.stdout:8/58: creat d3/de/f13 x:0 0 0 2024-04-15T21:02:31.585 INFO:tasks.workunit.client.0.smithi072.stdout:8/59: fdatasync d3/de/f13 0 2024-04-15T21:02:31.586 INFO:tasks.workunit.client.1.smithi149.stdout:8/357: creat d2/df/d10/d21/d50/d5d/d6d/f84 x:0 0 0 2024-04-15T21:02:31.586 INFO:tasks.workunit.client.0.smithi072.stdout:9/50: write f3 [976189,31744] 0 2024-04-15T21:02:31.586 INFO:tasks.workunit.client.0.smithi072.stdout:8/60: read f1 [2603676,4544] 0 2024-04-15T21:02:31.586 INFO:tasks.workunit.client.1.smithi149.stdout:8/358: stat d2/df/d10/d21/d46/d74 0 2024-04-15T21:02:31.587 INFO:tasks.workunit.client.0.smithi072.stdout:8/61: fdatasync d3/de/f11 0 2024-04-15T21:02:31.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/51: dwrite d4/f5 [0,4194304] 0 2024-04-15T21:02:31.658 INFO:tasks.workunit.client.0.smithi072.stdout:6/49: write d2/f4 [3721236,91] 0 2024-04-15T21:02:31.658 INFO:tasks.workunit.client.0.smithi072.stdout:6/50: dread - d2/fe zero size 2024-04-15T21:02:31.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/51: write d2/fb [3033372,111683] 0 2024-04-15T21:02:31.663 INFO:tasks.workunit.client.0.smithi072.stdout:7/14: truncate d2/f5 1007970 0 2024-04-15T21:02:31.664 INFO:tasks.workunit.client.0.smithi072.stdout:7/15: chown d2 7056125 1 2024-04-15T21:02:31.664 INFO:tasks.workunit.client.1.smithi149.stdout:0/443: symlink d1/d5/d24/d30/d92/l9a 0 2024-04-15T21:02:31.665 INFO:tasks.workunit.client.1.smithi149.stdout:6/268: dread da/d18/f23 [0,4194304] 0 2024-04-15T21:02:31.666 INFO:tasks.workunit.client.1.smithi149.stdout:0/444: read d1/d5/f4a [3536827,117812] 0 2024-04-15T21:02:31.666 INFO:tasks.workunit.client.1.smithi149.stdout:2/347: dread d4/d7/d10/d6b/d21/f5f [0,4194304] 0 2024-04-15T21:02:31.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/351: fsync d3/d16/f30 0 2024-04-15T21:02:31.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/352: write d3/d16/f30 [2280808,126073] 0 2024-04-15T21:02:31.670 INFO:tasks.workunit.client.1.smithi149.stdout:7/353: write d3/f9 [1189421,117822] 0 2024-04-15T21:02:31.671 INFO:tasks.workunit.client.1.smithi149.stdout:4/340: link f1 dc/d2c/d3e/d15/d5b/f74 0 2024-04-15T21:02:31.672 INFO:tasks.workunit.client.0.smithi072.stdout:4/32: chown f3 8 1 2024-04-15T21:02:31.673 INFO:tasks.workunit.client.1.smithi149.stdout:7/354: readlink d3/d16/d6e/l75 0 2024-04-15T21:02:31.673 INFO:tasks.workunit.client.0.smithi072.stdout:4/33: dread - d7/f9 zero size 2024-04-15T21:02:31.675 INFO:tasks.workunit.client.1.smithi149.stdout:0/445: dwrite d1/d5/d24/d50/d13/d59/f8d [0,4194304] 0 2024-04-15T21:02:31.676 INFO:tasks.workunit.client.0.smithi072.stdout:0/22: creat d0/d3/f7 x:0 0 0 2024-04-15T21:02:31.679 INFO:tasks.workunit.client.0.smithi072.stdout:4/34: dwrite d7/f8 [0,4194304] 0 2024-04-15T21:02:31.684 INFO:tasks.workunit.client.0.smithi072.stdout:0/23: dwrite d0/f1 [0,4194304] 0 2024-04-15T21:02:31.685 INFO:tasks.workunit.client.0.smithi072.stdout:9/52: mknod d4/cf 0 2024-04-15T21:02:31.689 INFO:tasks.workunit.client.0.smithi072.stdout:9/53: dread d4/fc [0,4194304] 0 2024-04-15T21:02:31.690 INFO:tasks.workunit.client.0.smithi072.stdout:6/52: symlink d2/lf 0 2024-04-15T21:02:31.692 INFO:tasks.workunit.client.0.smithi072.stdout:6/53: write d2/fb [1897520,120010] 0 2024-04-15T21:02:31.693 INFO:tasks.workunit.client.0.smithi072.stdout:2/65: link d2/d8/fe d2/d8/f16 0 2024-04-15T21:02:31.694 INFO:tasks.workunit.client.0.smithi072.stdout:9/54: dread d4/f5 [0,4194304] 0 2024-04-15T21:02:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:8/359: dread d2/df/d10/f11 [4194304,4194304] 0 2024-04-15T21:02:31.700 INFO:tasks.workunit.client.0.smithi072.stdout:3/55: rename d1/f8 to d1/f10 0 2024-04-15T21:02:31.703 INFO:tasks.workunit.client.1.smithi149.stdout:6/269: dwrite da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:31.706 INFO:tasks.workunit.client.1.smithi149.stdout:2/348: rmdir d4/d7/d10/d6b/d21/d3b/d4c 39 2024-04-15T21:02:31.707 INFO:tasks.workunit.client.0.smithi072.stdout:1/17: creat d5/f6 x:0 0 0 2024-04-15T21:02:31.713 INFO:tasks.workunit.client.0.smithi072.stdout:5/40: mknod d0/d3/d7/dc/cd 0 2024-04-15T21:02:31.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/285: creat d23/f5a x:0 0 0 2024-04-15T21:02:31.719 INFO:tasks.workunit.client.1.smithi149.stdout:6/270: mknod da/d18/d10/d3f/c5e 0 2024-04-15T21:02:31.720 INFO:tasks.workunit.client.0.smithi072.stdout:0/24: creat d0/d3/f8 x:0 0 0 2024-04-15T21:02:31.720 INFO:tasks.workunit.client.1.smithi149.stdout:6/271: write da/d2e/f52 [268607,44586] 0 2024-04-15T21:02:31.721 INFO:tasks.workunit.client.0.smithi072.stdout:0/25: dread - d0/d3/f7 zero size 2024-04-15T21:02:31.721 INFO:tasks.workunit.client.0.smithi072.stdout:0/26: chown d0/f1 1213450938 1 2024-04-15T21:02:31.721 INFO:tasks.workunit.client.1.smithi149.stdout:3/321: creat d1/db/d24/f5f x:0 0 0 2024-04-15T21:02:31.722 INFO:tasks.workunit.client.0.smithi072.stdout:0/27: write d0/d3/f7 [172532,123889] 0 2024-04-15T21:02:31.724 INFO:tasks.workunit.client.1.smithi149.stdout:4/341: mkdir dc/d2c/d3e/d35/d4b/d75 0 2024-04-15T21:02:31.726 INFO:tasks.workunit.client.1.smithi149.stdout:0/446: mknod d1/d5/c9b 0 2024-04-15T21:02:31.728 INFO:tasks.workunit.client.1.smithi149.stdout:5/336: rename d0/d9/f57 to d0/d9/db/f7b 0 2024-04-15T21:02:31.729 INFO:tasks.workunit.client.0.smithi072.stdout:9/55: mknod d4/c10 0 2024-04-15T21:02:31.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/16: dread d2/f5 [0,4194304] 0 2024-04-15T21:02:31.732 INFO:tasks.workunit.client.1.smithi149.stdout:6/272: symlink da/d18/d10/d3f/l5f 0 2024-04-15T21:02:31.732 INFO:tasks.workunit.client.0.smithi072.stdout:9/56: dread f3 [0,4194304] 0 2024-04-15T21:02:31.733 INFO:tasks.workunit.client.1.smithi149.stdout:3/322: write d1/db/d28/f51 [1722085,52026] 0 2024-04-15T21:02:31.733 INFO:tasks.workunit.client.1.smithi149.stdout:3/323: chown d1/db/f21 55949 1 2024-04-15T21:02:31.734 INFO:tasks.workunit.client.0.smithi072.stdout:3/56: creat d1/d7/f11 x:0 0 0 2024-04-15T21:02:31.735 INFO:tasks.workunit.client.1.smithi149.stdout:4/342: mknod dc/d1a/c76 0 2024-04-15T21:02:31.735 INFO:tasks.workunit.client.0.smithi072.stdout:1/18: creat d5/f7 x:0 0 0 2024-04-15T21:02:31.735 INFO:tasks.workunit.client.1.smithi149.stdout:3/324: write d1/db/d28/f32 [2289009,110002] 0 2024-04-15T21:02:31.736 INFO:tasks.workunit.client.0.smithi072.stdout:1/19: write d5/f7 [34512,56438] 0 2024-04-15T21:02:31.736 INFO:tasks.workunit.client.1.smithi149.stdout:4/343: dread - dc/d18/d21/f64 zero size 2024-04-15T21:02:31.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/447: creat d1/d29/d2c/d4f/f9c x:0 0 0 2024-04-15T21:02:31.739 INFO:tasks.workunit.client.1.smithi149.stdout:8/360: rename d2/df/d10/d20/d30 to d2/df/d10/d25/d37/d53/d76/d85 0 2024-04-15T21:02:31.740 INFO:tasks.workunit.client.1.smithi149.stdout:8/361: fdatasync d2/df/d10/d25/d37/f3e 0 2024-04-15T21:02:31.743 INFO:tasks.workunit.client.0.smithi072.stdout:5/41: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:31.748 INFO:tasks.workunit.client.1.smithi149.stdout:9/286: dread d23/d2b/f4f [0,4194304] 0 2024-04-15T21:02:31.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/325: unlink d1/db/d24/c46 0 2024-04-15T21:02:31.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/337: write d0/d9/db/d12/d16/f18 [1864197,32748] 0 2024-04-15T21:02:31.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/326: fdatasync d1/db/d24/f5d 0 2024-04-15T21:02:31.756 INFO:tasks.workunit.client.1.smithi149.stdout:3/327: fdatasync d1/db/f52 0 2024-04-15T21:02:31.758 INFO:tasks.workunit.client.1.smithi149.stdout:0/448: mkdir d1/d5/d24/d50/d13/d38/d71/d9d 0 2024-04-15T21:02:31.761 INFO:tasks.workunit.client.1.smithi149.stdout:0/449: read d1/d5/dc/f46 [1267598,29815] 0 2024-04-15T21:02:31.762 INFO:tasks.workunit.client.1.smithi149.stdout:7/355: rename d3/d16/d20/d36/d3d/d56/f62 to d3/d16/d20/d60/f7b 0 2024-04-15T21:02:31.763 INFO:tasks.workunit.client.1.smithi149.stdout:7/356: read - d3/d16/d20/d36/d3d/d56/f5f zero size 2024-04-15T21:02:31.767 INFO:tasks.workunit.client.1.smithi149.stdout:6/273: mkdir da/d60 0 2024-04-15T21:02:31.769 INFO:tasks.workunit.client.1.smithi149.stdout:9/287: write d23/d2b/f4f [2161431,64308] 0 2024-04-15T21:02:31.770 INFO:tasks.workunit.client.1.smithi149.stdout:5/338: unlink d0/d9/d3f/l52 0 2024-04-15T21:02:31.771 INFO:tasks.workunit.client.1.smithi149.stdout:7/357: dwrite d3/d16/d32/f53 [0,4194304] 0 2024-04-15T21:02:31.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/344: creat dc/d2c/d3e/d35/d4b/d75/f77 x:0 0 0 2024-04-15T21:02:31.779 INFO:tasks.workunit.client.1.smithi149.stdout:7/358: mknod d3/d16/d20/d60/c7c 0 2024-04-15T21:02:31.780 INFO:tasks.workunit.client.1.smithi149.stdout:8/362: dwrite d2/df/d10/d20/f27 [4194304,4194304] 0 2024-04-15T21:02:31.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/345: creat dc/d1a/f78 x:0 0 0 2024-04-15T21:02:31.784 INFO:tasks.workunit.client.1.smithi149.stdout:6/274: link da/d18/d10/d3f/f41 da/d49/d55/f61 0 2024-04-15T21:02:31.786 INFO:tasks.workunit.client.1.smithi149.stdout:6/275: truncate da/d2e/d45/f5d 799449 0 2024-04-15T21:02:31.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/339: mknod d0/d6/d2d/d63/c7c 0 2024-04-15T21:02:31.792 INFO:tasks.workunit.client.1.smithi149.stdout:0/450: creat d1/d5/d24/f9e x:0 0 0 2024-04-15T21:02:31.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/346: unlink dc/d2c/d3e/d15/d3f/f43 0 2024-04-15T21:02:31.795 INFO:tasks.workunit.client.1.smithi149.stdout:4/347: readlink dc/d18/d21/l2f 0 2024-04-15T21:02:31.796 INFO:tasks.workunit.client.1.smithi149.stdout:5/340: mknod d0/d6/d2d/c7d 0 2024-04-15T21:02:31.796 INFO:tasks.workunit.client.1.smithi149.stdout:8/363: dwrite d2/f1b [4194304,4194304] 0 2024-04-15T21:02:31.798 INFO:tasks.workunit.client.1.smithi149.stdout:3/328: getdents d1/db/d24/d2b 0 2024-04-15T21:02:31.803 INFO:tasks.workunit.client.1.smithi149.stdout:0/451: dread d1/d5/d24/d50/f2a [0,4194304] 0 2024-04-15T21:02:31.804 INFO:tasks.workunit.client.1.smithi149.stdout:6/276: dwrite da/d11/f35 [0,4194304] 0 2024-04-15T21:02:31.805 INFO:tasks.workunit.client.1.smithi149.stdout:0/452: chown d1/d5/d24/d50/d13/d38/d44/c53 2281218 1 2024-04-15T21:02:31.807 INFO:tasks.workunit.client.1.smithi149.stdout:0/453: chown d1/d5/d24/d50/l27 7666 1 2024-04-15T21:02:31.807 INFO:tasks.workunit.client.1.smithi149.stdout:6/277: truncate da/d18/d10/d3f/f41 408841 0 2024-04-15T21:02:31.808 INFO:tasks.workunit.client.1.smithi149.stdout:5/341: unlink d0/d9/db/d12/d16/f18 0 2024-04-15T21:02:31.808 INFO:tasks.workunit.client.1.smithi149.stdout:0/454: write d1/f7b [1822151,37186] 0 2024-04-15T21:02:31.809 INFO:tasks.workunit.client.0.smithi072.stdout:4/35: rename c1 to d7/ca 0 2024-04-15T21:02:31.809 INFO:tasks.workunit.client.1.smithi149.stdout:7/359: truncate d3/d16/f5a 215247 0 2024-04-15T21:02:31.811 INFO:tasks.workunit.client.0.smithi072.stdout:2/66: creat d2/d3/f17 x:0 0 0 2024-04-15T21:02:31.811 INFO:tasks.workunit.client.0.smithi072.stdout:4/36: read - d7/f9 zero size 2024-04-15T21:02:31.813 INFO:tasks.workunit.client.0.smithi072.stdout:2/67: chown d2/f9 34469 1 2024-04-15T21:02:31.815 INFO:tasks.workunit.client.0.smithi072.stdout:8/62: getdents d3 0 2024-04-15T21:02:31.817 INFO:tasks.workunit.client.1.smithi149.stdout:6/278: dwrite da/d32/f43 [0,4194304] 0 2024-04-15T21:02:31.817 INFO:tasks.workunit.client.0.smithi072.stdout:8/63: chown d3/de/f11 27099588 1 2024-04-15T21:02:31.817 INFO:tasks.workunit.client.1.smithi149.stdout:5/342: fdatasync d0/f8 0 2024-04-15T21:02:31.820 INFO:tasks.workunit.client.0.smithi072.stdout:5/42: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:31.822 INFO:tasks.workunit.client.1.smithi149.stdout:7/360: creat d3/d39/f7d x:0 0 0 2024-04-15T21:02:31.826 INFO:tasks.workunit.client.0.smithi072.stdout:5/43: dread d0/f9 [0,4194304] 0 2024-04-15T21:02:31.830 INFO:tasks.workunit.client.0.smithi072.stdout:5/44: dread d0/f9 [0,4194304] 0 2024-04-15T21:02:31.830 INFO:tasks.workunit.client.0.smithi072.stdout:0/28: mkdir d0/d3/d5/d9 0 2024-04-15T21:02:31.835 INFO:tasks.workunit.client.1.smithi149.stdout:4/348: dread fa [0,4194304] 0 2024-04-15T21:02:31.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/329: rename d1/db/d24/d2b/c16 to d1/db/d24/c60 0 2024-04-15T21:02:31.838 INFO:tasks.workunit.client.1.smithi149.stdout:3/330: dread d1/db/d24/f4b [0,4194304] 0 2024-04-15T21:02:31.839 INFO:tasks.workunit.client.1.smithi149.stdout:8/364: getdents d2/df/d10 0 2024-04-15T21:02:31.840 INFO:tasks.workunit.client.1.smithi149.stdout:8/365: dread - d2/df/d10/d25/d32/d45/f59 zero size 2024-04-15T21:02:31.842 INFO:tasks.workunit.client.0.smithi072.stdout:4/37: creat d7/fb x:0 0 0 2024-04-15T21:02:31.842 INFO:tasks.workunit.client.1.smithi149.stdout:8/366: dread - d2/df/d10/d21/d50/d5d/d6d/f84 zero size 2024-04-15T21:02:31.844 INFO:tasks.workunit.client.0.smithi072.stdout:3/57: fdatasync d1/f6 0 2024-04-15T21:02:31.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/331: dwrite d1/db/f41 [0,4194304] 0 2024-04-15T21:02:31.847 INFO:tasks.workunit.client.0.smithi072.stdout:1/20: link d5/f7 d5/f8 0 2024-04-15T21:02:31.848 INFO:tasks.workunit.client.0.smithi072.stdout:6/54: sync 2024-04-15T21:02:31.848 INFO:tasks.workunit.client.0.smithi072.stdout:6/55: stat d2/l8 0 2024-04-15T21:02:31.849 INFO:tasks.workunit.client.0.smithi072.stdout:6/56: write d2/fc [3876050,35830] 0 2024-04-15T21:02:31.850 INFO:tasks.workunit.client.1.smithi149.stdout:5/343: link d0/f50 d0/d9/db/d3d/f7e 0 2024-04-15T21:02:31.851 INFO:tasks.workunit.client.0.smithi072.stdout:2/68: creat d2/d8/f18 x:0 0 0 2024-04-15T21:02:31.852 INFO:tasks.workunit.client.0.smithi072.stdout:2/69: dread - d2/d3/f15 zero size 2024-04-15T21:02:31.853 INFO:tasks.workunit.client.0.smithi072.stdout:8/64: fsync d3/d4/f9 0 2024-04-15T21:02:31.854 INFO:tasks.workunit.client.0.smithi072.stdout:8/65: chown d3/ff 33 1 2024-04-15T21:02:31.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/279: truncate da/d32/f48 1457691 0 2024-04-15T21:02:31.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/344: unlink d0/d9/db/d12/d16/c70 0 2024-04-15T21:02:31.865 INFO:tasks.workunit.client.0.smithi072.stdout:0/29: dwrite d0/f2 [0,4194304] 0 2024-04-15T21:02:31.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/349: symlink dc/d2c/d3e/d35/d4b/l79 0 2024-04-15T21:02:31.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/280: dwrite da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:31.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/281: truncate da/d2e/f52 1033903 0 2024-04-15T21:02:31.870 INFO:tasks.workunit.client.0.smithi072.stdout:3/58: creat d1/d7/f12 x:0 0 0 2024-04-15T21:02:31.872 INFO:tasks.workunit.client.0.smithi072.stdout:1/21: creat d5/f9 x:0 0 0 2024-04-15T21:02:31.872 INFO:tasks.workunit.client.0.smithi072.stdout:1/22: readlink l4 0 2024-04-15T21:02:31.873 INFO:tasks.workunit.client.0.smithi072.stdout:5/45: write d0/fa [980535,59936] 0 2024-04-15T21:02:31.876 INFO:tasks.workunit.client.0.smithi072.stdout:6/57: mkdir d2/d10 0 2024-04-15T21:02:31.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/70: creat d2/d3/f19 x:0 0 0 2024-04-15T21:02:31.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/71: fsync d2/f9 0 2024-04-15T21:02:31.880 INFO:tasks.workunit.client.1.smithi149.stdout:6/282: symlink da/d18/d33/l62 0 2024-04-15T21:02:31.880 INFO:tasks.workunit.client.0.smithi072.stdout:8/66: symlink d3/d4/l14 0 2024-04-15T21:02:31.882 INFO:tasks.workunit.client.1.smithi149.stdout:7/361: getdents d3/d16/d20/d36/d3d/d56 0 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 -- 172.21.15.72:0/890251037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0100740 msgr2=0x7f83f0100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 --2- 172.21.15.72:0/890251037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0100740 0x7f83f0100b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009910 tx=0x7f83e0009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 -- 172.21.15.72:0/890251037 shutdown_connections 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 --2- 172.21.15.72:0/890251037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0101090 0x7f83f00ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 --2- 172.21.15.72:0/890251037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0100740 0x7f83f0100b50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 -- 172.21.15.72:0/890251037 >> 172.21.15.72:0/890251037 conn(0x7f83f00f9f10 msgr2=0x7f83f00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:31.883 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:31 smithi072 ceph-mon[29079]: pgmap v272: 65 pgs: 65 active+clean; 569 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 49 MiB/s wr, 221 op/s 2024-04-15T21:02:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 -- 172.21.15.72:0/890251037 shutdown_connections 2024-04-15T21:02:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 -- 172.21.15.72:0/890251037 wait complete. 2024-04-15T21:02:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.890+0000 7f83f60a2700 1 Processor -- start 2024-04-15T21:02:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83f60a2700 1 -- start start 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83f60a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0100740 0x7f83f0194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83f60a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83f60a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0195570 con 0x7f83f0101090 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83f60a2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f01956b0 con 0x7f83f0100740 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42110/0 (socket says 172.21.15.72:42110) 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 -- 172.21.15.72:0/2963595038 learned_addr learned my addr 172.21.15.72:0/2963595038 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0100740 0x7f83f0194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 -- 172.21.15.72:0/2963595038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0100740 msgr2=0x7f83f0194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0100740 0x7f83f0194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.891+0000 7f83eeffd700 1 -- 172.21.15.72:0/2963595038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00095f0 con 0x7f83f0101090 2024-04-15T21:02:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83eeffd700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83e400d8d0 tx=0x7f83e400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e400f860 con 0x7f83f0101090 2024-04-15T21:02:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f00fe3e0 con 0x7f83f0101090 2024-04-15T21:02:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83e400fe70 con 0x7f83f0101090 2024-04-15T21:02:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e400e5e0 con 0x7f83f0101090 2024-04-15T21:02:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.892+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f00fe930 con 0x7f83f0101090 2024-04-15T21:02:31.887 INFO:tasks.workunit.client.0.smithi072.stdout:7/17: getdents d2 0 2024-04-15T21:02:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.893+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f0107c50 con 0x7f83f0101090 2024-04-15T21:02:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.894+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7f83e4010460 con 0x7f83f0101090 2024-04-15T21:02:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.894+0000 7f83ecff9700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 0x7f83d806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:31.889 INFO:tasks.workunit.client.0.smithi072.stdout:4/38: link d7/f8 d7/fc 0 2024-04-15T21:02:31.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/367: creat d2/f86 x:0 0 0 2024-04-15T21:02:31.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/368: dread - d2/df/d10/d25/d57/f72 zero size 2024-04-15T21:02:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.894+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f83e408cae0 con 0x7f83f0101090 2024-04-15T21:02:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.894+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 0x7f83d806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.895+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 0x7f83d806fc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f83e0006010 tx=0x7f83e000b560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:31.890 INFO:tasks.workunit.client.0.smithi072.stdout:0/30: creat d0/d3/fa x:0 0 0 2024-04-15T21:02:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:31.900+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f83e405ac70 con 0x7f83f0101090 2024-04-15T21:02:31.893 INFO:tasks.workunit.client.1.smithi149.stdout:4/350: rename dc/d18/d21/c5f to dc/d2c/d3e/c7a 0 2024-04-15T21:02:31.894 INFO:tasks.workunit.client.1.smithi149.stdout:7/362: dwrite d3/ff [4194304,4194304] 0 2024-04-15T21:02:31.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/351: truncate dc/d18/d21/f64 301084 0 2024-04-15T21:02:31.896 INFO:tasks.workunit.client.1.smithi149.stdout:4/352: fsync dc/d2c/d3e/d15/d5b/f6d 0 2024-04-15T21:02:31.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/345: link d0/f5 d0/d9/db/f7f 0 2024-04-15T21:02:31.902 INFO:tasks.workunit.client.0.smithi072.stdout:6/58: rmdir d2 39 2024-04-15T21:02:31.902 INFO:tasks.workunit.client.0.smithi072.stdout:1/23: creat d5/fa x:0 0 0 2024-04-15T21:02:31.902 INFO:tasks.workunit.client.0.smithi072.stdout:2/72: rename d2/fa to d2/d3/f1a 0 2024-04-15T21:02:31.903 INFO:tasks.workunit.client.0.smithi072.stdout:1/24: read - d5/fa zero size 2024-04-15T21:02:31.903 INFO:tasks.workunit.client.0.smithi072.stdout:8/67: symlink d3/d4/l15 0 2024-04-15T21:02:31.904 INFO:tasks.workunit.client.0.smithi072.stdout:1/25: chown c1 1369 1 2024-04-15T21:02:31.904 INFO:tasks.workunit.client.1.smithi149.stdout:5/346: rename d0/d6/d2d/f44 to d0/d9/db/d12/d16/d28/d1b/d61/f80 0 2024-04-15T21:02:31.904 INFO:tasks.workunit.client.0.smithi072.stdout:8/68: read - d3/de/f13 zero size 2024-04-15T21:02:31.905 INFO:tasks.workunit.client.0.smithi072.stdout:4/39: dread d7/fc [0,4194304] 0 2024-04-15T21:02:31.906 INFO:tasks.workunit.client.0.smithi072.stdout:7/18: creat d2/f6 x:0 0 0 2024-04-15T21:02:31.906 INFO:tasks.workunit.client.0.smithi072.stdout:4/40: write d7/fb [178257,83754] 0 2024-04-15T21:02:31.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/283: fsync da/d49/d55/f61 0 2024-04-15T21:02:31.917 INFO:tasks.workunit.client.1.smithi149.stdout:5/347: link d0/d9/db/d3d/f7e d0/d9/db/d12/d16/d28/f81 0 2024-04-15T21:02:31.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/284: mknod da/d2e/c63 0 2024-04-15T21:02:31.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/285: fsync da/d11/f1d 0 2024-04-15T21:02:31.921 INFO:tasks.workunit.client.1.smithi149.stdout:5/348: rename d0/d6/d2d/d63 to d0/d6/d82 0 2024-04-15T21:02:31.922 INFO:tasks.workunit.client.1.smithi149.stdout:6/286: creat da/d2e/f64 x:0 0 0 2024-04-15T21:02:31.923 INFO:tasks.workunit.client.1.smithi149.stdout:6/287: write da/f36 [234297,55361] 0 2024-04-15T21:02:31.924 INFO:tasks.workunit.client.1.smithi149.stdout:5/349: mkdir d0/d9/db/d12/d16/d28/d1b/d83 0 2024-04-15T21:02:31.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/288: stat da/d49 0 2024-04-15T21:02:31.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/350: chown d0/d6/d2d/c4c 16327 1 2024-04-15T21:02:31.928 INFO:tasks.workunit.client.1.smithi149.stdout:7/363: dwrite d3/d16/f30 [0,4194304] 0 2024-04-15T21:02:31.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/351: dread d0/d9/db/d3d/f62 [0,4194304] 0 2024-04-15T21:02:31.935 INFO:tasks.workunit.client.1.smithi149.stdout:7/364: rename d3/d16/d32/f53 to d3/d16/d20/d60/f7e 0 2024-04-15T21:02:31.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/365: rmdir d3/d16/d20/d36 39 2024-04-15T21:02:31.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/352: dwrite d0/d9/db/f2e [0,4194304] 0 2024-04-15T21:02:31.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:31 smithi149 ceph-mon[36029]: pgmap v272: 65 pgs: 65 active+clean; 569 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 49 MiB/s wr, 221 op/s 2024-04-15T21:02:31.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/353: write d0/d9/db/d12/d16/f54 [674211,94094] 0 2024-04-15T21:02:31.946 INFO:tasks.workunit.client.0.smithi072.stdout:9/57: sync 2024-04-15T21:02:31.948 INFO:tasks.workunit.client.0.smithi072.stdout:0/31: symlink d0/lb 0 2024-04-15T21:02:31.950 INFO:tasks.workunit.client.0.smithi072.stdout:2/73: mknod d2/d3/c1b 0 2024-04-15T21:02:31.951 INFO:tasks.workunit.client.0.smithi072.stdout:1/26: mkdir d5/db 0 2024-04-15T21:02:31.952 INFO:tasks.workunit.client.0.smithi072.stdout:8/69: mknod d3/d4/c16 0 2024-04-15T21:02:31.952 INFO:tasks.workunit.client.0.smithi072.stdout:0/32: truncate d0/d3/f7 947641 0 2024-04-15T21:02:31.952 INFO:tasks.workunit.client.0.smithi072.stdout:4/41: symlink d7/ld 0 2024-04-15T21:02:31.953 INFO:tasks.workunit.client.0.smithi072.stdout:1/27: dread - d5/f9 zero size 2024-04-15T21:02:31.956 INFO:tasks.workunit.client.0.smithi072.stdout:7/19: dwrite d2/f6 [0,4194304] 0 2024-04-15T21:02:31.956 INFO:tasks.workunit.client.0.smithi072.stdout:9/58: creat d4/f11 x:0 0 0 2024-04-15T21:02:31.957 INFO:tasks.workunit.client.0.smithi072.stdout:2/74: fdatasync d2/d3/f5 0 2024-04-15T21:02:31.958 INFO:tasks.workunit.client.0.smithi072.stdout:4/42: creat d7/fe x:0 0 0 2024-04-15T21:02:31.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/28: dread d5/f7 [0,4194304] 0 2024-04-15T21:02:31.961 INFO:tasks.workunit.client.0.smithi072.stdout:9/59: fsync f3 0 2024-04-15T21:02:31.962 INFO:tasks.workunit.client.0.smithi072.stdout:1/29: dread - d5/f9 zero size 2024-04-15T21:02:31.964 INFO:tasks.workunit.client.0.smithi072.stdout:4/43: readlink l4 0 2024-04-15T21:02:31.965 INFO:tasks.workunit.client.0.smithi072.stdout:2/75: unlink d2/d8/c14 0 2024-04-15T21:02:31.968 INFO:tasks.workunit.client.0.smithi072.stdout:4/44: creat d7/ff x:0 0 0 2024-04-15T21:02:31.971 INFO:tasks.workunit.client.0.smithi072.stdout:2/76: dread - d2/d3/f17 zero size 2024-04-15T21:02:31.972 INFO:tasks.workunit.client.0.smithi072.stdout:9/60: truncate d4/fc 218367 0 2024-04-15T21:02:31.973 INFO:tasks.workunit.client.0.smithi072.stdout:0/33: dwrite d0/d3/f7 [0,4194304] 0 2024-04-15T21:02:31.978 INFO:tasks.workunit.client.0.smithi072.stdout:9/61: chown d4/cf 337061579 1 2024-04-15T21:02:31.978 INFO:tasks.workunit.client.0.smithi072.stdout:2/77: unlink d2/d8/l10 0 2024-04-15T21:02:31.978 INFO:tasks.workunit.client.0.smithi072.stdout:8/70: dwrite d3/d4/f9 [0,4194304] 0 2024-04-15T21:02:31.979 INFO:tasks.workunit.client.0.smithi072.stdout:0/34: creat d0/d3/fc x:0 0 0 2024-04-15T21:02:31.985 INFO:tasks.workunit.client.0.smithi072.stdout:7/20: dwrite d2/f5 [0,4194304] 0 2024-04-15T21:02:31.986 INFO:tasks.workunit.client.0.smithi072.stdout:9/62: truncate f3 2236462 0 2024-04-15T21:02:31.987 INFO:tasks.workunit.client.0.smithi072.stdout:8/71: chown d3/d4/ca 23 1 2024-04-15T21:02:31.989 INFO:tasks.workunit.client.0.smithi072.stdout:1/30: dwrite d5/fa [0,4194304] 0 2024-04-15T21:02:31.991 INFO:tasks.workunit.client.0.smithi072.stdout:0/35: dread - d0/d3/f4 zero size 2024-04-15T21:02:31.991 INFO:tasks.workunit.client.0.smithi072.stdout:8/72: write d3/de/f13 [320807,101475] 0 2024-04-15T21:02:31.995 INFO:tasks.workunit.client.0.smithi072.stdout:7/21: unlink d2/f6 0 2024-04-15T21:02:31.998 INFO:tasks.workunit.client.0.smithi072.stdout:1/31: write d5/f8 [33171,47214] 0 2024-04-15T21:02:32.001 INFO:tasks.workunit.client.0.smithi072.stdout:2/78: dwrite d2/d3/f1a [0,4194304] 0 2024-04-15T21:02:32.002 INFO:tasks.workunit.client.0.smithi072.stdout:7/22: chown d2/c4 6224 1 2024-04-15T21:02:32.002 INFO:tasks.workunit.client.0.smithi072.stdout:0/36: link d0/d3/fc d0/fd 0 2024-04-15T21:02:32.006 INFO:tasks.workunit.client.0.smithi072.stdout:8/73: dread d3/d4/f9 [0,4194304] 0 2024-04-15T21:02:32.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/79: chown d2/d3/f19 121935162 1 2024-04-15T21:02:32.007 INFO:tasks.workunit.client.0.smithi072.stdout:1/32: creat d5/db/fc x:0 0 0 2024-04-15T21:02:32.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/80: chown d2/d8 4 1 2024-04-15T21:02:32.007 INFO:tasks.workunit.client.0.smithi072.stdout:7/23: mkdir d2/d7 0 2024-04-15T21:02:32.007 INFO:tasks.workunit.client.0.smithi072.stdout:0/37: rename d0/d3/f7 to d0/d3/fe 0 2024-04-15T21:02:32.016 INFO:tasks.workunit.client.0.smithi072.stdout:8/74: dwrite d3/de/f11 [0,4194304] 0 2024-04-15T21:02:32.016 INFO:tasks.workunit.client.0.smithi072.stdout:1/33: rename l4 to d5/ld 0 2024-04-15T21:02:32.017 INFO:tasks.workunit.client.0.smithi072.stdout:7/24: dwrite d2/f5 [0,4194304] 0 2024-04-15T21:02:32.022 INFO:tasks.workunit.client.0.smithi072.stdout:0/38: creat d0/d6/ff x:0 0 0 2024-04-15T21:02:32.023 INFO:tasks.workunit.client.0.smithi072.stdout:7/25: creat d2/d7/f8 x:0 0 0 2024-04-15T21:02:32.023 INFO:tasks.workunit.client.0.smithi072.stdout:0/39: readlink d0/lb 0 2024-04-15T21:02:32.028 INFO:tasks.workunit.client.0.smithi072.stdout:0/40: write d0/f1 [4125377,66915] 0 2024-04-15T21:02:32.036 INFO:tasks.workunit.client.0.smithi072.stdout:1/34: dwrite d5/f9 [0,4194304] 0 2024-04-15T21:02:32.038 INFO:tasks.workunit.client.0.smithi072.stdout:9/63: dwrite f3 [0,4194304] 0 2024-04-15T21:02:32.040 INFO:tasks.workunit.client.0.smithi072.stdout:8/75: truncate d3/de/f11 2029678 0 2024-04-15T21:02:32.043 INFO:tasks.workunit.client.0.smithi072.stdout:9/64: rmdir d4 39 2024-04-15T21:02:32.045 INFO:tasks.workunit.client.0.smithi072.stdout:2/81: dwrite d2/d8/f16 [0,4194304] 0 2024-04-15T21:02:32.045 INFO:tasks.workunit.client.0.smithi072.stdout:8/76: mkdir d3/de/d17 0 2024-04-15T21:02:32.048 INFO:tasks.workunit.client.0.smithi072.stdout:7/26: dwrite d2/f5 [4194304,4194304] 0 2024-04-15T21:02:32.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/82: dread - d2/d3/f19 zero size 2024-04-15T21:02:32.052 INFO:tasks.workunit.client.0.smithi072.stdout:0/41: dwrite d0/d3/fa [0,4194304] 0 2024-04-15T21:02:32.053 INFO:tasks.workunit.client.0.smithi072.stdout:9/65: chown d4/ce 216133920 1 2024-04-15T21:02:32.056 INFO:tasks.workunit.client.0.smithi072.stdout:7/27: dread d2/f5 [0,4194304] 0 2024-04-15T21:02:32.059 INFO:tasks.workunit.client.0.smithi072.stdout:3/59: sync 2024-04-15T21:02:32.062 INFO:tasks.workunit.client.0.smithi072.stdout:2/83: rename d2/d8/f18 to d2/d8/f1c 0 2024-04-15T21:02:32.062 INFO:tasks.workunit.client.0.smithi072.stdout:9/66: rmdir d4 39 2024-04-15T21:02:32.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/60: read - d1/f10 zero size 2024-04-15T21:02:32.064 INFO:tasks.workunit.client.0.smithi072.stdout:2/84: chown c0 198477 1 2024-04-15T21:02:32.064 INFO:tasks.workunit.client.0.smithi072.stdout:0/42: mknod d0/d3/d5/d9/c10 0 2024-04-15T21:02:32.064 INFO:tasks.workunit.client.0.smithi072.stdout:8/77: getdents d3/de 0 2024-04-15T21:02:32.065 INFO:tasks.workunit.client.0.smithi072.stdout:0/43: chown d0/d6 22 1 2024-04-15T21:02:32.065 INFO:tasks.workunit.client.0.smithi072.stdout:8/78: write f1 [28558,94858] 0 2024-04-15T21:02:32.069 INFO:tasks.workunit.client.0.smithi072.stdout:7/28: getdents d2 0 2024-04-15T21:02:32.072 INFO:tasks.workunit.client.0.smithi072.stdout:7/29: symlink d2/d7/l9 0 2024-04-15T21:02:32.075 INFO:tasks.workunit.client.0.smithi072.stdout:7/30: read - d2/d7/f8 zero size 2024-04-15T21:02:32.075 INFO:tasks.workunit.client.0.smithi072.stdout:2/85: dread d2/d3/f1a [0,4194304] 0 2024-04-15T21:02:32.076 INFO:tasks.workunit.client.0.smithi072.stdout:9/67: fsync f3 0 2024-04-15T21:02:32.077 INFO:tasks.workunit.client.0.smithi072.stdout:8/79: dwrite f1 [0,4194304] 0 2024-04-15T21:02:32.079 INFO:tasks.workunit.client.0.smithi072.stdout:7/31: creat d2/fa x:0 0 0 2024-04-15T21:02:32.079 INFO:tasks.workunit.client.0.smithi072.stdout:0/44: dwrite d0/d6/ff [0,4194304] 0 2024-04-15T21:02:32.081 INFO:tasks.workunit.client.0.smithi072.stdout:0/45: chown d0/d3/d5/d9/c10 8578758 1 2024-04-15T21:02:32.081 INFO:tasks.workunit.client.0.smithi072.stdout:2/86: rename d2/f9 to d2/d3/f1d 0 2024-04-15T21:02:32.081 INFO:tasks.workunit.client.0.smithi072.stdout:0/46: chown d0/d6 146841175 1 2024-04-15T21:02:32.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/68: creat d4/f12 x:0 0 0 2024-04-15T21:02:32.084 INFO:tasks.workunit.client.0.smithi072.stdout:7/32: mkdir d2/db 0 2024-04-15T21:02:32.085 INFO:tasks.workunit.client.0.smithi072.stdout:3/61: write d1/d7/f9 [2083147,115818] 0 2024-04-15T21:02:32.088 INFO:tasks.workunit.client.0.smithi072.stdout:2/87: unlink d2/c4 0 2024-04-15T21:02:32.091 INFO:tasks.workunit.client.0.smithi072.stdout:0/47: rename d0/fd to d0/d3/d5/f11 0 2024-04-15T21:02:32.092 INFO:tasks.workunit.client.0.smithi072.stdout:0/48: write d0/d6/ff [2366121,63023] 0 2024-04-15T21:02:32.094 INFO:tasks.workunit.client.0.smithi072.stdout:8/80: symlink d3/de/d17/l18 0 2024-04-15T21:02:32.096 INFO:tasks.workunit.client.0.smithi072.stdout:3/62: truncate d1/d7/fb 1036397 0 2024-04-15T21:02:32.098 INFO:tasks.workunit.client.1.smithi149.stdout:1/248: sync 2024-04-15T21:02:32.098 INFO:tasks.workunit.client.1.smithi149.stdout:2/349: sync 2024-04-15T21:02:32.099 INFO:tasks.workunit.client.0.smithi072.stdout:0/49: creat d0/f12 x:0 0 0 2024-04-15T21:02:32.100 INFO:tasks.workunit.client.1.smithi149.stdout:2/350: fsync d4/d7/d10/d6b/d21/d2c/f4b 0 2024-04-15T21:02:32.101 INFO:tasks.workunit.client.0.smithi072.stdout:0/50: chown d0/d3/f8 0 1 2024-04-15T21:02:32.102 INFO:tasks.workunit.client.0.smithi072.stdout:2/88: rename c0 to d2/c1e 0 2024-04-15T21:02:32.103 INFO:tasks.workunit.client.0.smithi072.stdout:2/89: fdatasync d2/d8/f13 0 2024-04-15T21:02:32.105 INFO:tasks.workunit.client.1.smithi149.stdout:1/249: dwrite d1/db/d14/d1e/f1f [0,4194304] 0 2024-04-15T21:02:32.106 INFO:tasks.workunit.client.0.smithi072.stdout:8/81: rename d3/d4/l15 to d3/de/l19 0 2024-04-15T21:02:32.106 INFO:tasks.workunit.client.0.smithi072.stdout:8/82: readlink d3/l10 0 2024-04-15T21:02:32.108 INFO:tasks.workunit.client.0.smithi072.stdout:2/90: creat d2/d3/f1f x:0 0 0 2024-04-15T21:02:32.113 INFO:tasks.workunit.client.0.smithi072.stdout:2/91: dread d2/f12 [0,4194304] 0 2024-04-15T21:02:32.116 INFO:tasks.workunit.client.1.smithi149.stdout:1/250: fsync d1/db/d14/d21/f2a 0 2024-04-15T21:02:32.117 INFO:tasks.workunit.client.1.smithi149.stdout:1/251: chown d1/db/d14/d1e 5584 1 2024-04-15T21:02:32.118 INFO:tasks.workunit.client.0.smithi072.stdout:7/33: truncate d2/f5 1300832 0 2024-04-15T21:02:32.120 INFO:tasks.workunit.client.1.smithi149.stdout:1/252: unlink d1/db/d14/d21/c31 0 2024-04-15T21:02:32.121 INFO:tasks.workunit.client.1.smithi149.stdout:1/253: truncate d1/d17/f41 653640 0 2024-04-15T21:02:32.123 INFO:tasks.workunit.client.0.smithi072.stdout:2/92: dwrite d2/d8/fe [0,4194304] 0 2024-04-15T21:02:32.127 INFO:tasks.workunit.client.0.smithi072.stdout:9/69: dwrite d4/fc [0,4194304] 0 2024-04-15T21:02:32.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/351: dwrite d4/d7/d10/d6b/d21/d3b/f3f [0,4194304] 0 2024-04-15T21:02:32.128 INFO:tasks.workunit.client.1.smithi149.stdout:2/352: dread - d4/d7/d10/d6b/d21/d2c/f4b zero size 2024-04-15T21:02:32.133 INFO:tasks.workunit.client.0.smithi072.stdout:7/34: dwrite d2/fa [0,4194304] 0 2024-04-15T21:02:32.137 INFO:tasks.workunit.client.0.smithi072.stdout:9/70: creat d4/f13 x:0 0 0 2024-04-15T21:02:32.138 INFO:tasks.workunit.client.0.smithi072.stdout:8/83: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:32.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/353: read - d4/d7/d10/d6b/d21/d5e/f40 zero size 2024-04-15T21:02:32.143 INFO:tasks.workunit.client.0.smithi072.stdout:2/93: dread d2/d8/fe [0,4194304] 0 2024-04-15T21:02:32.144 INFO:tasks.workunit.client.0.smithi072.stdout:2/94: chown d2/d3/f1a 1088396 1 2024-04-15T21:02:32.146 INFO:tasks.workunit.client.1.smithi149.stdout:2/354: creat d4/d7/da/f84 x:0 0 0 2024-04-15T21:02:32.147 INFO:tasks.workunit.client.0.smithi072.stdout:2/95: write d2/d3/f1f [828668,95890] 0 2024-04-15T21:02:32.150 INFO:tasks.workunit.client.0.smithi072.stdout:8/84: rename d3/c8 to d3/d4/c1a 0 2024-04-15T21:02:32.152 INFO:tasks.workunit.client.1.smithi149.stdout:2/355: creat d4/d7/f85 x:0 0 0 2024-04-15T21:02:32.152 INFO:tasks.workunit.client.0.smithi072.stdout:9/71: dwrite d4/f11 [0,4194304] 0 2024-04-15T21:02:32.153 INFO:tasks.workunit.client.0.smithi072.stdout:2/96: mknod d2/d3/c20 0 2024-04-15T21:02:32.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/356: write d4/d7/d10/f11 [1243974,86025] 0 2024-04-15T21:02:32.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/72: symlink d4/l14 0 2024-04-15T21:02:32.156 INFO:tasks.workunit.client.0.smithi072.stdout:7/35: dwrite d2/fa [4194304,4194304] 0 2024-04-15T21:02:32.156 INFO:tasks.workunit.client.1.smithi149.stdout:2/357: mknod d4/d7/c86 0 2024-04-15T21:02:32.158 INFO:tasks.workunit.client.0.smithi072.stdout:9/73: chown d4/ld 308161 1 2024-04-15T21:02:32.160 INFO:tasks.workunit.client.0.smithi072.stdout:9/74: chown f3 80303 1 2024-04-15T21:02:32.162 INFO:tasks.workunit.client.0.smithi072.stdout:2/97: dread d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:32.163 INFO:tasks.workunit.client.0.smithi072.stdout:7/36: symlink d2/db/lc 0 2024-04-15T21:02:32.164 INFO:tasks.workunit.client.1.smithi149.stdout:2/358: dwrite d4/d7/d10/d36/f62 [0,4194304] 0 2024-04-15T21:02:32.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/37: write d2/fa [6089068,104815] 0 2024-04-15T21:02:32.169 INFO:tasks.workunit.client.0.smithi072.stdout:9/75: dwrite d4/f12 [0,4194304] 0 2024-04-15T21:02:32.170 INFO:tasks.workunit.client.0.smithi072.stdout:2/98: symlink d2/d8/l21 0 2024-04-15T21:02:32.170 INFO:tasks.workunit.client.0.smithi072.stdout:9/76: chown d4/f13 210 1 2024-04-15T21:02:32.172 INFO:tasks.workunit.client.0.smithi072.stdout:9/77: write d4/f13 [223857,72438] 0 2024-04-15T21:02:32.172 INFO:tasks.workunit.client.0.smithi072.stdout:7/38: dread d2/fa [4194304,4194304] 0 2024-04-15T21:02:32.173 INFO:tasks.workunit.client.0.smithi072.stdout:2/99: fdatasync d2/d8/fe 0 2024-04-15T21:02:32.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/39: chown d2/c3 507 1 2024-04-15T21:02:32.175 INFO:tasks.workunit.client.0.smithi072.stdout:2/100: truncate d2/d8/f13 677501 0 2024-04-15T21:02:32.175 INFO:tasks.workunit.client.0.smithi072.stdout:7/40: rename d2/d7 to d2/d7/dd 22 2024-04-15T21:02:32.177 INFO:tasks.workunit.client.0.smithi072.stdout:9/78: dread d4/f11 [0,4194304] 0 2024-04-15T21:02:32.177 INFO:tasks.workunit.client.0.smithi072.stdout:9/79: rename d4 to d4/d15 22 2024-04-15T21:02:32.179 INFO:tasks.workunit.client.1.smithi149.stdout:2/359: dwrite d4/d7/d10/d6b/d21/d3b/f7f [0,4194304] 0 2024-04-15T21:02:32.182 INFO:tasks.workunit.client.0.smithi072.stdout:7/41: mknod d2/db/ce 0 2024-04-15T21:02:32.187 INFO:tasks.workunit.client.0.smithi072.stdout:9/80: mknod d4/c16 0 2024-04-15T21:02:32.188 INFO:tasks.workunit.client.0.smithi072.stdout:9/81: truncate d4/f7 5014451 0 2024-04-15T21:02:32.196 INFO:tasks.workunit.client.0.smithi072.stdout:9/82: dwrite f3 [0,4194304] 0 2024-04-15T21:02:32.198 INFO:tasks.workunit.client.0.smithi072.stdout:9/83: write d4/f11 [3623687,29618] 0 2024-04-15T21:02:32.199 INFO:tasks.workunit.client.0.smithi072.stdout:5/46: sync 2024-04-15T21:02:32.199 INFO:tasks.workunit.client.0.smithi072.stdout:9/84: truncate d4/f12 4413196 0 2024-04-15T21:02:32.201 INFO:tasks.workunit.client.0.smithi072.stdout:5/47: unlink d0/f9 0 2024-04-15T21:02:32.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/48: fsync d0/fa 0 2024-04-15T21:02:32.203 INFO:tasks.workunit.client.0.smithi072.stdout:9/85: mkdir d4/d17 0 2024-04-15T21:02:32.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/86: symlink d4/l18 0 2024-04-15T21:02:32.211 INFO:tasks.workunit.client.0.smithi072.stdout:7/42: write d2/fa [9427399,129377] 0 2024-04-15T21:02:32.211 INFO:tasks.workunit.client.0.smithi072.stdout:9/87: read d4/f13 [24856,31321] 0 2024-04-15T21:02:32.211 INFO:tasks.workunit.client.0.smithi072.stdout:5/49: dwrite d0/fa [0,4194304] 0 2024-04-15T21:02:32.211 INFO:tasks.workunit.client.0.smithi072.stdout:9/88: chown d4/cb 32461 1 2024-04-15T21:02:32.212 INFO:tasks.workunit.client.0.smithi072.stdout:5/50: readlink d0/d3/d7/lb 0 2024-04-15T21:02:32.212 INFO:tasks.workunit.client.0.smithi072.stdout:5/51: chown d0/d3/d7 5979 1 2024-04-15T21:02:32.212 INFO:tasks.workunit.client.0.smithi072.stdout:7/43: creat d2/db/ff x:0 0 0 2024-04-15T21:02:32.213 INFO:tasks.workunit.client.0.smithi072.stdout:5/52: readlink d0/d3/d7/lb 0 2024-04-15T21:02:32.213 INFO:tasks.workunit.client.1.smithi149.stdout:9/288: sync 2024-04-15T21:02:32.213 INFO:tasks.workunit.client.0.smithi072.stdout:5/53: chown d0/d3/d6 490873 1 2024-04-15T21:02:32.214 INFO:tasks.workunit.client.0.smithi072.stdout:9/89: rename d4/ld to d4/l19 0 2024-04-15T21:02:32.215 INFO:tasks.workunit.client.0.smithi072.stdout:7/44: mkdir d2/d10 0 2024-04-15T21:02:32.216 INFO:tasks.workunit.client.0.smithi072.stdout:9/90: write d4/fc [3940896,64943] 0 2024-04-15T21:02:32.217 INFO:tasks.workunit.client.1.smithi149.stdout:9/289: readlink d23/l42 0 2024-04-15T21:02:32.217 INFO:tasks.workunit.client.0.smithi072.stdout:9/91: write d4/f11 [56108,7306] 0 2024-04-15T21:02:32.219 INFO:tasks.workunit.client.1.smithi149.stdout:2/360: dread d4/d7/f31 [0,4194304] 0 2024-04-15T21:02:32.219 INFO:tasks.workunit.client.0.smithi072.stdout:2/101: rmdir d2 39 2024-04-15T21:02:32.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/290: creat d23/d2b/d44/f5b x:0 0 0 2024-04-15T21:02:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.232+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83f0104df0 con 0x7f83d806d7e0 2024-04-15T21:02:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.233+0000 7f83ecff9700 1 -- 172.21.15.72:0/2963595038 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f83f0104df0 con 0x7f83d806d7e0 2024-04-15T21:02:32.226 INFO:tasks.workunit.client.1.smithi149.stdout:2/361: dwrite d4/d7/da/f1c [0,4194304] 0 2024-04-15T21:02:32.227 INFO:tasks.workunit.client.0.smithi072.stdout:9/92: symlink d4/l1a 0 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 msgr2=0x7f83d806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 0x7f83d806fc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f83e0006010 tx=0x7f83e000b560 comp rx=0 tx=0).stop 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 msgr2=0x7f83f0194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83e400d8d0 tx=0x7f83e400dbe0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 shutdown_connections 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f83d806d7e0 0x7f83d806fc90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83f0100740 0x7f83f0194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 --2- 172.21.15.72:0/2963595038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f0101090 0x7f83f0194f50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 >> 172.21.15.72:0/2963595038 conn(0x7f83f00f9f10 msgr2=0x7f83f01036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 shutdown_connections 2024-04-15T21:02:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.236+0000 7f83f60a2700 1 -- 172.21.15.72:0/2963595038 wait complete. 2024-04-15T21:02:32.230 INFO:tasks.workunit.client.0.smithi072.stdout:5/54: read d0/d3/f4 [972844,19350] 0 2024-04-15T21:02:32.231 INFO:tasks.workunit.client.0.smithi072.stdout:5/55: write d0/fa [3827277,8321] 0 2024-04-15T21:02:32.234 INFO:tasks.workunit.client.0.smithi072.stdout:7/45: creat d2/d10/f11 x:0 0 0 2024-04-15T21:02:32.235 INFO:tasks.workunit.client.1.smithi149.stdout:9/291: unlink d23/f43 0 2024-04-15T21:02:32.235 INFO:tasks.workunit.client.0.smithi072.stdout:9/93: dwrite f3 [0,4194304] 0 2024-04-15T21:02:32.235 INFO:tasks.workunit.client.0.smithi072.stdout:7/46: stat d2/d7/l9 0 2024-04-15T21:02:32.240 INFO:tasks.workunit.client.1.smithi149.stdout:9/292: creat d23/d2b/d44/f5c x:0 0 0 2024-04-15T21:02:32.241 INFO:tasks.workunit.client.0.smithi072.stdout:7/47: dread d2/fa [0,4194304] 0 2024-04-15T21:02:32.242 INFO:tasks.workunit.client.0.smithi072.stdout:2/102: symlink d2/d8/l22 0 2024-04-15T21:02:32.243 INFO:tasks.workunit.client.1.smithi149.stdout:9/293: read d23/d2b/f41 [234226,20028] 0 2024-04-15T21:02:32.243 INFO:tasks.workunit.client.0.smithi072.stdout:2/103: truncate d2/d3/f17 524726 0 2024-04-15T21:02:32.247 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:02:32.251 INFO:tasks.workunit.client.0.smithi072.stdout:7/48: rmdir d2/db 39 2024-04-15T21:02:32.251 INFO:tasks.workunit.client.0.smithi072.stdout:7/49: fsync d2/d7/f8 0 2024-04-15T21:02:32.254 INFO:tasks.workunit.client.0.smithi072.stdout:9/94: link d4/f12 d4/f1b 0 2024-04-15T21:02:32.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/95: write d4/fc [1476263,109927] 0 2024-04-15T21:02:32.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/96: chown d4 6 1 2024-04-15T21:02:32.257 INFO:tasks.workunit.client.0.smithi072.stdout:2/104: mkdir d2/d3/d23 0 2024-04-15T21:02:32.257 INFO:tasks.workunit.client.1.smithi149.stdout:2/362: dwrite d4/f18 [0,4194304] 0 2024-04-15T21:02:32.259 INFO:tasks.workunit.client.0.smithi072.stdout:7/50: fsync d2/db/ff 0 2024-04-15T21:02:32.261 INFO:tasks.workunit.client.0.smithi072.stdout:7/51: truncate d2/d7/f8 789461 0 2024-04-15T21:02:32.263 INFO:tasks.workunit.client.0.smithi072.stdout:2/105: dwrite d2/d8/fe [0,4194304] 0 2024-04-15T21:02:32.264 INFO:tasks.workunit.client.0.smithi072.stdout:9/97: write d4/f13 [1014735,94455] 0 2024-04-15T21:02:32.273 INFO:tasks.workunit.client.0.smithi072.stdout:2/106: rmdir d2 39 2024-04-15T21:02:32.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/294: dread f1f [0,4194304] 0 2024-04-15T21:02:32.278 INFO:tasks.workunit.client.1.smithi149.stdout:2/363: creat d4/d7/d46/d74/f87 x:0 0 0 2024-04-15T21:02:32.279 INFO:tasks.workunit.client.1.smithi149.stdout:2/364: write d4/d7/d29/f4f [1163239,77217] 0 2024-04-15T21:02:32.283 INFO:tasks.workunit.client.1.smithi149.stdout:9/295: dwrite f4 [4194304,4194304] 0 2024-04-15T21:02:32.284 INFO:tasks.workunit.client.0.smithi072.stdout:6/59: sync 2024-04-15T21:02:32.284 INFO:tasks.workunit.client.0.smithi072.stdout:4/45: sync 2024-04-15T21:02:32.284 INFO:tasks.workunit.client.0.smithi072.stdout:1/35: sync 2024-04-15T21:02:32.286 INFO:tasks.workunit.client.0.smithi072.stdout:9/98: dwrite d4/f12 [4194304,4194304] 0 2024-04-15T21:02:32.286 INFO:tasks.workunit.client.0.smithi072.stdout:7/52: creat d2/f12 x:0 0 0 2024-04-15T21:02:32.287 INFO:tasks.workunit.client.0.smithi072.stdout:5/56: fdatasync d0/d3/d6/f8 0 2024-04-15T21:02:32.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/53: read d2/d7/f8 [260779,38762] 0 2024-04-15T21:02:32.290 INFO:tasks.workunit.client.1.smithi149.stdout:2/365: creat d4/d7/d10/d6b/d21/d2c/d32/d4a/f88 x:0 0 0 2024-04-15T21:02:32.292 INFO:tasks.workunit.client.0.smithi072.stdout:4/46: mkdir d7/d10 0 2024-04-15T21:02:32.293 INFO:tasks.workunit.client.0.smithi072.stdout:1/36: unlink d5/f7 0 2024-04-15T21:02:32.294 INFO:tasks.workunit.client.0.smithi072.stdout:2/107: write d2/d3/f1d [3339800,81649] 0 2024-04-15T21:02:32.295 INFO:tasks.workunit.client.1.smithi149.stdout:2/366: symlink d4/l89 0 2024-04-15T21:02:32.296 INFO:tasks.workunit.client.0.smithi072.stdout:6/60: dread d2/fb [0,4194304] 0 2024-04-15T21:02:32.298 INFO:tasks.workunit.client.1.smithi149.stdout:9/296: getdents d23/d2b 0 2024-04-15T21:02:32.300 INFO:tasks.workunit.client.0.smithi072.stdout:5/57: dread - d0/d3/d6/f8 zero size 2024-04-15T21:02:32.301 INFO:tasks.workunit.client.0.smithi072.stdout:9/99: dwrite d4/f5 [0,4194304] 0 2024-04-15T21:02:32.301 INFO:tasks.workunit.client.1.smithi149.stdout:2/367: symlink d4/d7/d10/d6b/l8a 0 2024-04-15T21:02:32.304 INFO:tasks.workunit.client.0.smithi072.stdout:7/54: creat d2/d10/f13 x:0 0 0 2024-04-15T21:02:32.305 INFO:tasks.workunit.client.1.smithi149.stdout:9/297: dwrite f17 [0,4194304] 0 2024-04-15T21:02:32.306 INFO:tasks.workunit.client.0.smithi072.stdout:7/55: fsync d2/d10/f11 0 2024-04-15T21:02:32.307 INFO:tasks.workunit.client.0.smithi072.stdout:7/56: chown d2/d7/f8 7146 1 2024-04-15T21:02:32.308 INFO:tasks.workunit.client.0.smithi072.stdout:9/100: dwrite d4/f11 [0,4194304] 0 2024-04-15T21:02:32.308 INFO:tasks.workunit.client.0.smithi072.stdout:7/57: read - d2/db/ff zero size 2024-04-15T21:02:32.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/368: unlink d4/d7/d10/d6b/d21/d3b/f41 0 2024-04-15T21:02:32.317 INFO:tasks.workunit.client.1.smithi149.stdout:2/369: dread d4/d7/f31 [0,4194304] 0 2024-04-15T21:02:32.318 INFO:tasks.workunit.client.1.smithi149.stdout:2/370: chown d4/l6e 10 1 2024-04-15T21:02:32.321 INFO:tasks.workunit.client.0.smithi072.stdout:2/108: truncate d2/f12 809926 0 2024-04-15T21:02:32.325 INFO:tasks.workunit.client.1.smithi149.stdout:9/298: unlink d23/d46/l55 0 2024-04-15T21:02:32.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/299: dwrite d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:32.337 INFO:tasks.workunit.client.1.smithi149.stdout:0/455: sync 2024-04-15T21:02:32.338 INFO:tasks.workunit.client.1.smithi149.stdout:0/456: stat d1/d5/dc/c34 0 2024-04-15T21:02:32.372 INFO:tasks.workunit.client.0.smithi072.stdout:5/58: truncate d0/d3/d6/f8 827653 0 2024-04-15T21:02:32.374 INFO:tasks.workunit.client.1.smithi149.stdout:0/457: mknod d1/d9/d64/d73/c9f 0 2024-04-15T21:02:32.375 INFO:tasks.workunit.client.1.smithi149.stdout:0/458: fdatasync d1/d5/d24/d50/d13/d38/d44/d61/f8f 0 2024-04-15T21:02:32.381 INFO:tasks.workunit.client.0.smithi072.stdout:9/101: unlink d4/f12 0 2024-04-15T21:02:32.381 INFO:tasks.workunit.client.0.smithi072.stdout:4/47: getdents d7/d10 0 2024-04-15T21:02:32.382 INFO:tasks.workunit.client.0.smithi072.stdout:4/48: readlink l4 0 2024-04-15T21:02:32.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/459: symlink d1/d5/dc/la0 0 2024-04-15T21:02:32.384 INFO:tasks.workunit.client.1.smithi149.stdout:0/460: read d1/d5/d24/d30/d43/f75 [54060,43345] 0 2024-04-15T21:02:32.385 INFO:tasks.workunit.client.0.smithi072.stdout:2/109: rename d2/d3/f1a to d2/d3/d23/f24 0 2024-04-15T21:02:32.387 INFO:tasks.workunit.client.0.smithi072.stdout:6/61: mkdir d2/d10/d11 0 2024-04-15T21:02:32.387 INFO:tasks.workunit.client.0.smithi072.stdout:6/62: stat d2/d10/d11 0 2024-04-15T21:02:32.388 INFO:tasks.workunit.client.0.smithi072.stdout:6/63: fdatasync d2/f4 0 2024-04-15T21:02:32.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/63: sync 2024-04-15T21:02:32.393 INFO:tasks.workunit.client.0.smithi072.stdout:8/85: sync 2024-04-15T21:02:32.394 INFO:tasks.workunit.client.0.smithi072.stdout:0/51: sync 2024-04-15T21:02:32.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/461: dread d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:32.394 INFO:tasks.workunit.client.0.smithi072.stdout:8/86: fdatasync f1 0 2024-04-15T21:02:32.395 INFO:tasks.workunit.client.0.smithi072.stdout:0/52: dread - d0/d3/d5/f11 zero size 2024-04-15T21:02:32.395 INFO:tasks.workunit.client.0.smithi072.stdout:9/102: creat d4/f1c x:0 0 0 2024-04-15T21:02:32.396 INFO:tasks.workunit.client.0.smithi072.stdout:8/87: readlink d3/d4/l14 0 2024-04-15T21:02:32.397 INFO:tasks.workunit.client.0.smithi072.stdout:0/53: write d0/f12 [677145,5317] 0 2024-04-15T21:02:32.397 INFO:tasks.workunit.client.0.smithi072.stdout:4/49: chown f6 257 1 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 -- 172.21.15.72:0/2862952776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc601003d0 msgr2=0x7fbc60100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2862952776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc601003d0 0x7fbc60100840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009910 tx=0x7fbc54009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 -- 172.21.15.72:0/2862952776 shutdown_connections 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2862952776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc601003d0 0x7fbc60100840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2862952776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc600ff130 0x7fbc600ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.406+0000 7fbc657e6700 1 -- 172.21.15.72:0/2862952776 >> 172.21.15.72:0/2862952776 conn(0x7fbc600fa780 msgr2=0x7fbc600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:32.399 INFO:tasks.workunit.client.0.smithi072.stdout:8/88: stat f1 0 2024-04-15T21:02:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.407+0000 7fbc657e6700 1 -- 172.21.15.72:0/2862952776 shutdown_connections 2024-04-15T21:02:32.400 INFO:tasks.workunit.client.0.smithi072.stdout:4/50: write f3 [119809,6069] 0 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.407+0000 7fbc657e6700 1 -- 172.21.15.72:0/2862952776 wait complete. 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 Processor -- start 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 -- start start 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 0x7fbc6010eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 0x7fbc6010f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6010f620 con 0x7fbc601003d0 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.408+0000 7fbc657e6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6010f760 con 0x7fbc600ff130 2024-04-15T21:02:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.409+0000 7fbc5e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 0x7fbc6010f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.410+0000 7fbc5e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 0x7fbc6010f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42138/0 (socket says 172.21.15.72:42138) 2024-04-15T21:02:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.410+0000 7fbc5e7fc700 1 -- 172.21.15.72:0/2539596064 learned_addr learned my addr 172.21.15.72:0/2539596064 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.410+0000 7fbc5effd700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 0x7fbc6010eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.411+0000 7fbc5effd700 1 -- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 msgr2=0x7fbc6010f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.411+0000 7fbc5effd700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 0x7fbc6010f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.411+0000 7fbc5effd700 1 -- 172.21.15.72:0/2539596064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540095f0 con 0x7fbc600ff130 2024-04-15T21:02:32.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.411+0000 7fbc5effd700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 0x7fbc6010eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e970 tx=0x7fbc5000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.411+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5000cba0 con 0x7fbc600ff130 2024-04-15T21:02:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.412+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc5000cd00 con 0x7fbc600ff130 2024-04-15T21:02:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.412+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc50018770 con 0x7fbc600ff130 2024-04-15T21:02:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.412+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60114210 con 0x7fbc600ff130 2024-04-15T21:02:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.412+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc601aa490 con 0x7fbc600ff130 2024-04-15T21:02:32.405 INFO:tasks.workunit.client.0.smithi072.stdout:6/64: rename d2/cd to d2/d10/c12 0 2024-04-15T21:02:32.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.413+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60106ae0 con 0x7fbc600ff130 2024-04-15T21:02:32.406 INFO:tasks.workunit.client.0.smithi072.stdout:4/51: stat d7/ld 0 2024-04-15T21:02:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.414+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7fbc50010430 con 0x7fbc600ff130 2024-04-15T21:02:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.414+0000 7fbc47fff700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 0x7fbc4806fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.414+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbc50014070 con 0x7fbc600ff130 2024-04-15T21:02:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.415+0000 7fbc5e7fc700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 0x7fbc4806fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.415+0000 7fbc5e7fc700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 0x7fbc4806fd30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b650 tx=0x7fbc5400b5e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:32.411 INFO:tasks.workunit.client.0.smithi072.stdout:5/59: chown d0/d3/d6/f8 11471132 1 2024-04-15T21:02:32.411 INFO:tasks.workunit.client.0.smithi072.stdout:7/58: creat d2/f14 x:0 0 0 2024-04-15T21:02:32.412 INFO:tasks.workunit.client.0.smithi072.stdout:4/52: readlink l4 0 2024-04-15T21:02:32.412 INFO:tasks.workunit.client.0.smithi072.stdout:8/89: dwrite f1 [0,4194304] 0 2024-04-15T21:02:32.412 INFO:tasks.workunit.client.0.smithi072.stdout:7/59: stat d2/db/lc 0 2024-04-15T21:02:32.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/103: unlink d4/l19 0 2024-04-15T21:02:32.415 INFO:tasks.workunit.client.0.smithi072.stdout:4/53: unlink d7/ld 0 2024-04-15T21:02:32.416 INFO:tasks.workunit.client.0.smithi072.stdout:7/60: fsync d2/f12 0 2024-04-15T21:02:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.423+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbc50051720 con 0x7fbc600ff130 2024-04-15T21:02:32.416 INFO:tasks.workunit.client.0.smithi072.stdout:2/110: dwrite d2/d8/f1c [0,4194304] 0 2024-04-15T21:02:32.417 INFO:tasks.workunit.client.0.smithi072.stdout:6/65: truncate d2/fa 346833 0 2024-04-15T21:02:32.424 INFO:tasks.workunit.client.0.smithi072.stdout:2/111: read f1 [4176523,46882] 0 2024-04-15T21:02:32.427 INFO:tasks.workunit.client.0.smithi072.stdout:3/64: dwrite d1/f10 [0,4194304] 0 2024-04-15T21:02:32.430 INFO:tasks.workunit.client.0.smithi072.stdout:8/90: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:32.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/462: dwrite d1/f82 [0,4194304] 0 2024-04-15T21:02:32.434 INFO:tasks.workunit.client.0.smithi072.stdout:9/104: mknod d4/d17/c1d 0 2024-04-15T21:02:32.434 INFO:tasks.workunit.client.0.smithi072.stdout:8/91: write d3/ff [1998551,120947] 0 2024-04-15T21:02:32.434 INFO:tasks.workunit.client.0.smithi072.stdout:6/66: dread d2/fb [0,4194304] 0 2024-04-15T21:02:32.435 INFO:tasks.workunit.client.0.smithi072.stdout:5/60: truncate d0/d3/f4 2962821 0 2024-04-15T21:02:32.436 INFO:tasks.workunit.client.0.smithi072.stdout:9/105: dread - d4/f1c zero size 2024-04-15T21:02:32.437 INFO:tasks.workunit.client.0.smithi072.stdout:6/67: read d2/f4 [2202195,99336] 0 2024-04-15T21:02:32.437 INFO:tasks.workunit.client.0.smithi072.stdout:1/37: sync 2024-04-15T21:02:32.438 INFO:tasks.workunit.client.1.smithi149.stdout:0/463: dwrite d1/d5/d24/d30/f93 [0,4194304] 0 2024-04-15T21:02:32.438 INFO:tasks.workunit.client.0.smithi072.stdout:6/68: stat d2/d10 0 2024-04-15T21:02:32.444 INFO:tasks.workunit.client.1.smithi149.stdout:0/464: unlink d1/d5/d24/d50/f72 0 2024-04-15T21:02:32.450 INFO:tasks.workunit.client.1.smithi149.stdout:0/465: fdatasync d1/d5/d24/d50/d13/d59/f66 0 2024-04-15T21:02:32.454 INFO:tasks.workunit.client.1.smithi149.stdout:0/466: write d1/d5/d24/d50/f2a [2960887,77812] 0 2024-04-15T21:02:32.466 INFO:tasks.workunit.client.1.smithi149.stdout:9/300: mknod d23/c5d 0 2024-04-15T21:02:32.468 INFO:tasks.workunit.client.1.smithi149.stdout:9/301: chown d23/c2a 2495739 1 2024-04-15T21:02:32.473 INFO:tasks.workunit.client.1.smithi149.stdout:9/302: dwrite f1f [0,4194304] 0 2024-04-15T21:02:32.474 INFO:tasks.workunit.client.1.smithi149.stdout:3/332: sync 2024-04-15T21:02:32.474 INFO:tasks.workunit.client.1.smithi149.stdout:4/353: sync 2024-04-15T21:02:32.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/369: sync 2024-04-15T21:02:32.477 INFO:tasks.workunit.client.1.smithi149.stdout:4/354: write dc/d2c/d3e/d35/d3a/f65 [14123,86539] 0 2024-04-15T21:02:32.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/355: chown dc/d2c/d3e/d35/d4b/l4c 3127 1 2024-04-15T21:02:32.484 INFO:tasks.workunit.client.0.smithi072.stdout:1/38: read - d5/f6 zero size 2024-04-15T21:02:32.484 INFO:tasks.workunit.client.1.smithi149.stdout:4/356: fsync dc/d2c/d3e/d15/f34 0 2024-04-15T21:02:32.484 INFO:tasks.workunit.client.1.smithi149.stdout:9/303: chown d23/l38 1 1 2024-04-15T21:02:32.485 INFO:tasks.workunit.client.1.smithi149.stdout:4/357: read - dc/d1a/f4e zero size 2024-04-15T21:02:32.488 INFO:tasks.workunit.client.1.smithi149.stdout:3/333: dwrite d1/db/d23/f49 [0,4194304] 0 2024-04-15T21:02:32.490 INFO:tasks.workunit.client.1.smithi149.stdout:8/370: dwrite d2/df/d10/d20/f4b [0,4194304] 0 2024-04-15T21:02:32.505 INFO:tasks.workunit.client.0.smithi072.stdout:1/39: rmdir d5/db 39 2024-04-15T21:02:32.506 INFO:tasks.workunit.client.1.smithi149.stdout:8/371: mknod d2/df/d10/d25/d32/c87 0 2024-04-15T21:02:32.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/40: write d5/fa [4255239,36759] 0 2024-04-15T21:02:32.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/41: truncate d5/fa 4475848 0 2024-04-15T21:02:32.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/42: chown d5 256761571 1 2024-04-15T21:02:32.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/43: chown d5/fa 107050343 1 2024-04-15T21:02:32.512 INFO:tasks.workunit.client.1.smithi149.stdout:8/372: mknod d2/df/d10/d25/c88 0 2024-04-15T21:02:32.513 INFO:tasks.workunit.client.1.smithi149.stdout:8/373: write d2/df/d10/d25/d32/d45/f5e [4944466,50505] 0 2024-04-15T21:02:32.514 INFO:tasks.workunit.client.0.smithi072.stdout:1/44: read d5/f8 [89377,51637] 0 2024-04-15T21:02:32.515 INFO:tasks.workunit.client.1.smithi149.stdout:2/371: rename d4/l89 to d4/d7/d10/d6b/d21/d2c/d58/l8b 0 2024-04-15T21:02:32.516 INFO:tasks.workunit.client.1.smithi149.stdout:0/467: rename d1/d5/d24/d50 to d1/d5/d24/d50/d13/da1 22 2024-04-15T21:02:32.524 INFO:tasks.workunit.client.0.smithi072.stdout:1/45: creat d5/fe x:0 0 0 2024-04-15T21:02:32.524 INFO:tasks.workunit.client.1.smithi149.stdout:9/304: dread f1d [0,4194304] 0 2024-04-15T21:02:32.527 INFO:tasks.workunit.client.1.smithi149.stdout:2/372: truncate d4/d7/d10/d36/f83 4927733 0 2024-04-15T21:02:32.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/69: dread d2/fa [0,4194304] 0 2024-04-15T21:02:32.530 INFO:tasks.workunit.client.0.smithi072.stdout:1/46: dwrite d5/fe [0,4194304] 0 2024-04-15T21:02:32.530 INFO:tasks.workunit.client.1.smithi149.stdout:8/374: link d2/la d2/df/d10/d25/d37/d53/d76/d85/l89 0 2024-04-15T21:02:32.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/334: unlink d1/f57 0 2024-04-15T21:02:32.535 INFO:tasks.workunit.client.1.smithi149.stdout:3/335: write d1/db/d24/d2b/f22 [5871157,63488] 0 2024-04-15T21:02:32.536 INFO:tasks.workunit.client.0.smithi072.stdout:6/70: mknod d2/c13 0 2024-04-15T21:02:32.539 INFO:tasks.workunit.client.0.smithi072.stdout:1/47: read - d5/db/fc zero size 2024-04-15T21:02:32.540 INFO:tasks.workunit.client.0.smithi072.stdout:1/48: dread d5/f8 [0,4194304] 0 2024-04-15T21:02:32.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/71: creat d2/f14 x:0 0 0 2024-04-15T21:02:32.542 INFO:tasks.workunit.client.0.smithi072.stdout:5/61: fsync d0/d3/f4 0 2024-04-15T21:02:32.544 INFO:tasks.workunit.client.0.smithi072.stdout:3/65: write d1/f4 [719923,83099] 0 2024-04-15T21:02:32.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/468: link d1/l33 d1/d5/d24/d50/d13/d59/la2 0 2024-04-15T21:02:32.547 INFO:tasks.workunit.client.1.smithi149.stdout:3/336: creat d1/db/d24/d39/f61 x:0 0 0 2024-04-15T21:02:32.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/305: link l20 d23/d2b/l5e 0 2024-04-15T21:02:32.551 INFO:tasks.workunit.client.0.smithi072.stdout:1/49: mknod d5/cf 0 2024-04-15T21:02:32.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/469: mkdir d1/d9/d64/d73/da3 0 2024-04-15T21:02:32.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/470: stat d1/d5/d24/d30/d92 0 2024-04-15T21:02:32.554 INFO:tasks.workunit.client.0.smithi072.stdout:3/66: rename d1/d7/f12 to d1/d7/f13 0 2024-04-15T21:02:32.554 INFO:tasks.workunit.client.0.smithi072.stdout:0/54: rename d0/d3/fc to d0/f13 0 2024-04-15T21:02:32.557 INFO:tasks.workunit.client.1.smithi149.stdout:3/337: rename d1/db/c34 to d1/db/d23/c62 0 2024-04-15T21:02:32.557 INFO:tasks.workunit.client.1.smithi149.stdout:9/306: truncate d23/d2b/f32 995674 0 2024-04-15T21:02:32.559 INFO:tasks.workunit.client.0.smithi072.stdout:5/62: mknod d0/d3/d7/ce 0 2024-04-15T21:02:32.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/471: symlink d1/d29/d2c/d4f/la4 0 2024-04-15T21:02:32.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/472: stat d1/d5 0 2024-04-15T21:02:32.561 INFO:tasks.workunit.client.1.smithi149.stdout:0/473: chown d1/d5/d24/d30/d43/l8b 0 1 2024-04-15T21:02:32.561 INFO:tasks.workunit.client.0.smithi072.stdout:1/50: mkdir d5/db/d10 0 2024-04-15T21:02:32.562 INFO:tasks.workunit.client.1.smithi149.stdout:0/474: fdatasync d1/d5/d24/d50/d13/d38/f68 0 2024-04-15T21:02:32.562 INFO:tasks.workunit.client.0.smithi072.stdout:8/92: truncate f1 3205989 0 2024-04-15T21:02:32.562 INFO:tasks.workunit.client.0.smithi072.stdout:5/63: dread d0/fa [0,4194304] 0 2024-04-15T21:02:32.562 INFO:tasks.workunit.client.0.smithi072.stdout:1/51: chown c0 59768 1 2024-04-15T21:02:32.566 INFO:tasks.workunit.client.0.smithi072.stdout:3/67: read d1/fa [84715,80367] 0 2024-04-15T21:02:32.566 INFO:tasks.workunit.client.0.smithi072.stdout:2/112: rmdir d2/d8 39 2024-04-15T21:02:32.566 INFO:tasks.workunit.client.0.smithi072.stdout:8/93: dread d3/de/f13 [0,4194304] 0 2024-04-15T21:02:32.567 INFO:tasks.workunit.client.0.smithi072.stdout:0/55: creat d0/f14 x:0 0 0 2024-04-15T21:02:32.568 INFO:tasks.workunit.client.0.smithi072.stdout:8/94: fdatasync d3/ff 0 2024-04-15T21:02:32.569 INFO:tasks.workunit.client.0.smithi072.stdout:4/54: rename d7/f8 to d7/d10/f11 0 2024-04-15T21:02:32.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/307: symlink d23/l5f 0 2024-04-15T21:02:32.571 INFO:tasks.workunit.client.0.smithi072.stdout:5/64: dwrite d0/fa [4194304,4194304] 0 2024-04-15T21:02:32.574 INFO:tasks.workunit.client.0.smithi072.stdout:1/52: unlink d5/fa 0 2024-04-15T21:02:32.578 INFO:tasks.workunit.client.0.smithi072.stdout:0/56: dwrite d0/f12 [0,4194304] 0 2024-04-15T21:02:32.578 INFO:tasks.workunit.client.1.smithi149.stdout:9/308: dread d23/d46/f49 [4194304,4194304] 0 2024-04-15T21:02:32.579 INFO:tasks.workunit.client.0.smithi072.stdout:3/68: fdatasync d1/f6 0 2024-04-15T21:02:32.580 INFO:tasks.workunit.client.1.smithi149.stdout:0/475: link d1/d29/c4d d1/ca5 0 2024-04-15T21:02:32.581 INFO:tasks.workunit.client.0.smithi072.stdout:2/113: rmdir d2/d3/d23 39 2024-04-15T21:02:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:9/309: fsync f1d 0 2024-04-15T21:02:32.582 INFO:tasks.workunit.client.0.smithi072.stdout:3/69: write d1/f10 [2603699,96351] 0 2024-04-15T21:02:32.583 INFO:tasks.workunit.client.1.smithi149.stdout:4/358: write dc/d2c/d3e/d35/d3a/f40 [1908380,42251] 0 2024-04-15T21:02:32.585 INFO:tasks.workunit.client.1.smithi149.stdout:9/310: rmdir d23/d2b 39 2024-04-15T21:02:32.585 INFO:tasks.workunit.client.1.smithi149.stdout:9/311: chown f17 68652 1 2024-04-15T21:02:32.586 INFO:tasks.workunit.client.1.smithi149.stdout:9/312: write f1f [4580374,94985] 0 2024-04-15T21:02:32.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/359: dread dc/d2c/d3e/d15/d5b/f71 [0,4194304] 0 2024-04-15T21:02:32.588 INFO:tasks.workunit.client.0.smithi072.stdout:9/106: dwrite d4/f1b [4194304,4194304] 0 2024-04-15T21:02:32.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/476: mknod d1/d5/d24/d50/d15/d86/ca6 0 2024-04-15T21:02:32.590 INFO:tasks.workunit.client.1.smithi149.stdout:0/477: fsync d1/d5/d24/d50/d13/d38/d71/f80 0 2024-04-15T21:02:32.591 INFO:tasks.workunit.client.1.smithi149.stdout:4/360: dread fa [0,4194304] 0 2024-04-15T21:02:32.592 INFO:tasks.workunit.client.1.smithi149.stdout:0/478: truncate d1/d9/d64/d73/f91 157258 0 2024-04-15T21:02:32.592 INFO:tasks.workunit.client.1.smithi149.stdout:0/479: chown d1/d9/f19 30494 1 2024-04-15T21:02:32.594 INFO:tasks.workunit.client.1.smithi149.stdout:0/480: write d1/d5/d24/d50/d13/d38/d71/f87 [166611,3955] 0 2024-04-15T21:02:32.600 INFO:tasks.workunit.client.0.smithi072.stdout:4/55: rename d7/ff to d7/f12 0 2024-04-15T21:02:32.607 INFO:tasks.workunit.client.0.smithi072.stdout:5/65: fdatasync d0/d3/f4 0 2024-04-15T21:02:32.608 INFO:tasks.workunit.client.0.smithi072.stdout:6/72: write d2/fb [4783254,53493] 0 2024-04-15T21:02:32.609 INFO:tasks.workunit.client.1.smithi149.stdout:0/481: creat d1/d29/fa7 x:0 0 0 2024-04-15T21:02:32.609 INFO:tasks.workunit.client.0.smithi072.stdout:5/66: readlink d0/d3/d7/lb 0 2024-04-15T21:02:32.609 INFO:tasks.workunit.client.0.smithi072.stdout:5/67: stat d0 0 2024-04-15T21:02:32.609 INFO:tasks.workunit.client.1.smithi149.stdout:2/373: dwrite d4/d7/d10/d6b/f56 [0,4194304] 0 2024-04-15T21:02:32.611 INFO:tasks.workunit.client.0.smithi072.stdout:1/53: unlink c2 0 2024-04-15T21:02:32.614 INFO:tasks.workunit.client.0.smithi072.stdout:6/73: dread d2/f4 [0,4194304] 0 2024-04-15T21:02:32.615 INFO:tasks.workunit.client.0.smithi072.stdout:5/68: dread d0/fa [0,4194304] 0 2024-04-15T21:02:32.615 INFO:tasks.workunit.client.0.smithi072.stdout:5/69: stat d0/d3 0 2024-04-15T21:02:32.616 INFO:tasks.workunit.client.0.smithi072.stdout:0/57: unlink d0/d3/d5/d9/c10 0 2024-04-15T21:02:32.622 INFO:tasks.workunit.client.1.smithi149.stdout:0/482: write d1/d9/f1b [1951484,6802] 0 2024-04-15T21:02:32.622 INFO:tasks.workunit.client.1.smithi149.stdout:0/483: write d1/d5/d24/d50/d13/d38/d71/f80 [357962,128585] 0 2024-04-15T21:02:32.623 INFO:tasks.workunit.client.1.smithi149.stdout:2/374: read d4/d7/d46/f69 [3983608,102116] 0 2024-04-15T21:02:32.629 INFO:tasks.workunit.client.1.smithi149.stdout:3/338: dwrite d1/fd [0,4194304] 0 2024-04-15T21:02:32.630 INFO:tasks.workunit.client.1.smithi149.stdout:0/484: dread d1/d5/d24/d30/d43/f75 [0,4194304] 0 2024-04-15T21:02:32.633 INFO:tasks.workunit.client.1.smithi149.stdout:2/375: rename d4/d7/da/l72 to d4/d7/d10/d36/l8c 0 2024-04-15T21:02:32.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/339: dread d1/db/d24/f5d [0,4194304] 0 2024-04-15T21:02:32.638 INFO:tasks.workunit.client.1.smithi149.stdout:3/340: write d1/db/d40/f58 [546173,9760] 0 2024-04-15T21:02:32.640 INFO:tasks.workunit.client.1.smithi149.stdout:4/361: getdents dc/d18 0 2024-04-15T21:02:32.641 INFO:tasks.workunit.client.0.smithi072.stdout:4/56: symlink d7/l13 0 2024-04-15T21:02:32.641 INFO:tasks.workunit.client.0.smithi072.stdout:4/57: dread - f6 zero size 2024-04-15T21:02:32.643 INFO:tasks.workunit.client.1.smithi149.stdout:4/362: read dc/d18/d21/f6b [3432869,58045] 0 2024-04-15T21:02:32.644 INFO:tasks.workunit.client.1.smithi149.stdout:0/485: mknod d1/d5/d24/d50/d13/d59/ca8 0 2024-04-15T21:02:32.645 INFO:tasks.workunit.client.1.smithi149.stdout:3/341: dwrite d1/fa [4194304,4194304] 0 2024-04-15T21:02:32.645 INFO:tasks.workunit.client.1.smithi149.stdout:4/363: write dc/d18/d21/f64 [155616,87452] 0 2024-04-15T21:02:32.646 INFO:tasks.workunit.client.1.smithi149.stdout:2/376: mknod d4/d7/d10/d6b/d21/d2c/d32/d4a/c8d 0 2024-04-15T21:02:32.647 INFO:tasks.workunit.client.1.smithi149.stdout:3/342: chown d1/f2f 29142804 1 2024-04-15T21:02:32.648 INFO:tasks.workunit.client.1.smithi149.stdout:4/364: chown dc/d2c/d3e/d35/d4b/d75/f77 1688717171 1 2024-04-15T21:02:32.654 INFO:tasks.workunit.client.1.smithi149.stdout:7/366: sync 2024-04-15T21:02:32.654 INFO:tasks.workunit.client.1.smithi149.stdout:6/289: sync 2024-04-15T21:02:32.654 INFO:tasks.workunit.client.1.smithi149.stdout:3/343: dread d1/db/f41 [0,4194304] 0 2024-04-15T21:02:32.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/344: fdatasync d1/db/d24/d39/f61 0 2024-04-15T21:02:32.655 INFO:tasks.workunit.client.1.smithi149.stdout:6/290: write da/d2e/f50 [4040319,647] 0 2024-04-15T21:02:32.657 INFO:tasks.workunit.client.1.smithi149.stdout:6/291: chown da/d18/d10/f42 0 1 2024-04-15T21:02:32.657 INFO:tasks.workunit.client.1.smithi149.stdout:0/486: creat d1/d5/d24/d30/d54/fa9 x:0 0 0 2024-04-15T21:02:32.657 INFO:tasks.workunit.client.1.smithi149.stdout:3/345: write d1/db/d24/f33 [234042,67959] 0 2024-04-15T21:02:32.659 INFO:tasks.workunit.client.1.smithi149.stdout:6/292: write da/d2e/d45/f5d [1581991,11669] 0 2024-04-15T21:02:32.660 INFO:tasks.workunit.client.0.smithi072.stdout:2/114: symlink d2/d8/l25 0 2024-04-15T21:02:32.660 INFO:tasks.workunit.client.1.smithi149.stdout:6/293: truncate da/d2e/d45/f57 684555 0 2024-04-15T21:02:32.664 INFO:tasks.workunit.client.0.smithi072.stdout:9/107: write d4/fc [978280,18713] 0 2024-04-15T21:02:32.664 INFO:tasks.workunit.client.0.smithi072.stdout:8/95: write f1 [3279047,39611] 0 2024-04-15T21:02:32.665 INFO:tasks.workunit.client.0.smithi072.stdout:8/96: chown d3/ff 4041584 1 2024-04-15T21:02:32.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/313: truncate d23/d2b/d37/d50/f57 49014 0 2024-04-15T21:02:32.667 INFO:tasks.workunit.client.0.smithi072.stdout:7/61: rename d2/db/lc to d2/l15 0 2024-04-15T21:02:32.668 INFO:tasks.workunit.client.0.smithi072.stdout:7/62: write d2/d10/f11 [893792,79338] 0 2024-04-15T21:02:32.669 INFO:tasks.workunit.client.1.smithi149.stdout:7/367: symlink d3/d34/l7f 0 2024-04-15T21:02:32.669 INFO:tasks.workunit.client.1.smithi149.stdout:9/314: dread f16 [0,4194304] 0 2024-04-15T21:02:32.669 INFO:tasks.workunit.client.0.smithi072.stdout:3/70: write d1/f2 [5023376,52661] 0 2024-04-15T21:02:32.670 INFO:tasks.workunit.client.0.smithi072.stdout:3/71: write d1/d7/f11 [1013717,100107] 0 2024-04-15T21:02:32.670 INFO:tasks.workunit.client.0.smithi072.stdout:4/58: mknod d7/c14 0 2024-04-15T21:02:32.671 INFO:tasks.workunit.client.0.smithi072.stdout:4/59: chown l4 0 1 2024-04-15T21:02:32.675 INFO:tasks.workunit.client.0.smithi072.stdout:6/74: mkdir d2/d10/d11/d15 0 2024-04-15T21:02:32.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/75: fsync d2/f14 0 2024-04-15T21:02:32.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/76: readlink d2/lf 0 2024-04-15T21:02:32.677 INFO:tasks.workunit.client.0.smithi072.stdout:0/58: write d0/d3/f4 [539096,72219] 0 2024-04-15T21:02:32.677 INFO:tasks.workunit.client.0.smithi072.stdout:6/77: truncate d2/f14 618379 0 2024-04-15T21:02:32.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/70: link d0/fa d0/d3/d6/ff 0 2024-04-15T21:02:32.685 INFO:tasks.workunit.client.0.smithi072.stdout:9/108: write d4/f1c [163027,109480] 0 2024-04-15T21:02:32.687 INFO:tasks.workunit.client.0.smithi072.stdout:8/97: mkdir d3/de/d1b 0 2024-04-15T21:02:32.690 INFO:tasks.workunit.client.0.smithi072.stdout:1/54: truncate d5/fe 1291763 0 2024-04-15T21:02:32.691 INFO:tasks.workunit.client.0.smithi072.stdout:8/98: dread d3/d4/f9 [0,4194304] 0 2024-04-15T21:02:32.691 INFO:tasks.workunit.client.0.smithi072.stdout:8/99: write d3/ff [5128561,97583] 0 2024-04-15T21:02:32.691 INFO:tasks.workunit.client.0.smithi072.stdout:4/60: rmdir d7/d10 39 2024-04-15T21:02:32.692 INFO:tasks.workunit.client.0.smithi072.stdout:4/61: read - d7/fe zero size 2024-04-15T21:02:32.692 INFO:tasks.workunit.client.0.smithi072.stdout:8/100: write f1 [1691652,95129] 0 2024-04-15T21:02:32.693 INFO:tasks.workunit.client.1.smithi149.stdout:2/377: dread d4/d7/d10/d36/f83 [0,4194304] 0 2024-04-15T21:02:32.693 INFO:tasks.workunit.client.0.smithi072.stdout:4/62: write d7/fe [781094,126584] 0 2024-04-15T21:02:32.694 INFO:tasks.workunit.client.0.smithi072.stdout:6/78: creat d2/f16 x:0 0 0 2024-04-15T21:02:32.694 INFO:tasks.workunit.client.0.smithi072.stdout:8/101: truncate d3/ff 5272047 0 2024-04-15T21:02:32.695 INFO:tasks.workunit.client.0.smithi072.stdout:4/63: read f3 [42556,70483] 0 2024-04-15T21:02:32.696 INFO:tasks.workunit.client.0.smithi072.stdout:0/59: creat d0/d3/d5/f15 x:0 0 0 2024-04-15T21:02:32.696 INFO:tasks.workunit.client.1.smithi149.stdout:5/354: sync 2024-04-15T21:02:32.696 INFO:tasks.workunit.client.1.smithi149.stdout:1/254: sync 2024-04-15T21:02:32.696 INFO:tasks.workunit.client.1.smithi149.stdout:8/375: sync 2024-04-15T21:02:32.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/102: dread f1 [0,4194304] 0 2024-04-15T21:02:32.701 INFO:tasks.workunit.client.1.smithi149.stdout:9/315: symlink d23/d46/l60 0 2024-04-15T21:02:32.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/346: mkdir d1/db/d24/d4d/d63 0 2024-04-15T21:02:32.703 INFO:tasks.workunit.client.1.smithi149.stdout:3/347: readlink d1/db/d24/d2b/l3c 0 2024-04-15T21:02:32.704 INFO:tasks.workunit.client.1.smithi149.stdout:3/348: write d1/db/d40/f58 [774618,83998] 0 2024-04-15T21:02:32.704 INFO:tasks.workunit.client.0.smithi072.stdout:5/71: dwrite d0/d3/d6/ff [4194304,4194304] 0 2024-04-15T21:02:32.706 INFO:tasks.workunit.client.0.smithi072.stdout:5/72: write d0/d3/f4 [1749371,25009] 0 2024-04-15T21:02:32.708 INFO:tasks.workunit.client.0.smithi072.stdout:9/109: dwrite d4/f5 [0,4194304] 0 2024-04-15T21:02:32.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/79: rename d2/f4 to d2/f17 0 2024-04-15T21:02:32.710 INFO:tasks.workunit.client.1.smithi149.stdout:5/355: mknod d0/d9/d3f/c84 0 2024-04-15T21:02:32.711 INFO:tasks.workunit.client.0.smithi072.stdout:6/80: chown d2/lf 49 1 2024-04-15T21:02:32.713 INFO:tasks.workunit.client.0.smithi072.stdout:9/110: dread d4/f1c [0,4194304] 0 2024-04-15T21:02:32.714 INFO:tasks.workunit.client.1.smithi149.stdout:8/376: creat d2/df/d10/d25/d37/d53/d76/d85/d35/f8a x:0 0 0 2024-04-15T21:02:32.720 INFO:tasks.workunit.client.0.smithi072.stdout:9/111: dwrite d4/f5 [0,4194304] 0 2024-04-15T21:02:32.721 INFO:tasks.workunit.client.1.smithi149.stdout:2/378: dread d4/d7/d10/d36/f49 [0,4194304] 0 2024-04-15T21:02:32.721 INFO:tasks.workunit.client.1.smithi149.stdout:5/356: dwrite d0/d6/d2d/f76 [0,4194304] 0 2024-04-15T21:02:32.721 INFO:tasks.workunit.client.0.smithi072.stdout:9/112: write d4/f5 [3213286,59701] 0 2024-04-15T21:02:32.730 INFO:tasks.workunit.client.1.smithi149.stdout:0/487: rename d1/f82 to d1/d5/d24/d30/faa 0 2024-04-15T21:02:32.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/113: dwrite d4/f5 [4194304,4194304] 0 2024-04-15T21:02:32.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/63: creat d2/f16 x:0 0 0 2024-04-15T21:02:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.741+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc601aab20 con 0x7fbc4806d880 2024-04-15T21:02:32.734 INFO:tasks.workunit.client.1.smithi149.stdout:3/349: symlink d1/db/d40/l64 0 2024-04-15T21:02:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.743+0000 7fbc47fff700 1 -- 172.21.15.72:0/2539596064 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fbc601aab20 con 0x7fbc4806d880 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 msgr2=0x7fbc4806fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 0x7fbc4806fd30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b650 tx=0x7fbc5400b5e0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 msgr2=0x7fbc6010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 0x7fbc6010eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000e970 tx=0x7fbc5000ed30 comp rx=0 tx=0).stop 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 shutdown_connections 2024-04-15T21:02:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fbc4806d880 0x7fbc4806fd30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc600ff130 0x7fbc6010eac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 --2- 172.21.15.72:0/2539596064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc601003d0 0x7fbc6010f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 >> 172.21.15.72:0/2539596064 conn(0x7fbc600fa780 msgr2=0x7fbc60103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 shutdown_connections 2024-04-15T21:02:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.745+0000 7fbc657e6700 1 -- 172.21.15.72:0/2539596064 wait complete. 2024-04-15T21:02:32.740 INFO:tasks.workunit.client.0.smithi072.stdout:3/72: rename d1/f2 to d1/f14 0 2024-04-15T21:02:32.741 INFO:tasks.workunit.client.1.smithi149.stdout:0/488: dwrite d1/d29/d2c/f58 [0,4194304] 0 2024-04-15T21:02:32.745 INFO:tasks.workunit.client.1.smithi149.stdout:4/365: truncate dc/fe 1553310 0 2024-04-15T21:02:32.745 INFO:tasks.workunit.client.0.smithi072.stdout:1/55: mknod d5/db/d10/c11 0 2024-04-15T21:02:32.749 INFO:tasks.workunit.client.1.smithi149.stdout:9/316: symlink d23/d3c/d52/l61 0 2024-04-15T21:02:32.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/377: creat d2/df/d10/d25/d37/d53/d76/d85/d35/f8b x:0 0 0 2024-04-15T21:02:32.758 INFO:tasks.workunit.client.1.smithi149.stdout:0/489: dwrite d1/d5/d24/d30/d54/f8c [0,4194304] 0 2024-04-15T21:02:32.758 INFO:tasks.workunit.client.1.smithi149.stdout:2/379: creat d4/d7/d10/d6b/d21/d2c/d58/f8e x:0 0 0 2024-04-15T21:02:32.760 INFO:tasks.workunit.client.1.smithi149.stdout:2/380: write d4/d7/d10/f37 [1973354,16329] 0 2024-04-15T21:02:32.762 INFO:tasks.workunit.client.0.smithi072.stdout:5/73: mknod d0/d3/d6/c10 0 2024-04-15T21:02:32.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/255: rename d1/db/d14/d1e to d1/db/dc/d38/d39/d43 0 2024-04-15T21:02:32.771 INFO:tasks.workunit.client.0.smithi072.stdout:4/64: mkdir d7/d15 0 2024-04-15T21:02:32.775 INFO:tasks.workunit.client.1.smithi149.stdout:6/294: link da/d18/d10/c20 da/d18/c65 0 2024-04-15T21:02:32.776 INFO:tasks.workunit.client.1.smithi149.stdout:6/295: read - da/d18/d10/d3f/f5c zero size 2024-04-15T21:02:32.776 INFO:tasks.workunit.client.0.smithi072.stdout:8/103: dwrite d3/de/f13 [0,4194304] 0 2024-04-15T21:02:32.779 INFO:tasks.workunit.client.1.smithi149.stdout:4/366: chown dc/d2c/d3e/d35/d4b/d6c/d70 10 1 2024-04-15T21:02:32.782 INFO:tasks.workunit.client.1.smithi149.stdout:9/317: symlink d23/d46/l62 0 2024-04-15T21:02:32.782 INFO:tasks.workunit.client.0.smithi072.stdout:2/115: link d2/d3/c1b d2/d3/d23/c26 0 2024-04-15T21:02:32.787 INFO:tasks.workunit.client.1.smithi149.stdout:6/296: dwrite da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:32.788 INFO:tasks.workunit.client.1.smithi149.stdout:4/367: dread dc/d1a/f26 [0,4194304] 0 2024-04-15T21:02:32.791 INFO:tasks.workunit.client.1.smithi149.stdout:5/357: link d0/d9/db/f10 d0/d9/db/d12/d16/d28/d1b/d83/f85 0 2024-04-15T21:02:32.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/378: creat d2/df/d10/d25/d57/f8c x:0 0 0 2024-04-15T21:02:32.795 INFO:tasks.workunit.client.1.smithi149.stdout:8/379: write d2/d16/f2a [1124055,129776] 0 2024-04-15T21:02:32.796 INFO:tasks.workunit.client.0.smithi072.stdout:7/64: chown d2/l15 25080 1 2024-04-15T21:02:32.799 INFO:tasks.workunit.client.0.smithi072.stdout:6/81: write d2/f7 [929345,49228] 0 2024-04-15T21:02:32.801 INFO:tasks.workunit.client.0.smithi072.stdout:6/82: write d2/fe [828088,113827] 0 2024-04-15T21:02:32.801 INFO:tasks.workunit.client.0.smithi072.stdout:6/83: chown d2/fc 157 1 2024-04-15T21:02:32.803 INFO:tasks.workunit.client.0.smithi072.stdout:1/56: dread d5/fe [0,4194304] 0 2024-04-15T21:02:32.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/350: mkdir d1/db/d24/d4d/d63/d65 0 2024-04-15T21:02:32.805 INFO:tasks.workunit.client.1.smithi149.stdout:3/351: truncate d1/db/d24/d39/f61 554933 0 2024-04-15T21:02:32.808 INFO:tasks.workunit.client.1.smithi149.stdout:9/318: creat d23/d2b/d44/f63 x:0 0 0 2024-04-15T21:02:32.808 INFO:tasks.workunit.client.1.smithi149.stdout:9/319: stat d23/d2b/f4f 0 2024-04-15T21:02:32.810 INFO:tasks.workunit.client.1.smithi149.stdout:6/297: write da/d18/d10/d16/f3c [4273717,8671] 0 2024-04-15T21:02:32.810 INFO:tasks.workunit.client.0.smithi072.stdout:1/57: dwrite d5/f6 [0,4194304] 0 2024-04-15T21:02:32.811 INFO:tasks.workunit.client.1.smithi149.stdout:4/368: rmdir dc/d2c/d3e/d15/d3f 39 2024-04-15T21:02:32.817 INFO:tasks.workunit.client.1.smithi149.stdout:6/298: dwrite da/d18/d10/d16/f29 [0,4194304] 0 2024-04-15T21:02:32.819 INFO:tasks.workunit.client.0.smithi072.stdout:7/65: rename d2/c3 to d2/d7/c17 0 2024-04-15T21:02:32.820 INFO:tasks.workunit.client.1.smithi149.stdout:2/381: creat d4/d7/d10/d6b/d21/d3b/d4c/d6c/f8f x:0 0 0 2024-04-15T21:02:32.822 INFO:tasks.workunit.client.1.smithi149.stdout:5/358: dread d0/d9/db/f10 [0,4194304] 0 2024-04-15T21:02:32.826 INFO:tasks.workunit.client.1.smithi149.stdout:2/382: truncate d4/d7/d10/d6b/d21/d5e/f51 1262913 0 2024-04-15T21:02:32.826 INFO:tasks.workunit.client.1.smithi149.stdout:3/352: creat d1/db/d24/d2b/f66 x:0 0 0 2024-04-15T21:02:32.826 INFO:tasks.workunit.client.1.smithi149.stdout:3/353: chown d1/db/d24/d2b/f66 501 1 2024-04-15T21:02:32.827 INFO:tasks.workunit.client.0.smithi072.stdout:5/74: mknod d0/c11 0 2024-04-15T21:02:32.829 INFO:tasks.workunit.client.1.smithi149.stdout:0/490: creat d1/d5/d24/fab x:0 0 0 2024-04-15T21:02:32.831 INFO:tasks.workunit.client.0.smithi072.stdout:0/60: getdents d0/d3 0 2024-04-15T21:02:32.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/380: write d2/df/d10/d25/d37/d53/d76/d85/d35/f43 [944599,55894] 0 2024-04-15T21:02:32.832 INFO:tasks.workunit.client.0.smithi072.stdout:4/65: dwrite f3 [0,4194304] 0 2024-04-15T21:02:32.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/381: fsync d2/df/d10/d25/d32/f44 0 2024-04-15T21:02:32.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/299: rename da/d2e/d45 to da/d18/d10/d66 0 2024-04-15T21:02:32.836 INFO:tasks.workunit.client.1.smithi149.stdout:6/300: write da/d18/d10/d3f/f41 [1320493,121048] 0 2024-04-15T21:02:32.837 INFO:tasks.workunit.client.1.smithi149.stdout:6/301: fdatasync da/d18/d10/d3f/f5c 0 2024-04-15T21:02:32.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/116: link d2/d3/f19 d2/d3/d23/f27 0 2024-04-15T21:02:32.838 INFO:tasks.workunit.client.0.smithi072.stdout:2/117: dread - d2/d3/f15 zero size 2024-04-15T21:02:32.839 INFO:tasks.workunit.client.1.smithi149.stdout:5/359: stat d0/d6/c48 0 2024-04-15T21:02:32.841 INFO:tasks.workunit.client.0.smithi072.stdout:1/58: read d5/f9 [3402092,77895] 0 2024-04-15T21:02:32.843 INFO:tasks.workunit.client.0.smithi072.stdout:1/59: write d5/f6 [1589280,122234] 0 2024-04-15T21:02:32.843 INFO:tasks.workunit.client.0.smithi072.stdout:9/114: creat d4/f1e x:0 0 0 2024-04-15T21:02:32.844 INFO:tasks.workunit.client.1.smithi149.stdout:4/369: dread dc/fe [0,4194304] 0 2024-04-15T21:02:32.845 INFO:tasks.workunit.client.0.smithi072.stdout:2/118: dwrite d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:32.847 INFO:tasks.workunit.client.1.smithi149.stdout:4/370: truncate dc/d18/d21/f63 635675 0 2024-04-15T21:02:32.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/256: dwrite d1/db/dc/d38/d39/d43/fd [4194304,4194304] 0 2024-04-15T21:02:32.849 INFO:tasks.workunit.client.0.smithi072.stdout:5/75: mkdir d0/d3/d7/d12 0 2024-04-15T21:02:32.850 INFO:tasks.workunit.client.0.smithi072.stdout:5/76: chown d0/d3/d7/d12 15386418 1 2024-04-15T21:02:32.851 INFO:tasks.workunit.client.1.smithi149.stdout:1/257: dread d1/db/f37 [0,4194304] 0 2024-04-15T21:02:32.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/302: rename da/d18/d33/c4b to da/d18/d10/c67 0 2024-04-15T21:02:32.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/303: dread - da/d2e/f64 zero size 2024-04-15T21:02:32.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/77: dwrite d0/d3/d6/ff [8388608,4194304] 0 2024-04-15T21:02:32.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/78: readlink d0/d3/d7/lb 0 2024-04-15T21:02:32.862 INFO:tasks.workunit.client.1.smithi149.stdout:2/383: mkdir d4/d7/d10/d6b/d21/d3b/d90 0 2024-04-15T21:02:32.864 INFO:tasks.workunit.client.0.smithi072.stdout:0/61: symlink d0/l16 0 2024-04-15T21:02:32.865 INFO:tasks.workunit.client.0.smithi072.stdout:0/62: chown d0/f12 1558255469 1 2024-04-15T21:02:32.868 INFO:tasks.workunit.client.1.smithi149.stdout:3/354: creat d1/db/d24/d4d/d63/d65/f67 x:0 0 0 2024-04-15T21:02:32.869 INFO:tasks.workunit.client.0.smithi072.stdout:4/66: rename d7/c14 to d7/d15/c16 0 2024-04-15T21:02:32.870 INFO:tasks.workunit.client.0.smithi072.stdout:4/67: read - d7/f12 zero size 2024-04-15T21:02:32.872 INFO:tasks.workunit.client.0.smithi072.stdout:8/104: link d3/l10 d3/de/d17/l1c 0 2024-04-15T21:02:32.873 INFO:tasks.workunit.client.0.smithi072.stdout:8/105: chown d3/de/f13 756736 1 2024-04-15T21:02:32.875 INFO:tasks.workunit.client.1.smithi149.stdout:0/491: dwrite d1/d5/dc/f46 [0,4194304] 0 2024-04-15T21:02:32.877 INFO:tasks.workunit.client.1.smithi149.stdout:3/355: dwrite d1/db/d24/d39/f61 [0,4194304] 0 2024-04-15T21:02:32.877 INFO:tasks.workunit.client.0.smithi072.stdout:4/68: dwrite d7/f9 [0,4194304] 0 2024-04-15T21:02:32.878 INFO:tasks.workunit.client.1.smithi149.stdout:1/258: mknod d1/d17/d36/c44 0 2024-04-15T21:02:32.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/356: fsync d1/db/d24/f36 0 2024-04-15T21:02:32.883 INFO:tasks.workunit.client.0.smithi072.stdout:4/69: dwrite d7/fb [0,4194304] 0 2024-04-15T21:02:32.888 INFO:tasks.workunit.client.1.smithi149.stdout:2/384: unlink d4/d7/da/l6f 0 2024-04-15T21:02:32.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 -- 172.21.15.72:0/1456795458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d00ff130 msgr2=0x7fc5d00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/1456795458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d00ff130 0x7fc5d00ff540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009910 tx=0x7fc5c0009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 -- 172.21.15.72:0/1456795458 shutdown_connections 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/1456795458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d01003d0 0x7fc5d0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/1456795458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d00ff130 0x7fc5d00ff540 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 -- 172.21.15.72:0/1456795458 >> 172.21.15.72:0/1456795458 conn(0x7fc5d00fa780 msgr2=0x7fc5d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 -- 172.21.15.72:0/1456795458 shutdown_connections 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.896+0000 7fc5d51ee700 1 -- 172.21.15.72:0/1456795458 wait complete. 2024-04-15T21:02:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.897+0000 7fc5d51ee700 1 Processor -- start 2024-04-15T21:02:32.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5d51ee700 1 -- start start 2024-04-15T21:02:32.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5d51ee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00ff130 0x7fc5d01a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/371: write dc/d1a/f26 [887416,106718] 0 2024-04-15T21:02:32.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/385: dread - d4/f7a zero size 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5d51ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5d51ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01a55c0 con 0x7fc5d01003d0 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5d51ee700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01a9df0 con 0x7fc5d00ff130 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42160/0 (socket says 172.21.15.72:42160) 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5ce59c700 1 -- 172.21.15.72:0/2464312716 learned_addr learned my addr 172.21.15.72:0/2464312716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.898+0000 7fc5ced9d700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00ff130 0x7fc5d01a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5ce59c700 1 -- 172.21.15.72:0/2464312716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00ff130 msgr2=0x7fc5d01a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5ce59c700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00ff130 0x7fc5d01a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5ce59c700 1 -- 172.21.15.72:0/2464312716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00095f0 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5ce59c700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400b4b0 tx=0x7fc5c400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c4011800 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01a9ff0 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc5c4011e10 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.899+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c400f2e0 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.901+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01aa510 con 0x7fc5d01003d0 2024-04-15T21:02:32.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.901+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7fc5c400f440 con 0x7fc5d01003d0 2024-04-15T21:02:32.894 INFO:tasks.workunit.client.0.smithi072.stdout:1/60: creat d5/db/f12 x:0 0 0 2024-04-15T21:02:32.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.902+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0105ea0 con 0x7fc5d01003d0 2024-04-15T21:02:32.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.902+0000 7fc5b7fff700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 0x7fc5b806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:32.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.902+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc5c408be70 con 0x7fc5d01003d0 2024-04-15T21:02:32.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.902+0000 7fc5ced9d700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 0x7fc5b806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:32.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.903+0000 7fc5ced9d700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 0x7fc5b806fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0006010 tx=0x7fc5c000b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:32.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/382: creat d2/f8d x:0 0 0 2024-04-15T21:02:32.899 INFO:tasks.workunit.client.1.smithi149.stdout:8/383: chown d2/df/d10/f11 3 1 2024-04-15T21:02:32.899 INFO:tasks.workunit.client.0.smithi072.stdout:3/73: getdents d1 0 2024-04-15T21:02:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:32.909+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc5c4091060 con 0x7fc5d01003d0 2024-04-15T21:02:32.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/372: dwrite dc/d2c/d3e/d35/d3a/f60 [0,4194304] 0 2024-04-15T21:02:32.910 INFO:tasks.workunit.client.0.smithi072.stdout:0/63: mkdir d0/d17 0 2024-04-15T21:02:32.915 INFO:tasks.workunit.client.0.smithi072.stdout:2/119: rename d2/d3/d23/f24 to d2/d8/f28 0 2024-04-15T21:02:32.919 INFO:tasks.workunit.client.0.smithi072.stdout:8/106: creat d3/f1d x:0 0 0 2024-04-15T21:02:32.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/386: creat d4/d7/d10/d6b/d21/d2c/d63/f91 x:0 0 0 2024-04-15T21:02:32.922 INFO:tasks.workunit.client.1.smithi149.stdout:8/384: mkdir d2/df/d10/d21/d50/d8e 0 2024-04-15T21:02:32.923 INFO:tasks.workunit.client.1.smithi149.stdout:8/385: fsync d2/df/d10/d25/d37/f5f 0 2024-04-15T21:02:32.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/387: write d4/d7/d29/f4f [1670680,117268] 0 2024-04-15T21:02:32.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/304: dread da/ff [0,4194304] 0 2024-04-15T21:02:32.926 INFO:tasks.workunit.client.1.smithi149.stdout:4/373: creat dc/d2c/d3e/d35/d4b/d6c/f7b x:0 0 0 2024-04-15T21:02:32.926 INFO:tasks.workunit.client.1.smithi149.stdout:8/386: fsync d2/df/d10/d25/d32/f44 0 2024-04-15T21:02:32.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/259: write d1/db/d14/d21/f2a [810833,100148] 0 2024-04-15T21:02:32.931 INFO:tasks.workunit.client.1.smithi149.stdout:4/374: read dc/d18/f1d [840714,85255] 0 2024-04-15T21:02:32.933 INFO:tasks.workunit.client.0.smithi072.stdout:7/66: creat d2/f18 x:0 0 0 2024-04-15T21:02:32.933 INFO:tasks.workunit.client.0.smithi072.stdout:7/67: fdatasync d2/db/ff 0 2024-04-15T21:02:32.934 INFO:tasks.workunit.client.1.smithi149.stdout:2/388: creat d4/d7/d10/d6b/f92 x:0 0 0 2024-04-15T21:02:32.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/260: dwrite d1/db/f33 [4194304,4194304] 0 2024-04-15T21:02:32.935 INFO:tasks.workunit.client.0.smithi072.stdout:3/74: mkdir d1/d15 0 2024-04-15T21:02:32.936 INFO:tasks.workunit.client.0.smithi072.stdout:6/84: getdents d2/d10/d11 0 2024-04-15T21:02:32.937 INFO:tasks.workunit.client.1.smithi149.stdout:2/389: write d4/d7/da/f84 [861684,3617] 0 2024-04-15T21:02:32.939 INFO:tasks.workunit.client.0.smithi072.stdout:0/64: creat d0/f18 x:0 0 0 2024-04-15T21:02:32.939 INFO:tasks.workunit.client.0.smithi072.stdout:0/65: chown d0/d17 0 1 2024-04-15T21:02:32.940 INFO:tasks.workunit.client.1.smithi149.stdout:6/305: creat da/d18/d10/f68 x:0 0 0 2024-04-15T21:02:32.944 INFO:tasks.workunit.client.1.smithi149.stdout:3/357: creat d1/db/d24/f68 x:0 0 0 2024-04-15T21:02:32.945 INFO:tasks.workunit.client.0.smithi072.stdout:8/107: creat d3/d4/f1e x:0 0 0 2024-04-15T21:02:32.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/375: unlink dc/d2c/d3e/d35/d4b/l4c 0 2024-04-15T21:02:32.947 INFO:tasks.workunit.client.0.smithi072.stdout:8/108: write d3/d4/f1e [974143,118810] 0 2024-04-15T21:02:32.948 INFO:tasks.workunit.client.0.smithi072.stdout:4/70: symlink d7/l17 0 2024-04-15T21:02:32.948 INFO:tasks.workunit.client.1.smithi149.stdout:4/376: dread dc/d18/f62 [0,4194304] 0 2024-04-15T21:02:32.948 INFO:tasks.workunit.client.1.smithi149.stdout:8/387: dread d2/df/d10/d25/d32/d45/f5e [0,4194304] 0 2024-04-15T21:02:32.948 INFO:tasks.workunit.client.1.smithi149.stdout:4/377: readlink dc/l49 0 2024-04-15T21:02:32.950 INFO:tasks.workunit.client.1.smithi149.stdout:2/390: mkdir d4/d7/d93 0 2024-04-15T21:02:32.951 INFO:tasks.workunit.client.0.smithi072.stdout:8/109: dread d3/de/f11 [0,4194304] 0 2024-04-15T21:02:32.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/68: rmdir d2/db 39 2024-04-15T21:02:32.952 INFO:tasks.workunit.client.0.smithi072.stdout:8/110: fdatasync d3/f1d 0 2024-04-15T21:02:32.952 INFO:tasks.workunit.client.0.smithi072.stdout:7/69: dread - d2/f14 zero size 2024-04-15T21:02:32.953 INFO:tasks.workunit.client.0.smithi072.stdout:7/70: chown d2/d10 12409 1 2024-04-15T21:02:32.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/492: dread d1/d5/d24/d50/d13/d59/f76 [0,4194304] 0 2024-04-15T21:02:32.955 INFO:tasks.workunit.client.0.smithi072.stdout:0/66: mkdir d0/d19 0 2024-04-15T21:02:32.955 INFO:tasks.workunit.client.0.smithi072.stdout:4/71: dwrite f3 [0,4194304] 0 2024-04-15T21:02:32.956 INFO:tasks.workunit.client.1.smithi149.stdout:7/368: sync 2024-04-15T21:02:32.964 INFO:tasks.workunit.client.1.smithi149.stdout:3/358: dread d1/db/d24/d2b/f2e [0,4194304] 0 2024-04-15T21:02:32.965 INFO:tasks.workunit.client.0.smithi072.stdout:9/115: rename d4/d17 to d4/d1f 0 2024-04-15T21:02:32.966 INFO:tasks.workunit.client.1.smithi149.stdout:2/391: mkdir d4/d7/d10/d6b/d21/d55/d94 0 2024-04-15T21:02:32.972 INFO:tasks.workunit.client.0.smithi072.stdout:8/111: mknod d3/de/c1f 0 2024-04-15T21:02:32.973 INFO:tasks.workunit.client.1.smithi149.stdout:0/493: mknod d1/d5/d24/d50/d13/d38/d44/cac 0 2024-04-15T21:02:32.974 INFO:tasks.workunit.client.1.smithi149.stdout:0/494: dread d1/d29/f90 [0,4194304] 0 2024-04-15T21:02:32.975 INFO:tasks.workunit.client.0.smithi072.stdout:0/67: truncate d0/f13 744398 0 2024-04-15T21:02:32.976 INFO:tasks.workunit.client.0.smithi072.stdout:0/68: read d0/d6/ff [2983334,38845] 0 2024-04-15T21:02:32.976 INFO:tasks.workunit.client.0.smithi072.stdout:0/69: fdatasync d0/f18 0 2024-04-15T21:02:32.978 INFO:tasks.workunit.client.0.smithi072.stdout:5/79: rename d0/d3/d7/dc to d0/d13 0 2024-04-15T21:02:32.980 INFO:tasks.workunit.client.0.smithi072.stdout:3/75: chown d1/d7/f11 15598 1 2024-04-15T21:02:32.981 INFO:tasks.workunit.client.0.smithi072.stdout:5/80: dread d0/d3/d6/ff [8388608,4194304] 0 2024-04-15T21:02:32.984 INFO:tasks.workunit.client.0.smithi072.stdout:7/71: creat d2/db/f19 x:0 0 0 2024-04-15T21:02:32.986 INFO:tasks.workunit.client.0.smithi072.stdout:8/112: creat d3/de/f20 x:0 0 0 2024-04-15T21:02:32.988 INFO:tasks.workunit.client.0.smithi072.stdout:4/72: write d7/d10/f11 [328199,22667] 0 2024-04-15T21:02:32.990 INFO:tasks.workunit.client.0.smithi072.stdout:2/120: getdents d2/d3/d23 0 2024-04-15T21:02:32.991 INFO:tasks.workunit.client.0.smithi072.stdout:3/76: symlink d1/d7/l16 0 2024-04-15T21:02:32.992 INFO:tasks.workunit.client.0.smithi072.stdout:6/85: getdents d2 0 2024-04-15T21:02:32.992 INFO:tasks.workunit.client.0.smithi072.stdout:6/86: fsync d2/f14 0 2024-04-15T21:02:32.994 INFO:tasks.workunit.client.0.smithi072.stdout:8/113: fdatasync f1 0 2024-04-15T21:02:32.994 INFO:tasks.workunit.client.0.smithi072.stdout:7/72: dread d2/f5 [0,4194304] 0 2024-04-15T21:02:32.996 INFO:tasks.workunit.client.0.smithi072.stdout:7/73: dread - d2/db/ff zero size 2024-04-15T21:02:32.996 INFO:tasks.workunit.client.0.smithi072.stdout:4/73: rename l4 to d7/d15/l18 0 2024-04-15T21:02:32.996 INFO:tasks.workunit.client.0.smithi072.stdout:7/74: readlink d2/l15 0 2024-04-15T21:02:32.999 INFO:tasks.workunit.client.1.smithi149.stdout:4/378: mkdir dc/d2c/d3e/d7c 0 2024-04-15T21:02:32.999 INFO:tasks.workunit.client.1.smithi149.stdout:1/261: truncate d1/db/dc/d38/d39/d43/f1f 828272 0 2024-04-15T21:02:33.000 INFO:tasks.workunit.client.1.smithi149.stdout:3/359: symlink d1/db/d24/d4d/d63/l69 0 2024-04-15T21:02:33.000 INFO:tasks.workunit.client.0.smithi072.stdout:2/121: unlink d2/d8/f1c 0 2024-04-15T21:02:33.000 INFO:tasks.workunit.client.1.smithi149.stdout:2/392: symlink d4/d7/d10/d6b/d21/d3b/d4c/l95 0 2024-04-15T21:02:33.001 INFO:tasks.workunit.client.1.smithi149.stdout:6/306: link da/ff da/d18/d10/d66/f69 0 2024-04-15T21:02:33.003 INFO:tasks.workunit.client.0.smithi072.stdout:2/122: dread d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:33.004 INFO:tasks.workunit.client.1.smithi149.stdout:0/495: mknod d1/d5/d24/d50/d13/d38/d44/cad 0 2024-04-15T21:02:33.005 INFO:tasks.workunit.client.1.smithi149.stdout:2/393: read d4/d7/da/f4e [62225,78937] 0 2024-04-15T21:02:33.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/388: dread d2/fe [4194304,4194304] 0 2024-04-15T21:02:33.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/123: dread d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:33.008 INFO:tasks.workunit.client.0.smithi072.stdout:2/124: write d2/d3/f15 [616321,84181] 0 2024-04-15T21:02:33.008 INFO:tasks.workunit.client.0.smithi072.stdout:5/81: write d0/d3/d6/f8 [467081,53765] 0 2024-04-15T21:02:33.010 INFO:tasks.workunit.client.0.smithi072.stdout:6/87: mkdir d2/d10/d18 0 2024-04-15T21:02:33.010 INFO:tasks.workunit.client.0.smithi072.stdout:6/88: chown d2/c13 359776 1 2024-04-15T21:02:33.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/360: dread d1/db/d24/d2b/f1b [0,4194304] 0 2024-04-15T21:02:33.011 INFO:tasks.workunit.client.0.smithi072.stdout:6/89: dread d2/f14 [0,4194304] 0 2024-04-15T21:02:33.012 INFO:tasks.workunit.client.0.smithi072.stdout:8/114: mkdir d3/de/d21 0 2024-04-15T21:02:33.014 INFO:tasks.workunit.client.1.smithi149.stdout:4/379: dwrite dc/d18/d21/f73 [0,4194304] 0 2024-04-15T21:02:33.015 INFO:tasks.workunit.client.1.smithi149.stdout:6/307: dread da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:33.016 INFO:tasks.workunit.client.0.smithi072.stdout:0/70: rmdir d0/d3/d5/d9 0 2024-04-15T21:02:33.016 INFO:tasks.workunit.client.0.smithi072.stdout:8/115: dread d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:33.017 INFO:tasks.workunit.client.0.smithi072.stdout:4/74: chown d7/d15/c16 1 1 2024-04-15T21:02:33.018 INFO:tasks.workunit.client.0.smithi072.stdout:4/75: stat d7/l17 0 2024-04-15T21:02:33.019 INFO:tasks.workunit.client.0.smithi072.stdout:4/76: write d7/fb [2270845,51886] 0 2024-04-15T21:02:33.020 INFO:tasks.workunit.client.1.smithi149.stdout:0/496: fsync d1/d5/d24/d50/d13/d59/f76 0 2024-04-15T21:02:33.022 INFO:tasks.workunit.client.0.smithi072.stdout:7/75: symlink d2/db/l1a 0 2024-04-15T21:02:33.023 INFO:tasks.workunit.client.0.smithi072.stdout:0/71: dwrite d0/d3/f8 [0,4194304] 0 2024-04-15T21:02:33.025 INFO:tasks.workunit.client.1.smithi149.stdout:2/394: creat d4/d7/d10/d6b/d21/d2c/d58/f96 x:0 0 0 2024-04-15T21:02:33.031 INFO:tasks.workunit.client.1.smithi149.stdout:1/262: mkdir d1/db/dc/d11/d3f/d45 0 2024-04-15T21:02:33.031 INFO:tasks.workunit.client.1.smithi149.stdout:1/263: write d1/f5 [7268568,73576] 0 2024-04-15T21:02:33.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/361: rmdir d1/db/d24/d39 39 2024-04-15T21:02:33.033 INFO:tasks.workunit.client.0.smithi072.stdout:7/76: dwrite d2/f14 [0,4194304] 0 2024-04-15T21:02:33.036 INFO:tasks.workunit.client.1.smithi149.stdout:8/389: rename d2/df/d10/d21/d50/d5d/d6d/f84 to d2/df/d10/d25/d32/d45/f8f 0 2024-04-15T21:02:33.038 INFO:tasks.workunit.client.1.smithi149.stdout:8/390: chown d2/df/d10/d20/c2c 1 1 2024-04-15T21:02:33.038 INFO:tasks.workunit.client.0.smithi072.stdout:5/82: dwrite d0/fa [4194304,4194304] 0 2024-04-15T21:02:33.039 INFO:tasks.workunit.client.1.smithi149.stdout:8/391: stat d2/l55 0 2024-04-15T21:02:33.043 INFO:tasks.workunit.client.1.smithi149.stdout:7/369: creat d3/d16/d20/d36/d3d/f80 x:0 0 0 2024-04-15T21:02:33.046 INFO:tasks.workunit.client.1.smithi149.stdout:6/308: write da/d18/d10/d66/f69 [3607287,107434] 0 2024-04-15T21:02:33.050 INFO:tasks.workunit.client.0.smithi072.stdout:0/72: symlink d0/d6/l1a 0 2024-04-15T21:02:33.051 INFO:tasks.workunit.client.0.smithi072.stdout:3/77: creat d1/f17 x:0 0 0 2024-04-15T21:02:33.053 INFO:tasks.workunit.client.0.smithi072.stdout:2/125: rename d2/c1e to d2/d3/d23/c29 0 2024-04-15T21:02:33.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/392: creat d2/df/d10/f90 x:0 0 0 2024-04-15T21:02:33.055 INFO:tasks.workunit.client.0.smithi072.stdout:7/77: fdatasync d2/f5 0 2024-04-15T21:02:33.056 INFO:tasks.workunit.client.1.smithi149.stdout:7/370: mknod d3/d39/c81 0 2024-04-15T21:02:33.056 INFO:tasks.workunit.client.1.smithi149.stdout:7/371: stat d3/d16/d20/d36/d3d/f46 0 2024-04-15T21:02:33.057 INFO:tasks.workunit.client.0.smithi072.stdout:6/90: symlink d2/d10/d18/l19 0 2024-04-15T21:02:33.059 INFO:tasks.workunit.client.0.smithi072.stdout:5/83: mkdir d0/d3/d6/d14 0 2024-04-15T21:02:33.060 INFO:tasks.workunit.client.0.smithi072.stdout:0/73: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:33.061 INFO:tasks.workunit.client.0.smithi072.stdout:8/116: link d3/de/f11 d3/de/f22 0 2024-04-15T21:02:33.061 INFO:tasks.workunit.client.1.smithi149.stdout:2/395: symlink d4/l97 0 2024-04-15T21:02:33.062 INFO:tasks.workunit.client.0.smithi072.stdout:0/74: truncate d0/f12 5210702 0 2024-04-15T21:02:33.062 INFO:tasks.workunit.client.1.smithi149.stdout:2/396: readlink d4/d7/d10/l7b 0 2024-04-15T21:02:33.063 INFO:tasks.workunit.client.1.smithi149.stdout:2/397: truncate d4/f7a 12418 0 2024-04-15T21:02:33.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/362: mknod d1/db/d24/d39/c6a 0 2024-04-15T21:02:33.064 INFO:tasks.workunit.client.1.smithi149.stdout:2/398: chown d4/d7/d10/d6b/d21/d3b/f44 80777493 1 2024-04-15T21:02:33.064 INFO:tasks.workunit.client.1.smithi149.stdout:2/399: chown d4 21904 1 2024-04-15T21:02:33.066 INFO:tasks.workunit.client.1.smithi149.stdout:1/264: rename d1/db/d14/d21/c23 to d1/db/dc/d11/d3f/c46 0 2024-04-15T21:02:33.067 INFO:tasks.workunit.client.1.smithi149.stdout:1/265: write d1/db/d14/d21/f2a [1757760,24918] 0 2024-04-15T21:02:33.067 INFO:tasks.workunit.client.0.smithi072.stdout:3/78: truncate f0 232799 0 2024-04-15T21:02:33.070 INFO:tasks.workunit.client.1.smithi149.stdout:6/309: creat da/d60/f6a x:0 0 0 2024-04-15T21:02:33.071 INFO:tasks.workunit.client.0.smithi072.stdout:7/78: dread d2/fa [0,4194304] 0 2024-04-15T21:02:33.072 INFO:tasks.workunit.client.0.smithi072.stdout:7/79: readlink d2/db/l1a 0 2024-04-15T21:02:33.078 INFO:tasks.workunit.client.0.smithi072.stdout:7/80: dwrite d2/f14 [0,4194304] 0 2024-04-15T21:02:33.082 INFO:tasks.workunit.client.0.smithi072.stdout:7/81: dread d2/fa [4194304,4194304] 0 2024-04-15T21:02:33.151 INFO:tasks.workunit.client.0.smithi072.stdout:6/91: truncate d2/fa 1035825 0 2024-04-15T21:02:33.151 INFO:tasks.workunit.client.1.smithi149.stdout:3/363: creat d1/db/d24/d2b/f6b x:0 0 0 2024-04-15T21:02:33.152 INFO:tasks.workunit.client.0.smithi072.stdout:8/117: symlink d3/de/l23 0 2024-04-15T21:02:33.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/118: stat d3/ld 0 2024-04-15T21:02:33.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/119: chown d3/d4/f1e 329158708 1 2024-04-15T21:02:33.154 INFO:tasks.workunit.client.0.smithi072.stdout:4/77: creat d7/f19 x:0 0 0 2024-04-15T21:02:33.156 INFO:tasks.workunit.client.0.smithi072.stdout:0/75: chown d0/d3/d5/f11 123 1 2024-04-15T21:02:33.157 INFO:tasks.workunit.client.0.smithi072.stdout:0/76: write d0/f14 [962801,80567] 0 2024-04-15T21:02:33.157 INFO:tasks.workunit.client.0.smithi072.stdout:0/77: chown d0/f2 40533 1 2024-04-15T21:02:33.158 INFO:tasks.workunit.client.1.smithi149.stdout:3/364: dwrite d1/db/d28/f44 [0,4194304] 0 2024-04-15T21:02:33.162 INFO:tasks.workunit.client.1.smithi149.stdout:7/372: symlink d3/d16/d20/l82 0 2024-04-15T21:02:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.170+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d0104d20 con 0x7fc5b806d7e0 2024-04-15T21:02:33.165 INFO:tasks.workunit.client.1.smithi149.stdout:0/497: getdents d1/d5/d24/d50/d13/d59 0 2024-04-15T21:02:33.167 INFO:tasks.workunit.client.0.smithi072.stdout:6/92: mkdir d2/d1a 0 2024-04-15T21:02:33.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/400: creat d4/d7/d93/f98 x:0 0 0 2024-04-15T21:02:33.169 INFO:tasks.workunit.client.0.smithi072.stdout:8/120: creat d3/de/f24 x:0 0 0 2024-04-15T21:02:33.174 INFO:tasks.workunit.client.1.smithi149.stdout:1/266: link d1/db/f30 d1/db/dc/d11/f47 0 2024-04-15T21:02:33.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/401: dwrite d4/d7/d10/d6b/d21/d5e/f51 [0,4194304] 0 2024-04-15T21:02:33.176 INFO:tasks.workunit.client.1.smithi149.stdout:1/267: write d1/db/d14/d21/f2a [2636230,93034] 0 2024-04-15T21:02:33.178 INFO:tasks.workunit.client.1.smithi149.stdout:3/365: creat d1/db/d24/d2b/f6c x:0 0 0 2024-04-15T21:02:33.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.186+0000 7fc5b7fff700 1 -- 172.21.15.72:0/2464312716 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc5d0104d20 con 0x7fc5b806d7e0 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (7m) 2m ago 8m 25.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (9m) 2m ago 9m 7428k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (7m) 16s ago 7m 7545k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (9m) 2m ago 9m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (7m) 16s ago 7m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (6m) 2m ago 8m 79.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (2m) 2m ago 2m 13.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (3m) 2m ago 3m 11.3M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:02:33.179 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (2m) 16s ago 2m 14.4M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (3m) 16s ago 3m 187M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (10m) 2m ago 10m 487M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (21s) 16s ago 7m 54.9M - 19.0.0-3084-g87dbfb63 a452a57266c7 6ee5d0e0d775 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (10m) 2m ago 10m 48.3M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (7m) 16s ago 7m 36.5M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (8m) 2m ago 8m 16.4M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 16s ago 7m 16.5M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 2m ago 6m 50.1M 3946M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 2m ago 6m 47.7M 3946M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:02:33.180 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 2m ago 5m 48.4M 3946M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:02:33.181 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (5m) 16s ago 5m 93.1M 1213M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:02:33.181 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (4m) 16s ago 4m 90.3M 1213M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:02:33.181 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (4m) 16s ago 4m 82.9M 1213M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:02:33.181 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 2m ago 8m 62.8M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:02:33.181 INFO:tasks.workunit.client.0.smithi072.stdout:0/78: rename d0/d3/f8 to d0/d3/f1b 0 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 msgr2=0x7fc5b806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 0x7fc5b806fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0006010 tx=0x7fc5c000b540 comp rx=0 tx=0).stop 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 msgr2=0x7fc5d01a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400b4b0 tx=0x7fc5c400b870 comp rx=0 tx=0).stop 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 shutdown_connections 2024-04-15T21:02:33.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fc5b806d7e0 0x7fc5b806fc90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5d00ff130 0x7fc5d01a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 --2- 172.21.15.72:0/2464312716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5d01003d0 0x7fc5d01a4f50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.189+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 >> 172.21.15.72:0/2464312716 conn(0x7fc5d00fa780 msgr2=0x7fc5d0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:33.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.190+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 shutdown_connections 2024-04-15T21:02:33.183 INFO:tasks.workunit.client.0.smithi072.stdout:3/79: dwrite d1/ff [0,4194304] 0 2024-04-15T21:02:33.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.190+0000 7fc5d51ee700 1 -- 172.21.15.72:0/2464312716 wait complete. 2024-04-15T21:02:33.184 INFO:tasks.workunit.client.1.smithi149.stdout:7/373: creat d3/d16/d20/d6c/f83 x:0 0 0 2024-04-15T21:02:33.185 INFO:tasks.workunit.client.1.smithi149.stdout:0/498: symlink d1/d29/d2c/d4f/lae 0 2024-04-15T21:02:33.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/310: getdents da/d18/d10/d66/d59 0 2024-04-15T21:02:33.197 INFO:tasks.workunit.client.0.smithi072.stdout:4/78: truncate d7/f9 3192091 0 2024-04-15T21:02:33.198 INFO:tasks.workunit.client.0.smithi072.stdout:4/79: fdatasync d7/f19 0 2024-04-15T21:02:33.198 INFO:tasks.workunit.client.0.smithi072.stdout:4/80: dread - d7/f12 zero size 2024-04-15T21:02:33.199 INFO:tasks.workunit.client.1.smithi149.stdout:3/366: rename d1/db/d24/f33 to d1/db/d23/d5e/f6d 0 2024-04-15T21:02:33.201 INFO:tasks.workunit.client.0.smithi072.stdout:2/126: getdents d2/d8 0 2024-04-15T21:02:33.203 INFO:tasks.workunit.client.1.smithi149.stdout:0/499: creat d1/d9/d64/d65/faf x:0 0 0 2024-04-15T21:02:33.204 INFO:tasks.workunit.client.1.smithi149.stdout:0/500: fdatasync d1/d9/f1b 0 2024-04-15T21:02:33.204 INFO:tasks.workunit.client.0.smithi072.stdout:6/93: creat d2/d1a/f1b x:0 0 0 2024-04-15T21:02:33.204 INFO:tasks.workunit.client.1.smithi149.stdout:0/501: stat d1/d5/d24/d50/d13/d38/d44/f47 0 2024-04-15T21:02:33.205 INFO:tasks.workunit.client.0.smithi072.stdout:8/121: link d3/de/f24 d3/de/f25 0 2024-04-15T21:02:33.206 INFO:tasks.workunit.client.0.smithi072.stdout:0/79: getdents d0/d19 0 2024-04-15T21:02:33.207 INFO:tasks.workunit.client.0.smithi072.stdout:2/127: dwrite d2/d3/f15 [0,4194304] 0 2024-04-15T21:02:33.209 INFO:tasks.workunit.client.0.smithi072.stdout:6/94: rename d2/lf to d2/d10/d11/l1c 0 2024-04-15T21:02:33.210 INFO:tasks.workunit.client.1.smithi149.stdout:7/374: rename d3/d16/d20/f65 to d3/d16/d32/f84 0 2024-04-15T21:02:33.214 INFO:tasks.workunit.client.0.smithi072.stdout:0/80: dwrite d0/f14 [0,4194304] 0 2024-04-15T21:02:33.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/393: creat d2/df/d10/d20/f91 x:0 0 0 2024-04-15T21:02:33.218 INFO:tasks.workunit.client.1.smithi149.stdout:8/394: truncate d2/f86 836165 0 2024-04-15T21:02:33.219 INFO:tasks.workunit.client.1.smithi149.stdout:1/268: truncate d1/db/dc/f10 1532224 0 2024-04-15T21:02:33.222 INFO:tasks.workunit.client.0.smithi072.stdout:2/128: rmdir d2/d8 39 2024-04-15T21:02:33.228 INFO:tasks.workunit.client.1.smithi149.stdout:2/402: creat d4/f99 x:0 0 0 2024-04-15T21:02:33.228 INFO:tasks.workunit.client.0.smithi072.stdout:6/95: creat d2/d10/f1d x:0 0 0 2024-04-15T21:02:33.229 INFO:tasks.workunit.client.0.smithi072.stdout:0/81: creat d0/f1c x:0 0 0 2024-04-15T21:02:33.230 INFO:tasks.workunit.client.1.smithi149.stdout:7/375: write d3/d16/d20/d60/f77 [398450,111605] 0 2024-04-15T21:02:33.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/403: dread d4/d7/d10/d36/f49 [0,4194304] 0 2024-04-15T21:02:33.235 INFO:tasks.workunit.client.0.smithi072.stdout:8/122: dwrite f1 [0,4194304] 0 2024-04-15T21:02:33.235 INFO:tasks.workunit.client.0.smithi072.stdout:2/129: rename f1 to d2/d3/d23/f2a 0 2024-04-15T21:02:33.236 INFO:tasks.workunit.client.0.smithi072.stdout:3/80: truncate d1/d7/f9 112390 0 2024-04-15T21:02:33.236 INFO:tasks.workunit.client.0.smithi072.stdout:2/130: fsync d2/d3/f1f 0 2024-04-15T21:02:33.236 INFO:tasks.workunit.client.0.smithi072.stdout:3/81: chown d1/d7 0 1 2024-04-15T21:02:33.236 INFO:tasks.workunit.client.0.smithi072.stdout:3/82: fsync d1/f17 0 2024-04-15T21:02:33.237 INFO:tasks.workunit.client.0.smithi072.stdout:6/96: mknod d2/d1a/c1e 0 2024-04-15T21:02:33.238 INFO:tasks.workunit.client.1.smithi149.stdout:6/311: truncate da/d11/f1d 1464451 0 2024-04-15T21:02:33.244 INFO:tasks.workunit.client.0.smithi072.stdout:3/83: dread d1/d7/f11 [0,4194304] 0 2024-04-15T21:02:33.246 INFO:tasks.workunit.client.1.smithi149.stdout:3/367: truncate d1/db/d24/f5d 795606 0 2024-04-15T21:02:33.247 INFO:tasks.workunit.client.1.smithi149.stdout:6/312: dwrite da/d18/f19 [0,4194304] 0 2024-04-15T21:02:33.248 INFO:tasks.workunit.client.1.smithi149.stdout:6/313: stat da/d18/d10/d66 0 2024-04-15T21:02:33.249 INFO:tasks.workunit.client.1.smithi149.stdout:8/395: mkdir d2/df/d10/d25/d37/d53/d76/d92 0 2024-04-15T21:02:33.252 INFO:tasks.workunit.client.0.smithi072.stdout:0/82: creat d0/d17/f1d x:0 0 0 2024-04-15T21:02:33.255 INFO:tasks.workunit.client.0.smithi072.stdout:8/123: rename d3/d4/c1a to d3/c26 0 2024-04-15T21:02:33.256 INFO:tasks.workunit.client.1.smithi149.stdout:2/404: symlink d4/d7/d10/d6b/d21/d2c/l9a 0 2024-04-15T21:02:33.258 INFO:tasks.workunit.client.0.smithi072.stdout:3/84: creat d1/d7/f18 x:0 0 0 2024-04-15T21:02:33.258 INFO:tasks.workunit.client.0.smithi072.stdout:6/97: rmdir d2/d1a 39 2024-04-15T21:02:33.260 INFO:tasks.workunit.client.1.smithi149.stdout:6/314: unlink da/d18/d10/d16/f29 0 2024-04-15T21:02:33.264 INFO:tasks.workunit.client.1.smithi149.stdout:0/502: getdents d1/d29/d2c 0 2024-04-15T21:02:33.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/503: dread d1/d5/d24/d30/d54/f8c [0,4194304] 0 2024-04-15T21:02:33.268 INFO:tasks.workunit.client.0.smithi072.stdout:8/124: unlink d3/de/c1f 0 2024-04-15T21:02:33.274 INFO:tasks.workunit.client.0.smithi072.stdout:6/98: mkdir d2/d10/d11/d1f 0 2024-04-15T21:02:33.277 INFO:tasks.workunit.client.1.smithi149.stdout:0/504: mknod d1/d5/d24/d50/d13/d59/cb0 0 2024-04-15T21:02:33.278 INFO:tasks.workunit.client.0.smithi072.stdout:0/83: symlink d0/d19/l1e 0 2024-04-15T21:02:33.279 INFO:tasks.workunit.client.1.smithi149.stdout:8/396: write d2/df/d10/d25/d32/f42 [712013,68780] 0 2024-04-15T21:02:33.284 INFO:tasks.workunit.client.0.smithi072.stdout:2/131: link d2/d8/f28 d2/d3/f2b 0 2024-04-15T21:02:33.284 INFO:tasks.workunit.client.1.smithi149.stdout:0/505: creat d1/d29/d2c/d4f/fb1 x:0 0 0 2024-04-15T21:02:33.286 INFO:tasks.workunit.client.1.smithi149.stdout:8/397: chown d2/df/d10/d21 17190 1 2024-04-15T21:02:33.287 INFO:tasks.workunit.client.0.smithi072.stdout:6/99: link d2/d10/f1d d2/d10/d11/d15/f20 0 2024-04-15T21:02:33.290 INFO:tasks.workunit.client.0.smithi072.stdout:2/132: rename d2/d3/c20 to d2/d3/d23/c2c 0 2024-04-15T21:02:33.292 INFO:tasks.workunit.client.1.smithi149.stdout:2/405: dwrite d4/d7/d46/f54 [0,4194304] 0 2024-04-15T21:02:33.292 INFO:tasks.workunit.client.0.smithi072.stdout:3/85: unlink d1/f3 0 2024-04-15T21:02:33.294 INFO:tasks.workunit.client.0.smithi072.stdout:8/125: write d3/de/f24 [883281,47267] 0 2024-04-15T21:02:33.294 INFO:tasks.workunit.client.1.smithi149.stdout:0/506: mknod d1/d5/d24/d50/cb2 0 2024-04-15T21:02:33.294 INFO:tasks.workunit.client.0.smithi072.stdout:8/126: read f1 [1609529,11690] 0 2024-04-15T21:02:33.297 INFO:tasks.workunit.client.0.smithi072.stdout:6/100: symlink d2/l21 0 2024-04-15T21:02:33.298 INFO:tasks.workunit.client.0.smithi072.stdout:6/101: read - d2/d10/f1d zero size 2024-04-15T21:02:33.298 INFO:tasks.workunit.client.1.smithi149.stdout:0/507: read d1/d5/d24/d50/d13/d38/d44/f60 [2889171,108143] 0 2024-04-15T21:02:33.300 INFO:tasks.workunit.client.0.smithi072.stdout:2/133: symlink d2/l2d 0 2024-04-15T21:02:33.301 INFO:tasks.workunit.client.0.smithi072.stdout:8/127: mknod d3/d4/c27 0 2024-04-15T21:02:33.303 INFO:tasks.workunit.client.0.smithi072.stdout:3/86: fsync f0 0 2024-04-15T21:02:33.308 INFO:tasks.workunit.client.0.smithi072.stdout:6/102: mknod d2/d10/d18/c22 0 2024-04-15T21:02:33.312 INFO:tasks.workunit.client.0.smithi072.stdout:6/103: dread d2/f7 [0,4194304] 0 2024-04-15T21:02:33.314 INFO:tasks.workunit.client.1.smithi149.stdout:2/406: truncate d4/d7/d10/d36/f49 1821988 0 2024-04-15T21:02:33.317 INFO:tasks.workunit.client.0.smithi072.stdout:3/87: mkdir d1/d19 0 2024-04-15T21:02:33.318 INFO:tasks.workunit.client.1.smithi149.stdout:2/407: unlink d4/f99 0 2024-04-15T21:02:33.319 INFO:tasks.workunit.client.0.smithi072.stdout:6/104: rmdir d2/d10/d11 39 2024-04-15T21:02:33.320 INFO:tasks.workunit.client.0.smithi072.stdout:6/105: write d2/fb [3179824,102942] 0 2024-04-15T21:02:33.323 INFO:tasks.workunit.client.1.smithi149.stdout:2/408: creat d4/d7/d10/d6b/d21/f9b x:0 0 0 2024-04-15T21:02:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 -- 172.21.15.72:0/1357812426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 msgr2=0x7f3e940ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 --2- 172.21.15.72:0/1357812426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e940ff560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009910 tx=0x7f3e84009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 -- 172.21.15.72:0/1357812426 shutdown_connections 2024-04-15T21:02:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 --2- 172.21.15.72:0/1357812426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 0x7f3e94100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 --2- 172.21.15.72:0/1357812426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e940ff560 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 -- 172.21.15.72:0/1357812426 >> 172.21.15.72:0/1357812426 conn(0x7f3e940fa7a0 msgr2=0x7f3e940fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 -- 172.21.15.72:0/1357812426 shutdown_connections 2024-04-15T21:02:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 -- 172.21.15.72:0/1357812426 wait complete. 2024-04-15T21:02:33.325 INFO:tasks.workunit.client.1.smithi149.stdout:0/508: dwrite d1/d5/dc/f84 [0,4194304] 0 2024-04-15T21:02:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.332+0000 7f3e99430700 1 Processor -- start 2024-04-15T21:02:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e99430700 1 -- start start 2024-04-15T21:02:33.326 INFO:tasks.workunit.client.0.smithi072.stdout:2/134: rename d2/lf to d2/d3/l2e 0 2024-04-15T21:02:33.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e99430700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e99430700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 0x7f3e9419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e99430700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419b120 con 0x7f3e940ff150 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e99430700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419b260 con 0x7f3e941003f0 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42176/0 (socket says 172.21.15.72:42176) 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 -- 172.21.15.72:0/2713336657 learned_addr learned my addr 172.21.15.72:0/2713336657 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:33.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e927fc700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 0x7f3e9419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 -- 172.21.15.72:0/2713336657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 msgr2=0x7f3e9419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 0x7f3e9419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.333+0000 7f3e92ffd700 1 -- 172.21.15.72:0/2713336657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840095f0 con 0x7f3e940ff150 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.334+0000 7f3e92ffd700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e84006010 tx=0x7f3e8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.334+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8401d070 con 0x7f3e940ff150 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.334+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e8400f460 con 0x7f3e940ff150 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.334+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e84021640 con 0x7f3e940ff150 2024-04-15T21:02:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.334+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9419b4e0 con 0x7f3e940ff150 2024-04-15T21:02:33.329 INFO:tasks.workunit.client.0.smithi072.stdout:2/135: write d2/d8/f16 [3480301,41771] 0 2024-04-15T21:02:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.335+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94194bc0 con 0x7f3e940ff150 2024-04-15T21:02:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.336+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7f3e84017400 con 0x7f3e940ff150 2024-04-15T21:02:33.330 INFO:tasks.workunit.client.0.smithi072.stdout:2/136: readlink d2/d8/lc 0 2024-04-15T21:02:33.331 INFO:tasks.workunit.client.1.smithi149.stdout:2/409: truncate d4/d7/d10/d36/f47 196978 0 2024-04-15T21:02:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.337+0000 7f3e7bfff700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 0x7f3e7c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.337+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94068ab0 con 0x7f3e940ff150 2024-04-15T21:02:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.337+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3e8408df90 con 0x7f3e940ff150 2024-04-15T21:02:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.337+0000 7f3e927fc700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 0x7f3e7c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.338+0000 7f3e927fc700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 0x7f3e7c06fc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e94069eb0 tx=0x7f3e8800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:33.332 INFO:tasks.workunit.client.0.smithi072.stdout:8/128: dwrite d3/de/f11 [0,4194304] 0 2024-04-15T21:02:33.333 INFO:tasks.workunit.client.0.smithi072.stdout:3/88: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:33.337 INFO:tasks.workunit.client.0.smithi072.stdout:3/89: dread d1/f4 [0,4194304] 0 2024-04-15T21:02:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.346+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3e84093060 con 0x7f3e940ff150 2024-04-15T21:02:33.341 INFO:tasks.workunit.client.1.smithi149.stdout:0/509: getdents d1/d5 0 2024-04-15T21:02:33.344 INFO:tasks.workunit.client.0.smithi072.stdout:6/106: creat d2/d10/d11/d1f/f23 x:0 0 0 2024-04-15T21:02:33.345 INFO:tasks.workunit.client.0.smithi072.stdout:3/90: mkdir d1/d19/d1a 0 2024-04-15T21:02:33.345 INFO:tasks.workunit.client.0.smithi072.stdout:6/107: read d2/fb [2500936,125550] 0 2024-04-15T21:02:33.346 INFO:tasks.workunit.client.0.smithi072.stdout:6/108: stat d2/l21 0 2024-04-15T21:02:33.352 INFO:tasks.workunit.client.0.smithi072.stdout:6/109: dwrite d2/d10/d11/d1f/f23 [0,4194304] 0 2024-04-15T21:02:33.354 INFO:tasks.workunit.client.0.smithi072.stdout:6/110: mkdir d2/d10/d24 0 2024-04-15T21:02:33.356 INFO:tasks.workunit.client.1.smithi149.stdout:5/360: sync 2024-04-15T21:02:33.356 INFO:tasks.workunit.client.1.smithi149.stdout:9/320: sync 2024-04-15T21:02:33.356 INFO:tasks.workunit.client.1.smithi149.stdout:4/380: sync 2024-04-15T21:02:33.357 INFO:tasks.workunit.client.1.smithi149.stdout:9/321: write f4 [282959,118854] 0 2024-04-15T21:02:33.358 INFO:tasks.workunit.client.1.smithi149.stdout:4/381: chown dc/d1a/f4e 2017941 1 2024-04-15T21:02:33.360 INFO:tasks.workunit.client.1.smithi149.stdout:9/322: rmdir d23/d3c/d52 39 2024-04-15T21:02:33.361 INFO:tasks.workunit.client.0.smithi072.stdout:6/111: dwrite d2/f16 [0,4194304] 0 2024-04-15T21:02:33.362 INFO:tasks.workunit.client.0.smithi072.stdout:6/112: readlink d2/d10/d18/l19 0 2024-04-15T21:02:33.362 INFO:tasks.workunit.client.0.smithi072.stdout:6/113: chown d2/d10/d11 2410 1 2024-04-15T21:02:33.363 INFO:tasks.workunit.client.1.smithi149.stdout:4/382: creat dc/d2c/d3e/d35/d4b/f7d x:0 0 0 2024-04-15T21:02:33.366 INFO:tasks.workunit.client.1.smithi149.stdout:4/383: dread - dc/d2c/d3e/d15/d3f/f6e zero size 2024-04-15T21:02:33.366 INFO:tasks.workunit.client.1.smithi149.stdout:9/323: dwrite d23/d2b/d44/f5c [0,4194304] 0 2024-04-15T21:02:33.371 INFO:tasks.workunit.client.0.smithi072.stdout:6/114: dwrite d2/d1a/f1b [0,4194304] 0 2024-04-15T21:02:33.372 INFO:tasks.workunit.client.1.smithi149.stdout:9/324: link d23/d3c/f4e d23/d2b/d44/f64 0 2024-04-15T21:02:33.374 INFO:tasks.workunit.client.0.smithi072.stdout:6/115: mknod d2/d10/d11/d15/c25 0 2024-04-15T21:02:33.375 INFO:tasks.workunit.client.0.smithi072.stdout:6/116: chown d2/d10 456600 1 2024-04-15T21:02:33.375 INFO:tasks.workunit.client.1.smithi149.stdout:9/325: write d23/d2b/f4a [659256,37783] 0 2024-04-15T21:02:33.375 INFO:tasks.workunit.client.1.smithi149.stdout:4/384: dwrite dc/d18/d21/f67 [0,4194304] 0 2024-04-15T21:02:33.375 INFO:tasks.workunit.client.0.smithi072.stdout:6/117: dread - d2/d10/f1d zero size 2024-04-15T21:02:33.382 INFO:tasks.workunit.client.1.smithi149.stdout:9/326: dread d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:33.382 INFO:tasks.workunit.client.0.smithi072.stdout:6/118: dwrite d2/fe [0,4194304] 0 2024-04-15T21:02:33.383 INFO:tasks.workunit.client.0.smithi072.stdout:6/119: chown d2/d1a/c1e 6504060 1 2024-04-15T21:02:33.387 INFO:tasks.workunit.client.1.smithi149.stdout:9/327: creat d23/d2b/f65 x:0 0 0 2024-04-15T21:02:33.387 INFO:tasks.workunit.client.0.smithi072.stdout:6/120: write d2/fb [5740399,79294] 0 2024-04-15T21:02:33.391 INFO:tasks.workunit.client.0.smithi072.stdout:1/61: sync 2024-04-15T21:02:33.391 INFO:tasks.workunit.client.1.smithi149.stdout:9/328: creat d23/d2b/d44/f66 x:0 0 0 2024-04-15T21:02:33.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/329: fsync d23/d2b/f4f 0 2024-04-15T21:02:33.397 INFO:tasks.workunit.client.1.smithi149.stdout:9/330: creat d23/d3c/f67 x:0 0 0 2024-04-15T21:02:33.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/331: mknod d23/d3c/d52/c68 0 2024-04-15T21:02:33.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/332: dread - d23/d2b/d44/f64 zero size 2024-04-15T21:02:33.402 INFO:tasks.workunit.client.1.smithi149.stdout:9/333: mkdir d23/d2b/d37/d50/d69 0 2024-04-15T21:02:33.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/334: symlink d23/d3c/d52/l6a 0 2024-04-15T21:02:33.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/335: link f17 d23/d3c/f6b 0 2024-04-15T21:02:33.411 INFO:tasks.workunit.client.1.smithi149.stdout:9/336: link d23/d3c/d52/l61 d23/d2b/d37/d50/l6c 0 2024-04-15T21:02:33.413 INFO:tasks.workunit.client.1.smithi149.stdout:9/337: mkdir d23/d2b/d37/d6d 0 2024-04-15T21:02:33.423 INFO:tasks.workunit.client.1.smithi149.stdout:2/410: dwrite d4/d7/d46/f57 [0,4194304] 0 2024-04-15T21:02:33.424 INFO:tasks.workunit.client.1.smithi149.stdout:2/411: fsync d4/d7/d10/d6b/d21/d3b/f44 0 2024-04-15T21:02:33.424 INFO:tasks.workunit.client.0.smithi072.stdout:2/137: dwrite d2/d3/f2b [0,4194304] 0 2024-04-15T21:02:33.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/412: rename d4/d7/d10 to d4/d7/d10/d6b/d21/d3b/d9c 22 2024-04-15T21:02:33.430 INFO:tasks.workunit.client.1.smithi149.stdout:0/510: write d1/d5/f4a [3724912,125332] 0 2024-04-15T21:02:33.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/413: write d4/d7/d10/d6b/d21/d2c/d58/f8e [1013740,4867] 0 2024-04-15T21:02:33.432 INFO:tasks.workunit.client.0.smithi072.stdout:3/91: write d1/d7/fb [163045,114280] 0 2024-04-15T21:02:33.434 INFO:tasks.workunit.client.1.smithi149.stdout:5/361: write d0/d9/db/f7b [542615,60990] 0 2024-04-15T21:02:33.442 INFO:tasks.workunit.client.1.smithi149.stdout:2/414: mkdir d4/d7/d10/d6b/d21/d2c/d3e/d9d 0 2024-04-15T21:02:33.446 INFO:tasks.workunit.client.1.smithi149.stdout:0/511: dwrite d1/d5/d24/d50/d13/d38/f68 [0,4194304] 0 2024-04-15T21:02:33.451 INFO:tasks.workunit.client.1.smithi149.stdout:0/512: creat d1/d5/d24/d30/d92/fb3 x:0 0 0 2024-04-15T21:02:33.452 INFO:tasks.workunit.client.1.smithi149.stdout:2/415: dwrite d4/f33 [4194304,4194304] 0 2024-04-15T21:02:33.455 INFO:tasks.workunit.client.0.smithi072.stdout:1/62: dwrite d5/fe [0,4194304] 0 2024-04-15T21:02:33.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/416: creat d4/d7/d10/d6b/d21/d55/f9e x:0 0 0 2024-04-15T21:02:33.462 INFO:tasks.workunit.client.0.smithi072.stdout:2/138: write d2/d3/d23/f27 [602660,7868] 0 2024-04-15T21:02:33.466 INFO:tasks.workunit.client.0.smithi072.stdout:1/63: dwrite d5/db/f12 [0,4194304] 0 2024-04-15T21:02:33.468 INFO:tasks.workunit.client.1.smithi149.stdout:0/513: dread d1/d5/d24/d50/d15/f89 [0,4194304] 0 2024-04-15T21:02:33.470 INFO:tasks.workunit.client.0.smithi072.stdout:2/139: creat d2/d8/f2f x:0 0 0 2024-04-15T21:02:33.470 INFO:tasks.workunit.client.1.smithi149.stdout:5/362: dread d0/d9/db/d3d/f62 [0,4194304] 0 2024-04-15T21:02:33.471 INFO:tasks.workunit.client.1.smithi149.stdout:0/514: read d1/d9/f6b [238867,63729] 0 2024-04-15T21:02:33.472 INFO:tasks.workunit.client.0.smithi072.stdout:3/92: dwrite d1/f6 [0,4194304] 0 2024-04-15T21:02:33.472 INFO:tasks.workunit.client.0.smithi072.stdout:2/140: write d2/d8/fe [2440823,16973] 0 2024-04-15T21:02:33.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/363: truncate d0/d9/db/d12/f6e 988736 0 2024-04-15T21:02:33.474 INFO:tasks.workunit.client.1.smithi149.stdout:0/515: chown d1/d5/d24/d50/d15/c4c 16257618 1 2024-04-15T21:02:33.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/364: dread - d0/d6/f6f zero size 2024-04-15T21:02:33.474 INFO:tasks.workunit.client.1.smithi149.stdout:0/516: chown d1/d9/l56 272301336 1 2024-04-15T21:02:33.474 INFO:tasks.workunit.client.0.smithi072.stdout:3/93: dread - d1/d7/f18 zero size 2024-04-15T21:02:33.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/365: truncate d0/d6/f6f 420236 0 2024-04-15T21:02:33.476 INFO:tasks.workunit.client.0.smithi072.stdout:2/141: unlink d2/d8/f16 0 2024-04-15T21:02:33.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/517: creat d1/d9/d64/d65/fb4 x:0 0 0 2024-04-15T21:02:33.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/142: rename d2/d3/f2b to d2/d8/f30 0 2024-04-15T21:02:33.486 INFO:tasks.workunit.client.0.smithi072.stdout:3/94: write d1/d7/f13 [448925,43070] 0 2024-04-15T21:02:33.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/366: symlink d0/d9/db/d12/d16/d28/d1b/d83/l86 0 2024-04-15T21:02:33.490 INFO:tasks.workunit.client.0.smithi072.stdout:3/95: dread d1/ff [0,4194304] 0 2024-04-15T21:02:33.493 INFO:tasks.workunit.client.0.smithi072.stdout:2/143: rename d2/d3/l2e to d2/d8/l31 0 2024-04-15T21:02:33.493 INFO:tasks.workunit.client.0.smithi072.stdout:2/144: fdatasync d2/d3/f1f 0 2024-04-15T21:02:33.494 INFO:tasks.workunit.client.0.smithi072.stdout:3/96: stat d1/fa 0 2024-04-15T21:02:33.494 INFO:tasks.workunit.client.1.smithi149.stdout:5/367: dwrite d0/d9/db/d12/d2b/f78 [0,4194304] 0 2024-04-15T21:02:33.497 INFO:tasks.workunit.client.0.smithi072.stdout:1/64: fsync d5/db/f12 0 2024-04-15T21:02:33.499 INFO:tasks.workunit.client.0.smithi072.stdout:2/145: symlink d2/d3/d23/l32 0 2024-04-15T21:02:33.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/65: unlink c1 0 2024-04-15T21:02:33.504 INFO:tasks.workunit.client.0.smithi072.stdout:1/66: write d5/db/fc [395530,6320] 0 2024-04-15T21:02:33.505 INFO:tasks.workunit.client.1.smithi149.stdout:0/518: dwrite d1/d29/f90 [0,4194304] 0 2024-04-15T21:02:33.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/368: symlink d0/d6/d79/l87 0 2024-04-15T21:02:33.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/369: stat d0/d9/db 0 2024-04-15T21:02:33.508 INFO:tasks.workunit.client.1.smithi149.stdout:5/370: stat d0/d9/db/d12/d16/d28/d1b/f1f 0 2024-04-15T21:02:33.508 INFO:tasks.workunit.client.0.smithi072.stdout:1/67: fdatasync d5/f9 0 2024-04-15T21:02:33.509 INFO:tasks.workunit.client.1.smithi149.stdout:0/519: read d1/d5/d24/d30/f5a [473624,33695] 0 2024-04-15T21:02:33.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/371: truncate d0/f56 388891 0 2024-04-15T21:02:33.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/269: sync 2024-04-15T21:02:33.511 INFO:tasks.workunit.client.0.smithi072.stdout:3/97: link d1/f14 d1/d19/d1a/f1b 0 2024-04-15T21:02:33.512 INFO:tasks.workunit.client.0.smithi072.stdout:3/98: dread - d1/d7/f18 zero size 2024-04-15T21:02:33.516 INFO:tasks.workunit.client.0.smithi072.stdout:1/68: creat d5/db/d10/f13 x:0 0 0 2024-04-15T21:02:33.517 INFO:tasks.workunit.client.1.smithi149.stdout:5/372: write d0/f3 [1004933,78364] 0 2024-04-15T21:02:33.518 INFO:tasks.workunit.client.1.smithi149.stdout:0/520: dwrite d1/d5/d24/d30/f5a [0,4194304] 0 2024-04-15T21:02:33.522 INFO:tasks.workunit.client.1.smithi149.stdout:5/373: symlink d0/d9/db/l88 0 2024-04-15T21:02:33.525 INFO:tasks.workunit.client.0.smithi072.stdout:3/99: creat d1/d7/f1c x:0 0 0 2024-04-15T21:02:33.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/521: dread d1/d5/d24/d30/d54/f8c [0,4194304] 0 2024-04-15T21:02:33.526 INFO:tasks.workunit.client.0.smithi072.stdout:1/69: creat d5/f14 x:0 0 0 2024-04-15T21:02:33.527 INFO:tasks.workunit.client.0.smithi072.stdout:1/70: read d5/f8 [27193,27743] 0 2024-04-15T21:02:33.529 INFO:tasks.workunit.client.0.smithi072.stdout:3/100: chown d1/d7/f9 375584832 1 2024-04-15T21:02:33.529 INFO:tasks.workunit.client.1.smithi149.stdout:0/522: mknod d1/d9/d64/d73/cb5 0 2024-04-15T21:02:33.529 INFO:tasks.workunit.client.1.smithi149.stdout:5/374: dwrite d0/d9/db/f7b [0,4194304] 0 2024-04-15T21:02:33.531 INFO:tasks.workunit.client.0.smithi072.stdout:2/146: dwrite d2/f12 [0,4194304] 0 2024-04-15T21:02:33.532 INFO:tasks.workunit.client.0.smithi072.stdout:3/101: creat d1/d19/d1a/f1d x:0 0 0 2024-04-15T21:02:33.535 INFO:tasks.workunit.client.0.smithi072.stdout:3/102: dread - d1/d19/d1a/f1d zero size 2024-04-15T21:02:33.539 INFO:tasks.workunit.client.0.smithi072.stdout:3/103: chown d1/d7/fb 58775 1 2024-04-15T21:02:33.539 INFO:tasks.workunit.client.0.smithi072.stdout:1/71: dwrite d5/fe [4194304,4194304] 0 2024-04-15T21:02:33.541 INFO:tasks.workunit.client.0.smithi072.stdout:3/104: write d1/d7/f18 [76721,77760] 0 2024-04-15T21:02:33.543 INFO:tasks.workunit.client.0.smithi072.stdout:2/147: dread d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:33.545 INFO:tasks.workunit.client.0.smithi072.stdout:2/148: write d2/d3/f15 [956166,68783] 0 2024-04-15T21:02:33.547 INFO:tasks.workunit.client.1.smithi149.stdout:5/375: rename d0/d9/db/f10 to d0/f89 0 2024-04-15T21:02:33.550 INFO:tasks.workunit.client.0.smithi072.stdout:1/72: dwrite d5/f14 [0,4194304] 0 2024-04-15T21:02:33.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/523: truncate d1/f7b 10881 0 2024-04-15T21:02:33.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/524: mkdir d1/d5/d24/d30/d43/db6 0 2024-04-15T21:02:33.556 INFO:tasks.workunit.client.0.smithi072.stdout:2/149: creat d2/d3/f33 x:0 0 0 2024-04-15T21:02:33.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/525: symlink d1/d5/d24/d50/d13/d38/lb7 0 2024-04-15T21:02:33.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/526: creat d1/d5/fb8 x:0 0 0 2024-04-15T21:02:33.560 INFO:tasks.workunit.client.0.smithi072.stdout:3/105: write d1/f4 [2318135,102067] 0 2024-04-15T21:02:33.560 INFO:tasks.workunit.client.1.smithi149.stdout:0/527: readlink d1/d29/d2c/d4f/lae 0 2024-04-15T21:02:33.561 INFO:tasks.workunit.client.0.smithi072.stdout:1/73: dwrite d5/f9 [4194304,4194304] 0 2024-04-15T21:02:33.562 INFO:tasks.workunit.client.0.smithi072.stdout:2/150: unlink d2/d3/d23/f27 0 2024-04-15T21:02:33.566 INFO:tasks.workunit.client.0.smithi072.stdout:1/74: mknod d5/db/d10/c15 0 2024-04-15T21:02:33.566 INFO:tasks.workunit.client.0.smithi072.stdout:2/151: dread d2/f12 [0,4194304] 0 2024-04-15T21:02:33.568 INFO:tasks.workunit.client.0.smithi072.stdout:3/106: truncate d1/d7/f11 86610 0 2024-04-15T21:02:33.570 INFO:tasks.workunit.client.0.smithi072.stdout:1/75: mknod d5/c16 0 2024-04-15T21:02:33.571 INFO:tasks.workunit.client.0.smithi072.stdout:3/107: fsync d1/f10 0 2024-04-15T21:02:33.571 INFO:tasks.workunit.client.0.smithi072.stdout:2/152: dread d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:33.572 INFO:tasks.workunit.client.0.smithi072.stdout:1/76: truncate d5/db/d10/f13 979677 0 2024-04-15T21:02:33.574 INFO:tasks.workunit.client.0.smithi072.stdout:2/153: fsync d2/d3/f17 0 2024-04-15T21:02:33.578 INFO:tasks.workunit.client.0.smithi072.stdout:2/154: mknod d2/d3/d23/c34 0 2024-04-15T21:02:33.579 INFO:tasks.workunit.client.0.smithi072.stdout:2/155: stat d2/d3/d23/c26 0 2024-04-15T21:02:33.582 INFO:tasks.workunit.client.0.smithi072.stdout:2/156: unlink d2/d3/f1f 0 2024-04-15T21:02:33.583 INFO:tasks.workunit.client.0.smithi072.stdout:2/157: chown d2/d3/c1b 5 1 2024-04-15T21:02:33.584 INFO:tasks.workunit.client.0.smithi072.stdout:3/108: link d1/d19/d1a/f1b d1/d7/f1e 0 2024-04-15T21:02:33.586 INFO:tasks.workunit.client.0.smithi072.stdout:1/77: getdents d5/db 0 2024-04-15T21:02:33.586 INFO:tasks.workunit.client.0.smithi072.stdout:1/78: fsync d5/db/d10/f13 0 2024-04-15T21:02:33.587 INFO:tasks.workunit.client.1.smithi149.stdout:0/528: link d1/d5/c8 d1/d5/d24/d8a/cb9 0 2024-04-15T21:02:33.590 INFO:tasks.workunit.client.1.smithi149.stdout:0/529: symlink d1/d5/d24/d50/d15/lba 0 2024-04-15T21:02:33.592 INFO:tasks.workunit.client.0.smithi072.stdout:2/158: write d2/d3/f5 [4777793,9408] 0 2024-04-15T21:02:33.593 INFO:tasks.workunit.client.0.smithi072.stdout:5/84: sync 2024-04-15T21:02:33.593 INFO:tasks.workunit.client.0.smithi072.stdout:9/116: sync 2024-04-15T21:02:33.593 INFO:tasks.workunit.client.0.smithi072.stdout:3/109: mkdir d1/d1f 0 2024-04-15T21:02:33.595 INFO:tasks.workunit.client.0.smithi072.stdout:1/79: link d5/db/fc d5/f17 0 2024-04-15T21:02:33.595 INFO:tasks.workunit.client.0.smithi072.stdout:3/110: creat d1/d19/d1a/f20 x:0 0 0 2024-04-15T21:02:33.598 INFO:tasks.workunit.client.0.smithi072.stdout:1/80: rmdir d5/db/d10 39 2024-04-15T21:02:33.600 INFO:tasks.workunit.client.0.smithi072.stdout:9/117: getdents d4 0 2024-04-15T21:02:33.601 INFO:tasks.workunit.client.0.smithi072.stdout:2/159: dwrite d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:33.602 INFO:tasks.workunit.client.0.smithi072.stdout:3/111: dread d1/fa [0,4194304] 0 2024-04-15T21:02:33.602 INFO:tasks.workunit.client.0.smithi072.stdout:5/85: truncate d0/fa 577800 0 2024-04-15T21:02:33.603 INFO:tasks.workunit.client.0.smithi072.stdout:9/118: mknod d4/d1f/c20 0 2024-04-15T21:02:33.603 INFO:tasks.workunit.client.0.smithi072.stdout:1/81: dread d5/db/d10/f13 [0,4194304] 0 2024-04-15T21:02:33.604 INFO:tasks.workunit.client.0.smithi072.stdout:1/82: chown d5/db/d10 14586051 1 2024-04-15T21:02:33.605 INFO:tasks.workunit.client.0.smithi072.stdout:3/112: symlink d1/d7/l21 0 2024-04-15T21:02:33.605 INFO:tasks.workunit.client.0.smithi072.stdout:9/119: read d4/fc [1858124,37991] 0 2024-04-15T21:02:33.609 INFO:tasks.workunit.client.0.smithi072.stdout:5/86: chown d0/fa 73 1 2024-04-15T21:02:33.614 INFO:tasks.workunit.client.0.smithi072.stdout:9/120: rename c1 to d4/c21 0 2024-04-15T21:02:33.614 INFO:tasks.workunit.client.0.smithi072.stdout:5/87: rename d0/d3/d6/d14 to d0/d3/d6/d14/d15 22 2024-04-15T21:02:33.614 INFO:tasks.workunit.client.0.smithi072.stdout:1/83: symlink d5/l18 0 2024-04-15T21:02:33.615 INFO:tasks.workunit.client.0.smithi072.stdout:5/88: chown d0/d3/d6/f8 550104 1 2024-04-15T21:02:33.615 INFO:tasks.workunit.client.0.smithi072.stdout:1/84: chown d5/f8 4380269 1 2024-04-15T21:02:33.617 INFO:tasks.workunit.client.0.smithi072.stdout:2/160: truncate d2/d3/f15 3492958 0 2024-04-15T21:02:33.621 INFO:tasks.workunit.client.0.smithi072.stdout:1/85: getdents d5/db 0 2024-04-15T21:02:33.622 INFO:tasks.workunit.client.0.smithi072.stdout:1/86: readlink d5/l18 0 2024-04-15T21:02:33.623 INFO:tasks.workunit.client.0.smithi072.stdout:5/89: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:33.624 INFO:tasks.workunit.client.0.smithi072.stdout:1/87: chown d5/f6 627 1 2024-04-15T21:02:33.629 INFO:tasks.workunit.client.0.smithi072.stdout:1/88: rmdir d5/db/d10 39 2024-04-15T21:02:33.629 INFO:tasks.workunit.client.0.smithi072.stdout:2/161: dwrite d2/d3/f33 [0,4194304] 0 2024-04-15T21:02:33.631 INFO:tasks.workunit.client.0.smithi072.stdout:9/121: rename d4/l14 to d4/d1f/l22 0 2024-04-15T21:02:33.632 INFO:tasks.workunit.client.0.smithi072.stdout:1/89: dread d5/f8 [0,4194304] 0 2024-04-15T21:02:33.633 INFO:tasks.workunit.client.0.smithi072.stdout:3/113: dwrite d1/d7/f11 [0,4194304] 0 2024-04-15T21:02:33.635 INFO:tasks.workunit.client.0.smithi072.stdout:2/162: dread d2/d8/f13 [0,4194304] 0 2024-04-15T21:02:33.635 INFO:tasks.workunit.client.0.smithi072.stdout:3/114: dread - d1/f17 zero size 2024-04-15T21:02:33.635 INFO:tasks.workunit.client.0.smithi072.stdout:5/90: creat d0/d3/f16 x:0 0 0 2024-04-15T21:02:33.637 INFO:tasks.workunit.client.0.smithi072.stdout:5/91: chown d0/d3/d7/d12 75488 1 2024-04-15T21:02:33.646 INFO:tasks.workunit.client.0.smithi072.stdout:2/163: chown d2/d3/d23/c2c 0 1 2024-04-15T21:02:33.653 INFO:tasks.workunit.client.0.smithi072.stdout:5/92: mknod d0/d3/d6/d14/c17 0 2024-04-15T21:02:33.656 INFO:tasks.workunit.client.0.smithi072.stdout:2/164: symlink d2/l35 0 2024-04-15T21:02:33.658 INFO:tasks.workunit.client.0.smithi072.stdout:3/115: write d1/d7/f9 [321527,24396] 0 2024-04-15T21:02:33.659 INFO:tasks.workunit.client.0.smithi072.stdout:5/93: creat d0/d3/d6/d14/f18 x:0 0 0 2024-04-15T21:02:33.659 INFO:tasks.workunit.client.0.smithi072.stdout:1/90: link d5/l18 d5/db/l19 0 2024-04-15T21:02:33.660 INFO:tasks.workunit.client.0.smithi072.stdout:9/122: symlink d4/d1f/l23 0 2024-04-15T21:02:33.661 INFO:tasks.workunit.client.0.smithi072.stdout:5/94: truncate d0/d3/f16 988929 0 2024-04-15T21:02:33.661 INFO:tasks.workunit.client.0.smithi072.stdout:5/95: chown d0/d3 496060763 1 2024-04-15T21:02:33.661 INFO:tasks.workunit.client.0.smithi072.stdout:2/165: rmdir d2/d3 39 2024-04-15T21:02:33.663 INFO:tasks.workunit.client.0.smithi072.stdout:5/96: fsync d0/d3/d6/f8 0 2024-04-15T21:02:33.664 INFO:tasks.workunit.client.0.smithi072.stdout:9/123: creat d4/d1f/f24 x:0 0 0 2024-04-15T21:02:33.665 INFO:tasks.workunit.client.0.smithi072.stdout:2/166: stat d2/d3 0 2024-04-15T21:02:33.667 INFO:tasks.workunit.client.0.smithi072.stdout:1/91: dwrite d5/f6 [0,4194304] 0 2024-04-15T21:02:33.670 INFO:tasks.workunit.client.0.smithi072.stdout:9/124: mknod d4/d1f/c25 0 2024-04-15T21:02:33.672 INFO:tasks.workunit.client.0.smithi072.stdout:2/167: creat d2/d8/f36 x:0 0 0 2024-04-15T21:02:33.673 INFO:tasks.workunit.client.0.smithi072.stdout:5/97: symlink d0/d3/d7/d12/l19 0 2024-04-15T21:02:33.674 INFO:tasks.workunit.client.0.smithi072.stdout:3/116: write d1/d19/d1a/f1b [5225994,90297] 0 2024-04-15T21:02:33.679 INFO:tasks.workunit.client.0.smithi072.stdout:5/98: creat d0/d3/d7/d12/f1a x:0 0 0 2024-04-15T21:02:33.682 INFO:tasks.workunit.client.0.smithi072.stdout:5/99: creat d0/d3/d6/d14/f1b x:0 0 0 2024-04-15T21:02:33.684 INFO:tasks.workunit.client.0.smithi072.stdout:3/117: rename d1/d19/d1a/f20 to d1/d7/f22 0 2024-04-15T21:02:33.707 INFO:tasks.workunit.client.0.smithi072.stdout:3/118: mknod d1/d15/c23 0 2024-04-15T21:02:33.707 INFO:tasks.workunit.client.0.smithi072.stdout:5/100: fsync d0/d3/d6/ff 0 2024-04-15T21:02:33.707 INFO:tasks.workunit.client.0.smithi072.stdout:9/125: write d4/fc [3862456,25619] 0 2024-04-15T21:02:33.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/126: rmdir d4 39 2024-04-15T21:02:33.710 INFO:tasks.workunit.client.0.smithi072.stdout:5/101: chown d0/d3/d6/f8 11 1 2024-04-15T21:02:33.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.745+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e94068c40 con 0x7f3e940ff150 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.745+0000 7f3e7bfff700 1 -- 172.21.15.72:0/2713336657 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f3e84026310 con 0x7f3e940ff150 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:02:33.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:02:33.739 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 msgr2=0x7f3e7c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 0x7f3e7c06fc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e94069eb0 tx=0x7f3e8800b410 comp rx=0 tx=0).stop 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 msgr2=0x7f3e94069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e84006010 tx=0x7f3e8400bd70 comp rx=0 tx=0).stop 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 shutdown_connections 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f3e7c06d7e0 0x7f3e7c06fc90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e940ff150 0x7f3e94069930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 --2- 172.21.15.72:0/2713336657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e941003f0 0x7f3e9419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 >> 172.21.15.72:0/2713336657 conn(0x7f3e940fa7a0 msgr2=0x7f3e941036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 shutdown_connections 2024-04-15T21:02:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.748+0000 7f3e99430700 1 -- 172.21.15.72:0/2713336657 wait complete. 2024-04-15T21:02:33.805 INFO:tasks.workunit.client.0.smithi072.stdout:7/82: sync 2024-04-15T21:02:33.806 INFO:tasks.workunit.client.0.smithi072.stdout:4/81: sync 2024-04-15T21:02:33.806 INFO:tasks.workunit.client.0.smithi072.stdout:5/102: unlink d0/c11 0 2024-04-15T21:02:33.807 INFO:tasks.workunit.client.0.smithi072.stdout:3/119: link f0 d1/d1f/f24 0 2024-04-15T21:02:33.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/82: dread - f6 zero size 2024-04-15T21:02:33.808 INFO:tasks.workunit.client.0.smithi072.stdout:1/92: dwrite d5/f17 [0,4194304] 0 2024-04-15T21:02:33.810 INFO:tasks.workunit.client.0.smithi072.stdout:9/127: write d4/f5 [7518542,93503] 0 2024-04-15T21:02:33.812 INFO:tasks.workunit.client.0.smithi072.stdout:5/103: write d0/d3/d6/f8 [1864065,43264] 0 2024-04-15T21:02:33.815 INFO:tasks.workunit.client.0.smithi072.stdout:4/83: creat d7/d10/f1a x:0 0 0 2024-04-15T21:02:33.815 INFO:tasks.workunit.client.0.smithi072.stdout:7/83: truncate d2/db/f19 395046 0 2024-04-15T21:02:33.815 INFO:tasks.workunit.client.0.smithi072.stdout:3/120: mknod d1/d7/c25 0 2024-04-15T21:02:33.817 INFO:tasks.workunit.client.0.smithi072.stdout:7/84: dread d2/db/f19 [0,4194304] 0 2024-04-15T21:02:33.818 INFO:tasks.workunit.client.0.smithi072.stdout:7/85: stat d2/f18 0 2024-04-15T21:02:33.819 INFO:tasks.workunit.client.0.smithi072.stdout:1/93: creat d5/db/f1a x:0 0 0 2024-04-15T21:02:33.821 INFO:tasks.workunit.client.0.smithi072.stdout:3/121: mkdir d1/d26 0 2024-04-15T21:02:33.821 INFO:tasks.workunit.client.0.smithi072.stdout:4/84: creat d7/f1b x:0 0 0 2024-04-15T21:02:33.824 INFO:tasks.workunit.client.0.smithi072.stdout:3/122: fdatasync d1/d7/f11 0 2024-04-15T21:02:33.825 INFO:tasks.workunit.client.0.smithi072.stdout:9/128: dwrite d4/d1f/f24 [0,4194304] 0 2024-04-15T21:02:33.828 INFO:tasks.workunit.client.0.smithi072.stdout:7/86: link d2/fa d2/d10/f1b 0 2024-04-15T21:02:33.830 INFO:tasks.workunit.client.0.smithi072.stdout:5/104: dwrite d0/d3/d6/d14/f18 [0,4194304] 0 2024-04-15T21:02:33.833 INFO:tasks.workunit.client.0.smithi072.stdout:4/85: link d7/d10/f11 d7/f1c 0 2024-04-15T21:02:33.837 INFO:tasks.workunit.client.0.smithi072.stdout:5/105: symlink d0/d3/d6/d14/l1c 0 2024-04-15T21:02:33.842 INFO:tasks.workunit.client.0.smithi072.stdout:4/86: mkdir d7/d1d 0 2024-04-15T21:02:33.842 INFO:tasks.workunit.client.0.smithi072.stdout:7/87: getdents d2/d10 0 2024-04-15T21:02:33.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/123: dwrite d1/f6 [0,4194304] 0 2024-04-15T21:02:33.843 INFO:tasks.workunit.client.0.smithi072.stdout:4/87: chown d7/f19 48655 1 2024-04-15T21:02:33.844 INFO:tasks.workunit.client.0.smithi072.stdout:5/106: mkdir d0/d3/d7/d12/d1d 0 2024-04-15T21:02:33.845 INFO:tasks.workunit.client.0.smithi072.stdout:1/94: dwrite d5/db/f1a [0,4194304] 0 2024-04-15T21:02:33.846 INFO:tasks.workunit.client.0.smithi072.stdout:4/88: chown d7/d15/l18 46573 1 2024-04-15T21:02:33.850 INFO:tasks.workunit.client.0.smithi072.stdout:4/89: chown d7/l13 77 1 2024-04-15T21:02:33.850 INFO:tasks.workunit.client.0.smithi072.stdout:4/90: fdatasync d7/f19 0 2024-04-15T21:02:33.850 INFO:tasks.workunit.client.0.smithi072.stdout:5/107: symlink d0/l1e 0 2024-04-15T21:02:33.852 INFO:tasks.workunit.client.0.smithi072.stdout:4/91: unlink d7/fb 0 2024-04-15T21:02:33.852 INFO:tasks.workunit.client.0.smithi072.stdout:1/95: dread d5/db/f12 [0,4194304] 0 2024-04-15T21:02:33.854 INFO:tasks.workunit.client.0.smithi072.stdout:1/96: write d5/f6 [378967,57483] 0 2024-04-15T21:02:33.856 INFO:tasks.workunit.client.0.smithi072.stdout:3/124: rename d1/d7/f1e to d1/d7/f27 0 2024-04-15T21:02:33.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/108: mkdir d0/d3/d7/d1f 0 2024-04-15T21:02:33.861 INFO:tasks.workunit.client.0.smithi072.stdout:1/97: rmdir d5/db 39 2024-04-15T21:02:33.864 INFO:tasks.workunit.client.0.smithi072.stdout:5/109: symlink d0/l20 0 2024-04-15T21:02:33.865 INFO:tasks.workunit.client.0.smithi072.stdout:5/110: dread - d0/d3/d7/d12/f1a zero size 2024-04-15T21:02:33.866 INFO:tasks.workunit.client.0.smithi072.stdout:3/125: creat d1/f28 x:0 0 0 2024-04-15T21:02:33.866 INFO:tasks.workunit.client.0.smithi072.stdout:4/92: rmdir d7 39 2024-04-15T21:02:33.867 INFO:tasks.workunit.client.0.smithi072.stdout:5/111: write d0/d3/d6/d14/f18 [3362194,55178] 0 2024-04-15T21:02:33.867 INFO:tasks.workunit.client.0.smithi072.stdout:5/112: stat d0/d3/f4 0 2024-04-15T21:02:33.871 INFO:tasks.workunit.client.0.smithi072.stdout:3/126: read d1/d1f/f24 [197851,98826] 0 2024-04-15T21:02:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 -- 172.21.15.72:0/745288007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704101440 msgr2=0x7f6704101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 --2- 172.21.15.72:0/745288007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704101440 0x7f6704101890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009910 tx=0x7f66f8009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 -- 172.21.15.72:0/745288007 shutdown_connections 2024-04-15T21:02:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 --2- 172.21.15.72:0/745288007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704101440 0x7f6704101890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 --2- 172.21.15.72:0/745288007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704100240 0x7f6704100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 -- 172.21.15.72:0/745288007 >> 172.21.15.72:0/745288007 conn(0x7f67040fb7f0 msgr2=0x7f67040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:33.873 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:33 smithi072 ceph-mon[29079]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:33.873 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:33 smithi072 ceph-mon[29079]: pgmap v273: 65 pgs: 65 active+clean; 894 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 98 MiB/s wr, 288 op/s 2024-04-15T21:02:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 -- 172.21.15.72:0/745288007 shutdown_connections 2024-04-15T21:02:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.880+0000 7f6708be5700 1 -- 172.21.15.72:0/745288007 wait complete. 2024-04-15T21:02:33.874 INFO:tasks.workunit.client.0.smithi072.stdout:1/98: link c0 d5/c1b 0 2024-04-15T21:02:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.881+0000 7f6708be5700 1 Processor -- start 2024-04-15T21:02:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6708be5700 1 -- start start 2024-04-15T21:02:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6708be5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 0x7f6704197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.875 INFO:tasks.workunit.client.0.smithi072.stdout:3/127: creat d1/d26/f29 x:0 0 0 2024-04-15T21:02:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6708be5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6708be5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6704198840 con 0x7f6704100240 2024-04-15T21:02:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6708be5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670419d250 con 0x7f6704101440 2024-04-15T21:02:33.876 INFO:tasks.workunit.client.0.smithi072.stdout:1/99: dread d5/f8 [0,4194304] 0 2024-04-15T21:02:33.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6701d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6701d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:59012/0 (socket says 172.21.15.72:59012) 2024-04-15T21:02:33.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f6701d9b700 1 -- 172.21.15.72:0/4204949455 learned_addr learned my addr 172.21.15.72:0/4204949455 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:33.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.882+0000 7f670259c700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 0x7f6704197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.877 INFO:tasks.workunit.client.0.smithi072.stdout:3/128: stat d1/d7/fb 0 2024-04-15T21:02:33.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f670259c700 1 -- 172.21.15.72:0/4204949455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 msgr2=0x7f6704198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f670259c700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f670259c700 1 -- 172.21.15.72:0/4204949455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80095f0 con 0x7f6704100240 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f6701d9b700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f670259c700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 0x7f6704197ce0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f66f400eaa0 tx=0x7f66f400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66f40041f0 con 0x7f6704100240 2024-04-15T21:02:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.883+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66f400cd30 con 0x7f6704100240 2024-04-15T21:02:33.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/113: truncate d0/d3/f4 108417 0 2024-04-15T21:02:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.884+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670419d450 con 0x7f6704100240 2024-04-15T21:02:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.884+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66f4003dc0 con 0x7f6704100240 2024-04-15T21:02:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.884+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670419d970 con 0x7f6704100240 2024-04-15T21:02:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.885+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6704073fa0 con 0x7f6704100240 2024-04-15T21:02:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.885+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7f66f400c880 con 0x7f6704100240 2024-04-15T21:02:33.879 INFO:tasks.workunit.client.0.smithi072.stdout:5/114: creat d0/d13/f21 x:0 0 0 2024-04-15T21:02:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.886+0000 7f66f37fe700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 0x7f66ec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.886+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f66f4014070 con 0x7f6704100240 2024-04-15T21:02:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.886+0000 7f6701d9b700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 0x7f66ec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.887+0000 7f6701d9b700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 0x7f66ec06fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f8005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:33.881 INFO:tasks.workunit.client.0.smithi072.stdout:3/129: getdents d1/d19/d1a 0 2024-04-15T21:02:33.881 INFO:tasks.workunit.client.0.smithi072.stdout:5/115: truncate d0/d3/f16 1060077 0 2024-04-15T21:02:33.881 INFO:tasks.workunit.client.0.smithi072.stdout:3/130: stat d1/d19/d1a/f1b 0 2024-04-15T21:02:33.882 INFO:tasks.workunit.client.0.smithi072.stdout:1/100: dwrite d5/f9 [0,4194304] 0 2024-04-15T21:02:33.884 INFO:tasks.workunit.client.0.smithi072.stdout:1/101: write d5/f14 [2594690,8442] 0 2024-04-15T21:02:33.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/376: sync 2024-04-15T21:02:33.884 INFO:tasks.workunit.client.1.smithi149.stdout:3/368: sync 2024-04-15T21:02:33.884 INFO:tasks.workunit.client.1.smithi149.stdout:6/315: sync 2024-04-15T21:02:33.885 INFO:tasks.workunit.client.0.smithi072.stdout:5/116: symlink d0/d3/d7/d1f/l22 0 2024-04-15T21:02:33.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:33.893+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f66f4057b30 con 0x7f6704100240 2024-04-15T21:02:33.889 INFO:tasks.workunit.client.0.smithi072.stdout:5/117: rmdir d0/d3/d6 39 2024-04-15T21:02:33.891 INFO:tasks.workunit.client.0.smithi072.stdout:1/102: rename d5/db to d5/db/d10/d1c 22 2024-04-15T21:02:33.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/369: rmdir d1/db/d24/d2b/d5c 0 2024-04-15T21:02:33.894 INFO:tasks.workunit.client.1.smithi149.stdout:6/316: rmdir da/d18/d10/d66/d59 0 2024-04-15T21:02:33.895 INFO:tasks.workunit.client.0.smithi072.stdout:3/131: truncate d1/f14 1657789 0 2024-04-15T21:02:33.896 INFO:tasks.workunit.client.0.smithi072.stdout:3/132: fsync d1/d7/f11 0 2024-04-15T21:02:33.896 INFO:tasks.workunit.client.0.smithi072.stdout:5/118: mkdir d0/d3/d23 0 2024-04-15T21:02:33.897 INFO:tasks.workunit.client.0.smithi072.stdout:3/133: write d1/d7/fb [345217,78230] 0 2024-04-15T21:02:33.897 INFO:tasks.workunit.client.1.smithi149.stdout:3/370: write d1/db/f1d [4658388,25555] 0 2024-04-15T21:02:33.898 INFO:tasks.workunit.client.0.smithi072.stdout:3/134: write d1/f6 [2965442,110523] 0 2024-04-15T21:02:33.899 INFO:tasks.workunit.client.1.smithi149.stdout:6/317: dread da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:33.900 INFO:tasks.workunit.client.1.smithi149.stdout:6/318: fdatasync da/d49/d55/f61 0 2024-04-15T21:02:33.906 INFO:tasks.workunit.client.0.smithi072.stdout:1/103: truncate d5/db/d10/f13 193167 0 2024-04-15T21:02:33.907 INFO:tasks.workunit.client.1.smithi149.stdout:6/319: chown da/d18/c65 13468848 1 2024-04-15T21:02:33.908 INFO:tasks.workunit.client.0.smithi072.stdout:5/119: mkdir d0/d3/d23/d24 0 2024-04-15T21:02:33.908 INFO:tasks.workunit.client.1.smithi149.stdout:6/320: write da/d18/d10/d16/f3c [3405803,67218] 0 2024-04-15T21:02:33.909 INFO:tasks.workunit.client.1.smithi149.stdout:3/371: creat d1/db/f6e x:0 0 0 2024-04-15T21:02:33.911 INFO:tasks.workunit.client.1.smithi149.stdout:3/372: chown d1/db/d23/d5e/f6d 5944 1 2024-04-15T21:02:33.912 INFO:tasks.workunit.client.1.smithi149.stdout:6/321: dread da/ff [0,4194304] 0 2024-04-15T21:02:33.912 INFO:tasks.workunit.client.0.smithi072.stdout:1/104: symlink d5/db/d10/l1d 0 2024-04-15T21:02:33.914 INFO:tasks.workunit.client.0.smithi072.stdout:5/120: fdatasync d0/d3/d6/d14/f1b 0 2024-04-15T21:02:33.918 INFO:tasks.workunit.client.0.smithi072.stdout:1/105: mknod d5/db/d10/c1e 0 2024-04-15T21:02:33.918 INFO:tasks.workunit.client.0.smithi072.stdout:1/106: chown d5/db/d10 2119 1 2024-04-15T21:02:33.919 INFO:tasks.workunit.client.0.smithi072.stdout:1/107: write d5/f14 [2851135,123083] 0 2024-04-15T21:02:33.920 INFO:tasks.workunit.client.0.smithi072.stdout:1/108: fdatasync d5/f17 0 2024-04-15T21:02:33.921 INFO:tasks.workunit.client.0.smithi072.stdout:3/135: getdents d1/d7 0 2024-04-15T21:02:33.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/322: getdents da/d49 0 2024-04-15T21:02:33.926 INFO:tasks.workunit.client.0.smithi072.stdout:1/109: mkdir d5/db/d10/d1f 0 2024-04-15T21:02:33.926 INFO:tasks.workunit.client.1.smithi149.stdout:3/373: dwrite d1/db/f41 [0,4194304] 0 2024-04-15T21:02:33.927 INFO:tasks.workunit.client.1.smithi149.stdout:3/374: dread - d1/db/d24/d2b/f66 zero size 2024-04-15T21:02:33.928 INFO:tasks.workunit.client.0.smithi072.stdout:3/136: mknod d1/d1f/c2a 0 2024-04-15T21:02:33.928 INFO:tasks.workunit.client.0.smithi072.stdout:3/137: chown d1/d1f/f24 29045 1 2024-04-15T21:02:33.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/110: write d5/db/fc [5027524,54119] 0 2024-04-15T21:02:33.930 INFO:tasks.workunit.client.0.smithi072.stdout:3/138: read d1/d7/fb [625642,79984] 0 2024-04-15T21:02:33.930 INFO:tasks.workunit.client.0.smithi072.stdout:1/111: write d5/db/f12 [132303,2442] 0 2024-04-15T21:02:33.933 INFO:tasks.workunit.client.1.smithi149.stdout:3/375: rename d1/db/d24/d2b/c3e to d1/db/d40/d56/c6f 0 2024-04-15T21:02:33.934 INFO:tasks.workunit.client.0.smithi072.stdout:5/121: write d0/d3/f4 [798021,25773] 0 2024-04-15T21:02:33.935 INFO:tasks.workunit.client.1.smithi149.stdout:3/376: write d1/db/d40/f58 [267243,48814] 0 2024-04-15T21:02:33.936 INFO:tasks.workunit.client.1.smithi149.stdout:3/377: fsync d1/db/d24/d2b/f66 0 2024-04-15T21:02:33.936 INFO:tasks.workunit.client.0.smithi072.stdout:6/121: sync 2024-04-15T21:02:33.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/84: sync 2024-04-15T21:02:33.937 INFO:tasks.workunit.client.0.smithi072.stdout:8/129: sync 2024-04-15T21:02:33.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/85: chown d0/d3 286779276 1 2024-04-15T21:02:33.937 INFO:tasks.workunit.client.0.smithi072.stdout:6/122: fsync d2/f14 0 2024-04-15T21:02:33.939 INFO:tasks.workunit.client.1.smithi149.stdout:6/323: dread da/f1b [0,4194304] 0 2024-04-15T21:02:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:33 smithi149 ceph-mon[36029]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:33 smithi149 ceph-mon[36029]: pgmap v273: 65 pgs: 65 active+clean; 894 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 98 MiB/s wr, 288 op/s 2024-04-15T21:02:33.941 INFO:tasks.workunit.client.1.smithi149.stdout:6/324: mknod da/d60/c6b 0 2024-04-15T21:02:33.942 INFO:tasks.workunit.client.0.smithi072.stdout:0/86: creat d0/f1f x:0 0 0 2024-04-15T21:02:33.944 INFO:tasks.workunit.client.1.smithi149.stdout:6/325: fsync da/d18/d10/f1c 0 2024-04-15T21:02:33.945 INFO:tasks.workunit.client.0.smithi072.stdout:5/122: dread d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:33.945 INFO:tasks.workunit.client.1.smithi149.stdout:3/378: getdents d1/db/d40 0 2024-04-15T21:02:33.946 INFO:tasks.workunit.client.1.smithi149.stdout:6/326: symlink da/d60/l6c 0 2024-04-15T21:02:33.948 INFO:tasks.workunit.client.0.smithi072.stdout:3/139: rename d1/d7/f11 to d1/f2b 0 2024-04-15T21:02:33.948 INFO:tasks.workunit.client.0.smithi072.stdout:0/87: rmdir d0/d19 39 2024-04-15T21:02:33.950 INFO:tasks.workunit.client.0.smithi072.stdout:6/123: getdents d2/d10/d24 0 2024-04-15T21:02:33.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/327: rmdir da/d18/d10/d66 39 2024-04-15T21:02:33.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/328: fdatasync da/d11/f22 0 2024-04-15T21:02:33.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/123: mkdir d0/d3/d7/d25 0 2024-04-15T21:02:33.956 INFO:tasks.workunit.client.1.smithi149.stdout:6/329: truncate da/d32/f48 1163485 0 2024-04-15T21:02:33.959 INFO:tasks.workunit.client.1.smithi149.stdout:3/379: truncate d1/db/f41 2790580 0 2024-04-15T21:02:33.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/112: dwrite d5/db/d10/f13 [0,4194304] 0 2024-04-15T21:02:33.960 INFO:tasks.workunit.client.1.smithi149.stdout:3/380: write d1/db/d24/f4c [315730,33759] 0 2024-04-15T21:02:33.963 INFO:tasks.workunit.client.1.smithi149.stdout:6/330: dwrite da/d32/f43 [0,4194304] 0 2024-04-15T21:02:33.963 INFO:tasks.workunit.client.0.smithi072.stdout:5/124: unlink d0/d3/d7/ce 0 2024-04-15T21:02:33.965 INFO:tasks.workunit.client.1.smithi149.stdout:3/381: fsync d1/db/d24/f4c 0 2024-04-15T21:02:33.965 INFO:tasks.workunit.client.0.smithi072.stdout:8/130: rename d3/c26 to d3/de/d1b/c28 0 2024-04-15T21:02:33.966 INFO:tasks.workunit.client.0.smithi072.stdout:8/131: chown d3/de/d1b 492984 1 2024-04-15T21:02:33.966 INFO:tasks.workunit.client.1.smithi149.stdout:6/331: creat da/d18/d10/d16/f6d x:0 0 0 2024-04-15T21:02:33.967 INFO:tasks.workunit.client.0.smithi072.stdout:8/132: chown d3/d4/l14 80 1 2024-04-15T21:02:33.968 INFO:tasks.workunit.client.1.smithi149.stdout:3/382: unlink d1/db/d40/f58 0 2024-04-15T21:02:33.969 INFO:tasks.workunit.client.0.smithi072.stdout:0/88: rmdir d0/d19 39 2024-04-15T21:02:33.969 INFO:tasks.workunit.client.0.smithi072.stdout:0/89: fdatasync d0/f1f 0 2024-04-15T21:02:33.973 INFO:tasks.workunit.client.0.smithi072.stdout:5/125: read d0/fa [528387,86488] 0 2024-04-15T21:02:33.973 INFO:tasks.workunit.client.1.smithi149.stdout:3/383: dwrite d1/db/f52 [0,4194304] 0 2024-04-15T21:02:33.975 INFO:tasks.workunit.client.0.smithi072.stdout:8/133: symlink d3/l29 0 2024-04-15T21:02:33.976 INFO:tasks.workunit.client.0.smithi072.stdout:3/140: dwrite d1/d7/f9 [0,4194304] 0 2024-04-15T21:02:33.977 INFO:tasks.workunit.client.0.smithi072.stdout:1/113: symlink d5/db/l20 0 2024-04-15T21:02:33.977 INFO:tasks.workunit.client.0.smithi072.stdout:5/126: dread - d0/d3/d6/d14/f1b zero size 2024-04-15T21:02:33.977 INFO:tasks.workunit.client.0.smithi072.stdout:0/90: creat d0/d6/f20 x:0 0 0 2024-04-15T21:02:33.978 INFO:tasks.workunit.client.1.smithi149.stdout:6/332: getdents da/d18/d10/d66 0 2024-04-15T21:02:33.979 INFO:tasks.workunit.client.0.smithi072.stdout:3/141: write d1/f17 [370273,109657] 0 2024-04-15T21:02:33.980 INFO:tasks.workunit.client.0.smithi072.stdout:5/127: write d0/d3/d6/f8 [302186,58343] 0 2024-04-15T21:02:33.983 INFO:tasks.workunit.client.0.smithi072.stdout:8/134: creat d3/de/d17/f2a x:0 0 0 2024-04-15T21:02:33.983 INFO:tasks.workunit.client.1.smithi149.stdout:3/384: creat d1/db/d24/d39/f70 x:0 0 0 2024-04-15T21:02:33.983 INFO:tasks.workunit.client.0.smithi072.stdout:5/128: write d0/d3/f16 [1445001,103158] 0 2024-04-15T21:02:33.984 INFO:tasks.workunit.client.1.smithi149.stdout:6/333: truncate da/ff 77956 0 2024-04-15T21:02:33.988 INFO:tasks.workunit.client.1.smithi149.stdout:6/334: mknod da/d18/c6e 0 2024-04-15T21:02:33.990 INFO:tasks.workunit.client.0.smithi072.stdout:3/142: chown d1/fd 1 1 2024-04-15T21:02:33.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/385: symlink d1/db/l71 0 2024-04-15T21:02:33.991 INFO:tasks.workunit.client.0.smithi072.stdout:1/114: symlink d5/db/d10/d1f/l21 0 2024-04-15T21:02:33.992 INFO:tasks.workunit.client.0.smithi072.stdout:5/129: write d0/d3/d7/d12/f1a [671263,58379] 0 2024-04-15T21:02:33.994 INFO:tasks.workunit.client.1.smithi149.stdout:3/386: symlink d1/db/d24/d4d/l72 0 2024-04-15T21:02:33.994 INFO:tasks.workunit.client.0.smithi072.stdout:0/91: dwrite d0/f12 [0,4194304] 0 2024-04-15T21:02:33.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/387: dread - d1/db/d24/d2b/f6b zero size 2024-04-15T21:02:33.996 INFO:tasks.workunit.client.0.smithi072.stdout:6/124: dwrite d2/d10/d11/d15/f20 [0,4194304] 0 2024-04-15T21:02:33.996 INFO:tasks.workunit.client.1.smithi149.stdout:6/335: dwrite da/d49/d55/f61 [0,4194304] 0 2024-04-15T21:02:33.998 INFO:tasks.workunit.client.0.smithi072.stdout:6/125: chown d2/d10/d11 2 1 2024-04-15T21:02:34.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/388: rename d1/db/d24/f38 to d1/db/d24/d2b/f73 0 2024-04-15T21:02:34.003 INFO:tasks.workunit.client.0.smithi072.stdout:1/115: creat d5/db/d10/f22 x:0 0 0 2024-04-15T21:02:34.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/389: dread - d1/db/d24/d4d/d63/d65/f67 zero size 2024-04-15T21:02:34.005 INFO:tasks.workunit.client.0.smithi072.stdout:0/92: mknod d0/d3/c21 0 2024-04-15T21:02:34.008 INFO:tasks.workunit.client.0.smithi072.stdout:6/126: dwrite d2/f16 [0,4194304] 0 2024-04-15T21:02:34.008 INFO:tasks.workunit.client.0.smithi072.stdout:3/143: fdatasync d1/d19/d1a/f1b 0 2024-04-15T21:02:34.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/336: link da/d18/d10/f42 da/d18/d33/f6f 0 2024-04-15T21:02:34.011 INFO:tasks.workunit.client.0.smithi072.stdout:5/130: creat d0/d3/d7/d1f/f26 x:0 0 0 2024-04-15T21:02:34.013 INFO:tasks.workunit.client.1.smithi149.stdout:3/390: symlink d1/db/d23/d5e/l74 0 2024-04-15T21:02:34.014 INFO:tasks.workunit.client.0.smithi072.stdout:8/135: getdents d3 0 2024-04-15T21:02:34.016 INFO:tasks.workunit.client.1.smithi149.stdout:6/337: unlink da/d60/f6a 0 2024-04-15T21:02:34.017 INFO:tasks.workunit.client.1.smithi149.stdout:6/338: write da/d49/d55/f61 [3321490,56231] 0 2024-04-15T21:02:34.023 INFO:tasks.workunit.client.0.smithi072.stdout:6/127: creat d2/d10/d18/f26 x:0 0 0 2024-04-15T21:02:34.028 INFO:tasks.workunit.client.0.smithi072.stdout:5/131: rename d0/d3/d6/d14/l1c to d0/d3/d7/d1f/l27 0 2024-04-15T21:02:34.029 INFO:tasks.workunit.client.1.smithi149.stdout:6/339: mkdir da/d49/d70 0 2024-04-15T21:02:34.030 INFO:tasks.workunit.client.0.smithi072.stdout:1/116: mkdir d5/db/d23 0 2024-04-15T21:02:34.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/391: fdatasync d1/db/d24/f5d 0 2024-04-15T21:02:34.033 INFO:tasks.workunit.client.0.smithi072.stdout:8/136: symlink d3/de/l2b 0 2024-04-15T21:02:34.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/340: creat da/d11/f71 x:0 0 0 2024-04-15T21:02:34.034 INFO:tasks.workunit.client.0.smithi072.stdout:0/93: creat d0/d19/f22 x:0 0 0 2024-04-15T21:02:34.037 INFO:tasks.workunit.client.1.smithi149.stdout:3/392: mknod d1/db/d24/d2b/c75 0 2024-04-15T21:02:34.038 INFO:tasks.workunit.client.1.smithi149.stdout:3/393: write d1/db/d23/f49 [3799616,41240] 0 2024-04-15T21:02:34.039 INFO:tasks.workunit.client.0.smithi072.stdout:0/94: dwrite d0/f1c [0,4194304] 0 2024-04-15T21:02:34.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/341: symlink da/d18/l72 0 2024-04-15T21:02:34.044 INFO:tasks.workunit.client.1.smithi149.stdout:3/394: creat d1/db/d23/f76 x:0 0 0 2024-04-15T21:02:34.045 INFO:tasks.workunit.client.0.smithi072.stdout:8/137: chown d3/de/l19 27215335 1 2024-04-15T21:02:34.050 INFO:tasks.workunit.client.0.smithi072.stdout:3/144: link d1/d1f/c2a d1/d15/c2c 0 2024-04-15T21:02:34.051 INFO:tasks.workunit.client.1.smithi149.stdout:4/385: sync 2024-04-15T21:02:34.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/398: sync 2024-04-15T21:02:34.052 INFO:tasks.workunit.client.0.smithi072.stdout:8/138: dwrite d3/de/f13 [0,4194304] 0 2024-04-15T21:02:34.055 INFO:tasks.workunit.client.1.smithi149.stdout:4/386: symlink dc/d2c/l7e 0 2024-04-15T21:02:34.056 INFO:tasks.workunit.client.1.smithi149.stdout:4/387: write dc/d1a/f26 [2134800,27859] 0 2024-04-15T21:02:34.057 INFO:tasks.workunit.client.0.smithi072.stdout:5/132: creat d0/d3/d7/d25/f28 x:0 0 0 2024-04-15T21:02:34.057 INFO:tasks.workunit.client.1.smithi149.stdout:4/388: dread - dc/d2c/d3e/d35/d3a/f53 zero size 2024-04-15T21:02:34.058 INFO:tasks.workunit.client.1.smithi149.stdout:4/389: truncate dc/d1a/f2b 926658 0 2024-04-15T21:02:34.059 INFO:tasks.workunit.client.1.smithi149.stdout:8/399: symlink d2/df/d10/d21/l93 0 2024-04-15T21:02:34.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/342: link da/d49/d55/l58 da/d49/d55/l73 0 2024-04-15T21:02:34.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/343: chown da/d11 1197097 1 2024-04-15T21:02:34.062 INFO:tasks.workunit.client.0.smithi072.stdout:9/129: sync 2024-04-15T21:02:34.062 INFO:tasks.workunit.client.0.smithi072.stdout:2/168: sync 2024-04-15T21:02:34.062 INFO:tasks.workunit.client.0.smithi072.stdout:7/88: sync 2024-04-15T21:02:34.063 INFO:tasks.workunit.client.0.smithi072.stdout:7/89: chown d2/d10/f11 64 1 2024-04-15T21:02:34.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/344: stat da/d60/c6b 0 2024-04-15T21:02:34.063 INFO:tasks.workunit.client.0.smithi072.stdout:7/90: chown d2/f18 1246348 1 2024-04-15T21:02:34.066 INFO:tasks.workunit.client.1.smithi149.stdout:4/390: dwrite dc/d2c/d3e/d15/f4a [0,4194304] 0 2024-04-15T21:02:34.067 INFO:tasks.workunit.client.0.smithi072.stdout:6/128: rename d2/f17 to d2/d10/f27 0 2024-04-15T21:02:34.070 INFO:tasks.workunit.client.0.smithi072.stdout:8/139: creat d3/d4/f2c x:0 0 0 2024-04-15T21:02:34.071 INFO:tasks.workunit.client.0.smithi072.stdout:8/140: truncate d3/de/f22 5216148 0 2024-04-15T21:02:34.073 INFO:tasks.workunit.client.0.smithi072.stdout:0/95: symlink d0/l23 0 2024-04-15T21:02:34.074 INFO:tasks.workunit.client.0.smithi072.stdout:5/133: creat d0/d3/d7/d1f/f29 x:0 0 0 2024-04-15T21:02:34.075 INFO:tasks.workunit.client.1.smithi149.stdout:4/391: mknod dc/d2c/d3e/d15/d3f/c7f 0 2024-04-15T21:02:34.077 INFO:tasks.workunit.client.1.smithi149.stdout:3/395: truncate d1/db/d23/f49 2963019 0 2024-04-15T21:02:34.077 INFO:tasks.workunit.client.0.smithi072.stdout:1/117: dwrite d5/f8 [0,4194304] 0 2024-04-15T21:02:34.078 INFO:tasks.workunit.client.1.smithi149.stdout:3/396: write d1/db/d24/d2b/f22 [766298,32387] 0 2024-04-15T21:02:34.079 INFO:tasks.workunit.client.1.smithi149.stdout:3/397: dread - d1/db/d24/d2b/f6b zero size 2024-04-15T21:02:34.080 INFO:tasks.workunit.client.0.smithi072.stdout:1/118: write d5/db/d10/f22 [677160,118228] 0 2024-04-15T21:02:34.080 INFO:tasks.workunit.client.0.smithi072.stdout:9/130: write d4/f1b [6027077,20467] 0 2024-04-15T21:02:34.081 INFO:tasks.workunit.client.1.smithi149.stdout:4/392: mkdir dc/d2c/d3e/d35/d4b/d75/d80 0 2024-04-15T21:02:34.082 INFO:tasks.workunit.client.1.smithi149.stdout:4/393: fsync dc/d2c/d3e/d35/d3a/f65 0 2024-04-15T21:02:34.084 INFO:tasks.workunit.client.0.smithi072.stdout:1/119: dread d5/f14 [0,4194304] 0 2024-04-15T21:02:34.086 INFO:tasks.workunit.client.0.smithi072.stdout:3/145: mkdir d1/d2d 0 2024-04-15T21:02:34.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/141: symlink d3/d4/l2d 0 2024-04-15T21:02:34.090 INFO:tasks.workunit.client.0.smithi072.stdout:1/120: dwrite d5/db/f12 [0,4194304] 0 2024-04-15T21:02:34.091 INFO:tasks.workunit.client.1.smithi149.stdout:4/394: mkdir dc/d18/d21/d81 0 2024-04-15T21:02:34.093 INFO:tasks.workunit.client.0.smithi072.stdout:0/96: mkdir d0/d6/d24 0 2024-04-15T21:02:34.093 INFO:tasks.workunit.client.0.smithi072.stdout:0/97: chown d0 1131752815 1 2024-04-15T21:02:34.093 INFO:tasks.workunit.client.0.smithi072.stdout:0/98: readlink d0/d19/l1e 0 2024-04-15T21:02:34.095 INFO:tasks.workunit.client.1.smithi149.stdout:4/395: dread dc/d2c/d3e/d35/d3a/f60 [0,4194304] 0 2024-04-15T21:02:34.097 INFO:tasks.workunit.client.0.smithi072.stdout:2/169: mkdir d2/d37 0 2024-04-15T21:02:34.098 INFO:tasks.workunit.client.1.smithi149.stdout:8/400: truncate d2/f1b 6976320 0 2024-04-15T21:02:34.100 INFO:tasks.workunit.client.0.smithi072.stdout:2/170: dread d2/f12 [0,4194304] 0 2024-04-15T21:02:34.106 INFO:tasks.workunit.client.0.smithi072.stdout:9/131: symlink d4/d1f/l26 0 2024-04-15T21:02:34.108 INFO:tasks.workunit.client.0.smithi072.stdout:7/91: truncate d2/fa 8360402 0 2024-04-15T21:02:34.108 INFO:tasks.workunit.client.0.smithi072.stdout:7/92: fdatasync d2/d10/f13 0 2024-04-15T21:02:34.109 INFO:tasks.workunit.client.0.smithi072.stdout:7/93: dread - d2/f16 zero size 2024-04-15T21:02:34.109 INFO:tasks.workunit.client.1.smithi149.stdout:6/345: link da/ff da/d11/f74 0 2024-04-15T21:02:34.109 INFO:tasks.workunit.client.0.smithi072.stdout:7/94: dread - d2/f18 zero size 2024-04-15T21:02:34.110 INFO:tasks.workunit.client.1.smithi149.stdout:6/346: write da/d18/d10/d16/f3c [2356430,121324] 0 2024-04-15T21:02:34.113 INFO:tasks.workunit.client.1.smithi149.stdout:8/401: dread d2/f4 [4194304,4194304] 0 2024-04-15T21:02:34.116 INFO:tasks.workunit.client.0.smithi072.stdout:0/99: creat d0/d6/f25 x:0 0 0 2024-04-15T21:02:34.116 INFO:tasks.workunit.client.0.smithi072.stdout:0/100: chown d0/d3/fa 1544 1 2024-04-15T21:02:34.117 INFO:tasks.workunit.client.0.smithi072.stdout:0/101: truncate d0/f1f 529856 0 2024-04-15T21:02:34.117 INFO:tasks.workunit.client.0.smithi072.stdout:5/134: creat d0/d3/d23/d24/f2a x:0 0 0 2024-04-15T21:02:34.121 INFO:tasks.workunit.client.1.smithi149.stdout:4/396: write f2 [1062205,63968] 0 2024-04-15T21:02:34.124 INFO:tasks.workunit.client.0.smithi072.stdout:8/142: mkdir d3/de/d21/d2e 0 2024-04-15T21:02:34.125 INFO:tasks.workunit.client.1.smithi149.stdout:4/397: fsync dc/d2c/d3e/d15/d5b/f74 0 2024-04-15T21:02:34.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/402: creat d2/df/d10/d20/f94 x:0 0 0 2024-04-15T21:02:34.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/135: creat d0/d3/d6/f2b x:0 0 0 2024-04-15T21:02:34.132 INFO:tasks.workunit.client.0.smithi072.stdout:0/102: dread d0/d3/fa [0,4194304] 0 2024-04-15T21:02:34.134 INFO:tasks.workunit.client.0.smithi072.stdout:9/132: mknod d4/c27 0 2024-04-15T21:02:34.134 INFO:tasks.workunit.client.1.smithi149.stdout:4/398: write f1 [3084851,59289] 0 2024-04-15T21:02:34.137 INFO:tasks.workunit.client.1.smithi149.stdout:6/347: dwrite da/d11/f74 [0,4194304] 0 2024-04-15T21:02:34.137 INFO:tasks.workunit.client.1.smithi149.stdout:6/348: chown da/l2a 87 1 2024-04-15T21:02:34.138 INFO:tasks.workunit.client.0.smithi072.stdout:8/143: unlink d3/d4/f9 0 2024-04-15T21:02:34.139 INFO:tasks.workunit.client.0.smithi072.stdout:8/144: write d3/f1d [582259,69493] 0 2024-04-15T21:02:34.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/399: stat dc/d2c/l5c 0 2024-04-15T21:02:34.146 INFO:tasks.workunit.client.1.smithi149.stdout:8/403: getdents d2/df/d10/d25/d57 0 2024-04-15T21:02:34.148 INFO:tasks.workunit.client.0.smithi072.stdout:2/171: rename d2/d3/d23 to d2/d38 0 2024-04-15T21:02:34.150 INFO:tasks.workunit.client.0.smithi072.stdout:5/136: write d0/d3/d6/ff [1342758,71590] 0 2024-04-15T21:02:34.151 INFO:tasks.workunit.client.0.smithi072.stdout:5/137: fsync d0/d3/d6/d14/f18 0 2024-04-15T21:02:34.152 INFO:tasks.workunit.client.0.smithi072.stdout:5/138: read - d0/d3/d6/d14/f1b zero size 2024-04-15T21:02:34.153 INFO:tasks.workunit.client.1.smithi149.stdout:8/404: rmdir d2 39 2024-04-15T21:02:34.154 INFO:tasks.workunit.client.0.smithi072.stdout:9/133: symlink d4/d1f/l28 0 2024-04-15T21:02:34.157 INFO:tasks.workunit.client.0.smithi072.stdout:8/145: mkdir d3/de/d2f 0 2024-04-15T21:02:34.157 INFO:tasks.workunit.client.0.smithi072.stdout:1/121: link d5/c1b d5/db/d10/d1f/c24 0 2024-04-15T21:02:34.158 INFO:tasks.workunit.client.0.smithi072.stdout:8/146: fsync d3/f1d 0 2024-04-15T21:02:34.158 INFO:tasks.workunit.client.0.smithi072.stdout:8/147: chown d3/de/d21/d2e 317112 1 2024-04-15T21:02:34.159 INFO:tasks.workunit.client.0.smithi072.stdout:1/122: truncate d5/db/f12 4534605 0 2024-04-15T21:02:34.159 INFO:tasks.workunit.client.1.smithi149.stdout:4/400: write dc/d2c/d3e/d35/d3a/f40 [1495309,44806] 0 2024-04-15T21:02:34.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/139: unlink d0/d13/cd 0 2024-04-15T21:02:34.163 INFO:tasks.workunit.client.1.smithi149.stdout:4/401: mknod dc/d18/d21/d81/c82 0 2024-04-15T21:02:34.165 INFO:tasks.workunit.client.1.smithi149.stdout:8/405: getdents d2 0 2024-04-15T21:02:34.166 INFO:tasks.workunit.client.1.smithi149.stdout:4/402: symlink dc/d2c/d3e/d15/d3f/l83 0 2024-04-15T21:02:34.167 INFO:tasks.workunit.client.1.smithi149.stdout:4/403: write dc/d2c/d3e/d35/d3a/f53 [500806,54086] 0 2024-04-15T21:02:34.168 INFO:tasks.workunit.client.1.smithi149.stdout:8/406: fsync d2/df/d10/d21/d50/d5d/d6d/f75 0 2024-04-15T21:02:34.173 INFO:tasks.workunit.client.1.smithi149.stdout:8/407: mkdir d2/df/d10/d25/d37/d95 0 2024-04-15T21:02:34.175 INFO:tasks.workunit.client.1.smithi149.stdout:8/408: creat d2/df/d10/d21/d50/d5d/f96 x:0 0 0 2024-04-15T21:02:34.181 INFO:tasks.workunit.client.1.smithi149.stdout:4/404: dread dc/d2c/d3e/d15/d5b/f74 [0,4194304] 0 2024-04-15T21:02:34.181 INFO:tasks.workunit.client.1.smithi149.stdout:8/409: dwrite d2/df/d10/d20/f4b [0,4194304] 0 2024-04-15T21:02:34.185 INFO:tasks.workunit.client.1.smithi149.stdout:4/405: mknod dc/d2c/d3e/d35/d4b/d75/c84 0 2024-04-15T21:02:34.185 INFO:tasks.workunit.client.1.smithi149.stdout:4/406: stat f2 0 2024-04-15T21:02:34.186 INFO:tasks.workunit.client.1.smithi149.stdout:8/410: mknod d2/df/d10/d21/d50/d5d/d6d/c97 0 2024-04-15T21:02:34.188 INFO:tasks.workunit.client.1.smithi149.stdout:4/407: mkdir dc/d2c/d3e/d35/d85 0 2024-04-15T21:02:34.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/411: fdatasync d2/df/d10/f23 0 2024-04-15T21:02:34.193 INFO:tasks.workunit.client.1.smithi149.stdout:4/408: dread dc/d1a/f2b [0,4194304] 0 2024-04-15T21:02:34.193 INFO:tasks.workunit.client.1.smithi149.stdout:8/412: chown d2/df/d10/d4e/c62 14 1 2024-04-15T21:02:34.194 INFO:tasks.workunit.client.1.smithi149.stdout:8/413: write d2/df/d10/d25/d32/f44 [2353679,101276] 0 2024-04-15T21:02:34.197 INFO:tasks.workunit.client.1.smithi149.stdout:4/409: rename dc/d2c/d3e/d15/f6f to dc/d2c/d3e/d35/f86 0 2024-04-15T21:02:34.198 INFO:tasks.workunit.client.1.smithi149.stdout:8/414: mknod d2/df/d10/c98 0 2024-04-15T21:02:34.199 INFO:tasks.workunit.client.1.smithi149.stdout:4/410: creat dc/d2c/d3e/d15/d3f/f87 x:0 0 0 2024-04-15T21:02:34.201 INFO:tasks.workunit.client.1.smithi149.stdout:8/415: read d2/df/d10/d25/d32/f44 [965659,58829] 0 2024-04-15T21:02:34.202 INFO:tasks.workunit.client.1.smithi149.stdout:4/411: symlink dc/d18/d21/l88 0 2024-04-15T21:02:34.202 INFO:tasks.workunit.client.1.smithi149.stdout:8/416: readlink d2/l1c 0 2024-04-15T21:02:34.204 INFO:tasks.workunit.client.1.smithi149.stdout:4/412: mkdir dc/d18/d89 0 2024-04-15T21:02:34.205 INFO:tasks.workunit.client.1.smithi149.stdout:8/417: write d2/df/d10/d25/f28 [3740479,79022] 0 2024-04-15T21:02:34.208 INFO:tasks.workunit.client.1.smithi149.stdout:4/413: rename dc/d1a/f26 to dc/f8a 0 2024-04-15T21:02:34.212 INFO:tasks.workunit.client.1.smithi149.stdout:8/418: mknod d2/df/d10/d25/d37/d53/d76/d92/c99 0 2024-04-15T21:02:34.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/414: dwrite dc/d18/f1d [0,4194304] 0 2024-04-15T21:02:34.214 INFO:tasks.workunit.client.1.smithi149.stdout:8/419: write d2/df/d10/f11 [11839022,103388] 0 2024-04-15T21:02:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.224+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f670419e090 con 0x7f6704100240 2024-04-15T21:02:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.225+0000 7f66f37fe700 1 -- 172.21.15.72:0/4204949455 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f66f405b150 con 0x7f6704100240 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:02:34.219 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:02:34.220 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:34.221 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:02:34.222 INFO:tasks.workunit.client.1.smithi149.stdout:5/376: sync 2024-04-15T21:02:34.222 INFO:tasks.workunit.client.1.smithi149.stdout:9/338: sync 2024-04-15T21:02:34.223 INFO:tasks.workunit.client.1.smithi149.stdout:2/417: sync 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 msgr2=0x7f66ec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 0x7f66ec06fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f8005940 comp rx=0 tx=0).stop 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 msgr2=0x7f6704197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 0x7f6704197ce0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f66f400eaa0 tx=0x7f66f400edb0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 shutdown_connections 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7f66ec06d7e0 0x7f66ec06fc90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6704100240 0x7f6704197ce0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 --2- 172.21.15.72:0/4204949455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6704101440 0x7f6704198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 >> 172.21.15.72:0/4204949455 conn(0x7f67040fb7f0 msgr2=0x7f67040fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:34.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 shutdown_connections 2024-04-15T21:02:34.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.228+0000 7f6708be5700 1 -- 172.21.15.72:0/4204949455 wait complete. 2024-04-15T21:02:34.224 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:02:34.224 INFO:tasks.workunit.client.1.smithi149.stdout:4/415: rmdir dc/d2c/d3e/d35/d85 0 2024-04-15T21:02:34.226 INFO:tasks.workunit.client.1.smithi149.stdout:9/339: creat d23/d2b/d37/d6d/f6e x:0 0 0 2024-04-15T21:02:34.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/420: dwrite d2/df/d10/d25/d32/f39 [0,4194304] 0 2024-04-15T21:02:34.228 INFO:tasks.workunit.client.1.smithi149.stdout:2/418: symlink d4/d7/d10/d6b/d21/d2c/d32/d4a/l9f 0 2024-04-15T21:02:34.228 INFO:tasks.workunit.client.1.smithi149.stdout:4/416: creat dc/d2c/d3e/d15/d3f/f8b x:0 0 0 2024-04-15T21:02:34.230 INFO:tasks.workunit.client.1.smithi149.stdout:4/417: dread - dc/d2c/d3e/d15/d3f/f8b zero size 2024-04-15T21:02:34.233 INFO:tasks.workunit.client.1.smithi149.stdout:5/377: getdents d0/d9/db/d3d 0 2024-04-15T21:02:34.234 INFO:tasks.workunit.client.1.smithi149.stdout:2/419: unlink d4/d7/d10/d6b/d21/d3b/d4c/c66 0 2024-04-15T21:02:34.235 INFO:tasks.workunit.client.1.smithi149.stdout:5/378: chown d0/d9/db/d12/d16/f54 2 1 2024-04-15T21:02:34.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/420: fdatasync d4/d7/d10/d6b/d21/d55/f76 0 2024-04-15T21:02:34.236 INFO:tasks.workunit.client.1.smithi149.stdout:8/421: unlink d2/df/d10/d25/l48 0 2024-04-15T21:02:34.238 INFO:tasks.workunit.client.1.smithi149.stdout:9/340: rename d23/f3b to d23/d3c/d52/f6f 0 2024-04-15T21:02:34.242 INFO:tasks.workunit.client.1.smithi149.stdout:2/421: mknod d4/d7/d10/d6b/ca0 0 2024-04-15T21:02:34.244 INFO:tasks.workunit.client.0.smithi072.stdout:4/93: sync 2024-04-15T21:02:34.245 INFO:tasks.workunit.client.1.smithi149.stdout:8/422: creat d2/df/d10/d25/d37/d95/f9a x:0 0 0 2024-04-15T21:02:34.246 INFO:tasks.workunit.client.0.smithi072.stdout:7/95: getdents d2/db 0 2024-04-15T21:02:34.246 INFO:tasks.workunit.client.0.smithi072.stdout:0/103: dwrite d0/f13 [0,4194304] 0 2024-04-15T21:02:34.247 INFO:tasks.workunit.client.0.smithi072.stdout:2/172: mknod d2/c39 0 2024-04-15T21:02:34.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/140: fsync d0/d13/f21 0 2024-04-15T21:02:34.247 INFO:tasks.workunit.client.0.smithi072.stdout:8/148: dwrite d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:34.247 INFO:tasks.workunit.client.0.smithi072.stdout:7/96: stat d2/d10 0 2024-04-15T21:02:34.248 INFO:tasks.workunit.client.1.smithi149.stdout:8/423: truncate d2/df/d10/d25/d32/d45/f8f 403945 0 2024-04-15T21:02:34.249 INFO:tasks.workunit.client.0.smithi072.stdout:9/134: mkdir d4/d29 0 2024-04-15T21:02:34.249 INFO:tasks.workunit.client.0.smithi072.stdout:7/97: read - d2/f16 zero size 2024-04-15T21:02:34.250 INFO:tasks.workunit.client.1.smithi149.stdout:5/379: write d0/d6/fe [500015,37054] 0 2024-04-15T21:02:34.251 INFO:tasks.workunit.client.1.smithi149.stdout:4/418: getdents dc/d2c/d3e/d35 0 2024-04-15T21:02:34.254 INFO:tasks.workunit.client.1.smithi149.stdout:2/422: unlink d4/d7/d46/c5c 0 2024-04-15T21:02:34.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/424: rename d2/f4 to d2/d16/f9b 0 2024-04-15T21:02:34.265 INFO:tasks.workunit.client.1.smithi149.stdout:4/419: dwrite dc/d1a/f4e [0,4194304] 0 2024-04-15T21:02:34.266 INFO:tasks.workunit.client.1.smithi149.stdout:9/341: dread d23/d3c/d52/f6f [0,4194304] 0 2024-04-15T21:02:34.267 INFO:tasks.workunit.client.1.smithi149.stdout:9/342: write d23/d3c/f67 [1001730,88639] 0 2024-04-15T21:02:34.274 INFO:tasks.workunit.client.1.smithi149.stdout:4/420: dwrite dc/d2c/d3e/d15/d3f/f6e [0,4194304] 0 2024-04-15T21:02:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 -- 172.21.15.72:0/3941886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 msgr2=0x7fe3880ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/3941886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe3880ff560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe378009910 tx=0x7fe378009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 -- 172.21.15.72:0/3941886735 shutdown_connections 2024-04-15T21:02:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/3941886735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 0x7fe388100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/3941886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe3880ff560 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 -- 172.21.15.72:0/3941886735 >> 172.21.15.72:0/3941886735 conn(0x7fe3880fa7a0 msgr2=0x7fe3880fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 -- 172.21.15.72:0/3941886735 shutdown_connections 2024-04-15T21:02:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.354+0000 7fe38e7cd700 1 -- 172.21.15.72:0/3941886735 wait complete. 2024-04-15T21:02:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 Processor -- start 2024-04-15T21:02:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 -- start start 2024-04-15T21:02:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 0x7fe388196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3881968e0 con 0x7fe3880ff150 2024-04-15T21:02:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe38e7cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe388196a20 con 0x7fe3881003f0 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe387fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe387fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42210/0 (socket says 172.21.15.72:42210) 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe387fff700 1 -- 172.21.15.72:0/2934144293 learned_addr learned my addr 172.21.15.72:0/2934144293 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.355+0000 7fe3877fe700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 0x7fe388196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe387fff700 1 -- 172.21.15.72:0/2934144293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 msgr2=0x7fe388196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe387fff700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 0x7fe388196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe387fff700 1 -- 172.21.15.72:0/2934144293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780095f0 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe387fff700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe37800bd70 tx=0x7fe37800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37801d070 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe378005940 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe378021430 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38819b480 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.356+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38819b940 con 0x7fe3880ff150 2024-04-15T21:02:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.357+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe388068ab0 con 0x7fe3880ff150 2024-04-15T21:02:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.358+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7fe37800f860 con 0x7fe3880ff150 2024-04-15T21:02:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.358+0000 7fe3857fa700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 0x7fe37006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.358+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe37808e2f0 con 0x7fe3880ff150 2024-04-15T21:02:34.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.358+0000 7fe3877fe700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 0x7fe37006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.359+0000 7fe3877fe700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 0x7fe37006fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00ac50 tx=0x7fe37c00a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:34.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.362+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe37805c400 con 0x7fe3880ff150 2024-04-15T21:02:34.370 INFO:tasks.workunit.client.0.smithi072.stdout:6/129: sync 2024-04-15T21:02:34.371 INFO:tasks.workunit.client.0.smithi072.stdout:0/104: rmdir d0/d19 39 2024-04-15T21:02:34.371 INFO:tasks.workunit.client.0.smithi072.stdout:0/105: chown d0/d3 4416 1 2024-04-15T21:02:34.377 INFO:tasks.workunit.client.0.smithi072.stdout:8/149: creat d3/f30 x:0 0 0 2024-04-15T21:02:34.379 INFO:tasks.workunit.client.1.smithi149.stdout:2/423: symlink d4/d7/d10/d6b/d21/d2c/d58/la1 0 2024-04-15T21:02:34.380 INFO:tasks.workunit.client.0.smithi072.stdout:9/135: readlink d4/d1f/l22 0 2024-04-15T21:02:34.380 INFO:tasks.workunit.client.1.smithi149.stdout:2/424: write d4/d7/d10/d6b/f92 [405559,110328] 0 2024-04-15T21:02:34.382 INFO:tasks.workunit.client.1.smithi149.stdout:9/343: mkdir d23/d2b/d70 0 2024-04-15T21:02:34.384 INFO:tasks.workunit.client.0.smithi072.stdout:5/141: mknod d0/c2c 0 2024-04-15T21:02:34.384 INFO:tasks.workunit.client.0.smithi072.stdout:6/130: rmdir d2/d1a 39 2024-04-15T21:02:34.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/421: rename dc/d2c/d3e/d35/d4b/l79 to dc/d2c/d3e/d15/d3f/l8c 0 2024-04-15T21:02:34.387 INFO:tasks.workunit.client.0.smithi072.stdout:0/106: creat d0/d17/f26 x:0 0 0 2024-04-15T21:02:34.389 INFO:tasks.workunit.client.1.smithi149.stdout:2/425: creat d4/d7/da/fa2 x:0 0 0 2024-04-15T21:02:34.390 INFO:tasks.workunit.client.0.smithi072.stdout:8/150: symlink d3/d4/l31 0 2024-04-15T21:02:34.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/151: write d3/de/f22 [2125051,4548] 0 2024-04-15T21:02:34.393 INFO:tasks.workunit.client.0.smithi072.stdout:2/173: write d2/d3/f19 [1162318,33401] 0 2024-04-15T21:02:34.395 INFO:tasks.workunit.client.0.smithi072.stdout:4/94: creat d7/d1d/f1e x:0 0 0 2024-04-15T21:02:34.398 INFO:tasks.workunit.client.0.smithi072.stdout:5/142: rename d0/d3/d7/d25 to d0/d3/d6/d2d 0 2024-04-15T21:02:34.400 INFO:tasks.workunit.client.1.smithi149.stdout:2/426: fdatasync d4/d7/d29/f30 0 2024-04-15T21:02:34.401 INFO:tasks.workunit.client.1.smithi149.stdout:9/344: dwrite f3 [0,4194304] 0 2024-04-15T21:02:34.401 INFO:tasks.workunit.client.0.smithi072.stdout:9/136: dread d4/f1b [0,4194304] 0 2024-04-15T21:02:34.402 INFO:tasks.workunit.client.1.smithi149.stdout:9/345: readlink d23/d2b/l31 0 2024-04-15T21:02:34.402 INFO:tasks.workunit.client.0.smithi072.stdout:9/137: readlink d4/d1f/l28 0 2024-04-15T21:02:34.403 INFO:tasks.workunit.client.0.smithi072.stdout:9/138: readlink d4/d1f/l28 0 2024-04-15T21:02:34.404 INFO:tasks.workunit.client.1.smithi149.stdout:4/422: creat dc/d2c/d3e/d35/d4b/d6c/d70/f8d x:0 0 0 2024-04-15T21:02:34.407 INFO:tasks.workunit.client.0.smithi072.stdout:6/131: dwrite d2/d10/f27 [4194304,4194304] 0 2024-04-15T21:02:34.408 INFO:tasks.workunit.client.0.smithi072.stdout:8/152: symlink d3/l32 0 2024-04-15T21:02:34.408 INFO:tasks.workunit.client.0.smithi072.stdout:0/107: dread d0/f2 [0,4194304] 0 2024-04-15T21:02:34.408 INFO:tasks.workunit.client.0.smithi072.stdout:6/132: chown d2/d10/d11/d15/c25 38710763 1 2024-04-15T21:02:34.409 INFO:tasks.workunit.client.0.smithi072.stdout:6/133: fdatasync d2/fb 0 2024-04-15T21:02:34.410 INFO:tasks.workunit.client.0.smithi072.stdout:8/153: stat d3/de/d21/d2e 0 2024-04-15T21:02:34.410 INFO:tasks.workunit.client.1.smithi149.stdout:9/346: readlink d23/d3c/l40 0 2024-04-15T21:02:34.410 INFO:tasks.workunit.client.1.smithi149.stdout:9/347: fsync f1d 0 2024-04-15T21:02:34.411 INFO:tasks.workunit.client.0.smithi072.stdout:2/174: creat d2/d8/f3a x:0 0 0 2024-04-15T21:02:34.413 INFO:tasks.workunit.client.0.smithi072.stdout:5/143: symlink d0/d3/d6/l2e 0 2024-04-15T21:02:34.413 INFO:tasks.workunit.client.0.smithi072.stdout:1/123: sync 2024-04-15T21:02:34.413 INFO:tasks.workunit.client.0.smithi072.stdout:3/146: sync 2024-04-15T21:02:34.417 INFO:tasks.workunit.client.1.smithi149.stdout:8/425: creat d2/df/d10/d34/f9c x:0 0 0 2024-04-15T21:02:34.417 INFO:tasks.workunit.client.0.smithi072.stdout:0/108: dwrite d0/f12 [0,4194304] 0 2024-04-15T21:02:34.418 INFO:tasks.workunit.client.0.smithi072.stdout:0/109: chown d0/d6/l1a 215 1 2024-04-15T21:02:34.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/423: link dc/d18/d21/f64 dc/d18/d21/d81/f8e 0 2024-04-15T21:02:34.422 INFO:tasks.workunit.client.0.smithi072.stdout:8/154: creat d3/f33 x:0 0 0 2024-04-15T21:02:34.422 INFO:tasks.workunit.client.1.smithi149.stdout:9/348: mkdir d23/d71 0 2024-04-15T21:02:34.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/349: chown d23/d2b/d37/d50/f57 112 1 2024-04-15T21:02:34.424 INFO:tasks.workunit.client.0.smithi072.stdout:4/95: symlink d7/l1f 0 2024-04-15T21:02:34.425 INFO:tasks.workunit.client.0.smithi072.stdout:6/134: rmdir d2/d10/d11/d15 39 2024-04-15T21:02:34.426 INFO:tasks.workunit.client.1.smithi149.stdout:4/424: mkdir dc/d8f 0 2024-04-15T21:02:34.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/427: getdents d4/d7/d10/d6b/d21/d3b/d4c 0 2024-04-15T21:02:34.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/425: dread dc/d18/d21/f63 [0,4194304] 0 2024-04-15T21:02:34.428 INFO:tasks.workunit.client.1.smithi149.stdout:4/426: chown dc/d2c/d3e 191703822 1 2024-04-15T21:02:34.429 INFO:tasks.workunit.client.1.smithi149.stdout:9/350: symlink d23/d3c/d52/l72 0 2024-04-15T21:02:34.431 INFO:tasks.workunit.client.0.smithi072.stdout:8/155: dwrite d3/f33 [0,4194304] 0 2024-04-15T21:02:34.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/144: mknod d0/d3/d6/c2f 0 2024-04-15T21:02:34.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/96: dwrite d7/f1b [0,4194304] 0 2024-04-15T21:02:34.433 INFO:tasks.workunit.client.0.smithi072.stdout:2/175: mknod d2/c3b 0 2024-04-15T21:02:34.434 INFO:tasks.workunit.client.1.smithi149.stdout:8/426: mkdir d2/df/d10/d21/d50/d8e/d9d 0 2024-04-15T21:02:34.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/427: dread - d2/df/d10/f90 zero size 2024-04-15T21:02:34.435 INFO:tasks.workunit.client.0.smithi072.stdout:5/145: write d0/d3/d6/d2d/f28 [884586,481] 0 2024-04-15T21:02:34.435 INFO:tasks.workunit.client.0.smithi072.stdout:6/135: creat d2/d10/d11/d1f/f28 x:0 0 0 2024-04-15T21:02:34.437 INFO:tasks.workunit.client.0.smithi072.stdout:6/136: readlink d2/l5 0 2024-04-15T21:02:34.437 INFO:tasks.workunit.client.1.smithi149.stdout:2/428: symlink d4/d7/d10/d6b/d21/d2c/la3 0 2024-04-15T21:02:34.438 INFO:tasks.workunit.client.1.smithi149.stdout:1/270: sync 2024-04-15T21:02:34.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/124: symlink d5/l25 0 2024-04-15T21:02:34.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/125: write d5/f17 [6019573,70847] 0 2024-04-15T21:02:34.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/427: symlink dc/d2c/d3e/d35/d4b/l90 0 2024-04-15T21:02:34.442 INFO:tasks.workunit.client.0.smithi072.stdout:6/137: dread d2/d10/f27 [4194304,4194304] 0 2024-04-15T21:02:34.443 INFO:tasks.workunit.client.1.smithi149.stdout:4/428: read dc/d1a/f30 [278210,94377] 0 2024-04-15T21:02:34.443 INFO:tasks.workunit.client.0.smithi072.stdout:6/138: write d2/f16 [1151912,85448] 0 2024-04-15T21:02:34.443 INFO:tasks.workunit.client.0.smithi072.stdout:9/139: dread d4/fc [0,4194304] 0 2024-04-15T21:02:34.447 INFO:tasks.workunit.client.0.smithi072.stdout:6/139: truncate d2/d10/d18/f26 500431 0 2024-04-15T21:02:34.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/271: write d1/db/d14/d21/f40 [825977,1799] 0 2024-04-15T21:02:34.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/140: fdatasync d2/fb 0 2024-04-15T21:02:34.449 INFO:tasks.workunit.client.1.smithi149.stdout:1/272: write d1/db/f33 [5822170,12670] 0 2024-04-15T21:02:34.450 INFO:tasks.workunit.client.0.smithi072.stdout:4/97: write d7/f12 [71266,6424] 0 2024-04-15T21:02:34.451 INFO:tasks.workunit.client.0.smithi072.stdout:5/146: rmdir d0/d13 39 2024-04-15T21:02:34.451 INFO:tasks.workunit.client.0.smithi072.stdout:6/141: write d2/f16 [2983504,11430] 0 2024-04-15T21:02:34.453 INFO:tasks.workunit.client.0.smithi072.stdout:3/147: dwrite d1/d7/f22 [0,4194304] 0 2024-04-15T21:02:34.453 INFO:tasks.workunit.client.1.smithi149.stdout:8/428: rename d2/df/d10/d20/f94 to d2/df/d10/d21/d50/d8e/f9e 0 2024-04-15T21:02:34.453 INFO:tasks.workunit.client.0.smithi072.stdout:5/147: read d0/d3/f16 [257740,379] 0 2024-04-15T21:02:34.459 INFO:tasks.workunit.client.1.smithi149.stdout:4/429: getdents dc/d8f 0 2024-04-15T21:02:34.461 INFO:tasks.workunit.client.0.smithi072.stdout:4/98: dwrite d7/f12 [0,4194304] 0 2024-04-15T21:02:34.462 INFO:tasks.workunit.client.0.smithi072.stdout:4/99: readlink d7/l1f 0 2024-04-15T21:02:34.465 INFO:tasks.workunit.client.1.smithi149.stdout:1/273: rename d1/db/f30 to d1/db/d14/d21/d42/f48 0 2024-04-15T21:02:34.466 INFO:tasks.workunit.client.0.smithi072.stdout:8/156: mknod d3/de/d2f/c34 0 2024-04-15T21:02:34.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/274: read - d1/db/f2c zero size 2024-04-15T21:02:34.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/429: dread d4/d7/d10/d6b/d21/d3b/f7f [0,4194304] 0 2024-04-15T21:02:34.469 INFO:tasks.workunit.client.0.smithi072.stdout:8/157: dread d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:34.472 INFO:tasks.workunit.client.0.smithi072.stdout:8/158: dread d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:34.472 INFO:tasks.workunit.client.0.smithi072.stdout:8/159: read d3/de/f13 [1009566,15519] 0 2024-04-15T21:02:34.473 INFO:tasks.workunit.client.0.smithi072.stdout:8/160: write d3/de/f11 [1862298,73188] 0 2024-04-15T21:02:34.474 INFO:tasks.workunit.client.0.smithi072.stdout:2/176: mknod d2/c3c 0 2024-04-15T21:02:34.477 INFO:tasks.workunit.client.1.smithi149.stdout:2/430: dwrite d4/d7/d10/d6b/d21/d3b/f44 [0,4194304] 0 2024-04-15T21:02:34.477 INFO:tasks.workunit.client.1.smithi149.stdout:1/275: symlink d1/db/d16/l49 0 2024-04-15T21:02:34.481 INFO:tasks.workunit.client.0.smithi072.stdout:2/177: dwrite d2/d8/f36 [0,4194304] 0 2024-04-15T21:02:34.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/430: mkdir dc/d8f/d91 0 2024-04-15T21:02:34.486 INFO:tasks.workunit.client.1.smithi149.stdout:8/429: dwrite d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:34.489 INFO:tasks.workunit.client.1.smithi149.stdout:8/430: write d2/df/d10/d25/d32/f39 [5129768,87716] 0 2024-04-15T21:02:34.495 INFO:tasks.workunit.client.1.smithi149.stdout:4/431: unlink dc/d1a/c48 0 2024-04-15T21:02:34.496 INFO:tasks.workunit.client.0.smithi072.stdout:0/110: truncate d0/f14 536273 0 2024-04-15T21:02:34.497 INFO:tasks.workunit.client.0.smithi072.stdout:0/111: write d0/d17/f26 [787464,1929] 0 2024-04-15T21:02:34.500 INFO:tasks.workunit.client.1.smithi149.stdout:4/432: write dc/d2c/d3e/d15/f4a [263341,50370] 0 2024-04-15T21:02:34.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/126: mkdir d5/d26 0 2024-04-15T21:02:34.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/127: chown d5/db 362922 1 2024-04-15T21:02:34.504 INFO:tasks.workunit.client.1.smithi149.stdout:8/431: dwrite d2/df/d10/f90 [0,4194304] 0 2024-04-15T21:02:34.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/431: mknod d4/d7/d10/d6b/d21/d2c/ca4 0 2024-04-15T21:02:34.508 INFO:tasks.workunit.client.1.smithi149.stdout:2/432: readlink d4/d7/d10/d6b/d21/d3b/l5a 0 2024-04-15T21:02:34.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/276: fsync d1/db/dc/d11/f47 0 2024-04-15T21:02:34.518 INFO:tasks.workunit.client.1.smithi149.stdout:2/433: dwrite d4/f33 [8388608,4194304] 0 2024-04-15T21:02:34.518 INFO:tasks.workunit.client.1.smithi149.stdout:4/433: symlink dc/d2c/d3e/d35/d4b/d6c/d70/l92 0 2024-04-15T21:02:34.519 INFO:tasks.workunit.client.0.smithi072.stdout:8/161: truncate d3/d4/f1e 688881 0 2024-04-15T21:02:34.520 INFO:tasks.workunit.client.1.smithi149.stdout:2/434: dread - d4/d7/d10/d6b/d21/d2c/d58/f96 zero size 2024-04-15T21:02:34.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/277: symlink d1/d17/l4a 0 2024-04-15T21:02:34.528 INFO:tasks.workunit.client.1.smithi149.stdout:8/432: mkdir d2/df/d10/d4e/d9f 0 2024-04-15T21:02:34.529 INFO:tasks.workunit.client.1.smithi149.stdout:8/433: read d2/df/d10/f90 [4136119,5168] 0 2024-04-15T21:02:34.530 INFO:tasks.workunit.client.1.smithi149.stdout:8/434: read - d2/df/d10/d25/d32/d45/f59 zero size 2024-04-15T21:02:34.531 INFO:tasks.workunit.client.0.smithi072.stdout:2/178: dwrite d2/d38/f2a [4194304,4194304] 0 2024-04-15T21:02:34.532 INFO:tasks.workunit.client.1.smithi149.stdout:2/435: creat d4/d7/d10/d6b/d21/d55/fa5 x:0 0 0 2024-04-15T21:02:34.534 INFO:tasks.workunit.client.0.smithi072.stdout:7/98: sync 2024-04-15T21:02:34.535 INFO:tasks.workunit.client.1.smithi149.stdout:4/434: symlink dc/d2c/d3e/d35/d4b/d75/d80/l93 0 2024-04-15T21:02:34.540 INFO:tasks.workunit.client.0.smithi072.stdout:8/162: mknod d3/de/c35 0 2024-04-15T21:02:34.544 INFO:tasks.workunit.client.0.smithi072.stdout:3/148: rename d1/f4 to d1/f2e 0 2024-04-15T21:02:34.546 INFO:tasks.workunit.client.0.smithi072.stdout:8/163: dwrite d3/de/f25 [0,4194304] 0 2024-04-15T21:02:34.547 INFO:tasks.workunit.client.0.smithi072.stdout:8/164: dread - d3/de/f20 zero size 2024-04-15T21:02:34.547 INFO:tasks.workunit.client.1.smithi149.stdout:8/435: dwrite d2/f1f [0,4194304] 0 2024-04-15T21:02:34.548 INFO:tasks.workunit.client.0.smithi072.stdout:8/165: readlink d3/de/d17/l18 0 2024-04-15T21:02:34.551 INFO:tasks.workunit.client.1.smithi149.stdout:1/278: mknod d1/db/dc/d11/d3f/d45/c4b 0 2024-04-15T21:02:34.552 INFO:tasks.workunit.client.1.smithi149.stdout:1/279: chown d1/d17/d36/c44 3 1 2024-04-15T21:02:34.552 INFO:tasks.workunit.client.0.smithi072.stdout:0/112: symlink d0/d19/l27 0 2024-04-15T21:02:34.555 INFO:tasks.workunit.client.0.smithi072.stdout:4/100: write d7/f9 [2397674,82665] 0 2024-04-15T21:02:34.564 INFO:tasks.workunit.client.0.smithi072.stdout:9/140: getdents d4/d1f 0 2024-04-15T21:02:34.565 INFO:tasks.workunit.client.1.smithi149.stdout:8/436: fdatasync d2/df/d10/d25/d32/d45/f5e 0 2024-04-15T21:02:34.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/280: rename d1/d17/d36/c44 to d1/db/dc/d38/c4c 0 2024-04-15T21:02:34.569 INFO:tasks.workunit.client.1.smithi149.stdout:1/281: truncate d1/db/f2c 327291 0 2024-04-15T21:02:34.569 INFO:tasks.workunit.client.1.smithi149.stdout:2/436: creat d4/d7/d10/d6b/d21/d2c/d32/fa6 x:0 0 0 2024-04-15T21:02:34.571 INFO:tasks.workunit.client.1.smithi149.stdout:8/437: dwrite d2/df/d10/d25/f4a [0,4194304] 0 2024-04-15T21:02:34.573 INFO:tasks.workunit.client.0.smithi072.stdout:3/149: write d1/f2e [4625871,101110] 0 2024-04-15T21:02:34.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/437: write d4/d7/d10/d6b/d21/d3b/f44 [3602270,129576] 0 2024-04-15T21:02:34.575 INFO:tasks.workunit.client.1.smithi149.stdout:8/438: truncate d2/df/d10/d21/d50/d5d/f96 525392 0 2024-04-15T21:02:34.576 INFO:tasks.workunit.client.0.smithi072.stdout:5/148: getdents d0/d3/d7 0 2024-04-15T21:02:34.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/282: mkdir d1/d17/d4d 0 2024-04-15T21:02:34.578 INFO:tasks.workunit.client.1.smithi149.stdout:1/283: truncate d1/db/f37 583770 0 2024-04-15T21:02:34.579 INFO:tasks.workunit.client.1.smithi149.stdout:1/284: readlink d1/db/d16/l49 0 2024-04-15T21:02:34.579 INFO:tasks.workunit.client.1.smithi149.stdout:4/435: getdents dc/d2c/d3e/d35/d4b 0 2024-04-15T21:02:34.580 INFO:tasks.workunit.client.1.smithi149.stdout:4/436: chown dc/d2c/f22 2 1 2024-04-15T21:02:34.582 INFO:tasks.workunit.client.0.smithi072.stdout:3/150: dwrite d1/f28 [0,4194304] 0 2024-04-15T21:02:34.582 INFO:tasks.workunit.client.0.smithi072.stdout:0/113: rmdir d0/d19 39 2024-04-15T21:02:34.582 INFO:tasks.workunit.client.0.smithi072.stdout:4/101: dread f3 [0,4194304] 0 2024-04-15T21:02:34.585 INFO:tasks.workunit.client.1.smithi149.stdout:8/439: mknod d2/df/d10/d20/d6b/ca0 0 2024-04-15T21:02:34.585 INFO:tasks.workunit.client.0.smithi072.stdout:4/102: write d7/f19 [111783,60519] 0 2024-04-15T21:02:34.588 INFO:tasks.workunit.client.0.smithi072.stdout:8/166: write d3/de/f24 [5181198,38627] 0 2024-04-15T21:02:34.589 INFO:tasks.workunit.client.0.smithi072.stdout:5/149: dwrite d0/d3/d6/f8 [0,4194304] 0 2024-04-15T21:02:34.589 INFO:tasks.workunit.client.1.smithi149.stdout:4/437: truncate dc/fe 72760 0 2024-04-15T21:02:34.590 INFO:tasks.workunit.client.0.smithi072.stdout:9/141: write d4/f13 [9949,63012] 0 2024-04-15T21:02:34.595 INFO:tasks.workunit.client.1.smithi149.stdout:8/440: rename d2/df/d10/d25/d37/d53/d76/d85/l3b to d2/df/d10/d20/d6b/la1 0 2024-04-15T21:02:34.597 INFO:tasks.workunit.client.0.smithi072.stdout:0/114: rmdir d0/d17 39 2024-04-15T21:02:34.599 INFO:tasks.workunit.client.1.smithi149.stdout:1/285: creat d1/db/dc/f4e x:0 0 0 2024-04-15T21:02:34.600 INFO:tasks.workunit.client.0.smithi072.stdout:6/142: sync 2024-04-15T21:02:34.601 INFO:tasks.workunit.client.0.smithi072.stdout:3/151: rename d1/d19 to d1/d1f/d2f 0 2024-04-15T21:02:34.605 INFO:tasks.workunit.client.1.smithi149.stdout:4/438: rename dc/c12 to dc/d2c/d3e/d35/d4b/d6c/d70/c94 0 2024-04-15T21:02:34.608 INFO:tasks.workunit.client.1.smithi149.stdout:2/438: dread d4/d7/d10/d6b/d21/d3b/f3f [0,4194304] 0 2024-04-15T21:02:34.608 INFO:tasks.workunit.client.0.smithi072.stdout:4/103: creat d7/d15/f20 x:0 0 0 2024-04-15T21:02:34.609 INFO:tasks.workunit.client.1.smithi149.stdout:8/441: mknod d2/df/d10/d25/d37/d95/ca2 0 2024-04-15T21:02:34.609 INFO:tasks.workunit.client.0.smithi072.stdout:2/179: link d2/l35 d2/d37/l3d 0 2024-04-15T21:02:34.612 INFO:tasks.workunit.client.0.smithi072.stdout:5/150: readlink d0/d3/d7/d1f/l27 0 2024-04-15T21:02:34.613 INFO:tasks.workunit.client.0.smithi072.stdout:2/180: dread d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:34.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/377: sync 2024-04-15T21:02:34.613 INFO:tasks.workunit.client.1.smithi149.stdout:0/530: sync 2024-04-15T21:02:34.614 INFO:tasks.workunit.client.0.smithi072.stdout:2/181: dread - d2/d8/f3a zero size 2024-04-15T21:02:34.614 INFO:tasks.workunit.client.0.smithi072.stdout:5/151: write d0/d3/d6/f8 [3917820,29025] 0 2024-04-15T21:02:34.615 INFO:tasks.workunit.client.0.smithi072.stdout:5/152: write d0/d3/d7/d1f/f29 [641666,57270] 0 2024-04-15T21:02:34.617 INFO:tasks.workunit.client.0.smithi072.stdout:7/99: link d2/f14 d2/f1c 0 2024-04-15T21:02:34.617 INFO:tasks.workunit.client.0.smithi072.stdout:7/100: dread - d2/db/ff zero size 2024-04-15T21:02:34.619 INFO:tasks.workunit.client.0.smithi072.stdout:7/101: write d2/d10/f13 [448746,24302] 0 2024-04-15T21:02:34.621 INFO:tasks.workunit.client.0.smithi072.stdout:0/115: unlink d0/f2 0 2024-04-15T21:02:34.622 INFO:tasks.workunit.client.0.smithi072.stdout:0/116: chown d0/d3/d5/f11 799922396 1 2024-04-15T21:02:34.623 INFO:tasks.workunit.client.0.smithi072.stdout:5/153: dwrite d0/d3/d6/ff [0,4194304] 0 2024-04-15T21:02:34.627 INFO:tasks.workunit.client.0.smithi072.stdout:4/104: mknod d7/d1d/c21 0 2024-04-15T21:02:34.628 INFO:tasks.workunit.client.1.smithi149.stdout:2/439: rename d4/d7/d10/d6b/d21/d3b/d4c to d4/d7/d10/d6b/d21/d3b/d90/da7 0 2024-04-15T21:02:34.629 INFO:tasks.workunit.client.0.smithi072.stdout:4/105: chown d7/fe 1099 1 2024-04-15T21:02:34.629 INFO:tasks.workunit.client.1.smithi149.stdout:7/378: rmdir d3/d17 39 2024-04-15T21:02:34.630 INFO:tasks.workunit.client.0.smithi072.stdout:8/167: dread d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:34.630 INFO:tasks.workunit.client.1.smithi149.stdout:0/531: chown d1/d5/dc/c36 121 1 2024-04-15T21:02:34.630 INFO:tasks.workunit.client.1.smithi149.stdout:2/440: fsync d4/f18 0 2024-04-15T21:02:34.631 INFO:tasks.workunit.client.0.smithi072.stdout:8/168: stat d3/de/d17/l1c 0 2024-04-15T21:02:34.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/442: dwrite d2/df/d10/d25/d32/f42 [0,4194304] 0 2024-04-15T21:02:34.632 INFO:tasks.workunit.client.0.smithi072.stdout:8/169: dread - d3/de/d17/f2a zero size 2024-04-15T21:02:34.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/379: chown d3/d16/d20/d60/c69 881348610 1 2024-04-15T21:02:34.635 INFO:tasks.workunit.client.1.smithi149.stdout:8/443: stat d2/df/d10/d25/d57/c78 0 2024-04-15T21:02:34.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/286: dread d1/db/d14/d21/f40 [0,4194304] 0 2024-04-15T21:02:34.637 INFO:tasks.workunit.client.1.smithi149.stdout:8/444: dread - d2/df/d10/d20/f91 zero size 2024-04-15T21:02:34.638 INFO:tasks.workunit.client.0.smithi072.stdout:7/102: mknod d2/db/c1d 0 2024-04-15T21:02:34.639 INFO:tasks.workunit.client.0.smithi072.stdout:7/103: dread - d2/db/ff zero size 2024-04-15T21:02:34.640 INFO:tasks.workunit.client.0.smithi072.stdout:6/143: mknod d2/d10/d24/c29 0 2024-04-15T21:02:34.645 INFO:tasks.workunit.client.0.smithi072.stdout:0/117: write d0/d3/fe [1822500,90303] 0 2024-04-15T21:02:34.646 INFO:tasks.workunit.client.1.smithi149.stdout:0/532: mkdir d1/d29/dbb 0 2024-04-15T21:02:34.646 INFO:tasks.workunit.client.0.smithi072.stdout:0/118: write d0/d3/fe [4248680,112068] 0 2024-04-15T21:02:34.648 INFO:tasks.workunit.client.0.smithi072.stdout:1/128: sync 2024-04-15T21:02:34.652 INFO:tasks.workunit.client.0.smithi072.stdout:3/152: write f0 [961432,125666] 0 2024-04-15T21:02:34.652 INFO:tasks.workunit.client.1.smithi149.stdout:7/380: dread d3/f7 [0,4194304] 0 2024-04-15T21:02:34.653 INFO:tasks.workunit.client.1.smithi149.stdout:0/533: dwrite d1/d5/d24/d30/d54/fa9 [0,4194304] 0 2024-04-15T21:02:34.654 INFO:tasks.workunit.client.0.smithi072.stdout:1/129: dwrite d5/f6 [0,4194304] 0 2024-04-15T21:02:34.655 INFO:tasks.workunit.client.0.smithi072.stdout:4/106: mknod d7/d1d/c22 0 2024-04-15T21:02:34.658 INFO:tasks.workunit.client.0.smithi072.stdout:8/170: mknod d3/de/d21/c36 0 2024-04-15T21:02:34.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.667+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 --> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3880694e0 con 0x7fe37006d7e0 2024-04-15T21:02:34.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.670+0000 7fe3857fa700 1 -- 172.21.15.72:0/2934144293 <== mgr.14223 v2:172.21.15.72:6800/3446136011 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe3880694e0 con 0x7fe37006d7e0 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "1/23 daemons upgraded", 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mgr daemons", 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:02:34.666 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:02:34.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 msgr2=0x7fe37006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 0x7fe37006fc90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00ac50 tx=0x7fe37c00a380 comp rx=0 tx=0).stop 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 msgr2=0x7fe388195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe37800bd70 tx=0x7fe37800bda0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 shutdown_connections 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fe37006d7e0 0x7fe37006fc90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3880ff150 0x7fe388195e10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 --2- 172.21.15.72:0/2934144293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3881003f0 0x7fe388196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.673+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 >> 172.21.15.72:0/2934144293 conn(0x7fe3880fa7a0 msgr2=0x7fe388068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.674+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 shutdown_connections 2024-04-15T21:02:34.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.674+0000 7fe38e7cd700 1 -- 172.21.15.72:0/2934144293 wait complete. 2024-04-15T21:02:34.668 INFO:tasks.workunit.client.0.smithi072.stdout:2/182: dwrite d2/d8/fe [0,4194304] 0 2024-04-15T21:02:34.669 INFO:tasks.workunit.client.1.smithi149.stdout:8/445: link d2/fe d2/df/d10/d21/d46/d74/fa3 0 2024-04-15T21:02:34.669 INFO:tasks.workunit.client.0.smithi072.stdout:5/154: mknod d0/c30 0 2024-04-15T21:02:34.670 INFO:tasks.workunit.client.1.smithi149.stdout:2/441: dwrite d4/d7/d46/f69 [4194304,4194304] 0 2024-04-15T21:02:34.670 INFO:tasks.workunit.client.0.smithi072.stdout:5/155: write d0/d3/d6/f8 [2490799,116792] 0 2024-04-15T21:02:34.671 INFO:tasks.workunit.client.0.smithi072.stdout:5/156: write d0/d3/d6/f8 [5228795,93895] 0 2024-04-15T21:02:34.675 INFO:tasks.workunit.client.1.smithi149.stdout:1/287: truncate d1/d17/f1c 7490346 0 2024-04-15T21:02:34.678 INFO:tasks.workunit.client.1.smithi149.stdout:1/288: write d1/f5 [6202892,127343] 0 2024-04-15T21:02:34.679 INFO:tasks.workunit.client.0.smithi072.stdout:0/119: unlink d0/f18 0 2024-04-15T21:02:34.683 INFO:tasks.workunit.client.1.smithi149.stdout:0/534: link d1/d29/d2c/d4f/f7e d1/d5/d24/d50/d13/fbc 0 2024-04-15T21:02:34.699 INFO:tasks.workunit.client.0.smithi072.stdout:8/171: dwrite d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:34.700 INFO:tasks.workunit.client.0.smithi072.stdout:8/172: write d3/de/d17/f2a [233014,113829] 0 2024-04-15T21:02:34.701 INFO:tasks.workunit.client.1.smithi149.stdout:7/381: dread d3/d17/d1f/f38 [0,4194304] 0 2024-04-15T21:02:34.702 INFO:tasks.workunit.client.1.smithi149.stdout:7/382: fsync d3/d39/f7d 0 2024-04-15T21:02:34.703 INFO:tasks.workunit.client.1.smithi149.stdout:7/383: write d3/d16/d20/d36/f3a [183041,42455] 0 2024-04-15T21:02:34.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/157: fdatasync d0/d3/f4 0 2024-04-15T21:02:34.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/158: chown d0/c30 666 1 2024-04-15T21:02:34.713 INFO:tasks.workunit.client.1.smithi149.stdout:8/446: mkdir d2/df/d10/d25/d37/d53/d76/d85/d35/da4 0 2024-04-15T21:02:34.717 INFO:tasks.workunit.client.0.smithi072.stdout:4/107: dwrite f3 [0,4194304] 0 2024-04-15T21:02:34.717 INFO:tasks.workunit.client.0.smithi072.stdout:5/159: dwrite d0/d3/d6/f8 [4194304,4194304] 0 2024-04-15T21:02:34.718 INFO:tasks.workunit.client.0.smithi072.stdout:7/104: link d2/f18 d2/f1e 0 2024-04-15T21:02:34.719 INFO:tasks.workunit.client.0.smithi072.stdout:7/105: truncate d2/f12 662201 0 2024-04-15T21:02:34.719 INFO:tasks.workunit.client.1.smithi149.stdout:0/535: stat d1/d5/d24/d30/d43/c45 0 2024-04-15T21:02:34.724 INFO:tasks.workunit.client.0.smithi072.stdout:8/173: mknod d3/de/d17/c37 0 2024-04-15T21:02:34.724 INFO:tasks.workunit.client.1.smithi149.stdout:8/447: dwrite d2/df/d10/d25/d37/d53/d76/d85/d35/f8b [0,4194304] 0 2024-04-15T21:02:34.727 INFO:tasks.workunit.client.1.smithi149.stdout:1/289: dwrite d1/db/d14/d21/f40 [4194304,4194304] 0 2024-04-15T21:02:34.728 INFO:tasks.workunit.client.0.smithi072.stdout:5/160: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:34.729 INFO:tasks.workunit.client.1.smithi149.stdout:2/442: symlink d4/d7/d10/d6b/d21/d2c/d32/la8 0 2024-04-15T21:02:34.729 INFO:tasks.workunit.client.0.smithi072.stdout:5/161: readlink d0/d3/d7/d12/l19 0 2024-04-15T21:02:34.732 INFO:tasks.workunit.client.0.smithi072.stdout:0/120: unlink d0/d19/l1e 0 2024-04-15T21:02:34.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/174: dwrite d3/de/f22 [4194304,4194304] 0 2024-04-15T21:02:34.740 INFO:tasks.workunit.client.0.smithi072.stdout:6/144: link d2/d10/d11/d15/f20 d2/f2a 0 2024-04-15T21:02:34.741 INFO:tasks.workunit.client.0.smithi072.stdout:9/142: sync 2024-04-15T21:02:34.744 INFO:tasks.workunit.client.1.smithi149.stdout:6/349: sync 2024-04-15T21:02:34.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/398: sync 2024-04-15T21:02:34.744 INFO:tasks.workunit.client.1.smithi149.stdout:5/380: sync 2024-04-15T21:02:34.744 INFO:tasks.workunit.client.1.smithi149.stdout:9/351: sync 2024-04-15T21:02:34.747 INFO:tasks.workunit.client.1.smithi149.stdout:5/381: write d0/d9/db/d12/d2b/f53 [1750930,96122] 0 2024-04-15T21:02:34.747 INFO:tasks.workunit.client.0.smithi072.stdout:3/153: truncate d1/d7/f9 1281890 0 2024-04-15T21:02:34.748 INFO:tasks.workunit.client.1.smithi149.stdout:3/399: truncate d1/db/d24/f68 1004576 0 2024-04-15T21:02:34.750 INFO:tasks.workunit.client.1.smithi149.stdout:0/536: dread d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:34.751 INFO:tasks.workunit.client.0.smithi072.stdout:2/183: rename d2/d3/f33 to d2/f3e 0 2024-04-15T21:02:34.755 INFO:tasks.workunit.client.1.smithi149.stdout:1/290: rmdir d1/db/dc 39 2024-04-15T21:02:34.755 INFO:tasks.workunit.client.0.smithi072.stdout:1/130: truncate d5/f17 985809 0 2024-04-15T21:02:34.755 INFO:tasks.workunit.client.0.smithi072.stdout:1/131: fdatasync d5/db/f1a 0 2024-04-15T21:02:34.756 INFO:tasks.workunit.client.0.smithi072.stdout:1/132: readlink d5/db/d10/d1f/l21 0 2024-04-15T21:02:34.758 INFO:tasks.workunit.client.0.smithi072.stdout:5/162: mkdir d0/d3/d7/d12/d31 0 2024-04-15T21:02:34.758 INFO:tasks.workunit.client.1.smithi149.stdout:7/384: creat d3/d16/d20/d36/d3d/f85 x:0 0 0 2024-04-15T21:02:34.760 INFO:tasks.workunit.client.0.smithi072.stdout:8/175: creat d3/de/f38 x:0 0 0 2024-04-15T21:02:34.761 INFO:tasks.workunit.client.0.smithi072.stdout:8/176: fdatasync d3/f1d 0 2024-04-15T21:02:34.761 INFO:tasks.workunit.client.0.smithi072.stdout:4/108: mkdir d7/d23 0 2024-04-15T21:02:34.762 INFO:tasks.workunit.client.0.smithi072.stdout:5/163: dread d0/d3/d7/d12/f1a [0,4194304] 0 2024-04-15T21:02:34.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/448: creat d2/df/d10/d4e/d9f/fa5 x:0 0 0 2024-04-15T21:02:34.763 INFO:tasks.workunit.client.0.smithi072.stdout:5/164: readlink d0/d3/d7/d1f/l22 0 2024-04-15T21:02:34.763 INFO:tasks.workunit.client.1.smithi149.stdout:5/382: stat d0/d9/db/l25 0 2024-04-15T21:02:34.764 INFO:tasks.workunit.client.0.smithi072.stdout:5/165: write d0/d3/d7/d12/f1a [1274996,120759] 0 2024-04-15T21:02:34.765 INFO:tasks.workunit.client.0.smithi072.stdout:7/106: truncate d2/d10/f1b 7045175 0 2024-04-15T21:02:34.766 INFO:tasks.workunit.client.1.smithi149.stdout:0/537: unlink d1/d5/d24/d50/d13/d38/lb7 0 2024-04-15T21:02:34.766 INFO:tasks.workunit.client.0.smithi072.stdout:7/107: dread d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:34.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/538: chown d1/d5/f4a 5411616 1 2024-04-15T21:02:34.769 INFO:tasks.workunit.client.1.smithi149.stdout:2/443: symlink d4/d7/d10/d6b/d21/d2c/d3e/d9d/la9 0 2024-04-15T21:02:34.771 INFO:tasks.workunit.client.1.smithi149.stdout:2/444: dread - d4/d7/d10/d6b/d21/d2c/f4b zero size 2024-04-15T21:02:34.776 INFO:tasks.workunit.client.0.smithi072.stdout:2/184: dread d2/d38/f2a [0,4194304] 0 2024-04-15T21:02:34.777 INFO:tasks.workunit.client.0.smithi072.stdout:2/185: chown d2/d3/cb 31081824 1 2024-04-15T21:02:34.777 INFO:tasks.workunit.client.0.smithi072.stdout:0/121: creat d0/d6/d24/f28 x:0 0 0 2024-04-15T21:02:34.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/400: symlink d1/db/d24/l77 0 2024-04-15T21:02:34.782 INFO:tasks.workunit.client.1.smithi149.stdout:1/291: unlink d1/db/dc/f4e 0 2024-04-15T21:02:34.787 INFO:tasks.workunit.client.1.smithi149.stdout:0/539: dread d1/d5/d24/d50/d13/d59/f78 [4194304,4194304] 0 2024-04-15T21:02:34.790 INFO:tasks.workunit.client.1.smithi149.stdout:2/445: rename d4/d7/d10/d6b/d21/d2c/la3 to d4/d7/d10/laa 0 2024-04-15T21:02:34.793 INFO:tasks.workunit.client.1.smithi149.stdout:6/350: creat da/f75 x:0 0 0 2024-04-15T21:02:34.793 INFO:tasks.workunit.client.0.smithi072.stdout:8/177: rmdir d3 39 2024-04-15T21:02:34.795 INFO:tasks.workunit.client.1.smithi149.stdout:6/351: chown da/d18/d33/l62 170003 1 2024-04-15T21:02:34.796 INFO:tasks.workunit.client.1.smithi149.stdout:5/383: symlink d0/d9/db/l8a 0 2024-04-15T21:02:34.796 INFO:tasks.workunit.client.1.smithi149.stdout:6/352: fdatasync da/d18/d10/f68 0 2024-04-15T21:02:34.798 INFO:tasks.workunit.client.1.smithi149.stdout:6/353: dread - da/f75 zero size 2024-04-15T21:02:34.799 INFO:tasks.workunit.client.1.smithi149.stdout:2/446: dwrite d4/d7/d10/d6b/d21/d3b/d90/da7/d6c/f8f [0,4194304] 0 2024-04-15T21:02:34.805 INFO:tasks.workunit.client.1.smithi149.stdout:1/292: readlink d1/l29 0 2024-04-15T21:02:34.809 INFO:tasks.workunit.client.1.smithi149.stdout:7/385: creat d3/d16/f86 x:0 0 0 2024-04-15T21:02:34.811 INFO:tasks.workunit.client.1.smithi149.stdout:0/540: unlink d1/d5/d24/d50/d13/d38/d44/cac 0 2024-04-15T21:02:34.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/541: read - d1/d29/f74 zero size 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 -- 172.21.15.72:0/1313601524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 msgr2=0x7fd7340ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 --2- 172.21.15.72:0/1313601524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd7340ff560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd730009910 tx=0x7fd730009c20 comp rx=0 tx=0).stop 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 -- 172.21.15.72:0/1313601524 shutdown_connections 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 --2- 172.21.15.72:0/1313601524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd7341007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 --2- 172.21.15.72:0/1313601524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd7340ff560 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 -- 172.21.15.72:0/1313601524 >> 172.21.15.72:0/1313601524 conn(0x7fd7340fa700 msgr2=0x7fd7340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 -- 172.21.15.72:0/1313601524 shutdown_connections 2024-04-15T21:02:34.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.822+0000 7fd73c57b700 1 -- 172.21.15.72:0/1313601524 wait complete. 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 Processor -- start 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 -- start start 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd734196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734196660 con 0x7fd7340ff150 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.823+0000 7fd73c57b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341967a0 con 0x7fd734100350 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73a317700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd739b16700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd734196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73a317700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42216/0 (socket says 172.21.15.72:42216) 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73a317700 1 -- 172.21.15.72:0/3196893236 learned_addr learned my addr 172.21.15.72:0/3196893236 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:02:34.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd739b16700 1 -- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 msgr2=0x7fd734195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd739b16700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd739b16700 1 -- 172.21.15.72:0/3196893236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300095f0 con 0x7fd734100350 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73a317700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd739b16700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd734196040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e970 tx=0x7fd72400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72400c9d0 con 0x7fd734100350 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73419b250 con 0x7fd734100350 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd724010430 con 0x7fd734100350 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd724018650 con 0x7fd734100350 2024-04-15T21:02:34.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.824+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73419b7a0 con 0x7fd734100350 2024-04-15T21:02:34.819 INFO:tasks.workunit.client.0.smithi072.stdout:0/122: dwrite d0/d3/fa [0,4194304] 0 2024-04-15T21:02:34.819 INFO:tasks.workunit.client.1.smithi149.stdout:6/354: mkdir da/d18/d33/d76 0 2024-04-15T21:02:34.819 INFO:tasks.workunit.client.1.smithi149.stdout:6/355: write da/d18/d10/d16/f3c [1099657,129467] 0 2024-04-15T21:02:34.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/449: link d2/df/d10/d25/d37/d95/ca2 d2/df/d10/d4e/ca6 0 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.826+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd734108db0 con 0x7fd734100350 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.826+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 20) v1 ==== 91256+0+0 (secure 0 0 0) 0x7fd7240188c0 con 0x7fd734100350 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.827+0000 7fd72b7fe700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 0x7fd72006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.827+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd724014070 con 0x7fd734100350 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.827+0000 7fd73a317700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 0x7fd72006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:02:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.828+0000 7fd73a317700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 0x7fd72006fc90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd730009fd0 tx=0x7fd730005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:02:34.821 INFO:tasks.workunit.client.1.smithi149.stdout:8/450: stat d2/df/d10/d21/d50/d5d/f96 0 2024-04-15T21:02:34.821 INFO:tasks.workunit.client.0.smithi072.stdout:6/145: dwrite d2/fa [0,4194304] 0 2024-04-15T21:02:34.823 INFO:tasks.workunit.client.0.smithi072.stdout:5/166: creat d0/d13/f32 x:0 0 0 2024-04-15T21:02:34.824 INFO:tasks.workunit.client.1.smithi149.stdout:2/447: rename d4/d7/d10/f11 to d4/d7/d10/d6b/d21/d3b/d90/fab 0 2024-04-15T21:02:34.824 INFO:tasks.workunit.client.0.smithi072.stdout:5/167: truncate d0/d13/f32 109702 0 2024-04-15T21:02:34.825 INFO:tasks.workunit.client.0.smithi072.stdout:5/168: fdatasync d0/d3/d6/d14/f1b 0 2024-04-15T21:02:34.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:34.833+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd724051720 con 0x7fd734100350 2024-04-15T21:02:34.827 INFO:tasks.workunit.client.0.smithi072.stdout:8/178: readlink d3/d4/l2d 0 2024-04-15T21:02:34.828 INFO:tasks.workunit.client.0.smithi072.stdout:8/179: dread - d3/de/f20 zero size 2024-04-15T21:02:34.828 INFO:tasks.workunit.client.0.smithi072.stdout:8/180: readlink d3/de/l19 0 2024-04-15T21:02:34.828 INFO:tasks.workunit.client.0.smithi072.stdout:5/169: dread d0/d13/f32 [0,4194304] 0 2024-04-15T21:02:34.829 INFO:tasks.workunit.client.0.smithi072.stdout:3/154: rmdir d1/d2d 0 2024-04-15T21:02:34.829 INFO:tasks.workunit.client.1.smithi149.stdout:7/386: creat d3/d16/d20/d60/f87 x:0 0 0 2024-04-15T21:02:34.829 INFO:tasks.workunit.client.0.smithi072.stdout:5/170: fdatasync d0/d13/f21 0 2024-04-15T21:02:34.830 INFO:tasks.workunit.client.0.smithi072.stdout:5/171: fsync d0/d3/f4 0 2024-04-15T21:02:34.831 INFO:tasks.workunit.client.0.smithi072.stdout:9/143: truncate d4/f11 3204613 0 2024-04-15T21:02:34.833 INFO:tasks.workunit.client.1.smithi149.stdout:3/401: truncate d1/db/d24/d39/f61 3336632 0 2024-04-15T21:02:34.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/384: getdents d0/d9/db/d3d 0 2024-04-15T21:02:34.834 INFO:tasks.workunit.client.1.smithi149.stdout:5/385: readlink d0/d9/db/d12/l31 0 2024-04-15T21:02:34.834 INFO:tasks.workunit.client.0.smithi072.stdout:2/186: symlink d2/l3f 0 2024-04-15T21:02:34.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/109: rename d7/d1d to d7/d24 0 2024-04-15T21:02:34.837 INFO:tasks.workunit.client.1.smithi149.stdout:6/356: unlink da/d11/c15 0 2024-04-15T21:02:34.839 INFO:tasks.workunit.client.1.smithi149.stdout:8/451: creat d2/df/d10/d21/fa7 x:0 0 0 2024-04-15T21:02:34.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/448: mknod d4/d7/d10/d6b/d21/d3b/d90/da7/cac 0 2024-04-15T21:02:34.842 INFO:tasks.workunit.client.1.smithi149.stdout:1/293: symlink d1/db/dc/d11/d3e/l4f 0 2024-04-15T21:02:34.843 INFO:tasks.workunit.client.1.smithi149.stdout:6/357: dwrite da/f1b [0,4194304] 0 2024-04-15T21:02:34.845 INFO:tasks.workunit.client.0.smithi072.stdout:8/181: symlink d3/de/d21/l39 0 2024-04-15T21:02:34.845 INFO:tasks.workunit.client.1.smithi149.stdout:1/294: dread d1/db/f37 [0,4194304] 0 2024-04-15T21:02:34.846 INFO:tasks.workunit.client.0.smithi072.stdout:8/182: dread - d3/f30 zero size 2024-04-15T21:02:34.846 INFO:tasks.workunit.client.0.smithi072.stdout:8/183: chown d3/de/c35 8 1 2024-04-15T21:02:34.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/358: dwrite da/d18/d10/f1c [4194304,4194304] 0 2024-04-15T21:02:34.857 INFO:tasks.workunit.client.1.smithi149.stdout:8/452: creat d2/df/d10/d25/d37/d53/d76/d85/d35/fa8 x:0 0 0 2024-04-15T21:02:34.862 INFO:tasks.workunit.client.1.smithi149.stdout:2/449: rename d4/f33 to d4/d7/d93/fad 0 2024-04-15T21:02:34.865 INFO:tasks.workunit.client.0.smithi072.stdout:1/133: getdents d5/db 0 2024-04-15T21:02:34.866 INFO:tasks.workunit.client.0.smithi072.stdout:1/134: fsync d5/db/d10/f13 0 2024-04-15T21:02:34.867 INFO:tasks.workunit.client.0.smithi072.stdout:9/144: symlink d4/d1f/l2a 0 2024-04-15T21:02:34.868 INFO:tasks.workunit.client.1.smithi149.stdout:1/295: symlink d1/d17/d36/l50 0 2024-04-15T21:02:34.874 INFO:tasks.workunit.client.0.smithi072.stdout:4/110: fdatasync d7/d10/f11 0 2024-04-15T21:02:34.874 INFO:tasks.workunit.client.0.smithi072.stdout:4/111: read - d7/d24/f1e zero size 2024-04-15T21:02:34.874 INFO:tasks.workunit.client.0.smithi072.stdout:4/112: write d7/d10/f1a [512841,44070] 0 2024-04-15T21:02:34.874 INFO:tasks.workunit.client.0.smithi072.stdout:4/113: chown d7/d15/l18 490224 1 2024-04-15T21:02:34.876 INFO:tasks.workunit.client.0.smithi072.stdout:6/146: symlink d2/d1a/l2b 0 2024-04-15T21:02:34.877 INFO:tasks.workunit.client.1.smithi149.stdout:5/386: dwrite d0/d9/db/d12/d16/d28/d1b/f20 [4194304,4194304] 0 2024-04-15T21:02:34.880 INFO:tasks.workunit.client.0.smithi072.stdout:8/184: symlink d3/de/d2f/l3a 0 2024-04-15T21:02:34.880 INFO:tasks.workunit.client.0.smithi072.stdout:8/185: chown d3/de/d2f/c34 114762432 1 2024-04-15T21:02:34.887 INFO:tasks.workunit.client.0.smithi072.stdout:8/186: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:34.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/450: chown d4/d7/d10/d6b/d21/d2c/d58/l8b 559852279 1 2024-04-15T21:02:34.889 INFO:tasks.workunit.client.0.smithi072.stdout:5/172: mkdir d0/d3/d33 0 2024-04-15T21:02:34.892 INFO:tasks.workunit.client.1.smithi149.stdout:1/296: mknod d1/db/dc/d11/d3e/c51 0 2024-04-15T21:02:34.893 INFO:tasks.workunit.client.1.smithi149.stdout:0/542: link d1/d5/d24/d50/l99 d1/d5/d24/lbd 0 2024-04-15T21:02:34.893 INFO:tasks.workunit.client.1.smithi149.stdout:4/439: sync 2024-04-15T21:02:34.894 INFO:tasks.workunit.client.0.smithi072.stdout:7/108: dwrite d2/d10/f1b [0,4194304] 0 2024-04-15T21:02:34.895 INFO:tasks.workunit.client.1.smithi149.stdout:4/440: fdatasync dc/d2c/d3e/d15/f4a 0 2024-04-15T21:02:34.896 INFO:tasks.workunit.client.0.smithi072.stdout:3/155: write d1/d7/fb [1216096,95983] 0 2024-04-15T21:02:34.898 INFO:tasks.workunit.client.1.smithi149.stdout:4/441: write dc/d2c/d3e/d35/d4b/d75/f77 [596928,98977] 0 2024-04-15T21:02:34.902 INFO:tasks.workunit.client.1.smithi149.stdout:5/387: chown d0/d9/l32 15 1 2024-04-15T21:02:34.905 INFO:tasks.workunit.client.1.smithi149.stdout:2/451: fdatasync d4/d7/d93/fad 0 2024-04-15T21:02:34.906 INFO:tasks.workunit.client.1.smithi149.stdout:7/387: getdents d3/d34 0 2024-04-15T21:02:34.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/147: symlink d2/d10/d11/d15/l2c 0 2024-04-15T21:02:34.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/148: chown d2/d10/d11/d15/l2c 604064 1 2024-04-15T21:02:34.909 INFO:tasks.workunit.client.0.smithi072.stdout:6/149: stat d2/fa 0 2024-04-15T21:02:34.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:34 smithi149 ceph-mon[36029]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:34.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:34 smithi149 ceph-mon[36029]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:34.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:34 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2713336657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:02:34.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:34 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:34.909 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:34 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/4204949455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:02:34.912 INFO:tasks.workunit.client.0.smithi072.stdout:8/187: mkdir d3/d4/d3b 0 2024-04-15T21:02:34.912 INFO:tasks.workunit.client.0.smithi072.stdout:6/150: dread d2/f2a [0,4194304] 0 2024-04-15T21:02:34.912 INFO:tasks.workunit.client.0.smithi072.stdout:8/188: chown d3 1192552 1 2024-04-15T21:02:34.912 INFO:tasks.workunit.client.0.smithi072.stdout:2/187: truncate d2/f3e 4092278 0 2024-04-15T21:02:34.912 INFO:tasks.workunit.client.0.smithi072.stdout:6/151: readlink d2/l8 0 2024-04-15T21:02:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:34 smithi072 ceph-mon[29079]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:34 smithi072 ceph-mon[29079]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:34 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2713336657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:02:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:34 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:34.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:34 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/4204949455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:02:34.913 INFO:tasks.workunit.client.0.smithi072.stdout:8/189: write d3/f33 [2608519,34558] 0 2024-04-15T21:02:34.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/402: getdents d1/db/d24 0 2024-04-15T21:02:34.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/403: chown d1/db/d24/c60 27 1 2024-04-15T21:02:34.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/404: stat d1/db/d24/l59 0 2024-04-15T21:02:34.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/442: symlink dc/d1a/l95 0 2024-04-15T21:02:34.915 INFO:tasks.workunit.client.1.smithi149.stdout:3/405: chown d1/db/d24/c43 82790 1 2024-04-15T21:02:34.916 INFO:tasks.workunit.client.1.smithi149.stdout:8/453: write d2/df/d10/f23 [6097762,19620] 0 2024-04-15T21:02:34.918 INFO:tasks.workunit.client.0.smithi072.stdout:8/190: dread d3/f1d [0,4194304] 0 2024-04-15T21:02:34.918 INFO:tasks.workunit.client.1.smithi149.stdout:8/454: read d2/df/d10/f11 [7715802,18937] 0 2024-04-15T21:02:34.919 INFO:tasks.workunit.client.0.smithi072.stdout:9/145: link d4/f1b d4/d1f/f2b 0 2024-04-15T21:02:34.921 INFO:tasks.workunit.client.0.smithi072.stdout:7/109: mkdir d2/d10/d1f 0 2024-04-15T21:02:34.921 INFO:tasks.workunit.client.0.smithi072.stdout:7/110: read - d2/db/ff zero size 2024-04-15T21:02:34.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/452: fdatasync d4/d7/d10/d6b/d21/d3b/f7f 0 2024-04-15T21:02:34.922 INFO:tasks.workunit.client.0.smithi072.stdout:7/111: dread - d2/f18 zero size 2024-04-15T21:02:34.922 INFO:tasks.workunit.client.0.smithi072.stdout:7/112: chown d2/d7/f8 2 1 2024-04-15T21:02:34.923 INFO:tasks.workunit.client.0.smithi072.stdout:3/156: truncate d1/d7/f1c 842943 0 2024-04-15T21:02:34.924 INFO:tasks.workunit.client.0.smithi072.stdout:3/157: chown d1/f10 722233268 1 2024-04-15T21:02:34.925 INFO:tasks.workunit.client.0.smithi072.stdout:5/173: write d0/d13/f32 [148600,17081] 0 2024-04-15T21:02:34.926 INFO:tasks.workunit.client.1.smithi149.stdout:3/406: dread d1/db/f1c [0,4194304] 0 2024-04-15T21:02:34.926 INFO:tasks.workunit.client.0.smithi072.stdout:5/174: truncate d0/d3/f4 4414687 0 2024-04-15T21:02:34.928 INFO:tasks.workunit.client.0.smithi072.stdout:0/123: getdents d0/d6 0 2024-04-15T21:02:34.931 INFO:tasks.workunit.client.0.smithi072.stdout:4/114: creat d7/d23/f25 x:0 0 0 2024-04-15T21:02:34.932 INFO:tasks.workunit.client.0.smithi072.stdout:1/135: dwrite d5/db/fc [0,4194304] 0 2024-04-15T21:02:34.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/453: dread d4/d7/d10/d36/f83 [0,4194304] 0 2024-04-15T21:02:34.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/388: truncate d0/d9/db/d3d/f7e 653286 0 2024-04-15T21:02:34.938 INFO:tasks.workunit.client.1.smithi149.stdout:1/297: truncate d1/db/dc/d38/d39/d43/fd 3304415 0 2024-04-15T21:02:34.941 INFO:tasks.workunit.client.1.smithi149.stdout:0/543: creat d1/fbe x:0 0 0 2024-04-15T21:02:34.942 INFO:tasks.workunit.client.0.smithi072.stdout:2/188: dwrite d2/d3/f15 [0,4194304] 0 2024-04-15T21:02:34.943 INFO:tasks.workunit.client.0.smithi072.stdout:2/189: stat d2/d3/f17 0 2024-04-15T21:02:34.944 INFO:tasks.workunit.client.1.smithi149.stdout:7/388: link d3/d16/d20/d36/f3a d3/d39/f88 0 2024-04-15T21:02:34.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/443: dwrite dc/d2c/d3e/d35/f86 [0,4194304] 0 2024-04-15T21:02:34.948 INFO:tasks.workunit.client.0.smithi072.stdout:8/191: rename d3/de/f11 to d3/f3c 0 2024-04-15T21:02:34.951 INFO:tasks.workunit.client.0.smithi072.stdout:9/146: mkdir d4/d1f/d2c 0 2024-04-15T21:02:35.019 INFO:tasks.workunit.client.1.smithi149.stdout:5/389: unlink d0/d9/db/d12/d16/d28/d1b/l6a 0 2024-04-15T21:02:35.025 INFO:tasks.workunit.client.1.smithi149.stdout:1/298: rename d1/db/d14/d21 to d1/d17/d52 0 2024-04-15T21:02:35.028 INFO:tasks.workunit.client.1.smithi149.stdout:0/544: mknod d1/d5/d24/d50/d15/d86/cbf 0 2024-04-15T21:02:35.032 INFO:tasks.workunit.client.1.smithi149.stdout:7/389: write d3/d16/d20/f24 [3255762,119212] 0 2024-04-15T21:02:35.033 INFO:tasks.workunit.client.0.smithi072.stdout:0/124: dread d0/d17/f26 [0,4194304] 0 2024-04-15T21:02:35.034 INFO:tasks.workunit.client.0.smithi072.stdout:1/136: readlink d5/db/l19 0 2024-04-15T21:02:35.038 INFO:tasks.workunit.client.0.smithi072.stdout:7/113: dwrite d2/f1e [0,4194304] 0 2024-04-15T21:02:35.041 INFO:tasks.workunit.client.0.smithi072.stdout:1/137: dread d5/db/d10/f22 [0,4194304] 0 2024-04-15T21:02:35.041 INFO:tasks.workunit.client.1.smithi149.stdout:4/444: rename dc/d1a/c25 to dc/d8f/c96 0 2024-04-15T21:02:35.042 INFO:tasks.workunit.client.0.smithi072.stdout:2/190: dread d2/d8/f13 [0,4194304] 0 2024-04-15T21:02:35.042 INFO:tasks.workunit.client.1.smithi149.stdout:4/445: fsync dc/d2c/d3e/d15/f34 0 2024-04-15T21:02:35.043 INFO:tasks.workunit.client.1.smithi149.stdout:1/299: symlink d1/db/dc/d38/d39/l53 0 2024-04-15T21:02:35.044 INFO:tasks.workunit.client.0.smithi072.stdout:1/138: truncate d5/f8 4628071 0 2024-04-15T21:02:35.045 INFO:tasks.workunit.client.1.smithi149.stdout:4/446: write dc/d2c/d3e/d35/d4b/d75/f77 [1155595,109805] 0 2024-04-15T21:02:35.045 INFO:tasks.workunit.client.0.smithi072.stdout:1/139: chown d5/f9 155423501 1 2024-04-15T21:02:35.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/447: write dc/d2c/d3e/d15/d3f/f8b [209916,59178] 0 2024-04-15T21:02:35.047 INFO:tasks.workunit.client.1.smithi149.stdout:7/390: creat d3/d39/f89 x:0 0 0 2024-04-15T21:02:35.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/191: dread d2/d8/fe [0,4194304] 0 2024-04-15T21:02:35.048 INFO:tasks.workunit.client.1.smithi149.stdout:5/390: truncate d0/d9/db/d12/d16/d28/d1b/d83/f85 3382876 0 2024-04-15T21:02:35.049 INFO:tasks.workunit.client.0.smithi072.stdout:2/192: fsync d2/d3/f5 0 2024-04-15T21:02:35.049 INFO:tasks.workunit.client.1.smithi149.stdout:4/448: stat dc/d2c/d3e/c50 0 2024-04-15T21:02:35.050 INFO:tasks.workunit.client.1.smithi149.stdout:0/545: dread d1/d5/d24/d30/d43/f62 [0,4194304] 0 2024-04-15T21:02:35.050 INFO:tasks.workunit.client.0.smithi072.stdout:4/115: dread d7/f1c [0,4194304] 0 2024-04-15T21:02:35.050 INFO:tasks.workunit.client.0.smithi072.stdout:3/158: link d1/fd d1/d26/f30 0 2024-04-15T21:02:35.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/455: getdents d2/df/d10/d4e 0 2024-04-15T21:02:35.053 INFO:tasks.workunit.client.1.smithi149.stdout:1/300: rmdir d1/db/dc/d38 39 2024-04-15T21:02:35.056 INFO:tasks.workunit.client.1.smithi149.stdout:5/391: mknod d0/d6/d82/c8b 0 2024-04-15T21:02:35.058 INFO:tasks.workunit.client.0.smithi072.stdout:7/114: write d2/d7/f8 [1074143,93098] 0 2024-04-15T21:02:35.059 INFO:tasks.workunit.client.0.smithi072.stdout:8/192: creat d3/d4/d3b/f3d x:0 0 0 2024-04-15T21:02:35.062 INFO:tasks.workunit.client.0.smithi072.stdout:1/140: mkdir d5/db/d27 0 2024-04-15T21:02:35.066 INFO:tasks.workunit.client.1.smithi149.stdout:8/456: dwrite d2/df/d10/d34/f9c [0,4194304] 0 2024-04-15T21:02:35.067 INFO:tasks.workunit.client.1.smithi149.stdout:9/352: sync 2024-04-15T21:02:35.068 INFO:tasks.workunit.client.1.smithi149.stdout:5/392: creat d0/d9/db/d12/d16/f8c x:0 0 0 2024-04-15T21:02:35.073 INFO:tasks.workunit.client.1.smithi149.stdout:4/449: creat dc/d8f/d91/f97 x:0 0 0 2024-04-15T21:02:35.074 INFO:tasks.workunit.client.0.smithi072.stdout:3/159: creat d1/d15/f31 x:0 0 0 2024-04-15T21:02:35.074 INFO:tasks.workunit.client.1.smithi149.stdout:4/450: write dc/d2c/d3e/d15/f34 [422558,103639] 0 2024-04-15T21:02:35.078 INFO:tasks.workunit.client.0.smithi072.stdout:1/141: dread d5/fe [0,4194304] 0 2024-04-15T21:02:35.078 INFO:tasks.workunit.client.1.smithi149.stdout:0/546: creat d1/d5/d24/d50/d13/d38/d71/d9d/fc0 x:0 0 0 2024-04-15T21:02:35.078 INFO:tasks.workunit.client.1.smithi149.stdout:0/547: chown d1/d5/d24/d50 11665 1 2024-04-15T21:02:35.079 INFO:tasks.workunit.client.0.smithi072.stdout:9/147: write d4/f11 [1253944,26784] 0 2024-04-15T21:02:35.080 INFO:tasks.workunit.client.1.smithi149.stdout:8/457: mknod d2/df/d10/d25/d37/d95/ca9 0 2024-04-15T21:02:35.081 INFO:tasks.workunit.client.1.smithi149.stdout:8/458: write d2/df/d10/f19 [2746293,69460] 0 2024-04-15T21:02:35.082 INFO:tasks.workunit.client.0.smithi072.stdout:4/116: write d7/d10/f11 [2148051,94080] 0 2024-04-15T21:02:35.083 INFO:tasks.workunit.client.0.smithi072.stdout:7/115: rename d2 to d2/d20 22 2024-04-15T21:02:35.084 INFO:tasks.workunit.client.1.smithi149.stdout:5/393: mknod d0/d9/db/d12/d16/d28/d1b/d61/c8d 0 2024-04-15T21:02:35.086 INFO:tasks.workunit.client.1.smithi149.stdout:4/451: stat dc/d2c/d3e/d15/d3f/l8c 0 2024-04-15T21:02:35.090 INFO:tasks.workunit.client.0.smithi072.stdout:8/193: dwrite d3/de/f22 [8388608,4194304] 0 2024-04-15T21:02:35.091 INFO:tasks.workunit.client.0.smithi072.stdout:3/160: chown d1/d7/l21 89872 1 2024-04-15T21:02:35.092 INFO:tasks.workunit.client.0.smithi072.stdout:3/161: chown d1/d26/f29 708627 1 2024-04-15T21:02:35.092 INFO:tasks.workunit.client.0.smithi072.stdout:0/125: creat d0/f29 x:0 0 0 2024-04-15T21:02:35.093 INFO:tasks.workunit.client.1.smithi149.stdout:7/391: link d3/d34/f4d d3/d17/f8a 0 2024-04-15T21:02:35.095 INFO:tasks.workunit.client.0.smithi072.stdout:1/142: truncate d5/f14 3291392 0 2024-04-15T21:02:35.098 INFO:tasks.workunit.client.0.smithi072.stdout:6/152: link d2/d10/d11/l1c d2/l2d 0 2024-04-15T21:02:35.100 INFO:tasks.workunit.client.1.smithi149.stdout:1/301: getdents d1 0 2024-04-15T21:02:35.102 INFO:tasks.workunit.client.0.smithi072.stdout:4/117: mknod d7/d24/c26 0 2024-04-15T21:02:35.103 INFO:tasks.workunit.client.0.smithi072.stdout:6/153: dwrite d2/fb [0,4194304] 0 2024-04-15T21:02:35.104 INFO:tasks.workunit.client.1.smithi149.stdout:8/459: rename d2/d5b/c82 to d2/df/d10/d25/d32/d45/caa 0 2024-04-15T21:02:35.105 INFO:tasks.workunit.client.0.smithi072.stdout:7/116: rmdir d2/db 39 2024-04-15T21:02:35.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/392: stat d3/d34/c3b 0 2024-04-15T21:02:35.112 INFO:tasks.workunit.client.0.smithi072.stdout:3/162: rename d1/d1f to d1/d15/d32 0 2024-04-15T21:02:35.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/126: unlink d0/f12 0 2024-04-15T21:02:35.114 INFO:tasks.workunit.client.1.smithi149.stdout:4/452: dwrite dc/d1a/f4f [0,4194304] 0 2024-04-15T21:02:35.115 INFO:tasks.workunit.client.0.smithi072.stdout:9/148: creat d4/d1f/d2c/f2d x:0 0 0 2024-04-15T21:02:35.117 INFO:tasks.workunit.client.0.smithi072.stdout:4/118: symlink d7/d23/l27 0 2024-04-15T21:02:35.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/548: getdents d1/d29/d2c/d4f 0 2024-04-15T21:02:35.121 INFO:tasks.workunit.client.1.smithi149.stdout:1/302: creat d1/db/dc/d38/d39/d43/f54 x:0 0 0 2024-04-15T21:02:35.121 INFO:tasks.workunit.client.0.smithi072.stdout:8/194: write d3/d4/f1e [829662,91982] 0 2024-04-15T21:02:35.123 INFO:tasks.workunit.client.0.smithi072.stdout:7/117: rmdir d2 39 2024-04-15T21:02:35.126 INFO:tasks.workunit.client.1.smithi149.stdout:4/453: dread dc/d18/d21/f63 [0,4194304] 0 2024-04-15T21:02:35.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/549: symlink d1/d29/lc1 0 2024-04-15T21:02:35.132 INFO:tasks.workunit.client.0.smithi072.stdout:3/163: dwrite d1/d7/f13 [0,4194304] 0 2024-04-15T21:02:35.135 INFO:tasks.workunit.client.0.smithi072.stdout:4/119: unlink d7/d24/c22 0 2024-04-15T21:02:35.136 INFO:tasks.workunit.client.1.smithi149.stdout:4/454: rename dc/d2c/d3e/d35/d4b/c5d to dc/d18/c98 0 2024-04-15T21:02:35.140 INFO:tasks.workunit.client.1.smithi149.stdout:8/460: truncate d2/df/d10/d25/f28 2961251 0 2024-04-15T21:02:35.141 INFO:tasks.workunit.client.0.smithi072.stdout:5/175: sync 2024-04-15T21:02:35.141 INFO:tasks.workunit.client.0.smithi072.stdout:9/149: dread d4/d1f/f24 [0,4194304] 0 2024-04-15T21:02:35.142 INFO:tasks.workunit.client.1.smithi149.stdout:0/550: fdatasync d1/d5/d24/d50/d13/d38/d44/f60 0 2024-04-15T21:02:35.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/455: dread dc/d2c/d3e/d35/f86 [0,4194304] 0 2024-04-15T21:02:35.144 INFO:tasks.workunit.client.1.smithi149.stdout:0/551: write d1/d29/fa7 [216817,12462] 0 2024-04-15T21:02:35.144 INFO:tasks.workunit.client.1.smithi149.stdout:7/393: link d3/d39/f88 d3/d16/d20/f8b 0 2024-04-15T21:02:35.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/303: creat d1/db/dc/f55 x:0 0 0 2024-04-15T21:02:35.150 INFO:tasks.workunit.client.1.smithi149.stdout:8/461: creat d2/df/d10/d21/d50/d5d/fab x:0 0 0 2024-04-15T21:02:35.152 INFO:tasks.workunit.client.0.smithi072.stdout:3/164: creat d1/d15/d32/d2f/f33 x:0 0 0 2024-04-15T21:02:35.155 INFO:tasks.workunit.client.0.smithi072.stdout:4/120: unlink f3 0 2024-04-15T21:02:35.156 INFO:tasks.workunit.client.1.smithi149.stdout:0/552: dread d1/d5/f7d [0,4194304] 0 2024-04-15T21:02:35.156 INFO:tasks.workunit.client.0.smithi072.stdout:4/121: write d7/fe [517776,113866] 0 2024-04-15T21:02:35.156 INFO:tasks.workunit.client.1.smithi149.stdout:4/456: rmdir dc/d2c/d3e/d35 39 2024-04-15T21:02:35.157 INFO:tasks.workunit.client.1.smithi149.stdout:0/553: stat d1/d9/d64/d65 0 2024-04-15T21:02:35.157 INFO:tasks.workunit.client.0.smithi072.stdout:4/122: write d7/d10/f1a [1258343,79877] 0 2024-04-15T21:02:35.157 INFO:tasks.workunit.client.1.smithi149.stdout:4/457: chown dc/d18/d21 3 1 2024-04-15T21:02:35.158 INFO:tasks.workunit.client.0.smithi072.stdout:4/123: fdatasync d7/fc 0 2024-04-15T21:02:35.158 INFO:tasks.workunit.client.1.smithi149.stdout:0/554: fdatasync d1/d5/d24/d50/d13/d38/d71/f80 0 2024-04-15T21:02:35.158 INFO:tasks.workunit.client.0.smithi072.stdout:6/154: creat d2/d10/d11/f2e x:0 0 0 2024-04-15T21:02:35.159 INFO:tasks.workunit.client.0.smithi072.stdout:6/155: chown d2/f7 15976084 1 2024-04-15T21:02:35.161 INFO:tasks.workunit.client.0.smithi072.stdout:5/176: mknod d0/d3/d7/c34 0 2024-04-15T21:02:35.162 INFO:tasks.workunit.client.0.smithi072.stdout:0/127: truncate d0/d3/f4 2643268 0 2024-04-15T21:02:35.163 INFO:tasks.workunit.client.1.smithi149.stdout:1/304: write d1/db/f37 [515076,125733] 0 2024-04-15T21:02:35.164 INFO:tasks.workunit.client.1.smithi149.stdout:8/462: symlink d2/df/d10/d25/d37/d53/lac 0 2024-04-15T21:02:35.164 INFO:tasks.workunit.client.0.smithi072.stdout:4/124: dwrite d7/f9 [0,4194304] 0 2024-04-15T21:02:35.166 INFO:tasks.workunit.client.0.smithi072.stdout:3/165: creat d1/d15/f34 x:0 0 0 2024-04-15T21:02:35.173 INFO:tasks.workunit.client.1.smithi149.stdout:0/555: creat d1/d5/d24/d50/d13/d38/fc2 x:0 0 0 2024-04-15T21:02:35.177 INFO:tasks.workunit.client.0.smithi072.stdout:6/156: fdatasync d2/d10/d11/d15/f20 0 2024-04-15T21:02:35.178 INFO:tasks.workunit.client.0.smithi072.stdout:6/157: write d2/fc [6866556,79125] 0 2024-04-15T21:02:35.179 INFO:tasks.workunit.client.0.smithi072.stdout:0/128: rename d0/f1f to d0/d3/d5/f2a 0 2024-04-15T21:02:35.179 INFO:tasks.workunit.client.1.smithi149.stdout:7/394: link d3/d16/d20/d60/c7c d3/d16/d6e/c8c 0 2024-04-15T21:02:35.179 INFO:tasks.workunit.client.0.smithi072.stdout:7/118: symlink d2/d10/d1f/l21 0 2024-04-15T21:02:35.181 INFO:tasks.workunit.client.1.smithi149.stdout:6/359: sync 2024-04-15T21:02:35.181 INFO:tasks.workunit.client.1.smithi149.stdout:3/407: sync 2024-04-15T21:02:35.182 INFO:tasks.workunit.client.1.smithi149.stdout:7/395: read d3/d16/f30 [2605020,44552] 0 2024-04-15T21:02:35.183 INFO:tasks.workunit.client.1.smithi149.stdout:1/305: link d1/d17/d52/f40 d1/db/d16/f56 0 2024-04-15T21:02:35.185 INFO:tasks.workunit.client.0.smithi072.stdout:6/158: dread d2/fb [0,4194304] 0 2024-04-15T21:02:35.186 INFO:tasks.workunit.client.0.smithi072.stdout:3/166: unlink f0 0 2024-04-15T21:02:35.188 INFO:tasks.workunit.client.0.smithi072.stdout:3/167: fsync d1/f10 0 2024-04-15T21:02:35.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/119: dread d2/d10/f1b [0,4194304] 0 2024-04-15T21:02:35.188 INFO:tasks.workunit.client.0.smithi072.stdout:0/129: dwrite d0/f1c [4194304,4194304] 0 2024-04-15T21:02:35.188 INFO:tasks.workunit.client.0.smithi072.stdout:3/168: chown d1/d26 8260016 1 2024-04-15T21:02:35.189 INFO:tasks.workunit.client.0.smithi072.stdout:8/195: getdents d3/d4 0 2024-04-15T21:02:35.192 INFO:tasks.workunit.client.0.smithi072.stdout:3/169: write d1/d7/f22 [3099235,104512] 0 2024-04-15T21:02:35.192 INFO:tasks.workunit.client.1.smithi149.stdout:0/556: creat d1/d29/dbb/fc3 x:0 0 0 2024-04-15T21:02:35.196 INFO:tasks.workunit.client.0.smithi072.stdout:6/159: dwrite d2/f16 [0,4194304] 0 2024-04-15T21:02:35.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.204+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd734108fa0 con 0x7fd734100350 2024-04-15T21:02:35.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.206+0000 7fd72b7fe700 1 -- 172.21.15.72:0/3196893236 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd72405b400 con 0x7fd734100350 2024-04-15T21:02:35.199 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:02:35.199 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:02:35.199 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:02:35.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/360: stat da/d2e/l30 0 2024-04-15T21:02:35.201 INFO:tasks.workunit.client.1.smithi149.stdout:6/361: fsync da/d18/d10/d3f/f5c 0 2024-04-15T21:02:35.204 INFO:tasks.workunit.client.1.smithi149.stdout:0/557: dwrite d1/d5/dc/f84 [0,4194304] 0 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 msgr2=0x7fd72006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 0x7fd72006fc90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd730009fd0 tx=0x7fd730005940 comp rx=0 tx=0).stop 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 msgr2=0x7fd734196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd734196040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e970 tx=0x7fd72400ec80 comp rx=0 tx=0).stop 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 shutdown_connections 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:6800/3446136011,v1:172.21.15.72:6801/3446136011] conn(0x7fd72006d7e0 0x7fd72006fc90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7340ff150 0x7fd734195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 --2- 172.21.15.72:0/3196893236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd734100350 0x7fd734196040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:02:35.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.211+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 >> 172.21.15.72:0/3196893236 conn(0x7fd7340fa700 msgr2=0x7fd734103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:02:35.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.212+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 shutdown_connections 2024-04-15T21:02:35.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:02:35.212+0000 7fd73c57b700 1 -- 172.21.15.72:0/3196893236 wait complete. 2024-04-15T21:02:35.205 INFO:tasks.workunit.client.0.smithi072.stdout:6/160: dwrite d2/f14 [0,4194304] 0 2024-04-15T21:02:35.206 INFO:tasks.workunit.client.1.smithi149.stdout:0/558: read - d1/d5/d24/d50/d13/d38/fc2 zero size 2024-04-15T21:02:35.207 INFO:tasks.workunit.client.1.smithi149.stdout:0/559: stat d1/d5/fb8 0 2024-04-15T21:02:35.213 INFO:tasks.workunit.client.1.smithi149.stdout:3/408: dread d1/fa [0,4194304] 0 2024-04-15T21:02:35.215 INFO:tasks.workunit.client.1.smithi149.stdout:1/306: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:35.221 INFO:tasks.workunit.client.0.smithi072.stdout:4/125: mkdir d7/d28 0 2024-04-15T21:02:35.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/463: dwrite d2/fe [4194304,4194304] 0 2024-04-15T21:02:35.227 INFO:tasks.workunit.client.0.smithi072.stdout:4/126: dwrite d7/d24/f1e [0,4194304] 0 2024-04-15T21:02:35.235 INFO:tasks.workunit.client.0.smithi072.stdout:8/196: creat d3/d4/d3b/f3e x:0 0 0 2024-04-15T21:02:35.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/197: chown d3/de/f25 3148 1 2024-04-15T21:02:35.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/198: chown d3/de/f38 2615721 1 2024-04-15T21:02:35.239 INFO:tasks.workunit.client.1.smithi149.stdout:8/464: write d2/df/d10/f14 [2242757,106289] 0 2024-04-15T21:02:35.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/465: readlink d2/df/d10/d25/d37/l56 0 2024-04-15T21:02:35.241 INFO:tasks.workunit.client.1.smithi149.stdout:3/409: dwrite d1/db/d23/d5e/f6d [0,4194304] 0 2024-04-15T21:02:35.241 INFO:tasks.workunit.client.0.smithi072.stdout:8/199: dwrite d3/f33 [0,4194304] 0 2024-04-15T21:02:35.242 INFO:tasks.workunit.client.0.smithi072.stdout:5/177: creat d0/f35 x:0 0 0 2024-04-15T21:02:35.243 INFO:tasks.workunit.client.0.smithi072.stdout:5/178: write d0/d3/d6/d14/f18 [4893804,27960] 0 2024-04-15T21:02:35.246 INFO:tasks.workunit.client.1.smithi149.stdout:4/458: rename dc/d2c/d3e/d35/d4b/d75/f77 to dc/d2c/d3e/d15/f99 0 2024-04-15T21:02:35.247 INFO:tasks.workunit.client.1.smithi149.stdout:6/362: write f8 [3780582,130213] 0 2024-04-15T21:02:35.248 INFO:tasks.workunit.client.0.smithi072.stdout:6/161: symlink d2/d10/d11/d15/l2f 0 2024-04-15T21:02:35.249 INFO:tasks.workunit.client.0.smithi072.stdout:6/162: truncate d2/fe 4808396 0 2024-04-15T21:02:35.250 INFO:tasks.workunit.client.1.smithi149.stdout:7/396: write d3/d34/f4d [3187768,109279] 0 2024-04-15T21:02:35.253 INFO:tasks.workunit.client.0.smithi072.stdout:0/130: write d0/d6/ff [1651896,125584] 0 2024-04-15T21:02:35.254 INFO:tasks.workunit.client.0.smithi072.stdout:9/150: link d4/f1c d4/d1f/d2c/f2e 0 2024-04-15T21:02:35.256 INFO:tasks.workunit.client.1.smithi149.stdout:0/560: creat d1/d5/fc4 x:0 0 0 2024-04-15T21:02:35.259 INFO:tasks.workunit.client.0.smithi072.stdout:4/127: creat d7/d23/f29 x:0 0 0 2024-04-15T21:02:35.260 INFO:tasks.workunit.client.0.smithi072.stdout:8/200: dread d3/ff [4194304,4194304] 0 2024-04-15T21:02:35.260 INFO:tasks.workunit.client.0.smithi072.stdout:0/131: dwrite d0/d3/fe [0,4194304] 0 2024-04-15T21:02:35.264 INFO:tasks.workunit.client.1.smithi149.stdout:3/410: fdatasync d1/db/d24/d39/f61 0 2024-04-15T21:02:35.267 INFO:tasks.workunit.client.0.smithi072.stdout:3/170: dread d1/d7/f27 [0,4194304] 0 2024-04-15T21:02:35.267 INFO:tasks.workunit.client.1.smithi149.stdout:0/561: mkdir d1/d9/d64/d65/dc5 0 2024-04-15T21:02:35.267 INFO:tasks.workunit.client.0.smithi072.stdout:8/201: dwrite d3/f30 [0,4194304] 0 2024-04-15T21:02:35.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/459: dwrite dc/d18/f62 [0,4194304] 0 2024-04-15T21:02:35.268 INFO:tasks.workunit.client.0.smithi072.stdout:3/171: write d1/d7/f22 [3295535,90958] 0 2024-04-15T21:02:35.274 INFO:tasks.workunit.client.0.smithi072.stdout:3/172: dread d1/fa [0,4194304] 0 2024-04-15T21:02:35.277 INFO:tasks.workunit.client.1.smithi149.stdout:7/397: mknod d3/c8d 0 2024-04-15T21:02:35.282 INFO:tasks.workunit.client.0.smithi072.stdout:9/151: readlink d4/l18 0 2024-04-15T21:02:35.282 INFO:tasks.workunit.client.0.smithi072.stdout:4/128: unlink d7/f19 0 2024-04-15T21:02:35.284 INFO:tasks.workunit.client.0.smithi072.stdout:0/132: mkdir d0/d19/d2b 0 2024-04-15T21:02:35.285 INFO:tasks.workunit.client.0.smithi072.stdout:0/133: write d0/d3/fa [4538423,16015] 0 2024-04-15T21:02:35.287 INFO:tasks.workunit.client.1.smithi149.stdout:3/411: chown d1/db/f41 514 1 2024-04-15T21:02:35.289 INFO:tasks.workunit.client.1.smithi149.stdout:0/562: write d1/d5/d24/d50/d13/d38/d44/f47 [3165512,124024] 0 2024-04-15T21:02:35.290 INFO:tasks.workunit.client.1.smithi149.stdout:4/460: rename dc/d2c/d3e/d15/c1b to dc/d2c/d3e/d35/d4b/d75/c9a 0 2024-04-15T21:02:35.293 INFO:tasks.workunit.client.1.smithi149.stdout:6/363: rmdir da/d18/d33/d76 0 2024-04-15T21:02:35.294 INFO:tasks.workunit.client.1.smithi149.stdout:6/364: fdatasync da/d2e/f50 0 2024-04-15T21:02:35.297 INFO:tasks.workunit.client.1.smithi149.stdout:6/365: write da/d18/f19 [9066771,45732] 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:4/461: dwrite dc/d2c/d3e/d35/d3a/f40 [0,4194304] 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:7/398: dread d3/d16/d20/d36/f3a [0,4194304] 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:3/412: rename d1/l53 to d1/db/d24/l78 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:3/413: chown d1/db/d40/f5b 0 1 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:3/414: read d1/db/f21 [8357675,39666] 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:4/462: fsync dc/d2c/d3e/d35/f86 0 2024-04-15T21:02:35.323 INFO:tasks.workunit.client.1.smithi149.stdout:4/463: write dc/d2c/d3e/f47 [3294873,62693] 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:8/202: rename d3/de/d2f to d3/de/d1b/d3f 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:2/193: sync 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:6/163: dwrite d2/f2a [4194304,4194304] 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/173: mknod d1/d26/c35 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/174: stat d1/d7/fb 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/175: write d1/d7/fb [1534134,2356] 0 2024-04-15T21:02:35.324 INFO:tasks.workunit.client.0.smithi072.stdout:4/129: unlink d7/fe 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:4/130: write d7/d23/f25 [986379,2819] 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:4/131: write d7/f9 [4393993,23372] 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/134: creat d0/d6/f2c x:0 0 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:5/179: link d0/d3/d7/lb d0/d3/d7/d12/d1d/l36 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/135: truncate d0/d6/f25 624728 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/136: dread - d0/d19/f22 zero size 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:6/164: dread d2/d10/d11/d1f/f23 [0,4194304] 0 2024-04-15T21:02:35.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/137: readlink d0/l16 0 2024-04-15T21:02:35.326 INFO:tasks.workunit.client.0.smithi072.stdout:0/138: write d0/d3/fa [524960,115172] 0 2024-04-15T21:02:35.328 INFO:tasks.workunit.client.0.smithi072.stdout:4/132: dwrite d7/d15/f20 [0,4194304] 0 2024-04-15T21:02:35.329 INFO:tasks.workunit.client.1.smithi149.stdout:4/464: chown dc/d18/c36 15 1 2024-04-15T21:02:35.329 INFO:tasks.workunit.client.0.smithi072.stdout:0/139: write d0/d3/fa [1012192,16110] 0 2024-04-15T21:02:35.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/152: symlink d4/l2f 0 2024-04-15T21:02:35.330 INFO:tasks.workunit.client.0.smithi072.stdout:4/133: readlink d7/d23/l27 0 2024-04-15T21:02:35.330 INFO:tasks.workunit.client.0.smithi072.stdout:0/140: fdatasync d0/f1 0 2024-04-15T21:02:35.331 INFO:tasks.workunit.client.0.smithi072.stdout:9/153: chown d4/f13 3157798 1 2024-04-15T21:02:35.331 INFO:tasks.workunit.client.0.smithi072.stdout:4/134: dread - d7/d23/f29 zero size 2024-04-15T21:02:35.332 INFO:tasks.workunit.client.1.smithi149.stdout:0/563: dread d1/d5/d24/d50/f2a [0,4194304] 0 2024-04-15T21:02:35.333 INFO:tasks.workunit.client.0.smithi072.stdout:4/135: fsync d7/d23/f25 0 2024-04-15T21:02:35.333 INFO:tasks.workunit.client.1.smithi149.stdout:3/415: chown d1/db/d24/f36 0 1 2024-04-15T21:02:35.334 INFO:tasks.workunit.client.0.smithi072.stdout:3/176: readlink d1/d7/l16 0 2024-04-15T21:02:35.335 INFO:tasks.workunit.client.1.smithi149.stdout:6/366: link da/d2e/c63 da/d18/d33/c77 0 2024-04-15T21:02:35.335 INFO:tasks.workunit.client.0.smithi072.stdout:3/177: write d1/d7/f1c [746827,101546] 0 2024-04-15T21:02:35.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/465: rename dc/d2c/d3e/d35/c59 to dc/d2c/d3e/d15/d3f/c9b 0 2024-04-15T21:02:35.341 INFO:tasks.workunit.client.1.smithi149.stdout:0/564: dwrite d1/d9/f19 [0,4194304] 0 2024-04-15T21:02:35.345 INFO:tasks.workunit.client.1.smithi149.stdout:6/367: dwrite da/d49/d55/f61 [0,4194304] 0 2024-04-15T21:02:35.352 INFO:tasks.workunit.client.1.smithi149.stdout:7/399: write d3/d34/f4e [1098707,106026] 0 2024-04-15T21:02:35.354 INFO:tasks.workunit.client.1.smithi149.stdout:6/368: dread da/d18/d10/d66/f69 [0,4194304] 0 2024-04-15T21:02:35.357 INFO:tasks.workunit.client.0.smithi072.stdout:6/165: creat d2/d10/d11/d1f/f30 x:0 0 0 2024-04-15T21:02:35.357 INFO:tasks.workunit.client.1.smithi149.stdout:4/466: symlink dc/d2c/d3e/d35/d3a/l9c 0 2024-04-15T21:02:35.358 INFO:tasks.workunit.client.1.smithi149.stdout:4/467: truncate f1 5223219 0 2024-04-15T21:02:35.363 INFO:tasks.workunit.client.1.smithi149.stdout:2/454: sync 2024-04-15T21:02:35.364 INFO:tasks.workunit.client.0.smithi072.stdout:3/178: dread d1/fd [0,4194304] 0 2024-04-15T21:02:35.365 INFO:tasks.workunit.client.1.smithi149.stdout:2/455: write d4/d7/d10/d6b/d21/d2c/d32/d4a/f88 [1029602,21924] 0 2024-04-15T21:02:35.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/565: symlink d1/lc6 0 2024-04-15T21:02:35.366 INFO:tasks.workunit.client.1.smithi149.stdout:0/566: chown d1/d29/lc1 0 1 2024-04-15T21:02:35.367 INFO:tasks.workunit.client.0.smithi072.stdout:9/154: mknod d4/d1f/d2c/c30 0 2024-04-15T21:02:35.368 INFO:tasks.workunit.client.1.smithi149.stdout:0/567: chown d1/fbe 1924 1 2024-04-15T21:02:35.368 INFO:tasks.workunit.client.0.smithi072.stdout:2/194: dwrite d2/f3e [0,4194304] 0 2024-04-15T21:02:35.368 INFO:tasks.workunit.client.0.smithi072.stdout:9/155: write d4/f13 [662019,83006] 0 2024-04-15T21:02:35.380 INFO:tasks.workunit.client.0.smithi072.stdout:5/180: mknod d0/d3/d7/d12/d1d/c37 0 2024-04-15T21:02:35.382 INFO:tasks.workunit.client.1.smithi149.stdout:2/456: symlink d4/d7/d93/lae 0 2024-04-15T21:02:35.383 INFO:tasks.workunit.client.0.smithi072.stdout:6/166: mknod d2/d1a/c31 0 2024-04-15T21:02:35.384 INFO:tasks.workunit.client.1.smithi149.stdout:7/400: dread d3/f78 [0,4194304] 0 2024-04-15T21:02:35.384 INFO:tasks.workunit.client.0.smithi072.stdout:6/167: chown d2/f16 0 1 2024-04-15T21:02:35.384 INFO:tasks.workunit.client.0.smithi072.stdout:6/168: stat d2/d10/d11/d15/l2c 0 2024-04-15T21:02:35.386 INFO:tasks.workunit.client.1.smithi149.stdout:0/568: rename d1/d5/d24/d50/d13/d38/d44/cad to d1/d5/d24/d30/d54/cc7 0 2024-04-15T21:02:35.386 INFO:tasks.workunit.client.1.smithi149.stdout:7/401: write d3/d39/f89 [234032,32403] 0 2024-04-15T21:02:35.386 INFO:tasks.workunit.client.1.smithi149.stdout:3/416: dwrite d1/db/d24/d39/f61 [0,4194304] 0 2024-04-15T21:02:35.388 INFO:tasks.workunit.client.1.smithi149.stdout:7/402: readlink d3/d17/l68 0 2024-04-15T21:02:35.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/468: dread dc/f41 [0,4194304] 0 2024-04-15T21:02:35.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/403: chown d3/d34/l7f 398947497 1 2024-04-15T21:02:35.391 INFO:tasks.workunit.client.1.smithi149.stdout:7/404: chown d3/d16/d20/d36/d3d/f46 10077 1 2024-04-15T21:02:35.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/179: dread d1/d7/f18 [0,4194304] 0 2024-04-15T21:02:35.393 INFO:tasks.workunit.client.1.smithi149.stdout:6/369: truncate da/d11/f35 1436770 0 2024-04-15T21:02:35.394 INFO:tasks.workunit.client.0.smithi072.stdout:1/143: sync 2024-04-15T21:02:35.394 INFO:tasks.workunit.client.0.smithi072.stdout:7/120: sync 2024-04-15T21:02:35.399 INFO:tasks.workunit.client.1.smithi149.stdout:4/469: creat dc/d1a/f9d x:0 0 0 2024-04-15T21:02:35.400 INFO:tasks.workunit.client.0.smithi072.stdout:5/181: mknod d0/d3/d6/d14/c38 0 2024-04-15T21:02:35.401 INFO:tasks.workunit.client.0.smithi072.stdout:5/182: chown d0/d3/d6/d2d/f28 2436572 1 2024-04-15T21:02:35.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/457: creat d4/d7/d10/d6b/d21/d55/d94/faf x:0 0 0 2024-04-15T21:02:35.403 INFO:tasks.workunit.client.0.smithi072.stdout:6/169: rename d2/d10/d11/d1f/f23 to d2/d10/d11/d1f/f32 0 2024-04-15T21:02:35.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/569: write d1/d5/d24/d30/d54/f8c [4873643,70138] 0 2024-04-15T21:02:35.404 INFO:tasks.workunit.client.0.smithi072.stdout:6/170: write d2/d10/d11/d1f/f28 [888002,73491] 0 2024-04-15T21:02:35.406 INFO:tasks.workunit.client.1.smithi149.stdout:7/405: rename d3/d16/d20/d36/d3d/f46 to d3/d17/d1f/f8e 0 2024-04-15T21:02:35.407 INFO:tasks.workunit.client.0.smithi072.stdout:0/141: creat d0/f2d x:0 0 0 2024-04-15T21:02:35.408 INFO:tasks.workunit.client.0.smithi072.stdout:6/171: dread d2/fc [0,4194304] 0 2024-04-15T21:02:35.410 INFO:tasks.workunit.client.1.smithi149.stdout:3/417: unlink d1/db/d24/f68 0 2024-04-15T21:02:35.411 INFO:tasks.workunit.client.0.smithi072.stdout:2/195: creat d2/d37/f40 x:0 0 0 2024-04-15T21:02:35.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/458: dwrite d4/d7/d10/d6b/d21/d2c/d32/fa6 [0,4194304] 0 2024-04-15T21:02:35.412 INFO:tasks.workunit.client.1.smithi149.stdout:0/570: dread d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:35.412 INFO:tasks.workunit.client.1.smithi149.stdout:4/470: chown c0 710 1 2024-04-15T21:02:35.413 INFO:tasks.workunit.client.1.smithi149.stdout:4/471: chown dc/d18/d21/f67 30406624 1 2024-04-15T21:02:35.414 INFO:tasks.workunit.client.1.smithi149.stdout:6/370: rename da/d18/d10 to da/d18/d10/d78 22 2024-04-15T21:02:35.417 INFO:tasks.workunit.client.0.smithi072.stdout:7/121: unlink d2/f1e 0 2024-04-15T21:02:35.417 INFO:tasks.workunit.client.0.smithi072.stdout:7/122: write d2/d7/f8 [594971,24880] 0 2024-04-15T21:02:35.421 INFO:tasks.workunit.client.0.smithi072.stdout:4/136: truncate d7/d10/f11 3498532 0 2024-04-15T21:02:35.424 INFO:tasks.workunit.client.0.smithi072.stdout:5/183: creat d0/d13/f39 x:0 0 0 2024-04-15T21:02:35.425 INFO:tasks.workunit.client.0.smithi072.stdout:5/184: dread - d0/d3/d7/d1f/f26 zero size 2024-04-15T21:02:35.425 INFO:tasks.workunit.client.1.smithi149.stdout:3/418: mkdir d1/db/d24/d39/d79 0 2024-04-15T21:02:35.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/459: mknod d4/d7/d10/d6b/d21/d55/cb0 0 2024-04-15T21:02:35.428 INFO:tasks.workunit.client.0.smithi072.stdout:6/172: mknod d2/d10/d11/d15/c33 0 2024-04-15T21:02:35.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/571: creat d1/d5/d24/d50/d13/d38/d71/d9d/fc8 x:0 0 0 2024-04-15T21:02:35.429 INFO:tasks.workunit.client.0.smithi072.stdout:9/156: truncate d4/fc 4138571 0 2024-04-15T21:02:35.430 INFO:tasks.workunit.client.1.smithi149.stdout:4/472: creat dc/d2c/d3e/d15/d5b/f9e x:0 0 0 2024-04-15T21:02:35.432 INFO:tasks.workunit.client.0.smithi072.stdout:9/157: readlink d4/d1f/l22 0 2024-04-15T21:02:35.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/185: dwrite d0/fa [0,4194304] 0 2024-04-15T21:02:35.433 INFO:tasks.workunit.client.0.smithi072.stdout:5/186: chown d0/fa 13670485 1 2024-04-15T21:02:35.435 INFO:tasks.workunit.client.0.smithi072.stdout:3/180: dwrite d1/ff [0,4194304] 0 2024-04-15T21:02:35.436 INFO:tasks.workunit.client.0.smithi072.stdout:6/173: dread d2/fc [0,4194304] 0 2024-04-15T21:02:35.437 INFO:tasks.workunit.client.1.smithi149.stdout:9/353: sync 2024-04-15T21:02:35.437 INFO:tasks.workunit.client.1.smithi149.stdout:5/394: sync 2024-04-15T21:02:35.438 INFO:tasks.workunit.client.1.smithi149.stdout:2/460: creat d4/d7/d46/d74/fb1 x:0 0 0 2024-04-15T21:02:35.440 INFO:tasks.workunit.client.1.smithi149.stdout:9/354: chown d23/d3c/l45 734 1 2024-04-15T21:02:35.441 INFO:tasks.workunit.client.1.smithi149.stdout:7/406: dwrite d3/d16/f5a [4194304,4194304] 0 2024-04-15T21:02:35.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/473: mknod dc/d2c/d3e/d35/d4b/d75/c9f 0 2024-04-15T21:02:35.444 INFO:tasks.workunit.client.0.smithi072.stdout:4/137: rename d7/f9 to d7/d23/f2a 0 2024-04-15T21:02:35.452 INFO:tasks.workunit.client.1.smithi149.stdout:3/419: fdatasync d1/db/d24/d2b/f73 0 2024-04-15T21:02:35.452 INFO:tasks.workunit.client.0.smithi072.stdout:4/138: dwrite d7/d10/f1a [0,4194304] 0 2024-04-15T21:02:35.452 INFO:tasks.workunit.client.1.smithi149.stdout:0/572: symlink d1/d29/d2c/d4f/d95/lc9 0 2024-04-15T21:02:35.455 INFO:tasks.workunit.client.1.smithi149.stdout:5/395: symlink d0/d9/d3f/d47/l8e 0 2024-04-15T21:02:35.459 INFO:tasks.workunit.client.0.smithi072.stdout:9/158: dwrite d4/f1e [0,4194304] 0 2024-04-15T21:02:35.460 INFO:tasks.workunit.client.0.smithi072.stdout:9/159: chown d4/d29 103861709 1 2024-04-15T21:02:35.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/461: unlink d4/d7/d10/d6b/d21/d2c/d32/fa6 0 2024-04-15T21:02:35.465 INFO:tasks.workunit.client.1.smithi149.stdout:7/407: creat d3/d16/d32/d3f/f8f x:0 0 0 2024-04-15T21:02:35.465 INFO:tasks.workunit.client.0.smithi072.stdout:9/160: read d4/d1f/f2b [4728876,58799] 0 2024-04-15T21:02:35.467 INFO:tasks.workunit.client.1.smithi149.stdout:4/474: write dc/d2c/d3e/d35/d4b/f7d [372756,68434] 0 2024-04-15T21:02:35.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/144: rmdir d5/db/d23 0 2024-04-15T21:02:35.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/145: readlink d5/db/l19 0 2024-04-15T21:02:35.470 INFO:tasks.workunit.client.1.smithi149.stdout:3/420: mknod d1/db/d24/d39/c7a 0 2024-04-15T21:02:35.472 INFO:tasks.workunit.client.1.smithi149.stdout:0/573: mkdir d1/d9/d64/d65/dca 0 2024-04-15T21:02:35.472 INFO:tasks.workunit.client.1.smithi149.stdout:2/462: dread d4/d7/d10/d6b/d21/d3b/d90/da7/d6c/f8f [0,4194304] 0 2024-04-15T21:02:35.473 INFO:tasks.workunit.client.1.smithi149.stdout:0/574: truncate d1/d5/d24/f9e 173452 0 2024-04-15T21:02:35.474 INFO:tasks.workunit.client.0.smithi072.stdout:4/139: mknod d7/d10/c2b 0 2024-04-15T21:02:35.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/396: mknod d0/d9/d3f/c8f 0 2024-04-15T21:02:35.475 INFO:tasks.workunit.client.0.smithi072.stdout:4/140: readlink d7/d15/l18 0 2024-04-15T21:02:35.482 INFO:tasks.workunit.client.1.smithi149.stdout:0/575: dwrite d1/d29/d2c/d4f/f9c [0,4194304] 0 2024-04-15T21:02:35.486 INFO:tasks.workunit.client.1.smithi149.stdout:7/408: mkdir d3/d16/d32/d90 0 2024-04-15T21:02:35.486 INFO:tasks.workunit.client.1.smithi149.stdout:6/371: dwrite da/d32/f48 [0,4194304] 0 2024-04-15T21:02:35.489 INFO:tasks.workunit.client.0.smithi072.stdout:7/123: link d2/f12 d2/db/f22 0 2024-04-15T21:02:35.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/203: sync 2024-04-15T21:02:35.490 INFO:tasks.workunit.client.1.smithi149.stdout:3/421: unlink d1/db/d40/c5a 0 2024-04-15T21:02:35.492 INFO:tasks.workunit.client.1.smithi149.stdout:3/422: write d1/db/d23/f3a [2382970,55420] 0 2024-04-15T21:02:35.493 INFO:tasks.workunit.client.0.smithi072.stdout:6/174: mkdir d2/d10/d11/d34 0 2024-04-15T21:02:35.495 INFO:tasks.workunit.client.1.smithi149.stdout:2/463: rename d4/d7/d10/d6b/d21/d2c/d32/d4a/f61 to d4/d7/d10/d6b/d21/d2c/d32/d4a/fb2 0 2024-04-15T21:02:35.497 INFO:tasks.workunit.client.1.smithi149.stdout:2/464: dread - d4/d7/d10/d6b/d21/d55/f59 zero size 2024-04-15T21:02:35.498 INFO:tasks.workunit.client.0.smithi072.stdout:8/204: dwrite d3/f1d [0,4194304] 0 2024-04-15T21:02:35.500 INFO:tasks.workunit.client.0.smithi072.stdout:9/161: mkdir d4/d1f/d31 0 2024-04-15T21:02:35.500 INFO:tasks.workunit.client.1.smithi149.stdout:9/355: dwrite d23/d2b/d44/f64 [0,4194304] 0 2024-04-15T21:02:35.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/146: rmdir d5/db/d10 39 2024-04-15T21:02:35.506 INFO:tasks.workunit.client.0.smithi072.stdout:9/162: dwrite d4/f5 [8388608,4194304] 0 2024-04-15T21:02:35.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/196: getdents d2/d38 0 2024-04-15T21:02:35.512 INFO:tasks.workunit.client.0.smithi072.stdout:4/141: rename d7/d24/c26 to d7/d28/c2c 0 2024-04-15T21:02:35.517 INFO:tasks.workunit.client.1.smithi149.stdout:6/372: readlink l5 0 2024-04-15T21:02:35.520 INFO:tasks.workunit.client.1.smithi149.stdout:4/475: unlink dc/d18/d21/l29 0 2024-04-15T21:02:35.520 INFO:tasks.workunit.client.0.smithi072.stdout:4/142: read d7/d10/f1a [104500,32596] 0 2024-04-15T21:02:35.520 INFO:tasks.workunit.client.0.smithi072.stdout:3/181: symlink d1/d15/d32/d2f/d1a/l36 0 2024-04-15T21:02:35.521 INFO:tasks.workunit.client.0.smithi072.stdout:4/143: fsync d7/d23/f29 0 2024-04-15T21:02:35.523 INFO:tasks.workunit.client.0.smithi072.stdout:7/124: symlink d2/d10/d1f/l23 0 2024-04-15T21:02:35.530 INFO:tasks.workunit.client.1.smithi149.stdout:2/465: rename d4/d7/d29/f30 to d4/d7/da/fb3 0 2024-04-15T21:02:35.532 INFO:tasks.workunit.client.1.smithi149.stdout:2/466: readlink d4/d7/d10/d6b/d21/d3b/d90/da7/l53 0 2024-04-15T21:02:35.535 INFO:tasks.workunit.client.1.smithi149.stdout:6/373: stat da/d11/f35 0 2024-04-15T21:02:35.537 INFO:tasks.workunit.client.0.smithi072.stdout:2/197: mkdir d2/d8/d41 0 2024-04-15T21:02:35.537 INFO:tasks.workunit.client.0.smithi072.stdout:2/198: stat d2/d8/f13 0 2024-04-15T21:02:35.537 INFO:tasks.workunit.client.0.smithi072.stdout:2/199: fdatasync d2/f3e 0 2024-04-15T21:02:35.538 INFO:tasks.workunit.client.1.smithi149.stdout:4/476: unlink dc/d2c/d3e/d15/d3f/l83 0 2024-04-15T21:02:35.542 INFO:tasks.workunit.client.1.smithi149.stdout:5/397: truncate d0/d9/db/f2e 1739626 0 2024-04-15T21:02:35.544 INFO:tasks.workunit.client.1.smithi149.stdout:9/356: rename f3 to d23/d46/f73 0 2024-04-15T21:02:35.544 INFO:tasks.workunit.client.1.smithi149.stdout:9/357: chown d23/d2b/d44/f5b 15336414 1 2024-04-15T21:02:35.545 INFO:tasks.workunit.client.0.smithi072.stdout:5/187: getdents d0/d3/d23/d24 0 2024-04-15T21:02:35.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/467: truncate d4/d7/d10/d6b/d21/d3b/d90/da7/d6c/f70 506712 0 2024-04-15T21:02:35.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/163: dwrite d4/d1f/f2b [4194304,4194304] 0 2024-04-15T21:02:35.552 INFO:tasks.workunit.client.1.smithi149.stdout:2/468: dread d4/d7/d10/d6b/d21/d2c/d58/f8e [0,4194304] 0 2024-04-15T21:02:35.552 INFO:tasks.workunit.client.0.smithi072.stdout:4/144: rmdir d7/d24 39 2024-04-15T21:02:35.552 INFO:tasks.workunit.client.0.smithi072.stdout:4/145: readlink d7/l13 0 2024-04-15T21:02:35.558 INFO:tasks.workunit.client.1.smithi149.stdout:3/423: truncate d1/db/d24/d2b/f1b 1011046 0 2024-04-15T21:02:35.561 INFO:tasks.workunit.client.1.smithi149.stdout:5/398: write d0/d9/db/d12/d2b/f72 [3076763,16084] 0 2024-04-15T21:02:35.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/182: dread d1/d7/f9 [0,4194304] 0 2024-04-15T21:02:35.564 INFO:tasks.workunit.client.1.smithi149.stdout:6/374: rename da/d18/l39 to da/d18/d10/d66/l79 0 2024-04-15T21:02:35.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/358: creat d23/d2b/d37/d6d/f74 x:0 0 0 2024-04-15T21:02:35.565 INFO:tasks.workunit.client.1.smithi149.stdout:9/359: readlink d23/d3c/d52/l72 0 2024-04-15T21:02:35.566 INFO:tasks.workunit.client.1.smithi149.stdout:9/360: chown d23/d3c/f6b 15 1 2024-04-15T21:02:35.567 INFO:tasks.workunit.client.1.smithi149.stdout:0/576: getdents d1/d5/d24/d30/d43 0 2024-04-15T21:02:35.567 INFO:tasks.workunit.client.1.smithi149.stdout:9/361: fdatasync d23/d46/f53 0 2024-04-15T21:02:35.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/469: dread d4/f12 [0,4194304] 0 2024-04-15T21:02:35.574 INFO:tasks.workunit.client.0.smithi072.stdout:0/142: sync 2024-04-15T21:02:35.575 INFO:tasks.workunit.client.1.smithi149.stdout:3/424: write d1/db/d24/f5f [26193,119062] 0 2024-04-15T21:02:35.576 INFO:tasks.workunit.client.0.smithi072.stdout:4/146: write d7/d10/f1a [3688549,74178] 0 2024-04-15T21:02:35.576 INFO:tasks.workunit.client.1.smithi149.stdout:5/399: stat d0/d6/c3c 0 2024-04-15T21:02:35.577 INFO:tasks.workunit.client.0.smithi072.stdout:4/147: write d7/d23/f29 [551045,108394] 0 2024-04-15T21:02:35.579 INFO:tasks.workunit.client.1.smithi149.stdout:6/375: creat da/d32/f7a x:0 0 0 2024-04-15T21:02:35.580 INFO:tasks.workunit.client.1.smithi149.stdout:0/577: fdatasync d1/d5/f4a 0 2024-04-15T21:02:35.580 INFO:tasks.workunit.client.1.smithi149.stdout:6/376: write da/f36 [1315644,5287] 0 2024-04-15T21:02:35.581 INFO:tasks.workunit.client.0.smithi072.stdout:1/147: rmdir d5/d26 0 2024-04-15T21:02:35.582 INFO:tasks.workunit.client.1.smithi149.stdout:6/377: write da/d2e/f64 [116601,2437] 0 2024-04-15T21:02:35.582 INFO:tasks.workunit.client.0.smithi072.stdout:1/148: write d5/f8 [5598099,97697] 0 2024-04-15T21:02:35.582 INFO:tasks.workunit.client.0.smithi072.stdout:1/149: chown d5/c16 7145 1 2024-04-15T21:02:35.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/578: write d1/d5/d24/d50/d13/d38/d44/d61/f8f [288035,95359] 0 2024-04-15T21:02:35.584 INFO:tasks.workunit.client.0.smithi072.stdout:3/183: creat d1/d15/d32/d2f/d1a/f37 x:0 0 0 2024-04-15T21:02:35.584 INFO:tasks.workunit.client.0.smithi072.stdout:3/184: readlink d1/d7/l16 0 2024-04-15T21:02:35.585 INFO:tasks.workunit.client.0.smithi072.stdout:2/200: symlink d2/d8/d41/l42 0 2024-04-15T21:02:35.586 INFO:tasks.workunit.client.1.smithi149.stdout:4/477: creat dc/d2c/d3e/d15/fa0 x:0 0 0 2024-04-15T21:02:35.586 INFO:tasks.workunit.client.1.smithi149.stdout:2/470: dread d4/d7/d10/d36/f62 [0,4194304] 0 2024-04-15T21:02:35.587 INFO:tasks.workunit.client.0.smithi072.stdout:9/164: symlink d4/d29/l32 0 2024-04-15T21:02:35.588 INFO:tasks.workunit.client.1.smithi149.stdout:2/471: truncate d4/d7/d93/f98 121467 0 2024-04-15T21:02:35.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/400: unlink d0/d6/c24 0 2024-04-15T21:02:35.589 INFO:tasks.workunit.client.1.smithi149.stdout:5/401: write d0/d9/db/f5e [448252,85648] 0 2024-04-15T21:02:35.591 INFO:tasks.workunit.client.0.smithi072.stdout:7/125: link d2/d10/d1f/l21 d2/db/l24 0 2024-04-15T21:02:35.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/362: mkdir d23/d2b/d70/d75 0 2024-04-15T21:02:35.593 INFO:tasks.workunit.client.0.smithi072.stdout:9/165: dwrite d4/d1f/f2b [0,4194304] 0 2024-04-15T21:02:35.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/378: rename da/d32/f7a to da/d11/f7b 0 2024-04-15T21:02:35.595 INFO:tasks.workunit.client.0.smithi072.stdout:8/205: sync 2024-04-15T21:02:35.597 INFO:tasks.workunit.client.0.smithi072.stdout:3/185: write d1/fd [4743506,83926] 0 2024-04-15T21:02:35.598 INFO:tasks.workunit.client.0.smithi072.stdout:3/186: dread - d1/d15/d32/d2f/d1a/f37 zero size 2024-04-15T21:02:35.599 INFO:tasks.workunit.client.1.smithi149.stdout:4/478: creat dc/d2c/fa1 x:0 0 0 2024-04-15T21:02:35.601 INFO:tasks.workunit.client.0.smithi072.stdout:3/187: dread d1/f17 [0,4194304] 0 2024-04-15T21:02:35.604 INFO:tasks.workunit.client.0.smithi072.stdout:5/188: rename d0/d3/d7/c34 to d0/c3a 0 2024-04-15T21:02:35.607 INFO:tasks.workunit.client.1.smithi149.stdout:6/379: dwrite da/d18/d10/d66/f57 [0,4194304] 0 2024-04-15T21:02:35.608 INFO:tasks.workunit.client.1.smithi149.stdout:1/307: sync 2024-04-15T21:02:35.609 INFO:tasks.workunit.client.1.smithi149.stdout:8/466: sync 2024-04-15T21:02:35.611 INFO:tasks.workunit.client.0.smithi072.stdout:0/143: truncate d0/d3/f4 1500839 0 2024-04-15T21:02:35.612 INFO:tasks.workunit.client.1.smithi149.stdout:1/308: write d1/db/f32 [5058333,71444] 0 2024-04-15T21:02:35.616 INFO:tasks.workunit.client.0.smithi072.stdout:4/148: fsync d7/fc 0 2024-04-15T21:02:35.616 INFO:tasks.workunit.client.1.smithi149.stdout:2/472: dwrite d4/d7/d10/d6b/d21/d3b/f3f [0,4194304] 0 2024-04-15T21:02:35.618 INFO:tasks.workunit.client.0.smithi072.stdout:7/126: fdatasync d2/db/f19 0 2024-04-15T21:02:35.619 INFO:tasks.workunit.client.1.smithi149.stdout:5/402: dread d0/d9/db/d12/d16/d28/d1b/f59 [0,4194304] 0 2024-04-15T21:02:35.619 INFO:tasks.workunit.client.0.smithi072.stdout:7/127: dread d2/f12 [0,4194304] 0 2024-04-15T21:02:35.624 INFO:tasks.workunit.client.0.smithi072.stdout:6/175: link d2/d10/d11/l1c d2/d10/l35 0 2024-04-15T21:02:35.626 INFO:tasks.workunit.client.1.smithi149.stdout:0/579: symlink d1/lcb 0 2024-04-15T21:02:35.627 INFO:tasks.workunit.client.0.smithi072.stdout:9/166: symlink d4/d1f/d2c/l33 0 2024-04-15T21:02:35.630 INFO:tasks.workunit.client.1.smithi149.stdout:6/380: chown da/d2e/c63 109351945 1 2024-04-15T21:02:35.631 INFO:tasks.workunit.client.1.smithi149.stdout:6/381: fdatasync da/d18/d10/d3f/f41 0 2024-04-15T21:02:35.632 INFO:tasks.workunit.client.1.smithi149.stdout:7/409: sync 2024-04-15T21:02:35.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/425: truncate d1/db/d23/f3a 2314745 0 2024-04-15T21:02:35.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/410: fsync d3/d16/d20/d36/d3d/f85 0 2024-04-15T21:02:35.636 INFO:tasks.workunit.client.1.smithi149.stdout:8/467: creat d2/df/d10/d21/fad x:0 0 0 2024-04-15T21:02:35.637 INFO:tasks.workunit.client.0.smithi072.stdout:3/188: fsync d1/f2b 0 2024-04-15T21:02:35.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/363: mknod d23/c76 0 2024-04-15T21:02:35.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/411: dwrite d3/d16/d20/d36/d3d/d56/f5f [0,4194304] 0 2024-04-15T21:02:35.640 INFO:tasks.workunit.client.1.smithi149.stdout:1/309: creat d1/db/dc/d11/d3f/d45/f57 x:0 0 0 2024-04-15T21:02:35.641 INFO:tasks.workunit.client.1.smithi149.stdout:1/310: fdatasync d1/d17/d52/f2a 0 2024-04-15T21:02:35.646 INFO:tasks.workunit.client.1.smithi149.stdout:2/473: unlink d4/d7/d10/l17 0 2024-04-15T21:02:35.648 INFO:tasks.workunit.client.1.smithi149.stdout:5/403: rmdir d0/d9/db/d12/d16/d28/d1b 39 2024-04-15T21:02:35.649 INFO:tasks.workunit.client.0.smithi072.stdout:4/149: creat d7/d28/f2d x:0 0 0 2024-04-15T21:02:35.650 INFO:tasks.workunit.client.1.smithi149.stdout:0/580: creat d1/d9/d64/d65/fcc x:0 0 0 2024-04-15T21:02:35.651 INFO:tasks.workunit.client.0.smithi072.stdout:7/128: chown d2/d10/d1f/l21 7185284 1 2024-04-15T21:02:35.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/382: rmdir da/d18/d10/d66 39 2024-04-15T21:02:35.652 INFO:tasks.workunit.client.1.smithi149.stdout:0/581: truncate d1/d9/d64/d65/f79 146178 0 2024-04-15T21:02:35.656 INFO:tasks.workunit.client.0.smithi072.stdout:1/150: creat d5/db/f28 x:0 0 0 2024-04-15T21:02:35.657 INFO:tasks.workunit.client.0.smithi072.stdout:0/144: write d0/d17/f26 [1116880,85526] 0 2024-04-15T21:02:35.661 INFO:tasks.workunit.client.1.smithi149.stdout:8/468: creat d2/df/d10/d25/d37/fae x:0 0 0 2024-04-15T21:02:35.662 INFO:tasks.workunit.client.0.smithi072.stdout:2/201: creat d2/d3/f43 x:0 0 0 2024-04-15T21:02:35.663 INFO:tasks.workunit.client.1.smithi149.stdout:4/479: truncate dc/d2c/d3e/d15/d3f/f8b 84717 0 2024-04-15T21:02:35.664 INFO:tasks.workunit.client.1.smithi149.stdout:4/480: write dc/d18/d21/f67 [2207703,24104] 0 2024-04-15T21:02:35.665 INFO:tasks.workunit.client.1.smithi149.stdout:7/412: mkdir d3/d16/d20/d6c/d91 0 2024-04-15T21:02:35.666 INFO:tasks.workunit.client.1.smithi149.stdout:4/481: write dc/d2c/d3e/d15/f4a [1702635,88860] 0 2024-04-15T21:02:35.673 INFO:tasks.workunit.client.1.smithi149.stdout:6/383: mknod da/d18/d10/d16/c7c 0 2024-04-15T21:02:35.678 INFO:tasks.workunit.client.0.smithi072.stdout:7/129: dread d2/db/f19 [0,4194304] 0 2024-04-15T21:02:35.678 INFO:tasks.workunit.client.1.smithi149.stdout:6/384: chown da/d11/f22 56 1 2024-04-15T21:02:35.679 INFO:tasks.workunit.client.0.smithi072.stdout:4/150: dwrite d7/f1c [0,4194304] 0 2024-04-15T21:02:35.681 INFO:tasks.workunit.client.1.smithi149.stdout:9/364: truncate d23/f47 624349 0 2024-04-15T21:02:35.684 INFO:tasks.workunit.client.1.smithi149.stdout:0/582: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:35.686 INFO:tasks.workunit.client.0.smithi072.stdout:1/151: readlink d5/ld 0 2024-04-15T21:02:35.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/152: truncate d5/db/f1a 4255892 0 2024-04-15T21:02:35.690 INFO:tasks.workunit.client.1.smithi149.stdout:8/469: rename d2/df/d10/d25/d37/d53/d76 to d2/df/d10/d25/d37/d53/daf 0 2024-04-15T21:02:35.691 INFO:tasks.workunit.client.1.smithi149.stdout:3/426: write d1/db/d24/d2b/f1b [2018080,90321] 0 2024-04-15T21:02:35.696 INFO:tasks.workunit.client.0.smithi072.stdout:0/145: write d0/d3/d5/f2a [322498,56580] 0 2024-04-15T21:02:35.696 INFO:tasks.workunit.client.0.smithi072.stdout:8/206: link d3/de/d17/l1c d3/de/d21/l40 0 2024-04-15T21:02:35.696 INFO:tasks.workunit.client.1.smithi149.stdout:7/413: mkdir d3/d39/d92 0 2024-04-15T21:02:35.697 INFO:tasks.workunit.client.1.smithi149.stdout:7/414: read - d3/d39/f79 zero size 2024-04-15T21:02:35.698 INFO:tasks.workunit.client.1.smithi149.stdout:4/482: creat dc/fa2 x:0 0 0 2024-04-15T21:02:35.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/207: dread d3/de/d17/f2a [0,4194304] 0 2024-04-15T21:02:35.707 INFO:tasks.workunit.client.1.smithi149.stdout:5/404: creat d0/d9/db/d12/d16/d28/d1b/d83/f90 x:0 0 0 2024-04-15T21:02:35.709 INFO:tasks.workunit.client.1.smithi149.stdout:5/405: write d0/d6/d2d/f68 [5218688,79067] 0 2024-04-15T21:02:35.709 INFO:tasks.workunit.client.0.smithi072.stdout:7/130: rmdir d2/d10 39 2024-04-15T21:02:35.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/176: link d2/f7 d2/d10/d24/f36 0 2024-04-15T21:02:35.711 INFO:tasks.workunit.client.0.smithi072.stdout:6/177: truncate d2/d10/d18/f26 1276770 0 2024-04-15T21:02:35.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/178: dread d2/fc [0,4194304] 0 2024-04-15T21:02:35.716 INFO:tasks.workunit.client.0.smithi072.stdout:6/179: read d2/d10/d11/d1f/f28 [199705,27161] 0 2024-04-15T21:02:35.716 INFO:tasks.workunit.client.0.smithi072.stdout:6/180: dread - d2/d10/d11/f2e zero size 2024-04-15T21:02:35.717 INFO:tasks.workunit.client.0.smithi072.stdout:6/181: write d2/d10/d11/d1f/f30 [115270,78870] 0 2024-04-15T21:02:35.720 INFO:tasks.workunit.client.0.smithi072.stdout:8/208: mkdir d3/de/d1b/d41 0 2024-04-15T21:02:35.721 INFO:tasks.workunit.client.1.smithi149.stdout:2/474: write d4/d7/da/f4e [1507094,8272] 0 2024-04-15T21:02:35.722 INFO:tasks.workunit.client.0.smithi072.stdout:3/189: link d1/d15/d32/d2f/d1a/f1d d1/f38 0 2024-04-15T21:02:35.723 INFO:tasks.workunit.client.0.smithi072.stdout:3/190: chown d1/f2e 7 1 2024-04-15T21:02:35.723 INFO:tasks.workunit.client.1.smithi149.stdout:1/311: dwrite d1/db/d16/f24 [4194304,4194304] 0 2024-04-15T21:02:35.724 INFO:tasks.workunit.client.0.smithi072.stdout:5/189: getdents d0/d3/d7 0 2024-04-15T21:02:35.727 INFO:tasks.workunit.client.0.smithi072.stdout:3/191: dwrite d1/f2e [0,4194304] 0 2024-04-15T21:02:35.729 INFO:tasks.workunit.client.0.smithi072.stdout:7/131: mkdir d2/d7/d25 0 2024-04-15T21:02:35.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/167: link d4/l1a d4/d1f/d31/l34 0 2024-04-15T21:02:35.733 INFO:tasks.workunit.client.0.smithi072.stdout:3/192: dwrite d1/ff [0,4194304] 0 2024-04-15T21:02:35.734 INFO:tasks.workunit.client.0.smithi072.stdout:3/193: dread - d1/f38 zero size 2024-04-15T21:02:35.739 INFO:tasks.workunit.client.0.smithi072.stdout:6/182: mknod d2/d1a/c37 0 2024-04-15T21:02:35.747 INFO:tasks.workunit.client.0.smithi072.stdout:8/209: unlink d3/de/d21/l39 0 2024-04-15T21:02:35.749 INFO:tasks.workunit.client.1.smithi149.stdout:0/583: mknod d1/d29/d2c/d4f/ccd 0 2024-04-15T21:02:35.751 INFO:tasks.workunit.client.1.smithi149.stdout:8/470: creat d2/df/d10/d25/d37/d53/daf/d92/fb0 x:0 0 0 2024-04-15T21:02:35.752 INFO:tasks.workunit.client.0.smithi072.stdout:3/194: read d1/d7/f1c [510814,101051] 0 2024-04-15T21:02:35.755 INFO:tasks.workunit.client.0.smithi072.stdout:4/151: creat d7/f2e x:0 0 0 2024-04-15T21:02:35.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/427: read d1/f2f [2318983,33388] 0 2024-04-15T21:02:35.756 INFO:tasks.workunit.client.1.smithi149.stdout:7/415: mkdir d3/d17/d1f/d93 0 2024-04-15T21:02:35.759 INFO:tasks.workunit.client.0.smithi072.stdout:7/132: unlink d2/f12 0 2024-04-15T21:02:35.761 INFO:tasks.workunit.client.0.smithi072.stdout:9/168: creat d4/d1f/d2c/f35 x:0 0 0 2024-04-15T21:02:35.761 INFO:tasks.workunit.client.0.smithi072.stdout:9/169: fdatasync d4/d1f/d2c/f2d 0 2024-04-15T21:02:35.766 INFO:tasks.workunit.client.1.smithi149.stdout:5/406: rename d0/d9/db/l8a to d0/d9/db/d12/d16/d28/d1b/l91 0 2024-04-15T21:02:35.770 INFO:tasks.workunit.client.0.smithi072.stdout:1/153: truncate d5/db/fc 277597 0 2024-04-15T21:02:35.771 INFO:tasks.workunit.client.0.smithi072.stdout:6/183: rename d2/f7 to d2/d10/d11/d34/f38 0 2024-04-15T21:02:35.772 INFO:tasks.workunit.client.1.smithi149.stdout:5/407: dwrite d0/d9/db/d12/d2b/f72 [0,4194304] 0 2024-04-15T21:02:35.773 INFO:tasks.workunit.client.1.smithi149.stdout:9/365: mknod d23/c77 0 2024-04-15T21:02:35.774 INFO:tasks.workunit.client.0.smithi072.stdout:2/202: getdents d2 0 2024-04-15T21:02:35.774 INFO:tasks.workunit.client.1.smithi149.stdout:5/408: chown d0/d9/db/d12/d16/d28/d1b/d83/l86 516958 1 2024-04-15T21:02:35.775 INFO:tasks.workunit.client.0.smithi072.stdout:2/203: write d2/d3/f17 [2237050,45188] 0 2024-04-15T21:02:35.775 INFO:tasks.workunit.client.0.smithi072.stdout:2/204: stat d2/d37 0 2024-04-15T21:02:35.776 INFO:tasks.workunit.client.0.smithi072.stdout:5/190: symlink d0/d3/d7/d12/d31/l3b 0 2024-04-15T21:02:35.777 INFO:tasks.workunit.client.1.smithi149.stdout:8/471: mknod d2/df/d10/d4e/d51/cb1 0 2024-04-15T21:02:35.782 INFO:tasks.workunit.client.0.smithi072.stdout:4/152: creat d7/d15/f2f x:0 0 0 2024-04-15T21:02:35.783 INFO:tasks.workunit.client.1.smithi149.stdout:7/416: write d3/d16/d20/d60/f7e [4858174,82116] 0 2024-04-15T21:02:35.784 INFO:tasks.workunit.client.1.smithi149.stdout:6/385: dwrite da/d11/f74 [4194304,4194304] 0 2024-04-15T21:02:35.791 INFO:tasks.workunit.client.0.smithi072.stdout:9/170: creat d4/d29/f36 x:0 0 0 2024-04-15T21:02:35.794 INFO:tasks.workunit.client.1.smithi149.stdout:6/386: read da/d2e/f50 [2949996,122134] 0 2024-04-15T21:02:35.795 INFO:tasks.workunit.client.0.smithi072.stdout:9/171: dread d4/d1f/f2b [4194304,4194304] 0 2024-04-15T21:02:35.795 INFO:tasks.workunit.client.1.smithi149.stdout:7/417: dwrite d3/d16/f86 [0,4194304] 0 2024-04-15T21:02:35.796 INFO:tasks.workunit.client.0.smithi072.stdout:1/154: dread d5/db/f12 [0,4194304] 0 2024-04-15T21:02:35.797 INFO:tasks.workunit.client.1.smithi149.stdout:7/418: write d3/d34/f4d [1056773,69170] 0 2024-04-15T21:02:35.798 INFO:tasks.workunit.client.1.smithi149.stdout:2/475: mkdir d4/d7/d10/d6b/d21/d6d/db4 0 2024-04-15T21:02:35.801 INFO:tasks.workunit.client.1.smithi149.stdout:6/387: read da/d2e/f50 [4351990,66097] 0 2024-04-15T21:02:35.801 INFO:tasks.workunit.client.0.smithi072.stdout:0/146: getdents d0/d17 0 2024-04-15T21:02:35.801 INFO:tasks.workunit.client.0.smithi072.stdout:0/147: readlink d0/d19/l27 0 2024-04-15T21:02:35.801 INFO:tasks.workunit.client.0.smithi072.stdout:0/148: fsync d0/d17/f1d 0 2024-04-15T21:02:35.805 INFO:tasks.workunit.client.1.smithi149.stdout:7/419: dread d3/d17/d1f/f38 [0,4194304] 0 2024-04-15T21:02:35.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/420: chown d3/d16/d32/d3f/f8f 3 1 2024-04-15T21:02:35.807 INFO:tasks.workunit.client.1.smithi149.stdout:9/366: mknod d23/d46/c78 0 2024-04-15T21:02:35.808 INFO:tasks.workunit.client.1.smithi149.stdout:9/367: fsync f4 0 2024-04-15T21:02:35.811 INFO:tasks.workunit.client.0.smithi072.stdout:6/184: creat d2/d10/d18/f39 x:0 0 0 2024-04-15T21:02:35.813 INFO:tasks.workunit.client.0.smithi072.stdout:8/210: creat d3/de/d21/d2e/f42 x:0 0 0 2024-04-15T21:02:35.813 INFO:tasks.workunit.client.1.smithi149.stdout:8/472: mkdir d2/df/d10/d25/d37/db2 0 2024-04-15T21:02:35.814 INFO:tasks.workunit.client.0.smithi072.stdout:8/211: read - d3/de/f38 zero size 2024-04-15T21:02:35.814 INFO:tasks.workunit.client.1.smithi149.stdout:4/483: truncate dc/d2c/d3e/d15/f4a 2853978 0 2024-04-15T21:02:35.815 INFO:tasks.workunit.client.1.smithi149.stdout:8/473: chown d2/df/d10/d25/f33 124723900 1 2024-04-15T21:02:35.815 INFO:tasks.workunit.client.1.smithi149.stdout:4/484: chown dc/d18/d21/f63 3 1 2024-04-15T21:02:35.816 INFO:tasks.workunit.client.0.smithi072.stdout:2/205: creat d2/f44 x:0 0 0 2024-04-15T21:02:35.816 INFO:tasks.workunit.client.0.smithi072.stdout:8/212: truncate d3/d4/d3b/f3e 525282 0 2024-04-15T21:02:35.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/428: symlink d1/db/l7b 0 2024-04-15T21:02:35.819 INFO:tasks.workunit.client.0.smithi072.stdout:3/195: dwrite d1/f14 [0,4194304] 0 2024-04-15T21:02:35.820 INFO:tasks.workunit.client.0.smithi072.stdout:5/191: creat d0/d3/d7/f3c x:0 0 0 2024-04-15T21:02:35.822 INFO:tasks.workunit.client.0.smithi072.stdout:8/213: dread d3/d4/d3b/f3e [0,4194304] 0 2024-04-15T21:02:35.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/474: dwrite d2/df/d10/d25/d37/f5f [0,4194304] 0 2024-04-15T21:02:35.822 INFO:tasks.workunit.client.0.smithi072.stdout:8/214: fsync d3/f1d 0 2024-04-15T21:02:35.824 INFO:tasks.workunit.client.1.smithi149.stdout:5/409: write d0/d6/f65 [634781,57889] 0 2024-04-15T21:02:35.825 INFO:tasks.workunit.client.0.smithi072.stdout:7/133: mkdir d2/d10/d26 0 2024-04-15T21:02:35.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/172: dwrite d4/f7 [0,4194304] 0 2024-04-15T21:02:35.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/388: readlink da/d18/d10/d66/l5a 0 2024-04-15T21:02:35.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/389: stat da/d18/c6e 0 2024-04-15T21:02:35.836 INFO:tasks.workunit.client.1.smithi149.stdout:6/390: write da/d49/d55/f61 [2000162,120874] 0 2024-04-15T21:02:35.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/173: dread d4/d1f/f24 [0,4194304] 0 2024-04-15T21:02:35.842 INFO:tasks.workunit.client.1.smithi149.stdout:6/391: dwrite da/f1b [0,4194304] 0 2024-04-15T21:02:35.844 INFO:tasks.workunit.client.1.smithi149.stdout:6/392: write f8 [3003428,34984] 0 2024-04-15T21:02:35.844 INFO:tasks.workunit.client.1.smithi149.stdout:9/368: dread d23/f47 [0,4194304] 0 2024-04-15T21:02:35.847 INFO:tasks.workunit.client.1.smithi149.stdout:0/584: creat d1/d9/fce x:0 0 0 2024-04-15T21:02:35.849 INFO:tasks.workunit.client.1.smithi149.stdout:4/485: mknod dc/d18/d21/ca3 0 2024-04-15T21:02:35.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/429: rmdir d1/db/d40 39 2024-04-15T21:02:35.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/393: dwrite da/d11/f74 [4194304,4194304] 0 2024-04-15T21:02:35.856 INFO:tasks.workunit.client.1.smithi149.stdout:6/394: chown da/d49/d55 18711156 1 2024-04-15T21:02:35.859 INFO:tasks.workunit.client.1.smithi149.stdout:6/395: chown da/d11/f71 0 1 2024-04-15T21:02:35.862 INFO:tasks.workunit.client.0.smithi072.stdout:3/196: rmdir d1/d15/d32/d2f 39 2024-04-15T21:02:35.863 INFO:tasks.workunit.client.1.smithi149.stdout:8/475: rmdir d2/df/d10/d20/d6b 39 2024-04-15T21:02:35.864 INFO:tasks.workunit.client.1.smithi149.stdout:4/486: dwrite dc/d2c/d3e/d15/d3f/f87 [0,4194304] 0 2024-04-15T21:02:35.864 INFO:tasks.workunit.client.0.smithi072.stdout:5/192: creat d0/d3/d7/d12/d31/f3d x:0 0 0 2024-04-15T21:02:35.866 INFO:tasks.workunit.client.1.smithi149.stdout:2/476: dwrite d4/d7/d10/d6b/d21/d5e/f40 [0,4194304] 0 2024-04-15T21:02:35.866 INFO:tasks.workunit.client.1.smithi149.stdout:8/476: fdatasync d2/df/d10/d20/f91 0 2024-04-15T21:02:35.869 INFO:tasks.workunit.client.0.smithi072.stdout:8/215: creat d3/de/d1b/f43 x:0 0 0 2024-04-15T21:02:35.869 INFO:tasks.workunit.client.1.smithi149.stdout:2/477: write d4/d7/d10/d6b/f92 [689935,11027] 0 2024-04-15T21:02:35.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/312: getdents d1/db/dc/d38 0 2024-04-15T21:02:35.874 INFO:tasks.workunit.client.0.smithi072.stdout:7/134: unlink d2/d10/f1b 0 2024-04-15T21:02:35.874 INFO:tasks.workunit.client.0.smithi072.stdout:7/135: chown d2/f1c 1349965244 1 2024-04-15T21:02:35.881 INFO:tasks.workunit.client.1.smithi149.stdout:2/478: dwrite d4/d7/d10/d6b/d21/d3b/f7f [0,4194304] 0 2024-04-15T21:02:35.883 INFO:tasks.workunit.client.1.smithi149.stdout:2/479: write d4/d7/d10/d6b/d21/d2c/d63/f91 [32929,129024] 0 2024-04-15T21:02:35.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:35 smithi149 ceph-mon[36029]: pgmap v274: 65 pgs: 65 active+clean; 960 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 109 MiB/s wr, 242 op/s 2024-04-15T21:02:35.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:35 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3196893236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:02:35.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/480: truncate d4/d7/f85 377328 0 2024-04-15T21:02:35.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/481: stat d4/f5d 0 2024-04-15T21:02:35.886 INFO:tasks.workunit.client.0.smithi072.stdout:0/149: creat d0/d19/d2b/f2e x:0 0 0 2024-04-15T21:02:35.887 INFO:tasks.workunit.client.1.smithi149.stdout:9/369: mkdir d23/d2b/d37/d50/d79 0 2024-04-15T21:02:35.894 INFO:tasks.workunit.client.1.smithi149.stdout:6/396: mkdir da/d18/d7d 0 2024-04-15T21:02:35.894 INFO:tasks.workunit.client.0.smithi072.stdout:0/150: dwrite d0/d3/d5/f11 [0,4194304] 0 2024-04-15T21:02:35.894 INFO:tasks.workunit.client.0.smithi072.stdout:0/151: readlink d0/l23 0 2024-04-15T21:02:35.894 INFO:tasks.workunit.client.0.smithi072.stdout:0/152: fsync d0/f2d 0 2024-04-15T21:02:35.896 INFO:tasks.workunit.client.0.smithi072.stdout:5/193: creat d0/d3/d7/d12/d1d/f3e x:0 0 0 2024-04-15T21:02:35.907 INFO:tasks.workunit.client.0.smithi072.stdout:1/155: write d5/db/fc [817785,116791] 0 2024-04-15T21:02:35.908 INFO:tasks.workunit.client.1.smithi149.stdout:7/421: creat d3/f94 x:0 0 0 2024-04-15T21:02:35.910 INFO:tasks.workunit.client.0.smithi072.stdout:9/174: rename d4/d1f/d31/l34 to d4/d1f/d2c/l37 0 2024-04-15T21:02:35.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:35 smithi072 ceph-mon[29079]: pgmap v274: 65 pgs: 65 active+clean; 960 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 109 MiB/s wr, 242 op/s 2024-04-15T21:02:35.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:35 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3196893236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:02:35.913 INFO:tasks.workunit.client.0.smithi072.stdout:6/185: truncate d2/fe 4345700 0 2024-04-15T21:02:35.914 INFO:tasks.workunit.client.1.smithi149.stdout:0/585: symlink d1/lcf 0 2024-04-15T21:02:35.915 INFO:tasks.workunit.client.0.smithi072.stdout:2/206: symlink d2/d8/l45 0 2024-04-15T21:02:35.917 INFO:tasks.workunit.client.0.smithi072.stdout:3/197: mknod d1/d15/d32/c39 0 2024-04-15T21:02:35.917 INFO:tasks.workunit.client.0.smithi072.stdout:3/198: stat d1/d7/f18 0 2024-04-15T21:02:35.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/397: creat da/d18/d33/f7e x:0 0 0 2024-04-15T21:02:35.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/410: dwrite d0/d9/db/f7f [0,4194304] 0 2024-04-15T21:02:35.924 INFO:tasks.workunit.client.0.smithi072.stdout:4/153: link d7/d28/c2c d7/d15/c30 0 2024-04-15T21:02:35.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/411: write d0/f3a [2202528,8749] 0 2024-04-15T21:02:35.926 INFO:tasks.workunit.client.1.smithi149.stdout:8/477: creat d2/df/d10/d25/d32/d45/d77/fb3 x:0 0 0 2024-04-15T21:02:35.933 INFO:tasks.workunit.client.0.smithi072.stdout:7/136: read d2/db/f19 [286189,44958] 0 2024-04-15T21:02:35.937 INFO:tasks.workunit.client.0.smithi072.stdout:8/216: truncate d3/f3c 3900902 0 2024-04-15T21:02:35.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/398: dread da/d18/d33/f6f [0,4194304] 0 2024-04-15T21:02:35.938 INFO:tasks.workunit.client.1.smithi149.stdout:1/313: write d1/db/dc/d38/d39/d43/f1f [636430,10019] 0 2024-04-15T21:02:35.939 INFO:tasks.workunit.client.0.smithi072.stdout:9/175: symlink d4/d29/l38 0 2024-04-15T21:02:35.940 INFO:tasks.workunit.client.0.smithi072.stdout:9/176: write f3 [3275695,123941] 0 2024-04-15T21:02:35.940 INFO:tasks.workunit.client.1.smithi149.stdout:9/370: mkdir d23/d3c/d7a 0 2024-04-15T21:02:35.941 INFO:tasks.workunit.client.0.smithi072.stdout:6/186: creat d2/d10/d11/d34/f3a x:0 0 0 2024-04-15T21:02:35.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/487: creat dc/d2c/d3e/d35/d4b/d75/fa4 x:0 0 0 2024-04-15T21:02:35.946 INFO:tasks.workunit.client.1.smithi149.stdout:4/488: fdatasync dc/d2c/d3e/d15/d5b/f9e 0 2024-04-15T21:02:35.950 INFO:tasks.workunit.client.0.smithi072.stdout:5/194: symlink d0/l3f 0 2024-04-15T21:02:35.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/412: dread d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:35.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/413: chown d0/d9/f39 3314 1 2024-04-15T21:02:35.956 INFO:tasks.workunit.client.0.smithi072.stdout:7/137: rename d2/d10/d1f/l21 to d2/d7/d25/l27 0 2024-04-15T21:02:35.957 INFO:tasks.workunit.client.1.smithi149.stdout:2/482: link d4/d7/d10/d6b/d21/d3b/d90/da7/d6c/l78 d4/d7/da/lb5 0 2024-04-15T21:02:35.959 INFO:tasks.workunit.client.0.smithi072.stdout:0/153: truncate d0/f13 235027 0 2024-04-15T21:02:35.959 INFO:tasks.workunit.client.0.smithi072.stdout:0/154: dread - d0/d6/f2c zero size 2024-04-15T21:02:35.962 INFO:tasks.workunit.client.0.smithi072.stdout:9/177: creat d4/d1f/d2c/f39 x:0 0 0 2024-04-15T21:02:35.963 INFO:tasks.workunit.client.1.smithi149.stdout:1/314: creat d1/d17/d52/d42/f58 x:0 0 0 2024-04-15T21:02:35.963 INFO:tasks.workunit.client.0.smithi072.stdout:6/187: unlink d2/d1a/c31 0 2024-04-15T21:02:35.971 INFO:tasks.workunit.client.1.smithi149.stdout:8/478: dread d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:36.020 INFO:tasks.workunit.client.0.smithi072.stdout:2/207: truncate d2/d3/f1d 2739885 0 2024-04-15T21:02:36.020 INFO:tasks.workunit.client.1.smithi149.stdout:9/371: truncate d23/f47 1315389 0 2024-04-15T21:02:36.021 INFO:tasks.workunit.client.1.smithi149.stdout:4/489: mknod dc/d2c/d3e/d15/d5b/ca5 0 2024-04-15T21:02:36.023 INFO:tasks.workunit.client.1.smithi149.stdout:5/414: rename d0/d9/db/d12/d16/c2a to d0/d9/c92 0 2024-04-15T21:02:36.024 INFO:tasks.workunit.client.0.smithi072.stdout:4/154: mknod d7/d24/c31 0 2024-04-15T21:02:36.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/415: fsync d0/d9/db/d12/d16/f58 0 2024-04-15T21:02:36.025 INFO:tasks.workunit.client.0.smithi072.stdout:7/138: rmdir d2/d7 39 2024-04-15T21:02:36.027 INFO:tasks.workunit.client.1.smithi149.stdout:2/483: stat d4/d7/d10/d36/f49 0 2024-04-15T21:02:36.027 INFO:tasks.workunit.client.0.smithi072.stdout:7/139: truncate d2/d10/f11 1383300 0 2024-04-15T21:02:36.028 INFO:tasks.workunit.client.0.smithi072.stdout:3/199: rename d1/f38 to d1/d15/d32/d2f/f3a 0 2024-04-15T21:02:36.029 INFO:tasks.workunit.client.1.smithi149.stdout:0/586: link d1/d29/d2c/d4f/d95/lc9 d1/d9/d64/d65/ld0 0 2024-04-15T21:02:36.030 INFO:tasks.workunit.client.1.smithi149.stdout:5/416: dwrite d0/d9/db/f5e [0,4194304] 0 2024-04-15T21:02:36.032 INFO:tasks.workunit.client.1.smithi149.stdout:5/417: write d0/d9/db/f7b [1480614,43116] 0 2024-04-15T21:02:36.032 INFO:tasks.workunit.client.1.smithi149.stdout:0/587: read d1/d5/d24/d50/d13/d38/d44/f60 [3595740,7468] 0 2024-04-15T21:02:36.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/315: mknod d1/db/dc/d11/c59 0 2024-04-15T21:02:36.036 INFO:tasks.workunit.client.1.smithi149.stdout:1/316: dread d1/d17/f41 [0,4194304] 0 2024-04-15T21:02:36.038 INFO:tasks.workunit.client.1.smithi149.stdout:5/418: dread d0/f5 [0,4194304] 0 2024-04-15T21:02:36.040 INFO:tasks.workunit.client.1.smithi149.stdout:8/479: mkdir d2/df/d10/d25/d37/d53/daf/db4 0 2024-04-15T21:02:36.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/317: dwrite d1/d17/d52/f2a [0,4194304] 0 2024-04-15T21:02:36.047 INFO:tasks.workunit.client.0.smithi072.stdout:2/208: unlink d2/d3/c1b 0 2024-04-15T21:02:36.050 INFO:tasks.workunit.client.1.smithi149.stdout:4/490: write dc/d2c/d3e/d15/d5b/f74 [4621831,17982] 0 2024-04-15T21:02:36.051 INFO:tasks.workunit.client.0.smithi072.stdout:5/195: link d0/f35 d0/d3/d7/d1f/f40 0 2024-04-15T21:02:36.052 INFO:tasks.workunit.client.1.smithi149.stdout:7/422: getdents d3/d16/d20/d36/d3d 0 2024-04-15T21:02:36.055 INFO:tasks.workunit.client.1.smithi149.stdout:4/491: read dc/d18/d21/f6b [283665,65228] 0 2024-04-15T21:02:36.057 INFO:tasks.workunit.client.1.smithi149.stdout:2/484: mkdir d4/d7/d10/d6b/db6 0 2024-04-15T21:02:36.060 INFO:tasks.workunit.client.0.smithi072.stdout:3/200: rmdir d1 39 2024-04-15T21:02:36.060 INFO:tasks.workunit.client.0.smithi072.stdout:7/140: dwrite d2/db/ff [0,4194304] 0 2024-04-15T21:02:36.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/399: truncate da/d18/d10/d66/f69 6015654 0 2024-04-15T21:02:36.063 INFO:tasks.workunit.client.0.smithi072.stdout:1/156: link d5/db/d10/c15 d5/db/d10/d1f/c29 0 2024-04-15T21:02:36.066 INFO:tasks.workunit.client.1.smithi149.stdout:6/400: write da/d18/d10/d3f/f5c [726278,60254] 0 2024-04-15T21:02:36.066 INFO:tasks.workunit.client.0.smithi072.stdout:6/188: write d2/d10/d11/d1f/f28 [227147,13401] 0 2024-04-15T21:02:36.067 INFO:tasks.workunit.client.1.smithi149.stdout:0/588: creat d1/d5/d24/d50/d13/d38/fd1 x:0 0 0 2024-04-15T21:02:36.068 INFO:tasks.workunit.client.1.smithi149.stdout:0/589: dread - d1/d29/d2c/d4f/fb1 zero size 2024-04-15T21:02:36.072 INFO:tasks.workunit.client.0.smithi072.stdout:9/178: unlink d4/l1a 0 2024-04-15T21:02:36.073 INFO:tasks.workunit.client.0.smithi072.stdout:9/179: truncate d4/d1f/d2c/f39 328990 0 2024-04-15T21:02:36.073 INFO:tasks.workunit.client.1.smithi149.stdout:0/590: dread d1/d29/d2c/d4f/f9c [0,4194304] 0 2024-04-15T21:02:36.077 INFO:tasks.workunit.client.0.smithi072.stdout:2/209: rmdir d2 39 2024-04-15T21:02:36.079 INFO:tasks.workunit.client.0.smithi072.stdout:4/155: mknod d7/c32 0 2024-04-15T21:02:36.087 INFO:tasks.workunit.client.0.smithi072.stdout:1/157: rename d5/db/d10/d1f/c24 to d5/db/d10/d1f/c2a 0 2024-04-15T21:02:36.088 INFO:tasks.workunit.client.0.smithi072.stdout:1/158: rename d5/db to d5/db/d27/d2b 22 2024-04-15T21:02:36.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/189: dwrite d2/d10/d11/d1f/f32 [4194304,4194304] 0 2024-04-15T21:02:36.099 INFO:tasks.workunit.client.0.smithi072.stdout:9/180: dread f3 [0,4194304] 0 2024-04-15T21:02:36.100 INFO:tasks.workunit.client.0.smithi072.stdout:4/156: dread d7/f12 [0,4194304] 0 2024-04-15T21:02:36.101 INFO:tasks.workunit.client.0.smithi072.stdout:6/190: dread d2/d10/d11/d1f/f30 [0,4194304] 0 2024-04-15T21:02:36.101 INFO:tasks.workunit.client.0.smithi072.stdout:5/196: mkdir d0/d41 0 2024-04-15T21:02:36.102 INFO:tasks.workunit.client.0.smithi072.stdout:6/191: fdatasync d2/d10/f1d 0 2024-04-15T21:02:36.105 INFO:tasks.workunit.client.0.smithi072.stdout:1/159: symlink d5/db/d10/l2c 0 2024-04-15T21:02:36.112 INFO:tasks.workunit.client.0.smithi072.stdout:8/217: dread d3/de/f22 [0,4194304] 0 2024-04-15T21:02:36.113 INFO:tasks.workunit.client.0.smithi072.stdout:4/157: rmdir d7/d15 39 2024-04-15T21:02:36.113 INFO:tasks.workunit.client.0.smithi072.stdout:4/158: dread - d7/d28/f2d zero size 2024-04-15T21:02:36.114 INFO:tasks.workunit.client.0.smithi072.stdout:5/197: rmdir d0/d3/d23 39 2024-04-15T21:02:36.115 INFO:tasks.workunit.client.0.smithi072.stdout:6/192: mknod d2/d10/d11/d15/c3b 0 2024-04-15T21:02:36.116 INFO:tasks.workunit.client.0.smithi072.stdout:7/141: creat d2/f28 x:0 0 0 2024-04-15T21:02:36.147 INFO:tasks.workunit.client.1.smithi149.stdout:4/492: creat dc/d8f/fa6 x:0 0 0 2024-04-15T21:02:36.147 INFO:tasks.workunit.client.1.smithi149.stdout:6/401: fsync da/d11/f7b 0 2024-04-15T21:02:36.148 INFO:tasks.workunit.client.1.smithi149.stdout:9/372: write d23/f48 [99603,3234] 0 2024-04-15T21:02:36.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/419: write d0/d9/db/d12/d16/d28/f40 [2854691,93663] 0 2024-04-15T21:02:36.149 INFO:tasks.workunit.client.1.smithi149.stdout:8/480: write d2/df/d10/f90 [3250875,24327] 0 2024-04-15T21:02:36.149 INFO:tasks.workunit.client.1.smithi149.stdout:0/591: creat d1/d5/d24/d50/d15/fd2 x:0 0 0 2024-04-15T21:02:36.150 INFO:tasks.workunit.client.1.smithi149.stdout:1/318: mknod d1/db/d14/c5a 0 2024-04-15T21:02:36.150 INFO:tasks.workunit.client.1.smithi149.stdout:4/493: stat dc/d2c/d3e/d35/d3a/f53 0 2024-04-15T21:02:36.150 INFO:tasks.workunit.client.1.smithi149.stdout:7/423: write d3/d17/d1f/f25 [428355,15315] 0 2024-04-15T21:02:36.155 INFO:tasks.workunit.client.1.smithi149.stdout:7/424: dread - d3/d39/f7d zero size 2024-04-15T21:02:36.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/373: creat d23/d2b/d37/d6d/f7b x:0 0 0 2024-04-15T21:02:36.160 INFO:tasks.workunit.client.1.smithi149.stdout:7/425: chown d3/d39/f7d 18702 1 2024-04-15T21:02:36.160 INFO:tasks.workunit.client.0.smithi072.stdout:1/160: mkdir d5/db/d2d 0 2024-04-15T21:02:36.160 INFO:tasks.workunit.client.0.smithi072.stdout:3/201: dwrite d1/d7/f1c [0,4194304] 0 2024-04-15T21:02:36.161 INFO:tasks.workunit.client.0.smithi072.stdout:9/181: read - d4/d1f/d2c/f35 zero size 2024-04-15T21:02:36.162 INFO:tasks.workunit.client.0.smithi072.stdout:5/198: dwrite d0/d13/f21 [0,4194304] 0 2024-04-15T21:02:36.164 INFO:tasks.workunit.client.0.smithi072.stdout:9/182: chown d4/d1f/l28 861 1 2024-04-15T21:02:36.167 INFO:tasks.workunit.client.0.smithi072.stdout:4/159: dwrite d7/d23/f2a [0,4194304] 0 2024-04-15T21:02:36.170 INFO:tasks.workunit.client.1.smithi149.stdout:0/592: dwrite d1/d29/d2c/d4f/f98 [0,4194304] 0 2024-04-15T21:02:36.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/494: dwrite dc/d2c/d3e/d15/d3f/f87 [0,4194304] 0 2024-04-15T21:02:36.184 INFO:tasks.workunit.client.1.smithi149.stdout:5/420: dwrite d0/d9/db/d12/d16/d28/f40 [0,4194304] 0 2024-04-15T21:02:36.184 INFO:tasks.workunit.client.1.smithi149.stdout:7/426: dwrite d3/f94 [0,4194304] 0 2024-04-15T21:02:36.227 INFO:tasks.workunit.client.0.smithi072.stdout:0/155: sync 2024-04-15T21:02:36.255 INFO:tasks.workunit.client.0.smithi072.stdout:2/210: creat d2/d3/f46 x:0 0 0 2024-04-15T21:02:36.256 INFO:tasks.workunit.client.1.smithi149.stdout:8/481: symlink d2/df/d10/d21/lb5 0 2024-04-15T21:02:36.259 INFO:tasks.workunit.client.1.smithi149.stdout:6/402: unlink da/d11/f74 0 2024-04-15T21:02:36.260 INFO:tasks.workunit.client.1.smithi149.stdout:3/430: sync 2024-04-15T21:02:36.261 INFO:tasks.workunit.client.0.smithi072.stdout:7/142: unlink d2/db/ce 0 2024-04-15T21:02:36.264 INFO:tasks.workunit.client.0.smithi072.stdout:3/202: unlink d1/ff 0 2024-04-15T21:02:36.264 INFO:tasks.workunit.client.0.smithi072.stdout:3/203: readlink d1/d7/l16 0 2024-04-15T21:02:36.265 INFO:tasks.workunit.client.0.smithi072.stdout:3/204: write d1/f2e [3235,36059] 0 2024-04-15T21:02:36.266 INFO:tasks.workunit.client.0.smithi072.stdout:1/161: creat d5/db/d10/f2e x:0 0 0 2024-04-15T21:02:36.267 INFO:tasks.workunit.client.0.smithi072.stdout:1/162: write d5/db/f28 [975445,113689] 0 2024-04-15T21:02:36.270 INFO:tasks.workunit.client.0.smithi072.stdout:4/160: chown d7/d15/f20 878 1 2024-04-15T21:02:36.271 INFO:tasks.workunit.client.1.smithi149.stdout:7/427: mknod d3/d16/d20/d36/d3d/c95 0 2024-04-15T21:02:36.273 INFO:tasks.workunit.client.0.smithi072.stdout:0/156: rename d0/l23 to d0/d6/l2f 0 2024-04-15T21:02:36.275 INFO:tasks.workunit.client.1.smithi149.stdout:0/593: mknod d1/d29/d2c/d4f/cd3 0 2024-04-15T21:02:36.278 INFO:tasks.workunit.client.0.smithi072.stdout:9/183: dread d4/fc [0,4194304] 0 2024-04-15T21:02:36.279 INFO:tasks.workunit.client.1.smithi149.stdout:5/421: creat d0/d9/d3f/f93 x:0 0 0 2024-04-15T21:02:36.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/482: dread d2/df/d10/d25/f26 [0,4194304] 0 2024-04-15T21:02:36.282 INFO:tasks.workunit.client.0.smithi072.stdout:6/193: creat d2/d10/f3c x:0 0 0 2024-04-15T21:02:36.284 INFO:tasks.workunit.client.0.smithi072.stdout:6/194: read - d2/d10/d11/f2e zero size 2024-04-15T21:02:36.284 INFO:tasks.workunit.client.0.smithi072.stdout:9/184: dwrite d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:36.284 INFO:tasks.workunit.client.1.smithi149.stdout:1/319: mknod d1/db/dc/c5b 0 2024-04-15T21:02:36.285 INFO:tasks.workunit.client.0.smithi072.stdout:9/185: fdatasync d4/f7 0 2024-04-15T21:02:36.286 INFO:tasks.workunit.client.0.smithi072.stdout:9/186: truncate d4/d1f/d2c/f35 959229 0 2024-04-15T21:02:36.287 INFO:tasks.workunit.client.1.smithi149.stdout:0/594: dwrite d1/d29/d2c/d4f/fb1 [0,4194304] 0 2024-04-15T21:02:36.288 INFO:tasks.workunit.client.1.smithi149.stdout:6/403: symlink da/d49/l7f 0 2024-04-15T21:02:36.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/143: dread d2/fa [0,4194304] 0 2024-04-15T21:02:36.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/144: fdatasync d2/db/ff 0 2024-04-15T21:02:36.290 INFO:tasks.workunit.client.1.smithi149.stdout:3/431: rmdir d1/db/d24/d2b 39 2024-04-15T21:02:36.292 INFO:tasks.workunit.client.0.smithi072.stdout:3/205: creat d1/d15/f3b x:0 0 0 2024-04-15T21:02:36.296 INFO:tasks.workunit.client.1.smithi149.stdout:0/595: dread d1/d5/f4a [0,4194304] 0 2024-04-15T21:02:36.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/374: mkdir d23/d3c/d7a/d7c 0 2024-04-15T21:02:36.302 INFO:tasks.workunit.client.0.smithi072.stdout:4/161: unlink d7/d28/f2d 0 2024-04-15T21:02:36.307 INFO:tasks.workunit.client.0.smithi072.stdout:0/157: mknod d0/d17/c30 0 2024-04-15T21:02:36.309 INFO:tasks.workunit.client.1.smithi149.stdout:1/320: dread d1/db/d16/f56 [4194304,4194304] 0 2024-04-15T21:02:36.312 INFO:tasks.workunit.client.0.smithi072.stdout:6/195: mkdir d2/d10/d18/d3d 0 2024-04-15T21:02:36.313 INFO:tasks.workunit.client.1.smithi149.stdout:8/483: unlink d2/df/d10/d21/l93 0 2024-04-15T21:02:36.314 INFO:tasks.workunit.client.0.smithi072.stdout:6/196: write d2/f2a [246686,103553] 0 2024-04-15T21:02:36.314 INFO:tasks.workunit.client.0.smithi072.stdout:0/158: dwrite d0/d19/f22 [0,4194304] 0 2024-04-15T21:02:36.318 INFO:tasks.workunit.client.1.smithi149.stdout:3/432: truncate d1/db/d24/d2b/f1b 2909534 0 2024-04-15T21:02:36.318 INFO:tasks.workunit.client.1.smithi149.stdout:3/433: readlink d1/db/l11 0 2024-04-15T21:02:36.322 INFO:tasks.workunit.client.1.smithi149.stdout:4/495: dread dc/d2c/d3e/d35/d4b/f57 [0,4194304] 0 2024-04-15T21:02:36.324 INFO:tasks.workunit.client.1.smithi149.stdout:4/496: chown dc/d2c/d3e/d35/c46 78 1 2024-04-15T21:02:36.325 INFO:tasks.workunit.client.0.smithi072.stdout:7/145: rename d2/f28 to d2/d10/d26/f29 0 2024-04-15T21:02:36.326 INFO:tasks.workunit.client.0.smithi072.stdout:3/206: symlink d1/d15/d32/d2f/l3c 0 2024-04-15T21:02:36.326 INFO:tasks.workunit.client.1.smithi149.stdout:4/497: dread f1 [4194304,4194304] 0 2024-04-15T21:02:36.327 INFO:tasks.workunit.client.0.smithi072.stdout:3/207: truncate d1/d15/f31 703931 0 2024-04-15T21:02:36.329 INFO:tasks.workunit.client.0.smithi072.stdout:2/211: truncate d2/d8/f30 3389675 0 2024-04-15T21:02:36.334 INFO:tasks.workunit.client.0.smithi072.stdout:1/163: symlink d5/db/d27/l2f 0 2024-04-15T21:02:36.334 INFO:tasks.workunit.client.0.smithi072.stdout:1/164: chown d5/f6 36720427 1 2024-04-15T21:02:36.337 INFO:tasks.workunit.client.1.smithi149.stdout:7/428: mkdir d3/d96 0 2024-04-15T21:02:36.338 INFO:tasks.workunit.client.0.smithi072.stdout:4/162: creat d7/d15/f33 x:0 0 0 2024-04-15T21:02:36.341 INFO:tasks.workunit.client.1.smithi149.stdout:1/321: write d1/f6 [875360,90751] 0 2024-04-15T21:02:36.342 INFO:tasks.workunit.client.1.smithi149.stdout:1/322: chown d1/d17/d52/d42/f48 2464 1 2024-04-15T21:02:36.343 INFO:tasks.workunit.client.1.smithi149.stdout:1/323: write d1/f5 [1096339,34637] 0 2024-04-15T21:02:36.345 INFO:tasks.workunit.client.1.smithi149.stdout:9/375: write d23/d2b/d37/f4b [3970582,112907] 0 2024-04-15T21:02:36.345 INFO:tasks.workunit.client.1.smithi149.stdout:5/422: symlink d0/d9/db/d12/d16/d28/l94 0 2024-04-15T21:02:36.346 INFO:tasks.workunit.client.0.smithi072.stdout:4/163: dwrite d7/d23/f2a [4194304,4194304] 0 2024-04-15T21:02:36.346 INFO:tasks.workunit.client.1.smithi149.stdout:9/376: stat d23/c77 0 2024-04-15T21:02:36.347 INFO:tasks.workunit.client.0.smithi072.stdout:4/164: write d7/f1c [1352405,124453] 0 2024-04-15T21:02:36.348 INFO:tasks.workunit.client.0.smithi072.stdout:8/218: sync 2024-04-15T21:02:36.348 INFO:tasks.workunit.client.0.smithi072.stdout:4/165: write d7/d10/f11 [47130,197] 0 2024-04-15T21:02:36.349 INFO:tasks.workunit.client.1.smithi149.stdout:8/484: read d2/f86 [757247,28813] 0 2024-04-15T21:02:36.350 INFO:tasks.workunit.client.0.smithi072.stdout:4/166: write d7/d24/f1e [3840203,77075] 0 2024-04-15T21:02:36.350 INFO:tasks.workunit.client.1.smithi149.stdout:8/485: truncate d2/df/d10/d25/d37/fae 399253 0 2024-04-15T21:02:36.354 INFO:tasks.workunit.client.0.smithi072.stdout:9/187: unlink d4/ce 0 2024-04-15T21:02:36.354 INFO:tasks.workunit.client.0.smithi072.stdout:0/159: creat d0/d6/f31 x:0 0 0 2024-04-15T21:02:36.355 INFO:tasks.workunit.client.0.smithi072.stdout:9/188: chown d4/d1f/f24 20243 1 2024-04-15T21:02:36.355 INFO:tasks.workunit.client.0.smithi072.stdout:0/160: chown d0/d3/d5/f2a 32722 1 2024-04-15T21:02:36.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/404: rename da/ff to da/d18/d10/d66/f80 0 2024-04-15T21:02:36.357 INFO:tasks.workunit.client.0.smithi072.stdout:0/161: dread - d0/d19/d2b/f2e zero size 2024-04-15T21:02:36.358 INFO:tasks.workunit.client.0.smithi072.stdout:4/167: dread d7/d10/f11 [0,4194304] 0 2024-04-15T21:02:36.359 INFO:tasks.workunit.client.0.smithi072.stdout:4/168: chown d7/d10/f1a 0 1 2024-04-15T21:02:36.364 INFO:tasks.workunit.client.1.smithi149.stdout:1/324: creat d1/db/d16/f5c x:0 0 0 2024-04-15T21:02:36.367 INFO:tasks.workunit.client.0.smithi072.stdout:6/197: symlink d2/l3e 0 2024-04-15T21:02:36.369 INFO:tasks.workunit.client.1.smithi149.stdout:3/434: getdents d1/db/d24/d39/d79 0 2024-04-15T21:02:36.372 INFO:tasks.workunit.client.1.smithi149.stdout:4/498: rename dc/d2c/d3e/d15/f34 to dc/d18/d21/d81/fa7 0 2024-04-15T21:02:36.375 INFO:tasks.workunit.client.1.smithi149.stdout:2/485: sync 2024-04-15T21:02:36.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/325: mknod d1/db/d16/d35/c5d 0 2024-04-15T21:02:36.383 INFO:tasks.workunit.client.1.smithi149.stdout:8/486: dread d2/f1b [4194304,4194304] 0 2024-04-15T21:02:36.384 INFO:tasks.workunit.client.0.smithi072.stdout:0/162: symlink d0/d19/d2b/l32 0 2024-04-15T21:02:36.387 INFO:tasks.workunit.client.0.smithi072.stdout:4/169: creat d7/d10/f34 x:0 0 0 2024-04-15T21:02:36.389 INFO:tasks.workunit.client.1.smithi149.stdout:3/435: truncate d1/db/d24/d39/f47 372195 0 2024-04-15T21:02:36.392 INFO:tasks.workunit.client.0.smithi072.stdout:4/170: dread d7/f1c [0,4194304] 0 2024-04-15T21:02:36.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/596: getdents d1/d5/d24/d50/d13/d59 0 2024-04-15T21:02:36.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/208: symlink d1/l3d 0 2024-04-15T21:02:36.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/209: fsync d1/d7/f27 0 2024-04-15T21:02:36.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/597: write d1/d9/d64/d65/f79 [693772,51291] 0 2024-04-15T21:02:36.394 INFO:tasks.workunit.client.0.smithi072.stdout:3/210: readlink d1/d7/l21 0 2024-04-15T21:02:36.395 INFO:tasks.workunit.client.0.smithi072.stdout:3/211: stat d1/d26/f30 0 2024-04-15T21:02:36.395 INFO:tasks.workunit.client.0.smithi072.stdout:3/212: stat d1/d15/f31 0 2024-04-15T21:02:36.398 INFO:tasks.workunit.client.1.smithi149.stdout:5/423: rename d0/d9/db/d3d to d0/d6/d79/d95 0 2024-04-15T21:02:36.401 INFO:tasks.workunit.client.0.smithi072.stdout:3/213: dwrite d1/d15/d32/d2f/f33 [0,4194304] 0 2024-04-15T21:02:36.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/487: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:36.403 INFO:tasks.workunit.client.1.smithi149.stdout:7/429: link d3/d16/d20/d6c/c74 d3/d16/d32/c97 0 2024-04-15T21:02:36.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/165: mknod d5/c30 0 2024-04-15T21:02:36.404 INFO:tasks.workunit.client.1.smithi149.stdout:2/486: creat d4/d7/d10/d6b/d21/d55/fb7 x:0 0 0 2024-04-15T21:02:36.407 INFO:tasks.workunit.client.0.smithi072.stdout:0/163: creat d0/d3/f33 x:0 0 0 2024-04-15T21:02:36.408 INFO:tasks.workunit.client.0.smithi072.stdout:0/164: chown d0/d19/l27 728363990 1 2024-04-15T21:02:36.408 INFO:tasks.workunit.client.0.smithi072.stdout:7/146: link d2/f14 d2/d10/f2a 0 2024-04-15T21:02:36.414 INFO:tasks.workunit.client.1.smithi149.stdout:0/598: creat d1/d5/d24/d50/d13/d59/fd4 x:0 0 0 2024-04-15T21:02:36.414 INFO:tasks.workunit.client.1.smithi149.stdout:2/487: dwrite d4/d7/da/f25 [4194304,4194304] 0 2024-04-15T21:02:36.416 INFO:tasks.workunit.client.1.smithi149.stdout:2/488: chown d4/d7/da/f4e 708465559 1 2024-04-15T21:02:36.420 INFO:tasks.workunit.client.1.smithi149.stdout:9/377: rename d23/d2b/d37/d50/f59 to d23/d2b/d37/d6d/f7d 0 2024-04-15T21:02:36.422 INFO:tasks.workunit.client.1.smithi149.stdout:5/424: truncate d0/d9/db/f7f 3806193 0 2024-04-15T21:02:36.423 INFO:tasks.workunit.client.0.smithi072.stdout:2/212: rename d2/d38/c2c to d2/d8/c47 0 2024-04-15T21:02:36.430 INFO:tasks.workunit.client.0.smithi072.stdout:3/214: creat d1/d15/f3e x:0 0 0 2024-04-15T21:02:36.431 INFO:tasks.workunit.client.1.smithi149.stdout:4/499: write dc/d2c/d3e/d35/d3a/f60 [4251686,52486] 0 2024-04-15T21:02:36.433 INFO:tasks.workunit.client.1.smithi149.stdout:8/488: chown d2/f69 129097390 1 2024-04-15T21:02:36.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/165: creat d0/d3/f34 x:0 0 0 2024-04-15T21:02:36.451 INFO:tasks.workunit.client.0.smithi072.stdout:0/166: chown d0/f1c 946 1 2024-04-15T21:02:36.451 INFO:tasks.workunit.client.0.smithi072.stdout:7/147: creat d2/d10/d1f/f2b x:0 0 0 2024-04-15T21:02:36.455 INFO:tasks.workunit.client.0.smithi072.stdout:6/198: rename d2/d10/d18/d3d to d2/d10/d11/d1f/d3f 0 2024-04-15T21:02:36.457 INFO:tasks.workunit.client.1.smithi149.stdout:6/405: rename da/l4f to da/d49/l81 0 2024-04-15T21:02:36.462 INFO:tasks.workunit.client.1.smithi149.stdout:0/599: creat d1/d5/d24/d50/d13/d59/fd5 x:0 0 0 2024-04-15T21:02:36.464 INFO:tasks.workunit.client.0.smithi072.stdout:1/166: mkdir d5/d31 0 2024-04-15T21:02:36.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/189: rename d4/c21 to d4/c3a 0 2024-04-15T21:02:36.468 INFO:tasks.workunit.client.0.smithi072.stdout:0/167: mkdir d0/d17/d35 0 2024-04-15T21:02:36.469 INFO:tasks.workunit.client.0.smithi072.stdout:9/190: dread d4/fc [0,4194304] 0 2024-04-15T21:02:36.470 INFO:tasks.workunit.client.0.smithi072.stdout:9/191: write d4/d1f/d2c/f35 [1872159,86527] 0 2024-04-15T21:02:36.472 INFO:tasks.workunit.client.1.smithi149.stdout:4/500: dwrite dc/d2c/d3e/d35/f5e [0,4194304] 0 2024-04-15T21:02:36.473 INFO:tasks.workunit.client.0.smithi072.stdout:5/199: sync 2024-04-15T21:02:36.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/501: dread dc/d18/d21/f4d [0,4194304] 0 2024-04-15T21:02:36.482 INFO:tasks.workunit.client.0.smithi072.stdout:6/199: rmdir d2/d10 39 2024-04-15T21:02:36.484 INFO:tasks.workunit.client.1.smithi149.stdout:3/436: creat d1/f7c x:0 0 0 2024-04-15T21:02:36.488 INFO:tasks.workunit.client.1.smithi149.stdout:6/406: unlink da/d18/c6e 0 2024-04-15T21:02:36.489 INFO:tasks.workunit.client.0.smithi072.stdout:3/215: mkdir d1/d3f 0 2024-04-15T21:02:36.493 INFO:tasks.workunit.client.1.smithi149.stdout:0/600: symlink d1/d5/d24/d30/d92/ld6 0 2024-04-15T21:02:36.494 INFO:tasks.workunit.client.1.smithi149.stdout:0/601: truncate d1/d9/fce 409498 0 2024-04-15T21:02:36.495 INFO:tasks.workunit.client.0.smithi072.stdout:0/168: rename d0/f1c to d0/d17/d35/f36 0 2024-04-15T21:02:36.496 INFO:tasks.workunit.client.1.smithi149.stdout:0/602: write d1/d5/d24/d30/d43/f97 [1178391,19268] 0 2024-04-15T21:02:36.500 INFO:tasks.workunit.client.1.smithi149.stdout:8/489: creat d2/df/d10/d21/d46/d74/fb6 x:0 0 0 2024-04-15T21:02:36.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/489: truncate d4/d7/d10/d6b/d21/d2c/d32/d4a/f88 868486 0 2024-04-15T21:02:36.506 INFO:tasks.workunit.client.0.smithi072.stdout:1/167: dwrite d5/db/d10/f22 [0,4194304] 0 2024-04-15T21:02:36.507 INFO:tasks.workunit.client.0.smithi072.stdout:9/192: write d4/d1f/d2c/f2d [612248,76666] 0 2024-04-15T21:02:36.507 INFO:tasks.workunit.client.0.smithi072.stdout:1/168: chown d5/c16 15 1 2024-04-15T21:02:36.511 INFO:tasks.workunit.client.0.smithi072.stdout:9/193: dread d4/f7 [0,4194304] 0 2024-04-15T21:02:36.511 INFO:tasks.workunit.client.0.smithi072.stdout:5/200: symlink d0/d3/d6/d2d/l42 0 2024-04-15T21:02:36.512 INFO:tasks.workunit.client.1.smithi149.stdout:7/430: link d3/d34/l50 d3/d17/d1f/d93/l98 0 2024-04-15T21:02:36.513 INFO:tasks.workunit.client.0.smithi072.stdout:9/194: write d4/f13 [2035356,119606] 0 2024-04-15T21:02:36.515 INFO:tasks.workunit.client.0.smithi072.stdout:9/195: read d4/d29/f36 [3699570,63028] 0 2024-04-15T21:02:36.516 INFO:tasks.workunit.client.1.smithi149.stdout:7/431: fsync d3/d16/d20/d6c/f83 0 2024-04-15T21:02:36.517 INFO:tasks.workunit.client.0.smithi072.stdout:9/196: fdatasync d4/f7 0 2024-04-15T21:02:36.517 INFO:tasks.workunit.client.1.smithi149.stdout:4/502: fsync dc/d18/d21/f64 0 2024-04-15T21:02:36.518 INFO:tasks.workunit.client.0.smithi072.stdout:8/219: sync 2024-04-15T21:02:36.518 INFO:tasks.workunit.client.0.smithi072.stdout:4/171: getdents d7/d10 0 2024-04-15T21:02:36.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/503: chown dc/d2c/d3e/d35/f5e 147 1 2024-04-15T21:02:36.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/490: dread d2/df/d10/d25/d32/f42 [0,4194304] 0 2024-04-15T21:02:36.520 INFO:tasks.workunit.client.0.smithi072.stdout:7/148: dwrite d2/db/f22 [0,4194304] 0 2024-04-15T21:02:36.521 INFO:tasks.workunit.client.0.smithi072.stdout:2/213: creat d2/d38/f48 x:0 0 0 2024-04-15T21:02:36.521 INFO:tasks.workunit.client.0.smithi072.stdout:8/220: write d3/f1d [936845,85694] 0 2024-04-15T21:02:36.523 INFO:tasks.workunit.client.0.smithi072.stdout:8/221: readlink d3/l29 0 2024-04-15T21:02:36.527 INFO:tasks.workunit.client.1.smithi149.stdout:0/603: rename d1/d5/d24/d50/d13/d38/d71 to d1/d5/d24/d50/d13/d59/dd7 0 2024-04-15T21:02:36.527 INFO:tasks.workunit.client.0.smithi072.stdout:1/169: dread d5/f9 [0,4194304] 0 2024-04-15T21:02:36.528 INFO:tasks.workunit.client.0.smithi072.stdout:5/201: dread d0/d3/d6/d2d/f28 [0,4194304] 0 2024-04-15T21:02:36.530 INFO:tasks.workunit.client.1.smithi149.stdout:0/604: truncate d1/d5/d24/d50/d15/fd2 841569 0 2024-04-15T21:02:36.531 INFO:tasks.workunit.client.0.smithi072.stdout:5/202: dread - d0/f35 zero size 2024-04-15T21:02:36.531 INFO:tasks.workunit.client.0.smithi072.stdout:8/222: dread d3/f33 [0,4194304] 0 2024-04-15T21:02:36.531 INFO:tasks.workunit.client.0.smithi072.stdout:2/214: dwrite d2/d3/f19 [0,4194304] 0 2024-04-15T21:02:36.533 INFO:tasks.workunit.client.0.smithi072.stdout:8/223: chown d3/d4/l14 1016 1 2024-04-15T21:02:36.533 INFO:tasks.workunit.client.1.smithi149.stdout:0/605: truncate d1/d5/d24/d50/d13/fbc 1020056 0 2024-04-15T21:02:36.534 INFO:tasks.workunit.client.1.smithi149.stdout:8/491: creat d2/df/d10/d21/fb7 x:0 0 0 2024-04-15T21:02:36.535 INFO:tasks.workunit.client.0.smithi072.stdout:8/224: write d3/de/f38 [321786,91433] 0 2024-04-15T21:02:36.538 INFO:tasks.workunit.client.0.smithi072.stdout:8/225: write d3/d4/f2c [303205,109156] 0 2024-04-15T21:02:36.539 INFO:tasks.workunit.client.0.smithi072.stdout:8/226: chown d3/de/d17/l1c 261244487 1 2024-04-15T21:02:36.543 INFO:tasks.workunit.client.1.smithi149.stdout:9/378: getdents d23 0 2024-04-15T21:02:36.544 INFO:tasks.workunit.client.0.smithi072.stdout:3/216: dread d1/d15/d32/f24 [0,4194304] 0 2024-04-15T21:02:36.546 INFO:tasks.workunit.client.0.smithi072.stdout:6/200: mkdir d2/d40 0 2024-04-15T21:02:36.550 INFO:tasks.workunit.client.0.smithi072.stdout:7/149: readlink d2/db/l1a 0 2024-04-15T21:02:36.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/492: symlink d2/d5b/lb8 0 2024-04-15T21:02:36.556 INFO:tasks.workunit.client.1.smithi149.stdout:8/493: dread - d2/df/d10/d25/d37/d53/daf/d92/fb0 zero size 2024-04-15T21:02:36.561 INFO:tasks.workunit.client.1.smithi149.stdout:9/379: unlink d23/c5d 0 2024-04-15T21:02:36.567 INFO:tasks.workunit.client.1.smithi149.stdout:0/606: mknod d1/d5/d24/d30/cd8 0 2024-04-15T21:02:36.567 INFO:tasks.workunit.client.1.smithi149.stdout:6/407: dwrite da/d18/d10/d66/f69 [0,4194304] 0 2024-04-15T21:02:36.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/490: truncate d4/d7/d10/d6b/d21/d2c/f80 1603364 0 2024-04-15T21:02:36.574 INFO:tasks.workunit.client.1.smithi149.stdout:3/437: link d1/db/d24/d4d/d63/d65/f67 d1/db/d24/f7d 0 2024-04-15T21:02:36.576 INFO:tasks.workunit.client.0.smithi072.stdout:5/203: rename d0/d3/d6/d2d/l42 to d0/d3/d6/d2d/l43 0 2024-04-15T21:02:36.584 INFO:tasks.workunit.client.0.smithi072.stdout:8/227: mkdir d3/de/d1b/d44 0 2024-04-15T21:02:36.584 INFO:tasks.workunit.client.1.smithi149.stdout:8/494: write d2/df/d10/d25/f26 [3674574,14995] 0 2024-04-15T21:02:36.585 INFO:tasks.workunit.client.1.smithi149.stdout:8/495: stat d2/df/d10/d25/d37/d95 0 2024-04-15T21:02:36.587 INFO:tasks.workunit.client.1.smithi149.stdout:3/438: symlink d1/db/d24/d39/l7e 0 2024-04-15T21:02:36.588 INFO:tasks.workunit.client.1.smithi149.stdout:3/439: write d1/db/f6e [463463,4623] 0 2024-04-15T21:02:36.589 INFO:tasks.workunit.client.0.smithi072.stdout:6/201: rmdir d2/d1a 39 2024-04-15T21:02:36.590 INFO:tasks.workunit.client.1.smithi149.stdout:3/440: read d1/db/d24/d2b/f73 [2353899,43351] 0 2024-04-15T21:02:36.595 INFO:tasks.workunit.client.1.smithi149.stdout:7/432: rename d3/c11 to d3/d17/c99 0 2024-04-15T21:02:36.604 INFO:tasks.workunit.client.0.smithi072.stdout:5/204: symlink d0/d3/d6/d2d/l44 0 2024-04-15T21:02:36.605 INFO:tasks.workunit.client.0.smithi072.stdout:8/228: dread d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:36.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/504: rename dc/d2c/d3e/d35/d3a/f53 to dc/fa8 0 2024-04-15T21:02:36.609 INFO:tasks.workunit.client.1.smithi149.stdout:8/496: dread d2/d16/f2a [0,4194304] 0 2024-04-15T21:02:36.610 INFO:tasks.workunit.client.1.smithi149.stdout:9/380: write d23/d46/f73 [3342221,55918] 0 2024-04-15T21:02:36.612 INFO:tasks.workunit.client.0.smithi072.stdout:7/150: mknod d2/d7/d25/c2c 0 2024-04-15T21:02:36.614 INFO:tasks.workunit.client.0.smithi072.stdout:1/170: creat d5/f32 x:0 0 0 2024-04-15T21:02:36.615 INFO:tasks.workunit.client.0.smithi072.stdout:6/202: dwrite d2/d10/d18/f26 [0,4194304] 0 2024-04-15T21:02:36.616 INFO:tasks.workunit.client.0.smithi072.stdout:0/169: getdents d0/d19/d2b 0 2024-04-15T21:02:36.617 INFO:tasks.workunit.client.0.smithi072.stdout:6/203: dread - d2/d10/d11/f2e zero size 2024-04-15T21:02:36.618 INFO:tasks.workunit.client.0.smithi072.stdout:6/204: dread - d2/d10/d18/f39 zero size 2024-04-15T21:02:36.618 INFO:tasks.workunit.client.0.smithi072.stdout:7/151: dread d2/db/f22 [0,4194304] 0 2024-04-15T21:02:36.619 INFO:tasks.workunit.client.0.smithi072.stdout:6/205: read d2/f14 [4098335,3744] 0 2024-04-15T21:02:36.619 INFO:tasks.workunit.client.1.smithi149.stdout:3/441: fsync d1/db/f52 0 2024-04-15T21:02:36.621 INFO:tasks.workunit.client.0.smithi072.stdout:5/205: rmdir d0/d13 39 2024-04-15T21:02:36.625 INFO:tasks.workunit.client.1.smithi149.stdout:7/433: rename d3/d16/f30 to d3/d96/f9a 0 2024-04-15T21:02:36.626 INFO:tasks.workunit.client.1.smithi149.stdout:7/434: dread - d3/d16/d32/f84 zero size 2024-04-15T21:02:36.627 INFO:tasks.workunit.client.1.smithi149.stdout:4/505: fdatasync dc/d18/d21/f6b 0 2024-04-15T21:02:36.628 INFO:tasks.workunit.client.1.smithi149.stdout:9/381: stat d23/d2b/f65 0 2024-04-15T21:02:36.629 INFO:tasks.workunit.client.0.smithi072.stdout:9/197: rename d4/d1f/d2c/c30 to d4/c3b 0 2024-04-15T21:02:36.633 INFO:tasks.workunit.client.1.smithi149.stdout:2/491: getdents d4/d7/d10/d6b/d21/d2c/d32/d4a 0 2024-04-15T21:02:36.635 INFO:tasks.workunit.client.0.smithi072.stdout:1/171: creat d5/db/d27/f33 x:0 0 0 2024-04-15T21:02:36.635 INFO:tasks.workunit.client.0.smithi072.stdout:1/172: dread - d5/db/d10/f2e zero size 2024-04-15T21:02:36.637 INFO:tasks.workunit.client.0.smithi072.stdout:0/170: stat d0/d3/f4 0 2024-04-15T21:02:36.637 INFO:tasks.workunit.client.0.smithi072.stdout:0/171: chown d0/d6/l1a 971 1 2024-04-15T21:02:36.637 INFO:tasks.workunit.client.0.smithi072.stdout:0/172: read - d0/f29 zero size 2024-04-15T21:02:36.638 INFO:tasks.workunit.client.0.smithi072.stdout:2/215: link d2/f12 d2/d37/f49 0 2024-04-15T21:02:36.639 INFO:tasks.workunit.client.0.smithi072.stdout:2/216: fdatasync d2/d3/f5 0 2024-04-15T21:02:36.639 INFO:tasks.workunit.client.0.smithi072.stdout:2/217: dread - d2/f44 zero size 2024-04-15T21:02:36.640 INFO:tasks.workunit.client.0.smithi072.stdout:8/229: write d3/de/f13 [2015069,76436] 0 2024-04-15T21:02:36.645 INFO:tasks.workunit.client.1.smithi149.stdout:3/442: dwrite d1/db/f21 [0,4194304] 0 2024-04-15T21:02:36.645 INFO:tasks.workunit.client.0.smithi072.stdout:2/218: dwrite d2/f44 [0,4194304] 0 2024-04-15T21:02:36.646 INFO:tasks.workunit.client.0.smithi072.stdout:6/206: chown d2/d10/l35 0 1 2024-04-15T21:02:36.648 INFO:tasks.workunit.client.0.smithi072.stdout:5/206: creat d0/d3/d6/d2d/f45 x:0 0 0 2024-04-15T21:02:36.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/506: write f1 [4611957,118097] 0 2024-04-15T21:02:36.654 INFO:tasks.workunit.client.0.smithi072.stdout:2/219: dwrite d2/d37/f40 [0,4194304] 0 2024-04-15T21:02:36.656 INFO:tasks.workunit.client.0.smithi072.stdout:4/172: rename d7/d10/f1a to d7/d24/f35 0 2024-04-15T21:02:36.658 INFO:tasks.workunit.client.0.smithi072.stdout:4/173: read d7/d24/f35 [2904675,107188] 0 2024-04-15T21:02:36.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/207: dwrite d0/d3/d6/f2b [0,4194304] 0 2024-04-15T21:02:36.659 INFO:tasks.workunit.client.1.smithi149.stdout:9/382: mkdir d23/d2b/d44/d7e 0 2024-04-15T21:02:36.659 INFO:tasks.workunit.client.0.smithi072.stdout:4/174: readlink d7/l1f 0 2024-04-15T21:02:36.660 INFO:tasks.workunit.client.0.smithi072.stdout:9/198: fsync d4/d1f/f2b 0 2024-04-15T21:02:36.661 INFO:tasks.workunit.client.1.smithi149.stdout:7/435: dwrite d3/d16/d32/f84 [0,4194304] 0 2024-04-15T21:02:36.662 INFO:tasks.workunit.client.1.smithi149.stdout:0/607: link d1/d5/c2b d1/cd9 0 2024-04-15T21:02:36.663 INFO:tasks.workunit.client.1.smithi149.stdout:2/492: mkdir d4/d7/d10/d6b/d21/d2c/d63/db8 0 2024-04-15T21:02:36.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/436: fsync d3/d39/f79 0 2024-04-15T21:02:36.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/383: write d23/d46/f53 [612939,102995] 0 2024-04-15T21:02:36.666 INFO:tasks.workunit.client.1.smithi149.stdout:7/437: chown d3/d16/f5a 0 1 2024-04-15T21:02:36.666 INFO:tasks.workunit.client.1.smithi149.stdout:0/608: dread d1/d5/d24/f9e [0,4194304] 0 2024-04-15T21:02:36.666 INFO:tasks.workunit.client.0.smithi072.stdout:1/173: creat d5/db/d27/f34 x:0 0 0 2024-04-15T21:02:36.669 INFO:tasks.workunit.client.1.smithi149.stdout:0/609: chown d1/d9/d64/d65/fcc 3091 1 2024-04-15T21:02:36.670 INFO:tasks.workunit.client.0.smithi072.stdout:0/173: creat d0/d19/d2b/f37 x:0 0 0 2024-04-15T21:02:36.672 INFO:tasks.workunit.client.1.smithi149.stdout:8/497: rename d2/df/d10/d4e/d51/l6e to d2/df/d10/d21/d50/d5d/lb9 0 2024-04-15T21:02:36.675 INFO:tasks.workunit.client.1.smithi149.stdout:3/443: fsync d1/db/d24/d4d/d63/d65/f67 0 2024-04-15T21:02:36.676 INFO:tasks.workunit.client.0.smithi072.stdout:0/174: dwrite d0/d3/f34 [0,4194304] 0 2024-04-15T21:02:36.678 INFO:tasks.workunit.client.0.smithi072.stdout:0/175: fsync d0/d3/fe 0 2024-04-15T21:02:36.680 INFO:tasks.workunit.client.0.smithi072.stdout:3/217: sync 2024-04-15T21:02:36.680 INFO:tasks.workunit.client.0.smithi072.stdout:8/230: mknod d3/de/d17/c45 0 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:02:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr fail", "who": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: osdmap e47: 6 total, 6 up, 6 in 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "mgr fail", "who": "smithi072.wfjmmp"}]': finished 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: mgrmap e21: smithi149.qgbaiy(active, starting, since 0.0091166s) 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:02:36.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: Manager daemon smithi149.qgbaiy is now available 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/trash_purge_schedule"}]: dispatch 2024-04-15T21:02:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:36 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/trash_purge_schedule"}]: dispatch 2024-04-15T21:02:36.695 INFO:tasks.workunit.client.1.smithi149.stdout:2/493: creat d4/d7/d10/d6b/d21/d5e/fb9 x:0 0 0 2024-04-15T21:02:36.706 INFO:tasks.workunit.client.0.smithi072.stdout:2/220: symlink d2/d8/l4a 0 2024-04-15T21:02:36.712 INFO:tasks.workunit.client.1.smithi149.stdout:1/326: sync 2024-04-15T21:02:36.713 INFO:tasks.workunit.client.1.smithi149.stdout:2/494: dwrite d4/d7/d10/d6b/f92 [0,4194304] 0 2024-04-15T21:02:36.716 INFO:tasks.workunit.client.1.smithi149.stdout:7/438: dread d3/ff [4194304,4194304] 0 2024-04-15T21:02:36.717 INFO:tasks.workunit.client.1.smithi149.stdout:7/439: chown l0 61 1 2024-04-15T21:02:36.718 INFO:tasks.workunit.client.1.smithi149.stdout:7/440: chown d3/d39/c81 8397 1 2024-04-15T21:02:36.719 INFO:tasks.workunit.client.1.smithi149.stdout:8/498: creat d2/df/d10/d21/d46/d74/fba x:0 0 0 2024-04-15T21:02:36.719 INFO:tasks.workunit.client.0.smithi072.stdout:7/152: dwrite d2/d10/f2a [0,4194304] 0 2024-04-15T21:02:36.721 INFO:tasks.workunit.client.0.smithi072.stdout:4/175: write d7/d24/f35 [616156,79125] 0 2024-04-15T21:02:36.722 INFO:tasks.workunit.client.0.smithi072.stdout:4/176: fsync d7/f2e 0 2024-04-15T21:02:36.736 INFO:tasks.workunit.client.0.smithi072.stdout:0/176: mknod d0/d3/d5/c38 0 2024-04-15T21:02:36.741 INFO:tasks.workunit.client.1.smithi149.stdout:9/384: dwrite d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:36.741 INFO:tasks.workunit.client.0.smithi072.stdout:8/231: rename d3/de/d17/c37 to d3/de/d1b/d41/c46 0 2024-04-15T21:02:36.746 INFO:tasks.workunit.client.0.smithi072.stdout:6/207: creat d2/d1a/f41 x:0 0 0 2024-04-15T21:02:36.746 INFO:tasks.workunit.client.0.smithi072.stdout:6/208: readlink d2/l8 0 2024-04-15T21:02:36.750 INFO:tasks.workunit.client.0.smithi072.stdout:7/153: chown d2/d7/c17 0 1 2024-04-15T21:02:36.754 INFO:tasks.workunit.client.0.smithi072.stdout:5/208: dwrite d0/d3/d7/d1f/f40 [0,4194304] 0 2024-04-15T21:02:36.755 INFO:tasks.workunit.client.0.smithi072.stdout:4/177: symlink d7/d15/l36 0 2024-04-15T21:02:36.756 INFO:tasks.workunit.client.0.smithi072.stdout:5/209: chown d0/d3/d6/d2d 4046737 1 2024-04-15T21:02:36.757 INFO:tasks.workunit.client.0.smithi072.stdout:1/174: symlink d5/l35 0 2024-04-15T21:02:36.759 INFO:tasks.workunit.client.0.smithi072.stdout:7/154: dread d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:36.759 INFO:tasks.workunit.client.0.smithi072.stdout:4/178: write d7/d23/f29 [1478756,97908] 0 2024-04-15T21:02:36.760 INFO:tasks.workunit.client.0.smithi072.stdout:0/177: rmdir d0/d19 39 2024-04-15T21:02:36.761 INFO:tasks.workunit.client.0.smithi072.stdout:4/179: read - f6 zero size 2024-04-15T21:02:36.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/218: dwrite d1/f17 [0,4194304] 0 2024-04-15T21:02:36.763 INFO:tasks.workunit.client.0.smithi072.stdout:4/180: dread - d7/f2e zero size 2024-04-15T21:02:36.764 INFO:tasks.workunit.client.0.smithi072.stdout:8/232: mknod d3/d4/d3b/c47 0 2024-04-15T21:02:36.764 INFO:tasks.workunit.client.0.smithi072.stdout:4/181: fsync d7/d23/f2a 0 2024-04-15T21:02:36.766 INFO:tasks.workunit.client.0.smithi072.stdout:2/221: symlink d2/d38/l4b 0 2024-04-15T21:02:36.767 INFO:tasks.workunit.client.0.smithi072.stdout:8/233: rename d3/de to d3/de/d21/d48 22 2024-04-15T21:02:36.771 INFO:tasks.workunit.client.0.smithi072.stdout:4/182: truncate d7/d23/f25 1526071 0 2024-04-15T21:02:36.771 INFO:tasks.workunit.client.0.smithi072.stdout:1/175: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:36.773 INFO:tasks.workunit.client.0.smithi072.stdout:3/219: dwrite d1/f10 [0,4194304] 0 2024-04-15T21:02:36.773 INFO:tasks.workunit.client.0.smithi072.stdout:4/183: write f6 [768099,122486] 0 2024-04-15T21:02:36.774 INFO:tasks.workunit.client.0.smithi072.stdout:1/176: dread - d5/db/d27/f34 zero size 2024-04-15T21:02:36.779 INFO:tasks.workunit.client.0.smithi072.stdout:0/178: creat d0/d6/f39 x:0 0 0 2024-04-15T21:02:36.780 INFO:tasks.workunit.client.0.smithi072.stdout:8/234: dwrite d3/d4/d3b/f3d [0,4194304] 0 2024-04-15T21:02:36.784 INFO:tasks.workunit.client.0.smithi072.stdout:9/199: truncate d4/d1f/f24 2572353 0 2024-04-15T21:02:36.785 INFO:tasks.workunit.client.0.smithi072.stdout:6/209: mkdir d2/d42 0 2024-04-15T21:02:36.786 INFO:tasks.workunit.client.0.smithi072.stdout:9/200: chown d4/d1f/l23 0 1 2024-04-15T21:02:36.789 INFO:tasks.workunit.client.0.smithi072.stdout:7/155: dwrite d2/db/f22 [0,4194304] 0 2024-04-15T21:02:36.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/327: mkdir d1/d17/d5e 0 2024-04-15T21:02:36.796 INFO:tasks.workunit.client.0.smithi072.stdout:4/184: mkdir d7/d28/d37 0 2024-04-15T21:02:36.801 INFO:tasks.workunit.client.0.smithi072.stdout:4/185: dwrite d7/d24/f35 [0,4194304] 0 2024-04-15T21:02:36.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/495: rmdir d4/d7/d10/d6b/d21/d2c/d63 39 2024-04-15T21:02:36.804 INFO:tasks.workunit.client.1.smithi149.stdout:2/496: read - d4/d7/d10/d6b/d21/d55/f59 zero size 2024-04-15T21:02:36.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/499: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:36.805 INFO:tasks.workunit.client.0.smithi072.stdout:3/220: rename d1/d7 to d1/d15/d40 0 2024-04-15T21:02:36.806 INFO:tasks.workunit.client.0.smithi072.stdout:3/221: fdatasync d1/d15/d32/d2f/d1a/f37 0 2024-04-15T21:02:36.807 INFO:tasks.workunit.client.1.smithi149.stdout:2/497: chown d4/d7/d10/d6b/d21/d3b/f44 1927195 1 2024-04-15T21:02:36.808 INFO:tasks.workunit.client.1.smithi149.stdout:2/498: dread - d4/d7/d10/d6b/d21/d2c/d58/f96 zero size 2024-04-15T21:02:36.809 INFO:tasks.workunit.client.1.smithi149.stdout:2/499: chown d4/d7/d10/d6b/d21/d6d/db4 50555173 1 2024-04-15T21:02:36.809 INFO:tasks.workunit.client.0.smithi072.stdout:1/177: rmdir d5/db 39 2024-04-15T21:02:36.816 INFO:tasks.workunit.client.1.smithi149.stdout:4/507: link dc/d18/d21/f6b dc/d2c/d3e/d35/d4b/d6c/fa9 0 2024-04-15T21:02:36.818 INFO:tasks.workunit.client.1.smithi149.stdout:4/508: write dc/d2c/d3e/d15/d5b/f6d [232718,15286] 0 2024-04-15T21:02:36.819 INFO:tasks.workunit.client.1.smithi149.stdout:4/509: readlink dc/d2c/d3e/d15/l61 0 2024-04-15T21:02:36.822 INFO:tasks.workunit.client.1.smithi149.stdout:0/610: rename d1/d5/d24/d50/d13/d59/dd7/d9d to d1/d5/dda 0 2024-04-15T21:02:36.825 INFO:tasks.workunit.client.0.smithi072.stdout:6/210: rmdir d2/d1a 39 2024-04-15T21:02:36.826 INFO:tasks.workunit.client.1.smithi149.stdout:5/425: sync 2024-04-15T21:02:36.826 INFO:tasks.workunit.client.1.smithi149.stdout:1/328: symlink d1/d17/l5f 0 2024-04-15T21:02:36.827 INFO:tasks.workunit.client.0.smithi072.stdout:9/201: symlink d4/d1f/l3c 0 2024-04-15T21:02:36.827 INFO:tasks.workunit.client.0.smithi072.stdout:9/202: truncate d4/f7 5989416 0 2024-04-15T21:02:36.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/500: creat d2/df/d10/d25/d37/d53/daf/fbb x:0 0 0 2024-04-15T21:02:36.830 INFO:tasks.workunit.client.0.smithi072.stdout:7/156: mkdir d2/d7/d25/d2d 0 2024-04-15T21:02:36.835 INFO:tasks.workunit.client.0.smithi072.stdout:4/186: unlink d7/d10/c2b 0 2024-04-15T21:02:36.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/187: readlink d7/d15/l18 0 2024-04-15T21:02:36.836 INFO:tasks.workunit.client.1.smithi149.stdout:4/510: mkdir dc/d18/daa 0 2024-04-15T21:02:36.838 INFO:tasks.workunit.client.0.smithi072.stdout:3/222: unlink d1/d15/d40/f18 0 2024-04-15T21:02:36.840 INFO:tasks.workunit.client.0.smithi072.stdout:4/188: dread d7/d23/f25 [0,4194304] 0 2024-04-15T21:02:36.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/441: symlink d3/d16/d20/d36/d3d/d56/l9b 0 2024-04-15T21:02:36.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/189: dread d7/d23/f25 [0,4194304] 0 2024-04-15T21:02:36.842 INFO:tasks.workunit.client.1.smithi149.stdout:7/442: chown d3/d16/d6e/l75 166735185 1 2024-04-15T21:02:36.842 INFO:tasks.workunit.client.0.smithi072.stdout:4/190: fsync d7/d23/f29 0 2024-04-15T21:02:36.843 INFO:tasks.workunit.client.1.smithi149.stdout:5/426: mknod d0/d9/d3f/c96 0 2024-04-15T21:02:36.843 INFO:tasks.workunit.client.0.smithi072.stdout:8/235: write d3/de/f22 [4471130,34739] 0 2024-04-15T21:02:36.850 INFO:tasks.workunit.client.1.smithi149.stdout:5/427: dread d0/d9/db/d12/d16/f54 [0,4194304] 0 2024-04-15T21:02:36.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/443: dwrite d3/d39/f79 [0,4194304] 0 2024-04-15T21:02:36.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/444: getdents d1/db/d24/d2b 0 2024-04-15T21:02:36.858 INFO:tasks.workunit.client.1.smithi149.stdout:7/444: chown d3/d16/d20/d60/c69 117463395 1 2024-04-15T21:02:36.858 INFO:tasks.workunit.client.1.smithi149.stdout:8/501: dwrite d2/d16/f9b [0,4194304] 0 2024-04-15T21:02:36.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/445: chown d1/db/d23/c3d 975 1 2024-04-15T21:02:36.859 INFO:tasks.workunit.client.1.smithi149.stdout:9/385: mkdir d23/d3c/d7a/d7c/d7f 0 2024-04-15T21:02:36.866 INFO:tasks.workunit.client.0.smithi072.stdout:2/222: creat d2/d3/f4c x:0 0 0 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr fail", "who": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:02:36.867 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: osdmap e47: 6 total, 6 up, 6 in 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.14223 172.21.15.72:0/1380365574' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "mgr fail", "who": "smithi072.wfjmmp"}]': finished 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: mgrmap e21: smithi149.qgbaiy(active, starting, since 0.0091166s) 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:02:36.868 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: Manager daemon smithi149.qgbaiy is now available 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/trash_purge_schedule"}]: dispatch 2024-04-15T21:02:36.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:36 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.qgbaiy/trash_purge_schedule"}]: dispatch 2024-04-15T21:02:36.870 INFO:tasks.workunit.client.1.smithi149.stdout:4/511: mkdir dc/d2c/d3e/d35/d4b/d6c/d70/dab 0 2024-04-15T21:02:36.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/329: dread d1/db/f20 [0,4194304] 0 2024-04-15T21:02:36.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/330: readlink d1/db/dc/d38/d39/d43/l2e 0 2024-04-15T21:02:36.870 INFO:tasks.workunit.client.1.smithi149.stdout:0/611: mknod d1/d5/d24/d50/cdb 0 2024-04-15T21:02:36.870 INFO:tasks.workunit.client.1.smithi149.stdout:2/500: truncate d4/d7/d10/d6b/d21/d3b/f7f 4028611 0 2024-04-15T21:02:36.872 INFO:tasks.workunit.client.0.smithi072.stdout:3/223: mknod d1/d15/d32/d2f/d1a/c41 0 2024-04-15T21:02:36.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/428: creat d0/d9/db/d12/d16/d28/d1b/d83/f97 x:0 0 0 2024-04-15T21:02:36.875 INFO:tasks.workunit.client.0.smithi072.stdout:5/210: getdents d0 0 2024-04-15T21:02:36.876 INFO:tasks.workunit.client.1.smithi149.stdout:6/408: sync 2024-04-15T21:02:36.878 INFO:tasks.workunit.client.0.smithi072.stdout:7/157: dwrite d2/fa [4194304,4194304] 0 2024-04-15T21:02:36.880 INFO:tasks.workunit.client.0.smithi072.stdout:3/224: dwrite d1/f2b [0,4194304] 0 2024-04-15T21:02:36.880 INFO:tasks.workunit.client.0.smithi072.stdout:8/236: mknod d3/de/d1b/c49 0 2024-04-15T21:02:36.881 INFO:tasks.workunit.client.0.smithi072.stdout:8/237: dread - d3/de/f20 zero size 2024-04-15T21:02:36.883 INFO:tasks.workunit.client.0.smithi072.stdout:0/179: truncate d0/d3/fe 3065125 0 2024-04-15T21:02:36.884 INFO:tasks.workunit.client.0.smithi072.stdout:0/180: write d0/d6/f20 [814251,119179] 0 2024-04-15T21:02:36.890 INFO:tasks.workunit.client.1.smithi149.stdout:1/331: rename d1/db/dc/c27 to d1/db/dc/d11/d3f/d45/c60 0 2024-04-15T21:02:36.892 INFO:tasks.workunit.client.0.smithi072.stdout:9/203: rename d4/cb to d4/d1f/d31/c3d 0 2024-04-15T21:02:36.893 INFO:tasks.workunit.client.0.smithi072.stdout:9/204: write d4/d1f/d2c/f2d [1607644,11262] 0 2024-04-15T21:02:36.898 INFO:tasks.workunit.client.1.smithi149.stdout:2/501: unlink d4/d7/d10/d36/f49 0 2024-04-15T21:02:36.903 INFO:tasks.workunit.client.1.smithi149.stdout:7/445: fsync d3/d16/d20/d36/d3d/f73 0 2024-04-15T21:02:36.905 INFO:tasks.workunit.client.0.smithi072.stdout:6/211: truncate d2/d10/d18/f26 415561 0 2024-04-15T21:02:36.906 INFO:tasks.workunit.client.0.smithi072.stdout:6/212: write d2/d10/d11/f2e [594465,7928] 0 2024-04-15T21:02:36.906 INFO:tasks.workunit.client.0.smithi072.stdout:1/178: symlink d5/db/l36 0 2024-04-15T21:02:36.907 INFO:tasks.workunit.client.0.smithi072.stdout:1/179: read - d5/db/d10/f2e zero size 2024-04-15T21:02:36.910 INFO:tasks.workunit.client.1.smithi149.stdout:6/409: readlink da/d2e/l30 0 2024-04-15T21:02:36.911 INFO:tasks.workunit.client.1.smithi149.stdout:7/446: dwrite d3/d16/d20/f24 [0,4194304] 0 2024-04-15T21:02:36.915 INFO:tasks.workunit.client.0.smithi072.stdout:7/158: creat d2/d10/f2e x:0 0 0 2024-04-15T21:02:36.915 INFO:tasks.workunit.client.1.smithi149.stdout:7/447: dread d3/f94 [0,4194304] 0 2024-04-15T21:02:36.918 INFO:tasks.workunit.client.0.smithi072.stdout:8/238: fdatasync f1 0 2024-04-15T21:02:36.921 INFO:tasks.workunit.client.1.smithi149.stdout:4/512: truncate dc/fe 635308 0 2024-04-15T21:02:36.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/612: mknod d1/d5/d24/d50/cdc 0 2024-04-15T21:02:36.926 INFO:tasks.workunit.client.1.smithi149.stdout:0/613: chown d1/d5/d24/d30/cd8 683351 1 2024-04-15T21:02:36.927 INFO:tasks.workunit.client.1.smithi149.stdout:3/446: dwrite d1/db/d24/d39/f47 [0,4194304] 0 2024-04-15T21:02:36.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/502: truncate d4/d7/d10/f81 982290 0 2024-04-15T21:02:36.930 INFO:tasks.workunit.client.0.smithi072.stdout:2/223: truncate d2/d3/f1d 100081 0 2024-04-15T21:02:36.932 INFO:tasks.workunit.client.1.smithi149.stdout:8/502: truncate d2/df/d10/d25/d37/f5f 281634 0 2024-04-15T21:02:36.933 INFO:tasks.workunit.client.1.smithi149.stdout:5/429: mkdir d0/d9/db/d12/d16/d28/d98 0 2024-04-15T21:02:36.933 INFO:tasks.workunit.client.1.smithi149.stdout:8/503: fdatasync d2/df/d10/d25/d37/d53/daf/fbb 0 2024-04-15T21:02:36.936 INFO:tasks.workunit.client.0.smithi072.stdout:1/180: dread d5/db/f1a [0,4194304] 0 2024-04-15T21:02:36.936 INFO:tasks.workunit.client.0.smithi072.stdout:5/211: mknod d0/d3/d33/c46 0 2024-04-15T21:02:36.938 INFO:tasks.workunit.client.0.smithi072.stdout:5/212: chown d0/d3/d6/f8 0 1 2024-04-15T21:02:36.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/503: dwrite d4/d7/da/fb3 [0,4194304] 0 2024-04-15T21:02:36.942 INFO:tasks.workunit.client.0.smithi072.stdout:4/191: link f6 d7/f38 0 2024-04-15T21:02:36.942 INFO:tasks.workunit.client.0.smithi072.stdout:6/213: dwrite d2/d1a/f1b [0,4194304] 0 2024-04-15T21:02:36.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/430: dread d0/d9/db/d12/d16/d28/f40 [0,4194304] 0 2024-04-15T21:02:36.943 INFO:tasks.workunit.client.1.smithi149.stdout:2/504: chown d4/d7/d10/d6b/d21/d3b/d90/da7/d6c/l78 452 1 2024-04-15T21:02:36.948 INFO:tasks.workunit.client.0.smithi072.stdout:7/159: write d2/d10/d26/f29 [652940,82432] 0 2024-04-15T21:02:36.949 INFO:tasks.workunit.client.0.smithi072.stdout:6/214: chown d2/d10/f1d 2873 1 2024-04-15T21:02:36.949 INFO:tasks.workunit.client.1.smithi149.stdout:4/513: truncate dc/d18/d21/f4d 1075507 0 2024-04-15T21:02:36.951 INFO:tasks.workunit.client.0.smithi072.stdout:8/239: fdatasync f1 0 2024-04-15T21:02:36.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/213: dwrite d0/d13/f21 [0,4194304] 0 2024-04-15T21:02:36.953 INFO:tasks.workunit.client.0.smithi072.stdout:7/160: write d2/f14 [4877557,74615] 0 2024-04-15T21:02:36.957 INFO:tasks.workunit.client.0.smithi072.stdout:7/161: chown d2/db/f19 23143 1 2024-04-15T21:02:36.958 INFO:tasks.workunit.client.0.smithi072.stdout:4/192: dwrite d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:36.959 INFO:tasks.workunit.client.0.smithi072.stdout:5/214: truncate d0/d3/d6/d14/f1b 521417 0 2024-04-15T21:02:36.961 INFO:tasks.workunit.client.1.smithi149.stdout:6/410: dread da/d11/f1d [0,4194304] 0 2024-04-15T21:02:36.966 INFO:tasks.workunit.client.0.smithi072.stdout:7/162: dwrite d2/d10/f13 [0,4194304] 0 2024-04-15T21:02:36.978 INFO:tasks.workunit.client.1.smithi149.stdout:5/431: unlink d0/d9/db/d12/d16/d28/d1b/f59 0 2024-04-15T21:02:36.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/432: write d0/d9/d3f/f93 [600424,56967] 0 2024-04-15T21:02:36.987 INFO:tasks.workunit.client.1.smithi149.stdout:9/386: link d23/c76 d23/d2b/d37/d6d/c80 0 2024-04-15T21:02:36.995 INFO:tasks.workunit.client.0.smithi072.stdout:6/215: creat d2/d1a/f43 x:0 0 0 2024-04-15T21:02:36.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/411: mkdir da/d49/d55/d82 0 2024-04-15T21:02:37.000 INFO:tasks.workunit.client.0.smithi072.stdout:4/193: write d7/f1c [4304577,78673] 0 2024-04-15T21:02:37.001 INFO:tasks.workunit.client.1.smithi149.stdout:2/505: dread d4/d7/d46/f57 [0,4194304] 0 2024-04-15T21:02:37.001 INFO:tasks.workunit.client.0.smithi072.stdout:4/194: write d7/fc [1916963,16058] 0 2024-04-15T21:02:37.001 INFO:tasks.workunit.client.0.smithi072.stdout:5/215: mknod d0/d3/d6/c47 0 2024-04-15T21:02:37.002 INFO:tasks.workunit.client.0.smithi072.stdout:4/195: readlink d7/l13 0 2024-04-15T21:02:37.003 INFO:tasks.workunit.client.1.smithi149.stdout:8/504: fsync d2/df/d10/d25/d37/f5f 0 2024-04-15T21:02:37.003 INFO:tasks.workunit.client.0.smithi072.stdout:5/216: dread - d0/d3/d7/d12/d1d/f3e zero size 2024-04-15T21:02:37.003 INFO:tasks.workunit.client.0.smithi072.stdout:2/224: symlink d2/l4d 0 2024-04-15T21:02:37.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/433: creat d0/d6/f99 x:0 0 0 2024-04-15T21:02:37.005 INFO:tasks.workunit.client.0.smithi072.stdout:7/163: symlink d2/d10/d26/l2f 0 2024-04-15T21:02:37.006 INFO:tasks.workunit.client.0.smithi072.stdout:7/164: chown d2/d7 6552828 1 2024-04-15T21:02:37.008 INFO:tasks.workunit.client.1.smithi149.stdout:7/448: rename d3/d16/d32/d3f to d3/d16/d20/d9c 0 2024-04-15T21:02:37.009 INFO:tasks.workunit.client.0.smithi072.stdout:3/225: getdents d1/d15/d32/d2f/d1a 0 2024-04-15T21:02:37.010 INFO:tasks.workunit.client.0.smithi072.stdout:5/217: dwrite d0/d3/d7/d1f/f26 [0,4194304] 0 2024-04-15T21:02:37.010 INFO:tasks.workunit.client.0.smithi072.stdout:3/226: chown d1/d15/d32 108 1 2024-04-15T21:02:37.011 INFO:tasks.workunit.client.0.smithi072.stdout:5/218: fdatasync d0/d3/d6/f8 0 2024-04-15T21:02:37.011 INFO:tasks.workunit.client.0.smithi072.stdout:3/227: dread - d1/d15/d32/d2f/f3a zero size 2024-04-15T21:02:37.012 INFO:tasks.workunit.client.1.smithi149.stdout:1/332: link d1/db/d16/l49 d1/db/d14/l61 0 2024-04-15T21:02:37.013 INFO:tasks.workunit.client.0.smithi072.stdout:3/228: stat d1/d15/d32/d2f/l3c 0 2024-04-15T21:02:37.013 INFO:tasks.workunit.client.0.smithi072.stdout:3/229: stat d1/d15/d32/d2f/d1a/c41 0 2024-04-15T21:02:37.013 INFO:tasks.workunit.client.0.smithi072.stdout:0/181: write d0/d3/fe [2458595,22511] 0 2024-04-15T21:02:37.015 INFO:tasks.workunit.client.1.smithi149.stdout:3/447: creat d1/f7f x:0 0 0 2024-04-15T21:02:37.016 INFO:tasks.workunit.client.0.smithi072.stdout:6/216: write d2/fc [5383777,17319] 0 2024-04-15T21:02:37.019 INFO:tasks.workunit.client.0.smithi072.stdout:9/205: getdents d4/d29 0 2024-04-15T21:02:37.021 INFO:tasks.workunit.client.1.smithi149.stdout:6/412: unlink da/d49/d55/f61 0 2024-04-15T21:02:37.023 INFO:tasks.workunit.client.1.smithi149.stdout:2/506: mknod d4/d7/d46/d74/cba 0 2024-04-15T21:02:37.025 INFO:tasks.workunit.client.1.smithi149.stdout:8/505: creat d2/df/d10/d21/d46/fbc x:0 0 0 2024-04-15T21:02:37.029 INFO:tasks.workunit.client.0.smithi072.stdout:2/225: symlink d2/d37/l4e 0 2024-04-15T21:02:37.035 INFO:tasks.workunit.client.1.smithi149.stdout:1/333: rename d1/db/d16/f56 to d1/f62 0 2024-04-15T21:02:37.038 INFO:tasks.workunit.client.1.smithi149.stdout:4/514: truncate dc/d18/d21/d81/fa7 234671 0 2024-04-15T21:02:37.040 INFO:tasks.workunit.client.1.smithi149.stdout:3/448: chown d1/db/d24/f4b 0 1 2024-04-15T21:02:37.041 INFO:tasks.workunit.client.0.smithi072.stdout:8/240: truncate d3/f3c 2704465 0 2024-04-15T21:02:37.042 INFO:tasks.workunit.client.1.smithi149.stdout:3/449: read d1/db/d24/d2b/f2e [2131909,72541] 0 2024-04-15T21:02:37.042 INFO:tasks.workunit.client.0.smithi072.stdout:3/230: mknod d1/d15/d32/d2f/c42 0 2024-04-15T21:02:37.044 INFO:tasks.workunit.client.0.smithi072.stdout:0/182: rmdir d0/d17/d35 39 2024-04-15T21:02:37.045 INFO:tasks.workunit.client.1.smithi149.stdout:2/507: creat d4/d7/d10/d6b/d21/d2c/d3e/fbb x:0 0 0 2024-04-15T21:02:37.046 INFO:tasks.workunit.client.1.smithi149.stdout:3/450: dread d1/db/d24/d39/f47 [0,4194304] 0 2024-04-15T21:02:37.047 INFO:tasks.workunit.client.0.smithi072.stdout:2/226: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:37.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/227: stat d2/f44 0 2024-04-15T21:02:37.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/228: chown d2/d37 1135 1 2024-04-15T21:02:37.049 INFO:tasks.workunit.client.1.smithi149.stdout:9/387: truncate d23/d2b/f4a 595503 0 2024-04-15T21:02:37.050 INFO:tasks.workunit.client.1.smithi149.stdout:5/434: mknod d0/d9/d6c/c9a 0 2024-04-15T21:02:37.051 INFO:tasks.workunit.client.0.smithi072.stdout:9/206: dread d4/d1f/d2c/f2e [0,4194304] 0 2024-04-15T21:02:37.052 INFO:tasks.workunit.client.0.smithi072.stdout:9/207: chown d4/d1f/l26 198156 1 2024-04-15T21:02:37.053 INFO:tasks.workunit.client.0.smithi072.stdout:9/208: truncate d4/f11 3675490 0 2024-04-15T21:02:37.056 INFO:tasks.workunit.client.0.smithi072.stdout:5/219: write d0/d3/d7/d12/f1a [1941987,70112] 0 2024-04-15T21:02:37.057 INFO:tasks.workunit.client.0.smithi072.stdout:5/220: chown d0/d3/d7/d1f/f26 12873 1 2024-04-15T21:02:37.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/413: rename da/d49/l81 to da/d18/d10/d3f/l83 0 2024-04-15T21:02:37.061 INFO:tasks.workunit.client.1.smithi149.stdout:1/334: rmdir d1/db/d16 39 2024-04-15T21:02:37.062 INFO:tasks.workunit.client.1.smithi149.stdout:1/335: fdatasync d1/db/f33 0 2024-04-15T21:02:37.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/231: write d1/d15/d32/d2f/d1a/f1d [661100,18569] 0 2024-04-15T21:02:37.064 INFO:tasks.workunit.client.1.smithi149.stdout:4/515: readlink dc/d2c/d3e/d15/d5b/l6a 0 2024-04-15T21:02:37.065 INFO:tasks.workunit.client.0.smithi072.stdout:0/183: rmdir d0/d3 39 2024-04-15T21:02:37.066 INFO:tasks.workunit.client.0.smithi072.stdout:0/184: read - d0/d6/f31 zero size 2024-04-15T21:02:37.066 INFO:tasks.workunit.client.0.smithi072.stdout:6/217: write d2/d10/d11/d1f/f30 [507641,92313] 0 2024-04-15T21:02:37.068 INFO:tasks.workunit.client.0.smithi072.stdout:6/218: write d2/d10/d18/f39 [1020324,15031] 0 2024-04-15T21:02:37.068 INFO:tasks.workunit.client.0.smithi072.stdout:6/219: chown d2/d10/d11 282 1 2024-04-15T21:02:37.070 INFO:tasks.workunit.client.1.smithi149.stdout:9/388: dread d23/d2b/d44/f5c [0,4194304] 0 2024-04-15T21:02:37.073 INFO:tasks.workunit.client.1.smithi149.stdout:2/508: dread d4/d7/d10/d6b/d21/d2c/d58/f8e [0,4194304] 0 2024-04-15T21:02:37.076 INFO:tasks.workunit.client.0.smithi072.stdout:4/196: link d7/l13 d7/d28/d37/l39 0 2024-04-15T21:02:37.078 INFO:tasks.workunit.client.0.smithi072.stdout:9/209: mknod d4/d29/c3e 0 2024-04-15T21:02:37.079 INFO:tasks.workunit.client.1.smithi149.stdout:7/449: creat d3/d16/d20/d36/d3d/f9d x:0 0 0 2024-04-15T21:02:37.081 INFO:tasks.workunit.client.0.smithi072.stdout:7/165: rename d2/d10/d26/l2f to d2/l30 0 2024-04-15T21:02:37.084 INFO:tasks.workunit.client.0.smithi072.stdout:5/221: truncate d0/d3/f16 1933114 0 2024-04-15T21:02:37.085 INFO:tasks.workunit.client.1.smithi149.stdout:5/435: dread d0/f89 [0,4194304] 0 2024-04-15T21:02:37.085 INFO:tasks.workunit.client.0.smithi072.stdout:5/222: chown d0/d3/d7/d1f/f29 16 1 2024-04-15T21:02:37.086 INFO:tasks.workunit.client.1.smithi149.stdout:1/336: creat d1/db/dc/d38/f63 x:0 0 0 2024-04-15T21:02:37.088 INFO:tasks.workunit.client.1.smithi149.stdout:4/516: truncate dc/d1a/f30 154149 0 2024-04-15T21:02:37.089 INFO:tasks.workunit.client.0.smithi072.stdout:3/232: unlink d1/d26/f29 0 2024-04-15T21:02:37.090 INFO:tasks.workunit.client.0.smithi072.stdout:3/233: chown d1/d15/d32/d2f/f33 193050292 1 2024-04-15T21:02:37.092 INFO:tasks.workunit.client.0.smithi072.stdout:0/185: write d0/d19/f22 [5098406,32672] 0 2024-04-15T21:02:37.096 INFO:tasks.workunit.client.1.smithi149.stdout:6/414: dwrite da/d11/f35 [0,4194304] 0 2024-04-15T21:02:37.096 INFO:tasks.workunit.client.0.smithi072.stdout:2/229: unlink d2/d8/c47 0 2024-04-15T21:02:37.097 INFO:tasks.workunit.client.0.smithi072.stdout:2/230: dread - d2/d38/f48 zero size 2024-04-15T21:02:37.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/389: mknod d23/d3c/d7a/c81 0 2024-04-15T21:02:37.098 INFO:tasks.workunit.client.0.smithi072.stdout:2/231: dread d2/d8/f13 [0,4194304] 0 2024-04-15T21:02:37.099 INFO:tasks.workunit.client.0.smithi072.stdout:4/197: creat d7/d10/f3a x:0 0 0 2024-04-15T21:02:37.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/451: rename d1/l1f to d1/db/d40/l80 0 2024-04-15T21:02:37.102 INFO:tasks.workunit.client.0.smithi072.stdout:9/210: creat d4/d1f/d31/f3f x:0 0 0 2024-04-15T21:02:37.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/166: symlink d2/d7/d25/l31 0 2024-04-15T21:02:37.103 INFO:tasks.workunit.client.1.smithi149.stdout:2/509: fdatasync d4/f5d 0 2024-04-15T21:02:37.105 INFO:tasks.workunit.client.1.smithi149.stdout:8/506: link d2/df/d10/d4e/d51/c6a d2/df/d10/d25/d32/d45/cbd 0 2024-04-15T21:02:37.105 INFO:tasks.workunit.client.1.smithi149.stdout:8/507: chown d2/df/d10/d4e/d9f 370714873 1 2024-04-15T21:02:37.106 INFO:tasks.workunit.client.0.smithi072.stdout:5/223: mknod d0/d13/c48 0 2024-04-15T21:02:37.108 INFO:tasks.workunit.client.0.smithi072.stdout:8/241: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:37.109 INFO:tasks.workunit.client.0.smithi072.stdout:8/242: write d3/de/f25 [4674874,20459] 0 2024-04-15T21:02:37.120 INFO:tasks.workunit.client.1.smithi149.stdout:6/415: dread da/d32/f48 [0,4194304] 0 2024-04-15T21:02:37.122 INFO:tasks.workunit.client.1.smithi149.stdout:6/416: truncate da/d18/d10/d3f/f5c 1484578 0 2024-04-15T21:02:37.125 INFO:tasks.workunit.client.1.smithi149.stdout:9/390: mknod d23/d2b/d37/d6d/c82 0 2024-04-15T21:02:37.130 INFO:tasks.workunit.client.1.smithi149.stdout:7/450: write d3/d39/f88 [1150106,126071] 0 2024-04-15T21:02:37.131 INFO:tasks.workunit.client.1.smithi149.stdout:3/452: truncate d1/db/d24/f4c 1129677 0 2024-04-15T21:02:37.132 INFO:tasks.workunit.client.1.smithi149.stdout:3/453: fdatasync d1/db/d28/f44 0 2024-04-15T21:02:37.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/517: write dc/d18/d21/f6b [236570,120219] 0 2024-04-15T21:02:37.134 INFO:tasks.workunit.client.1.smithi149.stdout:4/518: write dc/d18/f1d [5226492,33599] 0 2024-04-15T21:02:37.139 INFO:tasks.workunit.client.1.smithi149.stdout:8/508: dread - d2/f8d zero size 2024-04-15T21:02:37.140 INFO:tasks.workunit.client.0.smithi072.stdout:7/167: dread d2/f18 [0,4194304] 0 2024-04-15T21:02:37.142 INFO:tasks.workunit.client.0.smithi072.stdout:8/243: rmdir d3/de/d1b 39 2024-04-15T21:02:37.142 INFO:tasks.workunit.client.1.smithi149.stdout:5/436: mkdir d0/d9/db/d12/d16/d28/d9b 0 2024-04-15T21:02:37.145 INFO:tasks.workunit.client.0.smithi072.stdout:0/186: rename d0/d6/d24 to d0/d17/d35/d3a 0 2024-04-15T21:02:37.145 INFO:tasks.workunit.client.1.smithi149.stdout:1/337: mkdir d1/d17/d5e/d64 0 2024-04-15T21:02:37.146 INFO:tasks.workunit.client.0.smithi072.stdout:5/224: dwrite d0/d3/d6/d2d/f28 [0,4194304] 0 2024-04-15T21:02:37.146 INFO:tasks.workunit.client.1.smithi149.stdout:0/614: sync 2024-04-15T21:02:37.147 INFO:tasks.workunit.client.0.smithi072.stdout:8/244: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:37.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/338: chown d1/db/dc/d11/d3f/d45/c4b 39104461 1 2024-04-15T21:02:37.147 INFO:tasks.workunit.client.0.smithi072.stdout:6/220: rmdir d2/d10/d11/d1f/d3f 0 2024-04-15T21:02:37.157 INFO:tasks.workunit.client.0.smithi072.stdout:3/234: creat d1/f43 x:0 0 0 2024-04-15T21:02:37.163 INFO:tasks.workunit.client.0.smithi072.stdout:2/232: dwrite d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:37.163 INFO:tasks.workunit.client.0.smithi072.stdout:0/187: write d0/d3/f33 [423516,55550] 0 2024-04-15T21:02:37.165 INFO:tasks.workunit.client.0.smithi072.stdout:5/225: rmdir d0/d3/d7/d1f 39 2024-04-15T21:02:37.166 INFO:tasks.workunit.client.0.smithi072.stdout:0/188: write d0/d17/d35/d3a/f28 [610553,44275] 0 2024-04-15T21:02:37.168 INFO:tasks.workunit.client.0.smithi072.stdout:0/189: chown d0/d17/d35/f36 2 1 2024-04-15T21:02:37.168 INFO:tasks.workunit.client.1.smithi149.stdout:8/509: chown d2/df/d10/d25/d32/d45/caa 100286 1 2024-04-15T21:02:37.172 INFO:tasks.workunit.client.0.smithi072.stdout:1/181: sync 2024-04-15T21:02:37.173 INFO:tasks.workunit.client.0.smithi072.stdout:5/226: dwrite d0/d3/d7/d12/f1a [0,4194304] 0 2024-04-15T21:02:37.177 INFO:tasks.workunit.client.1.smithi149.stdout:5/437: dread d0/d9/db/d12/d16/d28/f40 [0,4194304] 0 2024-04-15T21:02:37.180 INFO:tasks.workunit.client.0.smithi072.stdout:5/227: dwrite d0/d3/d6/f8 [0,4194304] 0 2024-04-15T21:02:37.180 INFO:tasks.workunit.client.0.smithi072.stdout:5/228: stat d0/c2c 0 2024-04-15T21:02:37.187 INFO:tasks.workunit.client.0.smithi072.stdout:8/245: dwrite d3/f33 [0,4194304] 0 2024-04-15T21:02:37.188 INFO:tasks.workunit.client.1.smithi149.stdout:4/519: dwrite dc/d2c/d3e/d15/d5b/f71 [0,4194304] 0 2024-04-15T21:02:37.190 INFO:tasks.workunit.client.1.smithi149.stdout:0/615: write d1/d29/d2c/d4f/f5f [12196031,28908] 0 2024-04-15T21:02:37.192 INFO:tasks.workunit.client.1.smithi149.stdout:9/391: mkdir d23/d3c/d7a/d7c/d7f/d83 0 2024-04-15T21:02:37.196 INFO:tasks.workunit.client.1.smithi149.stdout:7/451: symlink d3/d39/d92/l9e 0 2024-04-15T21:02:37.198 INFO:tasks.workunit.client.1.smithi149.stdout:3/454: mkdir d1/d81 0 2024-04-15T21:02:37.199 INFO:tasks.workunit.client.1.smithi149.stdout:0/616: truncate d1/d5/dda/fc8 482686 0 2024-04-15T21:02:37.203 INFO:tasks.workunit.client.1.smithi149.stdout:2/510: creat d4/d7/d10/d6b/d21/d2c/fbc x:0 0 0 2024-04-15T21:02:37.206 INFO:tasks.workunit.client.0.smithi072.stdout:4/198: getdents d7/d23 0 2024-04-15T21:02:37.207 INFO:tasks.workunit.client.1.smithi149.stdout:2/511: write d4/d7/d10/d6b/d21/d5e/f51 [2086336,81097] 0 2024-04-15T21:02:37.208 INFO:tasks.workunit.client.0.smithi072.stdout:5/229: mkdir d0/d3/d7/d12/d31/d49 0 2024-04-15T21:02:37.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/211: link d4/d1f/l3c d4/l40 0 2024-04-15T21:02:37.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/392: rename d23/d3c/d52/l6a to d23/d2b/d37/d50/l84 0 2024-04-15T21:02:37.213 INFO:tasks.workunit.client.1.smithi149.stdout:7/452: creat d3/d16/d20/d6c/f9f x:0 0 0 2024-04-15T21:02:37.215 INFO:tasks.workunit.client.0.smithi072.stdout:5/230: dwrite d0/d3/d6/d14/f18 [0,4194304] 0 2024-04-15T21:02:37.216 INFO:tasks.workunit.client.1.smithi149.stdout:3/455: creat d1/db/d24/d4d/f82 x:0 0 0 2024-04-15T21:02:37.216 INFO:tasks.workunit.client.0.smithi072.stdout:5/231: chown d0 1924 1 2024-04-15T21:02:37.217 INFO:tasks.workunit.client.0.smithi072.stdout:9/212: dread d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:37.217 INFO:tasks.workunit.client.0.smithi072.stdout:5/232: write d0/fa [322461,103097] 0 2024-04-15T21:02:37.218 INFO:tasks.workunit.client.1.smithi149.stdout:0/617: symlink d1/d29/d2c/d4f/d95/ldd 0 2024-04-15T21:02:37.220 INFO:tasks.workunit.client.1.smithi149.stdout:8/510: rmdir d2/df/d10/d20/d6b 39 2024-04-15T21:02:37.220 INFO:tasks.workunit.client.1.smithi149.stdout:8/511: chown d2/df/d10/d20 274612 1 2024-04-15T21:02:37.225 INFO:tasks.workunit.client.0.smithi072.stdout:1/182: creat d5/d31/f37 x:0 0 0 2024-04-15T21:02:37.226 INFO:tasks.workunit.client.0.smithi072.stdout:4/199: mknod d7/d24/c3b 0 2024-04-15T21:02:37.227 INFO:tasks.workunit.client.0.smithi072.stdout:5/233: dwrite d0/d3/d6/f8 [4194304,4194304] 0 2024-04-15T21:02:37.227 INFO:tasks.workunit.client.1.smithi149.stdout:6/417: getdents da 0 2024-04-15T21:02:37.228 INFO:tasks.workunit.client.1.smithi149.stdout:8/512: dwrite d2/df/d10/f90 [0,4194304] 0 2024-04-15T21:02:37.230 INFO:tasks.workunit.client.0.smithi072.stdout:6/221: dwrite d2/fe [0,4194304] 0 2024-04-15T21:02:37.231 INFO:tasks.workunit.client.1.smithi149.stdout:2/512: mkdir d4/d7/d10/d6b/d21/d2c/d32/d4a/dbd 0 2024-04-15T21:02:37.233 INFO:tasks.workunit.client.1.smithi149.stdout:8/513: write d2/df/d10/d25/d37/d53/daf/d85/d35/fa8 [227578,102762] 0 2024-04-15T21:02:37.233 INFO:tasks.workunit.client.0.smithi072.stdout:7/168: getdents d2/d7 0 2024-04-15T21:02:37.233 INFO:tasks.workunit.client.0.smithi072.stdout:7/169: dread - d2/d10/d1f/f2b zero size 2024-04-15T21:02:37.234 INFO:tasks.workunit.client.0.smithi072.stdout:7/170: chown d2/d10/f2a 1589 1 2024-04-15T21:02:37.238 INFO:tasks.workunit.client.1.smithi149.stdout:8/514: chown d2/df/d10/d25/d32/d45/f8f 1876275 1 2024-04-15T21:02:37.239 INFO:tasks.workunit.client.0.smithi072.stdout:2/233: creat d2/f4f x:0 0 0 2024-04-15T21:02:37.247 INFO:tasks.workunit.client.1.smithi149.stdout:3/456: unlink d1/db/d40/f5b 0 2024-04-15T21:02:37.253 INFO:tasks.workunit.client.1.smithi149.stdout:1/339: getdents d1 0 2024-04-15T21:02:37.254 INFO:tasks.workunit.client.1.smithi149.stdout:1/340: read - d1/db/dc/d38/d39/d43/f54 zero size 2024-04-15T21:02:37.255 INFO:tasks.workunit.client.1.smithi149.stdout:4/520: creat dc/d2c/d3e/d15/fac x:0 0 0 2024-04-15T21:02:37.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/418: symlink da/d18/d10/d66/l84 0 2024-04-15T21:02:37.257 INFO:tasks.workunit.client.1.smithi149.stdout:6/419: write da/d18/d10/d66/f80 [537417,47690] 0 2024-04-15T21:02:37.258 INFO:tasks.workunit.client.1.smithi149.stdout:9/393: fdatasync d23/d2b/f32 0 2024-04-15T21:02:37.260 INFO:tasks.workunit.client.1.smithi149.stdout:2/513: rename d4/d7/d10/d6b/d21/d3b/d90 to d4/d7/d10/d6b/d21/d5e/dbe 0 2024-04-15T21:02:37.260 INFO:tasks.workunit.client.1.smithi149.stdout:6/420: dread da/d18/d10/d66/f69 [4194304,4194304] 0 2024-04-15T21:02:37.261 INFO:tasks.workunit.client.1.smithi149.stdout:2/514: chown d4/f7a 21 1 2024-04-15T21:02:37.263 INFO:tasks.workunit.client.1.smithi149.stdout:6/421: dread da/d11/f1d [0,4194304] 0 2024-04-15T21:02:37.266 INFO:tasks.workunit.client.1.smithi149.stdout:4/521: creat dc/d8f/d91/fad x:0 0 0 2024-04-15T21:02:37.270 INFO:tasks.workunit.client.1.smithi149.stdout:2/515: readlink d4/d7/d10/d36/l8c 0 2024-04-15T21:02:37.276 INFO:tasks.workunit.client.1.smithi149.stdout:4/522: write fa [2222383,90767] 0 2024-04-15T21:02:37.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/394: mkdir d23/d2b/d70/d75/d85 0 2024-04-15T21:02:37.279 INFO:tasks.workunit.client.1.smithi149.stdout:7/453: getdents d3/d16/d20 0 2024-04-15T21:02:37.280 INFO:tasks.workunit.client.1.smithi149.stdout:7/454: chown d3/d17/f1a 189 1 2024-04-15T21:02:37.283 INFO:tasks.workunit.client.1.smithi149.stdout:8/515: write d2/df/d10/d20/f27 [8087549,75650] 0 2024-04-15T21:02:37.284 INFO:tasks.workunit.client.1.smithi149.stdout:0/618: getdents d1/d5/d24 0 2024-04-15T21:02:37.284 INFO:tasks.workunit.client.1.smithi149.stdout:3/457: write d1/db/d28/f51 [1721750,118775] 0 2024-04-15T21:02:37.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/516: dwrite d4/d7/d10/d6b/d21/d5e/dbe/fab [0,4194304] 0 2024-04-15T21:02:37.296 INFO:tasks.workunit.client.1.smithi149.stdout:0/619: mknod d1/d29/d2c/d4f/cde 0 2024-04-15T21:02:37.298 INFO:tasks.workunit.client.1.smithi149.stdout:1/341: dwrite d1/db/dc/f10 [0,4194304] 0 2024-04-15T21:02:37.300 INFO:tasks.workunit.client.1.smithi149.stdout:7/455: mkdir d3/d16/da0 0 2024-04-15T21:02:37.302 INFO:tasks.workunit.client.1.smithi149.stdout:6/422: truncate da/d2e/f52 362580 0 2024-04-15T21:02:37.302 INFO:tasks.workunit.client.1.smithi149.stdout:6/423: fsync da/d18/d10/d16/f6d 0 2024-04-15T21:02:37.304 INFO:tasks.workunit.client.1.smithi149.stdout:2/517: chown d4/d7/d10/d6b/d21/d2c/f80 6749124 1 2024-04-15T21:02:37.305 INFO:tasks.workunit.client.1.smithi149.stdout:4/523: truncate dc/d2c/d3e/d35/d3a/f40 1820953 0 2024-04-15T21:02:37.307 INFO:tasks.workunit.client.1.smithi149.stdout:3/458: write d1/db/d24/f4b [180104,126932] 0 2024-04-15T21:02:37.310 INFO:tasks.workunit.client.1.smithi149.stdout:6/424: fsync da/d18/f23 0 2024-04-15T21:02:37.313 INFO:tasks.workunit.client.1.smithi149.stdout:9/395: write d23/f24 [5152203,19071] 0 2024-04-15T21:02:37.313 INFO:tasks.workunit.client.1.smithi149.stdout:6/425: truncate da/f1b 4807900 0 2024-04-15T21:02:37.315 INFO:tasks.workunit.client.1.smithi149.stdout:2/518: rename d4/d7/d10/d6b/f92 to d4/d7/d10/d6b/d21/d5e/dbe/da7/fbf 0 2024-04-15T21:02:37.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/396: stat d23/l25 0 2024-04-15T21:02:37.323 INFO:tasks.workunit.client.1.smithi149.stdout:1/342: dwrite d1/d17/f41 [0,4194304] 0 2024-04-15T21:02:37.325 INFO:tasks.workunit.client.1.smithi149.stdout:3/459: creat d1/db/d24/d39/d79/f83 x:0 0 0 2024-04-15T21:02:37.331 INFO:tasks.workunit.client.1.smithi149.stdout:3/460: chown d1/c48 8025 1 2024-04-15T21:02:37.331 INFO:tasks.workunit.client.1.smithi149.stdout:1/343: stat d1/db/d14 0 2024-04-15T21:02:37.336 INFO:tasks.workunit.client.1.smithi149.stdout:6/426: dwrite da/d18/d10/d16/f6d [0,4194304] 0 2024-04-15T21:02:37.336 INFO:tasks.workunit.client.1.smithi149.stdout:0/620: dread d1/d5/d24/d50/d13/d59/f76 [0,4194304] 0 2024-04-15T21:02:37.348 INFO:tasks.workunit.client.1.smithi149.stdout:7/456: dread d3/d16/d20/d9c/f55 [0,4194304] 0 2024-04-15T21:02:37.350 INFO:tasks.workunit.client.1.smithi149.stdout:7/457: dread - d3/d16/d20/d6c/f9f zero size 2024-04-15T21:02:37.374 INFO:tasks.workunit.client.1.smithi149.stdout:2/519: symlink d4/d7/d10/d6b/d21/d2c/d58/lc0 0 2024-04-15T21:02:37.375 INFO:tasks.workunit.client.1.smithi149.stdout:1/344: stat d1/db/d14/l61 0 2024-04-15T21:02:37.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/397: rename d23/d2b/d70/d75/d85 to d23/d3c/d7a/d7c/d7f/d86 0 2024-04-15T21:02:37.379 INFO:tasks.workunit.client.1.smithi149.stdout:6/427: mkdir da/d11/d85 0 2024-04-15T21:02:37.381 INFO:tasks.workunit.client.1.smithi149.stdout:0/621: truncate d1/d5/d24/d50/d13/d59/f8d 4101258 0 2024-04-15T21:02:37.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/622: write d1/d5/fc4 [866441,67515] 0 2024-04-15T21:02:37.382 INFO:tasks.workunit.client.0.smithi072.stdout:0/190: link d0/d19/l27 d0/d19/d2b/l3b 0 2024-04-15T21:02:37.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/623: stat d1/d29/d2c/d4f/f5f 0 2024-04-15T21:02:37.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/524: getdents dc/d2c/d3e/d35 0 2024-04-15T21:02:37.384 INFO:tasks.workunit.client.0.smithi072.stdout:5/234: creat d0/f4a x:0 0 0 2024-04-15T21:02:37.384 INFO:tasks.workunit.client.0.smithi072.stdout:3/235: getdents d1/d15 0 2024-04-15T21:02:37.384 INFO:tasks.workunit.client.0.smithi072.stdout:7/171: creat d2/d10/f32 x:0 0 0 2024-04-15T21:02:37.385 INFO:tasks.workunit.client.0.smithi072.stdout:2/234: unlink d2/d37/f40 0 2024-04-15T21:02:37.386 INFO:tasks.workunit.client.0.smithi072.stdout:9/213: write d4/fc [4739409,85227] 0 2024-04-15T21:02:37.386 INFO:tasks.workunit.client.0.smithi072.stdout:0/191: write d0/f1 [1461838,39734] 0 2024-04-15T21:02:37.387 INFO:tasks.workunit.client.0.smithi072.stdout:3/236: readlink d1/d15/d32/d2f/d1a/l36 0 2024-04-15T21:02:37.389 INFO:tasks.workunit.client.0.smithi072.stdout:1/183: mknod d5/db/d2d/c38 0 2024-04-15T21:02:37.389 INFO:tasks.workunit.client.0.smithi072.stdout:3/237: chown d1/f17 2624 1 2024-04-15T21:02:37.390 INFO:tasks.workunit.client.0.smithi072.stdout:0/192: write d0/d19/d2b/f2e [374450,36098] 0 2024-04-15T21:02:37.393 INFO:tasks.workunit.client.0.smithi072.stdout:0/193: dread - d0/d3/d5/f15 zero size 2024-04-15T21:02:37.394 INFO:tasks.workunit.client.1.smithi149.stdout:6/428: unlink da/d11/f1d 0 2024-04-15T21:02:37.397 INFO:tasks.workunit.client.0.smithi072.stdout:6/222: dread d2/d10/f1d [4194304,4194304] 0 2024-04-15T21:02:37.397 INFO:tasks.workunit.client.0.smithi072.stdout:9/214: dwrite d4/d1f/d2c/f2d [0,4194304] 0 2024-04-15T21:02:37.398 INFO:tasks.workunit.client.1.smithi149.stdout:0/624: mknod d1/d5/d24/d50/d15/cdf 0 2024-04-15T21:02:37.398 INFO:tasks.workunit.client.0.smithi072.stdout:1/184: fdatasync d5/f6 0 2024-04-15T21:02:37.399 INFO:tasks.workunit.client.0.smithi072.stdout:1/185: fdatasync d5/f6 0 2024-04-15T21:02:37.400 INFO:tasks.workunit.client.0.smithi072.stdout:1/186: read - d5/db/d10/f2e zero size 2024-04-15T21:02:37.400 INFO:tasks.workunit.client.1.smithi149.stdout:4/525: symlink dc/d8f/lae 0 2024-04-15T21:02:37.416 INFO:tasks.workunit.client.0.smithi072.stdout:2/235: mknod d2/d38/c50 0 2024-04-15T21:02:37.418 INFO:tasks.workunit.client.1.smithi149.stdout:4/526: stat dc/d2c/d3e/d15/d3f/f8b 0 2024-04-15T21:02:37.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/527: fsync dc/d8f/fa6 0 2024-04-15T21:02:37.420 INFO:tasks.workunit.client.1.smithi149.stdout:4/528: write dc/d18/f62 [3421353,2147] 0 2024-04-15T21:02:37.421 INFO:tasks.workunit.client.1.smithi149.stdout:1/345: link d1/d17/f41 d1/db/f65 0 2024-04-15T21:02:37.423 INFO:tasks.workunit.client.0.smithi072.stdout:9/215: fdatasync d4/d1f/d2c/f2e 0 2024-04-15T21:02:37.424 INFO:tasks.workunit.client.0.smithi072.stdout:0/194: creat d0/d3/d5/f3c x:0 0 0 2024-04-15T21:02:37.425 INFO:tasks.workunit.client.0.smithi072.stdout:9/216: write d4/f1e [1707230,29785] 0 2024-04-15T21:02:37.427 INFO:tasks.workunit.client.1.smithi149.stdout:0/625: symlink d1/d5/d24/d50/le0 0 2024-04-15T21:02:37.429 INFO:tasks.workunit.client.0.smithi072.stdout:1/187: creat d5/db/d10/f39 x:0 0 0 2024-04-15T21:02:37.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/235: stat d0/d3/d23/d24 0 2024-04-15T21:02:37.432 INFO:tasks.workunit.client.0.smithi072.stdout:0/195: dwrite d0/d3/f34 [0,4194304] 0 2024-04-15T21:02:37.432 INFO:tasks.workunit.client.1.smithi149.stdout:6/429: dread da/d18/d10/d3f/f41 [0,4194304] 0 2024-04-15T21:02:37.436 INFO:tasks.workunit.client.0.smithi072.stdout:3/238: link d1/d15/f3e d1/d15/f44 0 2024-04-15T21:02:37.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/626: dwrite d1/d5/d24/fab [0,4194304] 0 2024-04-15T21:02:37.436 INFO:tasks.workunit.client.1.smithi149.stdout:1/346: truncate d1/db/d16/f5c 787330 0 2024-04-15T21:02:37.446 INFO:tasks.workunit.client.0.smithi072.stdout:7/172: creat d2/db/f33 x:0 0 0 2024-04-15T21:02:37.447 INFO:tasks.workunit.client.1.smithi149.stdout:9/398: getdents d23/d3c/d52 0 2024-04-15T21:02:37.447 INFO:tasks.workunit.client.0.smithi072.stdout:7/173: write d2/db/ff [2366854,79894] 0 2024-04-15T21:02:37.450 INFO:tasks.workunit.client.0.smithi072.stdout:2/236: symlink d2/d37/l51 0 2024-04-15T21:02:37.461 INFO:tasks.workunit.client.1.smithi149.stdout:1/347: dwrite d1/d17/d52/f40 [0,4194304] 0 2024-04-15T21:02:37.466 INFO:tasks.workunit.client.0.smithi072.stdout:8/246: sync 2024-04-15T21:02:37.468 INFO:tasks.workunit.client.1.smithi149.stdout:2/520: rmdir d4 39 2024-04-15T21:02:37.469 INFO:tasks.workunit.client.1.smithi149.stdout:4/529: link dc/d2c/d3e/d35/d4b/d75/c9f dc/d18/d21/d81/caf 0 2024-04-15T21:02:37.475 INFO:tasks.workunit.client.1.smithi149.stdout:1/348: write d1/d17/f41 [125924,11353] 0 2024-04-15T21:02:37.478 INFO:tasks.workunit.client.1.smithi149.stdout:7/458: write d3/f78 [1641438,97873] 0 2024-04-15T21:02:37.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/530: mkdir dc/d2c/d3e/d15/d3f/db0 0 2024-04-15T21:02:37.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/349: dwrite d1/db/d16/f5c [0,4194304] 0 2024-04-15T21:02:37.484 INFO:tasks.workunit.client.0.smithi072.stdout:8/247: creat d3/de/d21/f4a x:0 0 0 2024-04-15T21:02:37.484 INFO:tasks.workunit.client.1.smithi149.stdout:4/531: readlink dc/d18/d21/l56 0 2024-04-15T21:02:37.484 INFO:tasks.workunit.client.1.smithi149.stdout:1/350: chown d1/d17/d52/f2a 2 1 2024-04-15T21:02:37.485 INFO:tasks.workunit.client.1.smithi149.stdout:4/532: dread - dc/d2c/fa1 zero size 2024-04-15T21:02:37.486 INFO:tasks.workunit.client.0.smithi072.stdout:8/248: dread d3/de/f22 [0,4194304] 0 2024-04-15T21:02:37.489 INFO:tasks.workunit.client.1.smithi149.stdout:7/459: creat d3/d16/d32/fa1 x:0 0 0 2024-04-15T21:02:37.492 INFO:tasks.workunit.client.0.smithi072.stdout:3/239: symlink d1/l45 0 2024-04-15T21:02:37.493 INFO:tasks.workunit.client.1.smithi149.stdout:4/533: symlink dc/d8f/lb1 0 2024-04-15T21:02:37.494 INFO:tasks.workunit.client.0.smithi072.stdout:3/240: dread d1/d15/f31 [0,4194304] 0 2024-04-15T21:02:37.497 INFO:tasks.workunit.client.1.smithi149.stdout:7/460: rename d3/d17/d1f/f38 to d3/d34/fa2 0 2024-04-15T21:02:37.500 INFO:tasks.workunit.client.0.smithi072.stdout:5/236: link d0/d13/f21 d0/d3/d23/f4b 0 2024-04-15T21:02:37.504 INFO:tasks.workunit.client.0.smithi072.stdout:8/249: symlink d3/de/d1b/d3f/l4b 0 2024-04-15T21:02:37.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/534: creat dc/d2c/d3e/d7c/fb2 x:0 0 0 2024-04-15T21:02:37.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/196: getdents d0 0 2024-04-15T21:02:37.512 INFO:tasks.workunit.client.0.smithi072.stdout:1/188: rename d5/db/d10 to d5/db/d2d/d3a 0 2024-04-15T21:02:37.512 INFO:tasks.workunit.client.1.smithi149.stdout:1/351: link d1/db/dc/d11/d3e/c51 d1/db/d14/c66 0 2024-04-15T21:02:37.513 INFO:tasks.workunit.client.0.smithi072.stdout:1/189: write d5/f32 [930044,85645] 0 2024-04-15T21:02:37.514 INFO:tasks.workunit.client.0.smithi072.stdout:5/237: mkdir d0/d3/d7/d1f/d4c 0 2024-04-15T21:02:37.515 INFO:tasks.workunit.client.1.smithi149.stdout:1/352: write d1/db/dc/d11/d3f/d45/f57 [284815,10901] 0 2024-04-15T21:02:37.518 INFO:tasks.workunit.client.0.smithi072.stdout:7/174: rename d2/d10/f32 to d2/d7/d25/f34 0 2024-04-15T21:02:37.519 INFO:tasks.workunit.client.1.smithi149.stdout:1/353: dread d1/f62 [0,4194304] 0 2024-04-15T21:02:37.523 INFO:tasks.workunit.client.0.smithi072.stdout:7/175: dwrite d2/f16 [0,4194304] 0 2024-04-15T21:02:37.550 INFO:tasks.workunit.client.1.smithi149.stdout:4/535: dread dc/d2c/d3e/d15/d3f/f6e [0,4194304] 0 2024-04-15T21:02:37.551 INFO:tasks.workunit.client.0.smithi072.stdout:3/241: rename d1/l3d to d1/d15/l46 0 2024-04-15T21:02:37.551 INFO:tasks.workunit.client.1.smithi149.stdout:1/354: dwrite d1/db/f2c [0,4194304] 0 2024-04-15T21:02:37.552 INFO:tasks.workunit.client.0.smithi072.stdout:1/190: mknod d5/db/c3b 0 2024-04-15T21:02:37.560 INFO:tasks.workunit.client.1.smithi149.stdout:4/536: mkdir dc/d2c/d3e/d35/d4b/d75/db3 0 2024-04-15T21:02:37.561 INFO:tasks.workunit.client.1.smithi149.stdout:4/537: readlink dc/d2c/d3e/d15/d3f/l8c 0 2024-04-15T21:02:37.562 INFO:tasks.workunit.client.1.smithi149.stdout:6/430: dwrite da/d18/d10/d66/f69 [4194304,4194304] 0 2024-04-15T21:02:37.563 INFO:tasks.workunit.client.0.smithi072.stdout:6/223: truncate d2/d1a/f1b 2731892 0 2024-04-15T21:02:37.563 INFO:tasks.workunit.client.0.smithi072.stdout:6/224: write d2/d10/d11/d1f/f32 [353452,125951] 0 2024-04-15T21:02:37.564 INFO:tasks.workunit.client.1.smithi149.stdout:4/538: chown dc/d2c/d3e/d15/d5b/ca5 10 1 2024-04-15T21:02:37.567 INFO:tasks.workunit.client.0.smithi072.stdout:8/250: rename d3/de/d17 to d3/d4/d4c 0 2024-04-15T21:02:37.567 INFO:tasks.workunit.client.0.smithi072.stdout:5/238: rename d0/d3/d7/d12 to d0/d3/d7/d12/d1d/d4d 22 2024-04-15T21:02:37.567 INFO:tasks.workunit.client.0.smithi072.stdout:8/251: chown d3/de/c35 1277061 1 2024-04-15T21:02:37.568 INFO:tasks.workunit.client.0.smithi072.stdout:5/239: chown d0/d3/d7/d1f/l22 13224436 1 2024-04-15T21:02:37.568 INFO:tasks.workunit.client.0.smithi072.stdout:8/252: stat d3/de/d1b/d3f/c34 0 2024-04-15T21:02:37.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/399: write f1a [6069,50908] 0 2024-04-15T21:02:37.572 INFO:tasks.workunit.client.0.smithi072.stdout:4/200: sync 2024-04-15T21:02:37.573 INFO:tasks.workunit.client.0.smithi072.stdout:4/201: write d7/f2e [311171,30388] 0 2024-04-15T21:02:37.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/627: truncate d1/d29/d2c/d4f/f5f 2953329 0 2024-04-15T21:02:37.576 INFO:tasks.workunit.client.0.smithi072.stdout:7/176: mknod d2/db/c35 0 2024-04-15T21:02:37.576 INFO:tasks.workunit.client.0.smithi072.stdout:1/191: read d5/f14 [658589,50210] 0 2024-04-15T21:02:37.577 INFO:tasks.workunit.client.1.smithi149.stdout:6/431: link da/d18/d10/d66/f80 da/d18/f86 0 2024-04-15T21:02:37.578 INFO:tasks.workunit.client.0.smithi072.stdout:2/237: write d2/d8/fe [4727149,90636] 0 2024-04-15T21:02:37.581 INFO:tasks.workunit.client.0.smithi072.stdout:9/217: truncate d4/f7 5166534 0 2024-04-15T21:02:37.583 INFO:tasks.workunit.client.1.smithi149.stdout:4/539: fsync dc/d18/f1d 0 2024-04-15T21:02:37.583 INFO:tasks.workunit.client.0.smithi072.stdout:6/225: creat d2/d10/d11/d34/f44 x:0 0 0 2024-04-15T21:02:37.584 INFO:tasks.workunit.client.0.smithi072.stdout:9/218: chown c2 819 1 2024-04-15T21:02:37.584 INFO:tasks.workunit.client.0.smithi072.stdout:4/202: dwrite d7/f1c [0,4194304] 0 2024-04-15T21:02:37.585 INFO:tasks.workunit.client.0.smithi072.stdout:5/240: readlink d0/l20 0 2024-04-15T21:02:37.588 INFO:tasks.workunit.client.0.smithi072.stdout:8/253: mkdir d3/d4/d4d 0 2024-04-15T21:02:37.588 INFO:tasks.workunit.client.0.smithi072.stdout:7/177: dread d2/f18 [0,4194304] 0 2024-04-15T21:02:37.588 INFO:tasks.workunit.client.1.smithi149.stdout:7/461: rmdir d3/d16/d32 39 2024-04-15T21:02:37.589 INFO:tasks.workunit.client.1.smithi149.stdout:1/355: write d1/db/d16/f5c [4838109,54026] 0 2024-04-15T21:02:37.590 INFO:tasks.workunit.client.0.smithi072.stdout:3/242: dread d1/d26/f30 [0,4194304] 0 2024-04-15T21:02:37.593 INFO:tasks.workunit.client.0.smithi072.stdout:1/192: dwrite d5/db/fc [0,4194304] 0 2024-04-15T21:02:37.595 INFO:tasks.workunit.client.0.smithi072.stdout:2/238: dwrite d2/d8/f3a [0,4194304] 0 2024-04-15T21:02:37.601 INFO:tasks.workunit.client.0.smithi072.stdout:6/226: rmdir d2/d10/d24 39 2024-04-15T21:02:37.603 INFO:tasks.workunit.client.0.smithi072.stdout:5/241: dwrite d0/d3/d6/d14/f1b [0,4194304] 0 2024-04-15T21:02:37.603 INFO:tasks.workunit.client.1.smithi149.stdout:4/540: rmdir dc/d2c/d3e/d35 39 2024-04-15T21:02:37.605 INFO:tasks.workunit.client.1.smithi149.stdout:4/541: read dc/f8a [1352829,95992] 0 2024-04-15T21:02:37.606 INFO:tasks.workunit.client.0.smithi072.stdout:4/203: fdatasync d7/d23/f25 0 2024-04-15T21:02:37.606 INFO:tasks.workunit.client.0.smithi072.stdout:4/204: chown d7/d24/c21 7 1 2024-04-15T21:02:37.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/542: readlink dc/lf 0 2024-04-15T21:02:37.611 INFO:tasks.workunit.client.1.smithi149.stdout:7/462: dread - d3/d39/f5d zero size 2024-04-15T21:02:37.613 INFO:tasks.workunit.client.0.smithi072.stdout:4/205: dwrite d7/d23/f29 [0,4194304] 0 2024-04-15T21:02:37.614 INFO:tasks.workunit.client.0.smithi072.stdout:4/206: chown d7/d24/c31 31618807 1 2024-04-15T21:02:37.614 INFO:tasks.workunit.client.1.smithi149.stdout:1/356: dread - d1/d17/f3c zero size 2024-04-15T21:02:37.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/357: write d1/d17/f41 [1105581,24051] 0 2024-04-15T21:02:37.617 INFO:tasks.workunit.client.0.smithi072.stdout:0/197: truncate d0/d19/f22 1532552 0 2024-04-15T21:02:37.618 INFO:tasks.workunit.client.0.smithi072.stdout:0/198: fdatasync d0/d3/f33 0 2024-04-15T21:02:37.620 INFO:tasks.workunit.client.0.smithi072.stdout:0/199: truncate d0/d3/fe 3321458 0 2024-04-15T21:02:37.621 INFO:tasks.workunit.client.1.smithi149.stdout:4/543: fsync dc/fa8 0 2024-04-15T21:02:37.625 INFO:tasks.workunit.client.1.smithi149.stdout:7/463: creat d3/d39/fa3 x:0 0 0 2024-04-15T21:02:37.629 INFO:tasks.workunit.client.0.smithi072.stdout:8/254: dread d3/d4/d4c/f2a [0,4194304] 0 2024-04-15T21:02:37.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/438: sync 2024-04-15T21:02:37.636 INFO:tasks.workunit.client.0.smithi072.stdout:8/255: dwrite d3/f1d [0,4194304] 0 2024-04-15T21:02:37.642 INFO:tasks.workunit.client.0.smithi072.stdout:5/242: mknod d0/d3/d7/d12/c4e 0 2024-04-15T21:02:37.643 INFO:tasks.workunit.client.0.smithi072.stdout:5/243: chown d0/d3/d7/d12/d31/l3b 210358 1 2024-04-15T21:02:37.644 INFO:tasks.workunit.client.1.smithi149.stdout:4/544: rename dc/d18/d89 to dc/d2c/d3e/d35/db4 0 2024-04-15T21:02:37.647 INFO:tasks.workunit.client.1.smithi149.stdout:0/628: write d1/d5/d24/d30/d43/f75 [8992,16867] 0 2024-04-15T21:02:37.648 INFO:tasks.workunit.client.1.smithi149.stdout:7/464: mkdir d3/d16/d20/d36/d3d/da4 0 2024-04-15T21:02:37.649 INFO:tasks.workunit.client.1.smithi149.stdout:7/465: write d3/d16/f86 [543246,93664] 0 2024-04-15T21:02:37.649 INFO:tasks.workunit.client.0.smithi072.stdout:4/207: creat d7/d28/f3c x:0 0 0 2024-04-15T21:02:37.650 INFO:tasks.workunit.client.0.smithi072.stdout:5/244: dwrite d0/d3/d6/f2b [4194304,4194304] 0 2024-04-15T21:02:37.651 INFO:tasks.workunit.client.0.smithi072.stdout:4/208: chown d7/d15/f33 1 1 2024-04-15T21:02:37.651 INFO:tasks.workunit.client.0.smithi072.stdout:5/245: readlink d0/l20 0 2024-04-15T21:02:37.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/400: truncate d23/d46/f73 3451551 0 2024-04-15T21:02:37.662 INFO:tasks.workunit.client.1.smithi149.stdout:6/432: truncate da/d18/d33/f6f 691712 0 2024-04-15T21:02:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:37 smithi072 ceph-mon[29079]: [15/Apr/2024:21:02:36] ENGINE Bus STARTING 2024-04-15T21:02:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:37 smithi072 ceph-mon[29079]: Deploying cephadm binary to smithi072 2024-04-15T21:02:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:37 smithi072 ceph-mon[29079]: Deploying cephadm binary to smithi149 2024-04-15T21:02:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:37 smithi072 ceph-mon[29079]: [15/Apr/2024:21:02:37] ENGINE Serving on https://172.21.15.149:7150 2024-04-15T21:02:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:37 smithi072 ceph-mon[29079]: mgrmap e22: smithi149.qgbaiy(active, since 1.00919s) 2024-04-15T21:02:37.663 INFO:tasks.workunit.client.0.smithi072.stdout:7/178: rename d2/db/l24 to d2/d7/d25/d2d/l36 0 2024-04-15T21:02:37.665 INFO:tasks.workunit.client.1.smithi149.stdout:0/629: creat d1/d29/fe1 x:0 0 0 2024-04-15T21:02:37.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/358: getdents d1/db/d16 0 2024-04-15T21:02:37.670 INFO:tasks.workunit.client.1.smithi149.stdout:1/359: chown d1/d17/f1c 1288 1 2024-04-15T21:02:37.671 INFO:tasks.workunit.client.0.smithi072.stdout:1/193: dwrite d5/f14 [0,4194304] 0 2024-04-15T21:02:37.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/630: dwrite d1/d5/d24/d50/d13/d38/d44/f47 [4194304,4194304] 0 2024-04-15T21:02:37.673 INFO:tasks.workunit.client.1.smithi149.stdout:9/401: chown d23/l36 123063333 1 2024-04-15T21:02:37.676 INFO:tasks.workunit.client.0.smithi072.stdout:2/239: unlink d2/f3e 0 2024-04-15T21:02:37.679 INFO:tasks.workunit.client.0.smithi072.stdout:8/256: rmdir d3/de/d21/d2e 39 2024-04-15T21:02:37.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/257: write d3/de/d21/f4a [891038,3620] 0 2024-04-15T21:02:37.684 INFO:tasks.workunit.client.0.smithi072.stdout:6/227: creat d2/d42/f45 x:0 0 0 2024-04-15T21:02:37.687 INFO:tasks.workunit.client.1.smithi149.stdout:6/433: unlink da/f36 0 2024-04-15T21:02:37.692 INFO:tasks.workunit.client.1.smithi149.stdout:7/466: symlink d3/d16/d20/d6c/d91/la5 0 2024-04-15T21:02:37.692 INFO:tasks.workunit.client.1.smithi149.stdout:5/439: write d0/d9/db/f2e [2305831,28444] 0 2024-04-15T21:02:37.693 INFO:tasks.workunit.client.1.smithi149.stdout:5/440: fsync d0/d9/db/f5e 0 2024-04-15T21:02:37.695 INFO:tasks.workunit.client.1.smithi149.stdout:5/441: write d0/d9/db/d12/d16/f8c [638016,34789] 0 2024-04-15T21:02:37.696 INFO:tasks.workunit.client.1.smithi149.stdout:1/360: creat d1/db/dc/d38/d39/d43/f67 x:0 0 0 2024-04-15T21:02:37.697 INFO:tasks.workunit.client.1.smithi149.stdout:1/361: write d1/db/d16/f5c [315503,37071] 0 2024-04-15T21:02:37.698 INFO:tasks.workunit.client.1.smithi149.stdout:1/362: dread - d1/d17/d52/d42/f58 zero size 2024-04-15T21:02:37.700 INFO:tasks.workunit.client.0.smithi072.stdout:5/246: rmdir d0/d3 39 2024-04-15T21:02:37.708 INFO:tasks.workunit.client.1.smithi149.stdout:4/545: truncate dc/d2c/d3e/d35/d3a/f60 738212 0 2024-04-15T21:02:37.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/179: fsync d2/d7/d25/f34 0 2024-04-15T21:02:37.712 INFO:tasks.workunit.client.1.smithi149.stdout:8/516: sync 2024-04-15T21:02:37.716 INFO:tasks.workunit.client.0.smithi072.stdout:2/240: symlink d2/d37/l52 0 2024-04-15T21:02:37.721 INFO:tasks.workunit.client.0.smithi072.stdout:6/228: creat d2/d42/f46 x:0 0 0 2024-04-15T21:02:37.722 INFO:tasks.workunit.client.0.smithi072.stdout:9/219: getdents d4/d1f/d31 0 2024-04-15T21:02:37.726 INFO:tasks.workunit.client.0.smithi072.stdout:0/200: link d0/d3/c21 d0/d17/d35/c3d 0 2024-04-15T21:02:37.728 INFO:tasks.workunit.client.0.smithi072.stdout:3/243: getdents d1/d26 0 2024-04-15T21:02:37.728 INFO:tasks.workunit.client.0.smithi072.stdout:3/244: chown d1/d15/f3b 662 1 2024-04-15T21:02:37.730 INFO:tasks.workunit.client.0.smithi072.stdout:3/245: read d1/f14 [3466354,57201] 0 2024-04-15T21:02:37.734 INFO:tasks.workunit.client.0.smithi072.stdout:4/209: rename d7/ca to d7/d10/c3d 0 2024-04-15T21:02:37.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/258: rename d3 to d3/de/d21/d2e/d4e 22 2024-04-15T21:02:37.734 INFO:tasks.workunit.client.0.smithi072.stdout:4/210: chown d7/d28 2123 1 2024-04-15T21:02:37.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/259: chown d3/de/d1b/d3f/c34 1 1 2024-04-15T21:02:37.736 INFO:tasks.workunit.client.0.smithi072.stdout:2/241: unlink d2/d3/f19 0 2024-04-15T21:02:37.737 INFO:tasks.workunit.client.0.smithi072.stdout:2/242: write d2/d3/f4c [504490,21626] 0 2024-04-15T21:02:37.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/220: read d4/d1f/d2c/f39 [311750,90902] 0 2024-04-15T21:02:37.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/221: fsync d4/f1e 0 2024-04-15T21:02:37.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/222: chown d4/d29 31363 1 2024-04-15T21:02:37.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/223: fdatasync d4/f1e 0 2024-04-15T21:02:37.743 INFO:tasks.workunit.client.1.smithi149.stdout:7/467: creat d3/d16/d20/d6c/fa6 x:0 0 0 2024-04-15T21:02:37.749 INFO:tasks.workunit.client.0.smithi072.stdout:8/260: symlink d3/d4/d3b/l4f 0 2024-04-15T21:02:37.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/363: mknod d1/db/dc/d38/d39/c68 0 2024-04-15T21:02:37.751 INFO:tasks.workunit.client.0.smithi072.stdout:8/261: dread d3/de/f22 [0,4194304] 0 2024-04-15T21:02:37.751 INFO:tasks.workunit.client.0.smithi072.stdout:1/194: creat d5/f3c x:0 0 0 2024-04-15T21:02:37.752 INFO:tasks.workunit.client.0.smithi072.stdout:8/262: chown d3/de/f24 3253745 1 2024-04-15T21:02:37.753 INFO:tasks.workunit.client.1.smithi149.stdout:3/461: sync 2024-04-15T21:02:37.755 INFO:tasks.workunit.client.1.smithi149.stdout:9/402: mkdir d23/d3c/d87 0 2024-04-15T21:02:37.755 INFO:tasks.workunit.client.1.smithi149.stdout:9/403: truncate f1a 1172015 0 2024-04-15T21:02:37.756 INFO:tasks.workunit.client.1.smithi149.stdout:9/404: truncate d23/d3c/f67 1401558 0 2024-04-15T21:02:37.759 INFO:tasks.workunit.client.1.smithi149.stdout:8/517: write d2/df/d10/d25/d32/d45/f8f [1376251,112401] 0 2024-04-15T21:02:37.764 INFO:tasks.workunit.client.1.smithi149.stdout:9/405: dwrite d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:37.764 INFO:tasks.workunit.client.1.smithi149.stdout:6/434: read da/f1b [2401821,119713] 0 2024-04-15T21:02:37.765 INFO:tasks.workunit.client.1.smithi149.stdout:9/406: chown d23/d2b/d37/d6d 269 1 2024-04-15T21:02:37.766 INFO:tasks.workunit.client.1.smithi149.stdout:9/407: read d23/d2b/d44/f5c [2092145,92864] 0 2024-04-15T21:02:37.767 INFO:tasks.workunit.client.1.smithi149.stdout:7/468: unlink d3/d17/d1f/l2e 0 2024-04-15T21:02:37.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/408: truncate d23/d2b/d37/d6d/f7d 105971 0 2024-04-15T21:02:37.768 INFO:tasks.workunit.client.1.smithi149.stdout:9/409: fdatasync d23/d2b/d37/f4b 0 2024-04-15T21:02:37.771 INFO:tasks.workunit.client.1.smithi149.stdout:0/631: rmdir d1/d5/d24/d30/d43/db6 0 2024-04-15T21:02:37.772 INFO:tasks.workunit.client.0.smithi072.stdout:8/263: fsync d3/d4/d3b/f3d 0 2024-04-15T21:02:37.772 INFO:tasks.workunit.client.1.smithi149.stdout:3/462: mkdir d1/db/d40/d56/d84 0 2024-04-15T21:02:37.774 INFO:tasks.workunit.client.0.smithi072.stdout:8/264: chown d3/de/f22 232326390 1 2024-04-15T21:02:37.775 INFO:tasks.workunit.client.0.smithi072.stdout:1/195: write d5/db/f12 [1746142,59826] 0 2024-04-15T21:02:37.776 INFO:tasks.workunit.client.1.smithi149.stdout:5/442: write d0/f89 [4063636,55462] 0 2024-04-15T21:02:37.779 INFO:tasks.workunit.client.0.smithi072.stdout:7/180: dwrite d2/f18 [0,4194304] 0 2024-04-15T21:02:37.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/518: rename d2/df/d10/d21/fb7 to d2/df/d10/d25/d37/d53/daf/db4/fbe 0 2024-04-15T21:02:37.782 INFO:tasks.workunit.client.1.smithi149.stdout:8/519: dread - d2/df/d10/d21/d46/d74/fba zero size 2024-04-15T21:02:37.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/632: write d1/d5/dc/f46 [785717,45161] 0 2024-04-15T21:02:37.800 INFO:tasks.workunit.client.1.smithi149.stdout:1/364: dwrite d1/db/dc/d11/f47 [0,4194304] 0 2024-04-15T21:02:37.803 INFO:tasks.workunit.client.1.smithi149.stdout:2/521: sync 2024-04-15T21:02:37.806 INFO:tasks.workunit.client.1.smithi149.stdout:0/633: dwrite d1/d5/d24/d50/d13/d38/fc2 [0,4194304] 0 2024-04-15T21:02:37.810 INFO:tasks.workunit.client.1.smithi149.stdout:8/520: creat d2/df/d10/d25/fbf x:0 0 0 2024-04-15T21:02:37.812 INFO:tasks.workunit.client.1.smithi149.stdout:6/435: creat da/d18/f87 x:0 0 0 2024-04-15T21:02:37.817 INFO:tasks.workunit.client.1.smithi149.stdout:9/410: mknod d23/d3c/c88 0 2024-04-15T21:02:37.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/463: write d1/db/d24/d2b/f73 [485783,104248] 0 2024-04-15T21:02:37.822 INFO:tasks.workunit.client.1.smithi149.stdout:1/365: unlink d1/d17/f3c 0 2024-04-15T21:02:37.823 INFO:tasks.workunit.client.1.smithi149.stdout:5/443: write d0/d9/f39 [3180564,44126] 0 2024-04-15T21:02:37.825 INFO:tasks.workunit.client.1.smithi149.stdout:8/521: rmdir d2/d16 39 2024-04-15T21:02:37.826 INFO:tasks.workunit.client.1.smithi149.stdout:2/522: dread - d4/d7/d10/d6b/d21/d2c/d32/d4a/f79 zero size 2024-04-15T21:02:37.828 INFO:tasks.workunit.client.1.smithi149.stdout:3/464: fdatasync d1/db/d24/d2b/f73 0 2024-04-15T21:02:37.829 INFO:tasks.workunit.client.1.smithi149.stdout:9/411: symlink d23/d2b/d37/d6d/l89 0 2024-04-15T21:02:37.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/366: unlink d1/db/f32 0 2024-04-15T21:02:37.832 INFO:tasks.workunit.client.1.smithi149.stdout:4/546: dread dc/d2c/d3e/d35/d3a/f60 [0,4194304] 0 2024-04-15T21:02:37.833 INFO:tasks.workunit.client.1.smithi149.stdout:4/547: dread - dc/fa2 zero size 2024-04-15T21:02:37.836 INFO:tasks.workunit.client.1.smithi149.stdout:6/436: unlink da/d18/d10/l5b 0 2024-04-15T21:02:37.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/523: truncate d4/d7/da/f1c 3687847 0 2024-04-15T21:02:37.838 INFO:tasks.workunit.client.1.smithi149.stdout:2/524: write d4/f18 [4221922,43130] 0 2024-04-15T21:02:37.839 INFO:tasks.workunit.client.1.smithi149.stdout:3/465: rmdir d1/db/d24/d39 39 2024-04-15T21:02:37.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/367: mkdir d1/d17/d36/d69 0 2024-04-15T21:02:37.842 INFO:tasks.workunit.client.1.smithi149.stdout:1/368: write d1/db/dc/f55 [674457,115986] 0 2024-04-15T21:02:37.850 INFO:tasks.workunit.client.1.smithi149.stdout:2/525: creat d4/d7/d10/fc1 x:0 0 0 2024-04-15T21:02:37.850 INFO:tasks.workunit.client.1.smithi149.stdout:4/548: dwrite dc/d2c/d3e/d35/d4b/f7d [0,4194304] 0 2024-04-15T21:02:37.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/466: chown d1/db/d24/l77 178180086 1 2024-04-15T21:02:37.852 INFO:tasks.workunit.client.1.smithi149.stdout:1/369: stat d1/c2 0 2024-04-15T21:02:37.854 INFO:tasks.workunit.client.1.smithi149.stdout:2/526: dread d4/d7/d93/f98 [0,4194304] 0 2024-04-15T21:02:37.854 INFO:tasks.workunit.client.1.smithi149.stdout:8/522: dread d2/df/d10/f14 [0,4194304] 0 2024-04-15T21:02:37.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/444: write d0/d6/d79/d95/f7e [767406,68809] 0 2024-04-15T21:02:37.856 INFO:tasks.workunit.client.1.smithi149.stdout:6/437: mknod da/d60/c88 0 2024-04-15T21:02:37.860 INFO:tasks.workunit.client.1.smithi149.stdout:7/469: getdents d3/d16/d20 0 2024-04-15T21:02:37.863 INFO:tasks.workunit.client.0.smithi072.stdout:1/196: fsync d5/f3c 0 2024-04-15T21:02:37.865 INFO:tasks.workunit.client.0.smithi072.stdout:5/247: mknod d0/d3/d7/d12/d31/d49/c4f 0 2024-04-15T21:02:37.865 INFO:tasks.workunit.client.0.smithi072.stdout:9/224: symlink d4/l41 0 2024-04-15T21:02:37.865 INFO:tasks.workunit.client.0.smithi072.stdout:0/201: creat d0/d17/f3e x:0 0 0 2024-04-15T21:02:37.866 INFO:tasks.workunit.client.1.smithi149.stdout:7/470: fdatasync d3/d16/d20/d36/d3d/d56/f5f 0 2024-04-15T21:02:37.866 INFO:tasks.workunit.client.0.smithi072.stdout:3/246: truncate d1/f2e 171485 0 2024-04-15T21:02:37.867 INFO:tasks.workunit.client.0.smithi072.stdout:8/265: rename d3/d4/c12 to d3/d4/d4d/c50 0 2024-04-15T21:02:37.867 INFO:tasks.workunit.client.0.smithi072.stdout:7/181: unlink d2/db/l1a 0 2024-04-15T21:02:37.868 INFO:tasks.workunit.client.1.smithi149.stdout:1/370: dwrite d1/d17/d52/f2a [4194304,4194304] 0 2024-04-15T21:02:37.869 INFO:tasks.workunit.client.1.smithi149.stdout:3/467: dwrite d1/db/d24/f5f [0,4194304] 0 2024-04-15T21:02:37.869 INFO:tasks.workunit.client.1.smithi149.stdout:4/549: creat dc/d2c/d3e/d15/d3f/db0/fb5 x:0 0 0 2024-04-15T21:02:37.872 INFO:tasks.workunit.client.1.smithi149.stdout:8/523: mkdir d2/df/d10/d21/d50/d8e/d9d/dc0 0 2024-04-15T21:02:37.872 INFO:tasks.workunit.client.1.smithi149.stdout:5/445: write d0/d9/db/d12/f64 [503959,73959] 0 2024-04-15T21:02:37.873 INFO:tasks.workunit.client.1.smithi149.stdout:1/371: write d1/db/dc/d11/f47 [3510912,113909] 0 2024-04-15T21:02:37.875 INFO:tasks.workunit.client.0.smithi072.stdout:9/225: rmdir d4/d29 39 2024-04-15T21:02:37.877 INFO:tasks.workunit.client.0.smithi072.stdout:6/229: dwrite d2/d10/d24/f36 [0,4194304] 0 2024-04-15T21:02:37.880 INFO:tasks.workunit.client.0.smithi072.stdout:5/248: dread d0/d3/d7/d1f/f40 [0,4194304] 0 2024-04-15T21:02:37.880 INFO:tasks.workunit.client.0.smithi072.stdout:4/211: getdents d7 0 2024-04-15T21:02:37.880 INFO:tasks.workunit.client.0.smithi072.stdout:0/202: dwrite d0/f29 [0,4194304] 0 2024-04-15T21:02:37.881 INFO:tasks.workunit.client.1.smithi149.stdout:2/527: write d4/d7/d10/d6b/d21/f5f [4108292,125789] 0 2024-04-15T21:02:37.882 INFO:tasks.workunit.client.0.smithi072.stdout:0/203: stat d0/f29 0 2024-04-15T21:02:37.882 INFO:tasks.workunit.client.0.smithi072.stdout:7/182: dread d2/f18 [0,4194304] 0 2024-04-15T21:02:37.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/438: symlink da/d11/d85/l89 0 2024-04-15T21:02:37.889 INFO:tasks.workunit.client.0.smithi072.stdout:0/204: dwrite d0/d17/f3e [0,4194304] 0 2024-04-15T21:02:37.892 INFO:tasks.workunit.client.1.smithi149.stdout:4/550: mknod dc/d2c/d3e/d35/db4/cb6 0 2024-04-15T21:02:37.895 INFO:tasks.workunit.client.1.smithi149.stdout:7/471: dwrite d3/d16/d32/f84 [0,4194304] 0 2024-04-15T21:02:37.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/372: unlink d1/db/d14/c3d 0 2024-04-15T21:02:37.899 INFO:tasks.workunit.client.1.smithi149.stdout:5/446: dwrite d0/d9/db/d12/d16/d28/f81 [0,4194304] 0 2024-04-15T21:02:37.901 INFO:tasks.workunit.client.1.smithi149.stdout:3/468: rmdir d1/db/d24/d39/d79 39 2024-04-15T21:02:37.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/469: dread - d1/db/d24/d4d/f82 zero size 2024-04-15T21:02:37.910 INFO:tasks.workunit.client.1.smithi149.stdout:8/524: mkdir d2/df/d10/d21/dc1 0 2024-04-15T21:02:37.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/470: write d1/db/f21 [76982,13966] 0 2024-04-15T21:02:37.917 INFO:tasks.workunit.client.0.smithi072.stdout:8/266: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:37.918 INFO:tasks.workunit.client.0.smithi072.stdout:8/267: dread - d3/de/f20 zero size 2024-04-15T21:02:37.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/439: unlink da/d18/c65 0 2024-04-15T21:02:37.919 INFO:tasks.workunit.client.0.smithi072.stdout:8/268: write d3/de/f24 [2716186,115101] 0 2024-04-15T21:02:37.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/525: stat d2/df/d10/d21/fad 0 2024-04-15T21:02:37.919 INFO:tasks.workunit.client.1.smithi149.stdout:6/440: chown da/d11/f1a 5927 1 2024-04-15T21:02:37.923 INFO:tasks.workunit.client.0.smithi072.stdout:1/197: mkdir d5/d3d 0 2024-04-15T21:02:37.926 INFO:tasks.workunit.client.0.smithi072.stdout:6/230: unlink d2/f16 0 2024-04-15T21:02:37.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/447: mkdir d0/d9/db/d12/d16/d28/d1b/d9c 0 2024-04-15T21:02:37.932 INFO:tasks.workunit.client.0.smithi072.stdout:4/212: mkdir d7/d24/d3e 0 2024-04-15T21:02:37.938 INFO:tasks.workunit.client.0.smithi072.stdout:7/183: truncate d2/f5 2153777 0 2024-04-15T21:02:37.938 INFO:tasks.workunit.client.0.smithi072.stdout:7/184: dread - d2/d7/d25/f34 zero size 2024-04-15T21:02:37.938 INFO:tasks.workunit.client.0.smithi072.stdout:0/205: symlink d0/d19/d2b/l3f 0 2024-04-15T21:02:37.938 INFO:tasks.workunit.client.0.smithi072.stdout:0/206: chown d0/d6/l1a 139706805 1 2024-04-15T21:02:37.939 INFO:tasks.workunit.client.1.smithi149.stdout:2/528: dwrite d4/d7/d10/d6b/d21/d2c/d32/d4a/f79 [0,4194304] 0 2024-04-15T21:02:37.939 INFO:tasks.workunit.client.0.smithi072.stdout:0/207: write d0/d6/f39 [290780,10130] 0 2024-04-15T21:02:37.941 INFO:tasks.workunit.client.1.smithi149.stdout:8/526: rmdir d2/df/d10/d25 39 2024-04-15T21:02:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:37 smithi149 ceph-mon[36029]: [15/Apr/2024:21:02:36] ENGINE Bus STARTING 2024-04-15T21:02:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:37 smithi149 ceph-mon[36029]: Deploying cephadm binary to smithi072 2024-04-15T21:02:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:37 smithi149 ceph-mon[36029]: Deploying cephadm binary to smithi149 2024-04-15T21:02:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:37 smithi149 ceph-mon[36029]: [15/Apr/2024:21:02:37] ENGINE Serving on https://172.21.15.149:7150 2024-04-15T21:02:37.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:37 smithi149 ceph-mon[36029]: mgrmap e22: smithi149.qgbaiy(active, since 1.00919s) 2024-04-15T21:02:37.946 INFO:tasks.workunit.client.1.smithi149.stdout:1/373: creat d1/d17/d4d/f6a x:0 0 0 2024-04-15T21:02:37.947 INFO:tasks.workunit.client.0.smithi072.stdout:5/249: dread d0/fa [0,4194304] 0 2024-04-15T21:02:37.948 INFO:tasks.workunit.client.1.smithi149.stdout:1/374: chown d1/db/f37 1 1 2024-04-15T21:02:37.948 INFO:tasks.workunit.client.1.smithi149.stdout:1/375: fsync d1/db/dc/f55 0 2024-04-15T21:02:37.949 INFO:tasks.workunit.client.1.smithi149.stdout:5/448: creat d0/d6/d79/f9d x:0 0 0 2024-04-15T21:02:37.951 INFO:tasks.workunit.client.1.smithi149.stdout:5/449: write d0/d6/d79/d95/f62 [1034491,91714] 0 2024-04-15T21:02:37.953 INFO:tasks.workunit.client.0.smithi072.stdout:6/231: fsync d2/d10/d24/f36 0 2024-04-15T21:02:37.953 INFO:tasks.workunit.client.0.smithi072.stdout:6/232: readlink d2/d10/l35 0 2024-04-15T21:02:37.954 INFO:tasks.workunit.client.0.smithi072.stdout:6/233: fsync d2/d1a/f41 0 2024-04-15T21:02:37.955 INFO:tasks.workunit.client.0.smithi072.stdout:6/234: fdatasync d2/d1a/f41 0 2024-04-15T21:02:37.956 INFO:tasks.workunit.client.1.smithi149.stdout:3/471: mkdir d1/db/d40/d56/d84/d85 0 2024-04-15T21:02:37.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/551: truncate dc/d2c/d3e/d35/d4b/f57 1093194 0 2024-04-15T21:02:37.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/527: creat d2/df/d10/d21/d46/d74/fc2 x:0 0 0 2024-04-15T21:02:37.963 INFO:tasks.workunit.client.1.smithi149.stdout:7/472: dread d3/f47 [0,4194304] 0 2024-04-15T21:02:37.964 INFO:tasks.workunit.client.1.smithi149.stdout:8/528: truncate d2/df/d10/d21/d46/d74/fc2 74864 0 2024-04-15T21:02:37.965 INFO:tasks.workunit.client.1.smithi149.stdout:7/473: stat d3/d16/d20/d36/d3d/d56/l67 0 2024-04-15T21:02:37.965 INFO:tasks.workunit.client.1.smithi149.stdout:4/552: dread dc/d18/d21/d81/f8e [0,4194304] 0 2024-04-15T21:02:37.967 INFO:tasks.workunit.client.0.smithi072.stdout:5/250: mkdir d0/d3/d7/d1f/d50 0 2024-04-15T21:02:37.969 INFO:tasks.workunit.client.1.smithi149.stdout:5/450: creat d0/d9/db/d12/d2b/f9e x:0 0 0 2024-04-15T21:02:37.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/472: fdatasync d1/db/d28/f32 0 2024-04-15T21:02:37.973 INFO:tasks.workunit.client.1.smithi149.stdout:5/451: dread d0/d6/d79/d95/f7e [0,4194304] 0 2024-04-15T21:02:37.974 INFO:tasks.workunit.client.1.smithi149.stdout:3/473: write d1/db/d24/d2b/f22 [2637554,97975] 0 2024-04-15T21:02:37.976 INFO:tasks.workunit.client.1.smithi149.stdout:1/376: mkdir d1/db/d14/d6b 0 2024-04-15T21:02:37.977 INFO:tasks.workunit.client.1.smithi149.stdout:1/377: fsync d1/db/dc/d38/f63 0 2024-04-15T21:02:37.977 INFO:tasks.workunit.client.0.smithi072.stdout:4/213: mknod d7/d28/d37/c3f 0 2024-04-15T21:02:37.979 INFO:tasks.workunit.client.0.smithi072.stdout:4/214: write d7/f1c [1135594,78109] 0 2024-04-15T21:02:37.980 INFO:tasks.workunit.client.1.smithi149.stdout:7/474: rmdir d3/d17/d1f 39 2024-04-15T21:02:37.980 INFO:tasks.workunit.client.0.smithi072.stdout:4/215: stat d7/l17 0 2024-04-15T21:02:37.981 INFO:tasks.workunit.client.0.smithi072.stdout:4/216: chown d7/d23/l27 450033103 1 2024-04-15T21:02:37.982 INFO:tasks.workunit.client.0.smithi072.stdout:6/235: dwrite d2/d10/d11/d15/f20 [0,4194304] 0 2024-04-15T21:02:37.982 INFO:tasks.workunit.client.0.smithi072.stdout:0/208: link d0/d17/f26 d0/d19/d2b/f40 0 2024-04-15T21:02:37.985 INFO:tasks.workunit.client.1.smithi149.stdout:4/553: mknod dc/d2c/d3e/d35/d4b/d6c/d70/cb7 0 2024-04-15T21:02:37.987 INFO:tasks.workunit.client.0.smithi072.stdout:3/247: getdents d1 0 2024-04-15T21:02:37.991 INFO:tasks.workunit.client.0.smithi072.stdout:8/269: link d3/f1d d3/de/d21/f51 0 2024-04-15T21:02:37.994 INFO:tasks.workunit.client.1.smithi149.stdout:6/441: getdents da/d18 0 2024-04-15T21:02:37.994 INFO:tasks.workunit.client.0.smithi072.stdout:7/185: truncate d2/f5 2515494 0 2024-04-15T21:02:37.996 INFO:tasks.workunit.client.1.smithi149.stdout:5/452: dread d0/d9/db/d12/d16/d28/d1b/d61/f80 [0,4194304] 0 2024-04-15T21:02:37.996 INFO:tasks.workunit.client.0.smithi072.stdout:4/217: unlink d7/f1c 0 2024-04-15T21:02:37.998 INFO:tasks.workunit.client.0.smithi072.stdout:8/270: dwrite d3/de/d21/f4a [0,4194304] 0 2024-04-15T21:02:37.999 INFO:tasks.workunit.client.0.smithi072.stdout:6/236: mkdir d2/d10/d18/d47 0 2024-04-15T21:02:38.001 INFO:tasks.workunit.client.0.smithi072.stdout:0/209: creat d0/d6/f41 x:0 0 0 2024-04-15T21:02:38.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/474: creat d1/db/d23/d5e/f86 x:0 0 0 2024-04-15T21:02:38.004 INFO:tasks.workunit.client.1.smithi149.stdout:3/475: stat d1/db/d23/d5e/f86 0 2024-04-15T21:02:38.005 INFO:tasks.workunit.client.0.smithi072.stdout:8/271: dwrite f1 [0,4194304] 0 2024-04-15T21:02:38.008 INFO:tasks.workunit.client.1.smithi149.stdout:8/529: dread d2/df/d10/d25/f26 [0,4194304] 0 2024-04-15T21:02:38.008 INFO:tasks.workunit.client.0.smithi072.stdout:6/237: dwrite d2/d10/d11/d1f/f28 [0,4194304] 0 2024-04-15T21:02:38.009 INFO:tasks.workunit.client.1.smithi149.stdout:1/378: mkdir d1/d17/d52/d6c 0 2024-04-15T21:02:38.011 INFO:tasks.workunit.client.0.smithi072.stdout:8/272: dread d3/de/f22 [0,4194304] 0 2024-04-15T21:02:38.011 INFO:tasks.workunit.client.1.smithi149.stdout:1/379: write d1/db/dc/d38/d39/d43/f67 [958953,10121] 0 2024-04-15T21:02:38.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/475: mkdir d3/d16/d32/da7 0 2024-04-15T21:02:38.020 INFO:tasks.workunit.client.0.smithi072.stdout:7/186: rmdir d2/d7 39 2024-04-15T21:02:38.022 INFO:tasks.workunit.client.1.smithi149.stdout:8/530: dwrite d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:38.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/554: rename dc/d2c/d3e/d15/l44 to dc/lb8 0 2024-04-15T21:02:38.027 INFO:tasks.workunit.client.1.smithi149.stdout:4/555: stat dc/d2c/d3e/d15/d3f/l8c 0 2024-04-15T21:02:38.032 INFO:tasks.workunit.client.0.smithi072.stdout:0/210: creat d0/d6/f42 x:0 0 0 2024-04-15T21:02:38.033 INFO:tasks.workunit.client.1.smithi149.stdout:5/453: mkdir d0/d6/d9f 0 2024-04-15T21:02:38.034 INFO:tasks.workunit.client.0.smithi072.stdout:3/248: dwrite d1/fa [0,4194304] 0 2024-04-15T21:02:38.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/442: truncate da/d18/f19 8078379 0 2024-04-15T21:02:38.036 INFO:tasks.workunit.client.1.smithi149.stdout:6/443: read - da/d18/f87 zero size 2024-04-15T21:02:38.036 INFO:tasks.workunit.client.0.smithi072.stdout:6/238: creat d2/d10/d11/d34/f48 x:0 0 0 2024-04-15T21:02:38.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/529: getdents d4/d7/d10/d6b/d21/d6d 0 2024-04-15T21:02:38.038 INFO:tasks.workunit.client.1.smithi149.stdout:3/476: mkdir d1/db/d28/d87 0 2024-04-15T21:02:38.040 INFO:tasks.workunit.client.0.smithi072.stdout:8/273: write d3/f3c [1130450,57587] 0 2024-04-15T21:02:38.042 INFO:tasks.workunit.client.0.smithi072.stdout:4/218: fsync d7/d23/f25 0 2024-04-15T21:02:38.044 INFO:tasks.workunit.client.0.smithi072.stdout:8/274: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:38.045 INFO:tasks.workunit.client.0.smithi072.stdout:8/275: chown d3/d4/c27 449791109 1 2024-04-15T21:02:38.046 INFO:tasks.workunit.client.1.smithi149.stdout:7/476: rename d3/f9 to d3/d16/da0/fa8 0 2024-04-15T21:02:38.048 INFO:tasks.workunit.client.1.smithi149.stdout:4/556: truncate dc/d18/f1d 536757 0 2024-04-15T21:02:38.051 INFO:tasks.workunit.client.0.smithi072.stdout:6/239: mkdir d2/d10/d11/d34/d49 0 2024-04-15T21:02:38.052 INFO:tasks.workunit.client.1.smithi149.stdout:6/444: fdatasync da/f1b 0 2024-04-15T21:02:38.053 INFO:tasks.workunit.client.0.smithi072.stdout:6/240: read - d2/d10/d11/d34/f44 zero size 2024-04-15T21:02:38.055 INFO:tasks.workunit.client.1.smithi149.stdout:7/477: dwrite d3/d34/f4e [0,4194304] 0 2024-04-15T21:02:38.055 INFO:tasks.workunit.client.0.smithi072.stdout:7/187: mknod d2/d7/d25/c37 0 2024-04-15T21:02:38.057 INFO:tasks.workunit.client.0.smithi072.stdout:0/211: dread d0/d3/fa [0,4194304] 0 2024-04-15T21:02:38.058 INFO:tasks.workunit.client.1.smithi149.stdout:8/531: dread d2/df/d10/d20/f27 [8388608,4194304] 0 2024-04-15T21:02:38.060 INFO:tasks.workunit.client.1.smithi149.stdout:4/557: dwrite dc/d2c/d3e/d15/d5b/f6d [0,4194304] 0 2024-04-15T21:02:38.062 INFO:tasks.workunit.client.1.smithi149.stdout:2/530: rename d4/d7/d10/d36/f83 to d4/d7/d10/d6b/d21/fc2 0 2024-04-15T21:02:38.070 INFO:tasks.workunit.client.1.smithi149.stdout:5/454: creat d0/d9/db/d12/d16/d28/d1b/d9c/fa0 x:0 0 0 2024-04-15T21:02:38.073 INFO:tasks.workunit.client.1.smithi149.stdout:5/455: truncate d0/d9/db/d12/d16/d28/d1b/d9c/fa0 394984 0 2024-04-15T21:02:38.076 INFO:tasks.workunit.client.0.smithi072.stdout:7/188: rename d2/db to d2/d10/d1f/d38 0 2024-04-15T21:02:38.077 INFO:tasks.workunit.client.0.smithi072.stdout:7/189: truncate d2/f1c 5896027 0 2024-04-15T21:02:38.078 INFO:tasks.workunit.client.1.smithi149.stdout:3/477: mknod d1/c88 0 2024-04-15T21:02:38.082 INFO:tasks.workunit.client.0.smithi072.stdout:0/212: creat d0/d19/d2b/f43 x:0 0 0 2024-04-15T21:02:38.082 INFO:tasks.workunit.client.0.smithi072.stdout:3/249: write d1/d15/d32/f24 [1017489,3522] 0 2024-04-15T21:02:38.082 INFO:tasks.workunit.client.1.smithi149.stdout:8/532: chown d2/f1f 348168 1 2024-04-15T21:02:38.083 INFO:tasks.workunit.client.0.smithi072.stdout:0/213: write d0/d3/fe [170583,118976] 0 2024-04-15T21:02:38.083 INFO:tasks.workunit.client.0.smithi072.stdout:0/214: dread - d0/f2d zero size 2024-04-15T21:02:38.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/215: read d0/d3/f34 [1155985,13670] 0 2024-04-15T21:02:38.085 INFO:tasks.workunit.client.1.smithi149.stdout:4/558: rename dc/l52 to dc/d2c/d3e/d35/d4b/d6c/d70/lb9 0 2024-04-15T21:02:38.088 INFO:tasks.workunit.client.0.smithi072.stdout:3/250: dwrite d1/d15/d40/f1c [0,4194304] 0 2024-04-15T21:02:38.097 INFO:tasks.workunit.client.1.smithi149.stdout:7/478: mkdir d3/da9 0 2024-04-15T21:02:38.103 INFO:tasks.workunit.client.0.smithi072.stdout:6/241: creat d2/f4a x:0 0 0 2024-04-15T21:02:38.103 INFO:tasks.workunit.client.1.smithi149.stdout:0/634: sync 2024-04-15T21:02:38.104 INFO:tasks.workunit.client.1.smithi149.stdout:2/531: dread d4/f5d [0,4194304] 0 2024-04-15T21:02:38.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/635: write d1/d5/d24/d30/d43/f75 [933105,99728] 0 2024-04-15T21:02:38.105 INFO:tasks.workunit.client.0.smithi072.stdout:4/219: dwrite d7/f38 [0,4194304] 0 2024-04-15T21:02:38.106 INFO:tasks.workunit.client.1.smithi149.stdout:2/532: readlink d4/d7/d10/d6b/d21/d2c/d3e/d9d/la9 0 2024-04-15T21:02:38.110 INFO:tasks.workunit.client.0.smithi072.stdout:8/276: getdents d3/d4/d4c 0 2024-04-15T21:02:38.112 INFO:tasks.workunit.client.0.smithi072.stdout:0/216: write d0/f14 [547745,24564] 0 2024-04-15T21:02:38.115 INFO:tasks.workunit.client.1.smithi149.stdout:6/445: write da/d2e/f52 [493467,94215] 0 2024-04-15T21:02:38.115 INFO:tasks.workunit.client.1.smithi149.stdout:8/533: mknod d2/df/d10/d21/d50/d8e/d9d/dc0/cc3 0 2024-04-15T21:02:38.116 INFO:tasks.workunit.client.0.smithi072.stdout:6/242: rmdir d2/d10/d18 39 2024-04-15T21:02:38.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/534: fsync d2/df/d10/d21/d46/d74/fc2 0 2024-04-15T21:02:38.120 INFO:tasks.workunit.client.0.smithi072.stdout:7/190: rename d2/f18 to d2/d10/d1f/d38/f39 0 2024-04-15T21:02:38.122 INFO:tasks.workunit.client.0.smithi072.stdout:8/277: mknod d3/d4/d3b/c52 0 2024-04-15T21:02:38.127 INFO:tasks.workunit.client.0.smithi072.stdout:4/220: rmdir d7/d10 39 2024-04-15T21:02:38.131 INFO:tasks.workunit.client.0.smithi072.stdout:7/191: mkdir d2/d7/d25/d3a 0 2024-04-15T21:02:38.135 INFO:tasks.workunit.client.1.smithi149.stdout:4/559: dwrite f1 [0,4194304] 0 2024-04-15T21:02:38.135 INFO:tasks.workunit.client.1.smithi149.stdout:3/478: creat d1/db/d24/f89 x:0 0 0 2024-04-15T21:02:38.137 INFO:tasks.workunit.client.1.smithi149.stdout:0/636: dread d1/d9/f19 [0,4194304] 0 2024-04-15T21:02:38.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/412: sync 2024-04-15T21:02:38.138 INFO:tasks.workunit.client.1.smithi149.stdout:1/380: sync 2024-04-15T21:02:38.141 INFO:tasks.workunit.client.1.smithi149.stdout:5/456: getdents d0/d6/d79 0 2024-04-15T21:02:38.142 INFO:tasks.workunit.client.0.smithi072.stdout:8/278: mknod d3/de/c53 0 2024-04-15T21:02:38.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/457: write d0/f56 [1024889,54979] 0 2024-04-15T21:02:38.145 INFO:tasks.workunit.client.0.smithi072.stdout:4/221: creat d7/d28/f40 x:0 0 0 2024-04-15T21:02:38.146 INFO:tasks.workunit.client.1.smithi149.stdout:7/479: dread d3/d17/f31 [0,4194304] 0 2024-04-15T21:02:38.149 INFO:tasks.workunit.client.0.smithi072.stdout:7/192: symlink d2/d10/d1f/d38/l3b 0 2024-04-15T21:02:38.151 INFO:tasks.workunit.client.0.smithi072.stdout:8/279: symlink d3/de/d21/d2e/l54 0 2024-04-15T21:02:38.151 INFO:tasks.workunit.client.0.smithi072.stdout:8/280: fdatasync f1 0 2024-04-15T21:02:38.152 INFO:tasks.workunit.client.1.smithi149.stdout:5/458: fdatasync d0/d9/db/d12/d16/d28/d1b/d83/f97 0 2024-04-15T21:02:38.152 INFO:tasks.workunit.client.0.smithi072.stdout:8/281: write d3/de/f38 [278341,42748] 0 2024-04-15T21:02:38.153 INFO:tasks.workunit.client.1.smithi149.stdout:0/637: dwrite d1/fbe [0,4194304] 0 2024-04-15T21:02:38.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/282: stat d3/de/d1b/d3f/c34 0 2024-04-15T21:02:38.154 INFO:tasks.workunit.client.1.smithi149.stdout:9/413: dwrite d23/f24 [4194304,4194304] 0 2024-04-15T21:02:38.155 INFO:tasks.workunit.client.1.smithi149.stdout:5/459: chown d0/d9/f22 492348194 1 2024-04-15T21:02:38.156 INFO:tasks.workunit.client.1.smithi149.stdout:9/414: write f1d [2686493,38205] 0 2024-04-15T21:02:38.158 INFO:tasks.workunit.client.1.smithi149.stdout:5/460: write d0/d9/db/f7b [5032373,99707] 0 2024-04-15T21:02:38.158 INFO:tasks.workunit.client.0.smithi072.stdout:0/217: link d0/d6/l2f d0/d17/d35/d3a/l44 0 2024-04-15T21:02:38.159 INFO:tasks.workunit.client.1.smithi149.stdout:0/638: truncate d1/d5/d24/d50/d13/d59/fd4 287817 0 2024-04-15T21:02:38.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/461: read d0/f50 [940441,20365] 0 2024-04-15T21:02:38.164 INFO:tasks.workunit.client.1.smithi149.stdout:4/560: rmdir dc/d2c/d3e/d15/d3f 39 2024-04-15T21:02:38.171 INFO:tasks.workunit.client.1.smithi149.stdout:3/479: dread d1/fa [4194304,4194304] 0 2024-04-15T21:02:38.174 INFO:tasks.workunit.client.1.smithi149.stdout:2/533: truncate d4/d7/d10/d6b/d21/d3b/f44 2584525 0 2024-04-15T21:02:38.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/415: dwrite d23/d2b/d37/f4b [0,4194304] 0 2024-04-15T21:02:38.174 INFO:tasks.workunit.client.1.smithi149.stdout:4/561: chown dc/d2c/d3e/d35/d4b/d6c/d70/f8d 16284 1 2024-04-15T21:02:38.177 INFO:tasks.workunit.client.1.smithi149.stdout:3/480: dread - d1/db/d24/d2b/f6b zero size 2024-04-15T21:02:38.181 INFO:tasks.workunit.client.1.smithi149.stdout:9/416: chown d23/d2b/l31 2 1 2024-04-15T21:02:38.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/639: dread d1/d9/d64/d65/f79 [0,4194304] 0 2024-04-15T21:02:38.187 INFO:tasks.workunit.client.0.smithi072.stdout:8/283: rename d3/de/f13 to d3/d4/d3b/f55 0 2024-04-15T21:02:38.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/193: dwrite d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:38.189 INFO:tasks.workunit.client.1.smithi149.stdout:6/446: mkdir da/d49/d70/d8a 0 2024-04-15T21:02:38.189 INFO:tasks.workunit.client.0.smithi072.stdout:7/194: fdatasync d2/d7/d25/f34 0 2024-04-15T21:02:38.190 INFO:tasks.workunit.client.0.smithi072.stdout:7/195: fdatasync d2/f14 0 2024-04-15T21:02:38.191 INFO:tasks.workunit.client.0.smithi072.stdout:7/196: chown d2/d7 20038 1 2024-04-15T21:02:38.192 INFO:tasks.workunit.client.1.smithi149.stdout:3/481: dwrite d1/db/d24/d2b/f6c [0,4194304] 0 2024-04-15T21:02:38.199 INFO:tasks.workunit.client.1.smithi149.stdout:8/535: dwrite d2/f2b [0,4194304] 0 2024-04-15T21:02:38.213 INFO:tasks.workunit.client.0.smithi072.stdout:7/197: creat d2/d10/f3c x:0 0 0 2024-04-15T21:02:38.214 INFO:tasks.workunit.client.0.smithi072.stdout:7/198: write d2/f16 [1694852,103656] 0 2024-04-15T21:02:38.216 INFO:tasks.workunit.client.1.smithi149.stdout:9/417: rename d23/d2b/d37/d50/f56 to d23/d3c/d87/f8a 0 2024-04-15T21:02:38.216 INFO:tasks.workunit.client.1.smithi149.stdout:9/418: chown d23/d2b/d37/d6d/f7b 326 1 2024-04-15T21:02:38.217 INFO:tasks.workunit.client.0.smithi072.stdout:4/222: dwrite d7/fc [0,4194304] 0 2024-04-15T21:02:38.219 INFO:tasks.workunit.client.0.smithi072.stdout:8/284: truncate d3/f1d 2869321 0 2024-04-15T21:02:38.220 INFO:tasks.workunit.client.0.smithi072.stdout:9/226: sync 2024-04-15T21:02:38.220 INFO:tasks.workunit.client.0.smithi072.stdout:2/243: sync 2024-04-15T21:02:38.224 INFO:tasks.workunit.client.0.smithi072.stdout:9/227: truncate f3 5040123 0 2024-04-15T21:02:38.226 INFO:tasks.workunit.client.1.smithi149.stdout:5/462: dwrite d0/d9/db/d12/d16/d28/f40 [0,4194304] 0 2024-04-15T21:02:38.227 INFO:tasks.workunit.client.0.smithi072.stdout:0/218: dwrite d0/d3/d5/f11 [0,4194304] 0 2024-04-15T21:02:38.228 INFO:tasks.workunit.client.0.smithi072.stdout:7/199: rename d2/d10/d1f/f2b to d2/d10/d1f/f3d 0 2024-04-15T21:02:38.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/463: write d0/f3 [4211835,51331] 0 2024-04-15T21:02:38.229 INFO:tasks.workunit.client.0.smithi072.stdout:0/219: chown d0/d6/f20 788688808 1 2024-04-15T21:02:38.229 INFO:tasks.workunit.client.0.smithi072.stdout:7/200: chown d2/d10/d1f/d38/f33 12879670 1 2024-04-15T21:02:38.230 INFO:tasks.workunit.client.1.smithi149.stdout:5/464: fsync d0/d6/d2d/f76 0 2024-04-15T21:02:38.230 INFO:tasks.workunit.client.0.smithi072.stdout:0/220: truncate d0/d3/d5/f15 758823 0 2024-04-15T21:02:38.232 INFO:tasks.workunit.client.0.smithi072.stdout:0/221: readlink d0/l16 0 2024-04-15T21:02:38.234 INFO:tasks.workunit.client.0.smithi072.stdout:0/222: write d0/d3/f33 [1458367,5896] 0 2024-04-15T21:02:38.238 INFO:tasks.workunit.client.0.smithi072.stdout:7/201: dwrite d2/f1c [4194304,4194304] 0 2024-04-15T21:02:38.245 INFO:tasks.workunit.client.0.smithi072.stdout:8/285: dread d3/f30 [0,4194304] 0 2024-04-15T21:02:38.246 INFO:tasks.workunit.client.0.smithi072.stdout:8/286: chown d3/d4/d3b/f3e 1913 1 2024-04-15T21:02:38.248 INFO:tasks.workunit.client.0.smithi072.stdout:8/287: write d3/de/f38 [514042,90868] 0 2024-04-15T21:02:38.250 INFO:tasks.workunit.client.1.smithi149.stdout:4/562: write dc/d2c/d3e/d35/d3a/f40 [723686,129718] 0 2024-04-15T21:02:38.250 INFO:tasks.workunit.client.1.smithi149.stdout:2/534: truncate d4/d7/d10/d6b/d21/d3b/f3f 3525946 0 2024-04-15T21:02:38.256 INFO:tasks.workunit.client.1.smithi149.stdout:1/381: truncate d1/db/d16/f24 8189932 0 2024-04-15T21:02:38.259 INFO:tasks.workunit.client.1.smithi149.stdout:0/640: mkdir d1/d5/d24/d50/de2 0 2024-04-15T21:02:38.260 INFO:tasks.workunit.client.0.smithi072.stdout:4/223: getdents d7/d28 0 2024-04-15T21:02:38.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/482: mkdir d1/db/d24/d8a 0 2024-04-15T21:02:38.263 INFO:tasks.workunit.client.1.smithi149.stdout:3/483: fdatasync d1/db/d24/d39/f61 0 2024-04-15T21:02:38.264 INFO:tasks.workunit.client.0.smithi072.stdout:4/224: chown d7/d24/c3b 1471 1 2024-04-15T21:02:38.264 INFO:tasks.workunit.client.0.smithi072.stdout:0/223: write d0/d17/f26 [1853337,74422] 0 2024-04-15T21:02:38.266 INFO:tasks.workunit.client.0.smithi072.stdout:0/224: write d0/d3/d5/f3c [922254,77168] 0 2024-04-15T21:02:38.266 INFO:tasks.workunit.client.1.smithi149.stdout:5/465: truncate d0/d6/d2d/f4a 33867 0 2024-04-15T21:02:38.267 INFO:tasks.workunit.client.0.smithi072.stdout:0/225: chown d0/d17/d35/c3d 2407855 1 2024-04-15T21:02:38.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/641: dwrite d1/d5/dc/f84 [0,4194304] 0 2024-04-15T21:02:38.272 INFO:tasks.workunit.client.0.smithi072.stdout:0/226: read d0/d3/f1b [781649,72508] 0 2024-04-15T21:02:38.273 INFO:tasks.workunit.client.1.smithi149.stdout:2/535: mkdir d4/d7/d93/dc3 0 2024-04-15T21:02:38.274 INFO:tasks.workunit.client.0.smithi072.stdout:2/244: dread d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:38.277 INFO:tasks.workunit.client.1.smithi149.stdout:2/536: write d4/d7/d10/d6b/d21/d3b/f43 [9216427,72714] 0 2024-04-15T21:02:38.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/419: fsync d23/d3c/d87/f8a 0 2024-04-15T21:02:38.279 INFO:tasks.workunit.client.1.smithi149.stdout:2/537: chown d4/d7/d10/d6b/d21/d2c/d3e 201 1 2024-04-15T21:02:38.286 INFO:tasks.workunit.client.1.smithi149.stdout:4/563: dwrite dc/d2c/f22 [0,4194304] 0 2024-04-15T21:02:38.287 INFO:tasks.workunit.client.1.smithi149.stdout:7/480: rename d3/d16/d20/d36/d3d/c52 to d3/d16/d20/d36/d3d/caa 0 2024-04-15T21:02:38.288 INFO:tasks.workunit.client.0.smithi072.stdout:4/225: getdents d7/d10 0 2024-04-15T21:02:38.289 INFO:tasks.workunit.client.1.smithi149.stdout:3/484: fsync d1/db/d24/d4d/d63/d65/f67 0 2024-04-15T21:02:38.290 INFO:tasks.workunit.client.1.smithi149.stdout:3/485: fsync d1/db/f6e 0 2024-04-15T21:02:38.292 INFO:tasks.workunit.client.0.smithi072.stdout:4/226: mkdir d7/d10/d41 0 2024-04-15T21:02:38.293 INFO:tasks.workunit.client.0.smithi072.stdout:2/245: getdents d2/d8/d41 0 2024-04-15T21:02:38.295 INFO:tasks.workunit.client.0.smithi072.stdout:4/227: readlink d7/l17 0 2024-04-15T21:02:38.298 INFO:tasks.workunit.client.0.smithi072.stdout:7/202: dread d2/f5 [0,4194304] 0 2024-04-15T21:02:38.298 INFO:tasks.workunit.client.0.smithi072.stdout:8/288: dread d3/d4/d3b/f3d [0,4194304] 0 2024-04-15T21:02:38.299 INFO:tasks.workunit.client.0.smithi072.stdout:2/246: mknod d2/c53 0 2024-04-15T21:02:38.299 INFO:tasks.workunit.client.0.smithi072.stdout:4/228: write d7/d15/f20 [3178123,8389] 0 2024-04-15T21:02:38.301 INFO:tasks.workunit.client.0.smithi072.stdout:2/247: write d2/f4f [206386,97057] 0 2024-04-15T21:02:38.302 INFO:tasks.workunit.client.0.smithi072.stdout:8/289: creat d3/d4/f56 x:0 0 0 2024-04-15T21:02:38.303 INFO:tasks.workunit.client.1.smithi149.stdout:0/642: dwrite d1/d5/d24/d30/d43/f62 [4194304,4194304] 0 2024-04-15T21:02:38.303 INFO:tasks.workunit.client.1.smithi149.stdout:2/538: read d4/d7/d10/d6b/d21/d5e/dbe/da7/d6c/f8f [2326367,107257] 0 2024-04-15T21:02:38.304 INFO:tasks.workunit.client.0.smithi072.stdout:7/203: dread d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:38.305 INFO:tasks.workunit.client.1.smithi149.stdout:6/447: rename da/d32/f48 to da/d18/d10/f8b 0 2024-04-15T21:02:38.306 INFO:tasks.workunit.client.1.smithi149.stdout:0/643: fsync d1/d5/d24/d50/d13/d59/dd7/f80 0 2024-04-15T21:02:38.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/448: dread - da/d18/d33/f7e zero size 2024-04-15T21:02:38.308 INFO:tasks.workunit.client.1.smithi149.stdout:4/564: mkdir dc/d2c/d3e/d7c/dba 0 2024-04-15T21:02:38.310 INFO:tasks.workunit.client.0.smithi072.stdout:8/290: rmdir d3/d4/d3b 39 2024-04-15T21:02:38.311 INFO:tasks.workunit.client.0.smithi072.stdout:2/248: dread d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:38.311 INFO:tasks.workunit.client.0.smithi072.stdout:7/204: creat d2/d10/d1f/f3e x:0 0 0 2024-04-15T21:02:38.314 INFO:tasks.workunit.client.1.smithi149.stdout:1/382: truncate d1/db/d16/f5c 4579733 0 2024-04-15T21:02:38.314 INFO:tasks.workunit.client.1.smithi149.stdout:8/536: getdents d2/df/d10/d21/d50 0 2024-04-15T21:02:38.318 INFO:tasks.workunit.client.0.smithi072.stdout:2/249: dwrite d2/d8/f30 [0,4194304] 0 2024-04-15T21:02:38.319 INFO:tasks.workunit.client.0.smithi072.stdout:2/250: chown d2/f4f 1134251 1 2024-04-15T21:02:38.323 INFO:tasks.workunit.client.0.smithi072.stdout:8/291: getdents d3/d4/d4d 0 2024-04-15T21:02:38.324 INFO:tasks.workunit.client.0.smithi072.stdout:5/251: sync 2024-04-15T21:02:38.324 INFO:tasks.workunit.client.0.smithi072.stdout:1/198: sync 2024-04-15T21:02:38.325 INFO:tasks.workunit.client.0.smithi072.stdout:2/251: dwrite d2/d8/f36 [0,4194304] 0 2024-04-15T21:02:38.326 INFO:tasks.workunit.client.0.smithi072.stdout:2/252: chown d2/d38 923492 1 2024-04-15T21:02:38.328 INFO:tasks.workunit.client.0.smithi072.stdout:7/205: rmdir d2/d10 39 2024-04-15T21:02:38.332 INFO:tasks.workunit.client.0.smithi072.stdout:5/252: dwrite d0/d3/d7/d12/d31/f3d [0,4194304] 0 2024-04-15T21:02:38.335 INFO:tasks.workunit.client.1.smithi149.stdout:8/537: creat d2/df/d10/d25/d37/d53/daf/d92/fc4 x:0 0 0 2024-04-15T21:02:38.338 INFO:tasks.workunit.client.1.smithi149.stdout:6/449: dwrite da/f75 [0,4194304] 0 2024-04-15T21:02:38.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/538: write d2/df/d10/d21/d46/fbc [794248,105523] 0 2024-04-15T21:02:38.346 INFO:tasks.workunit.client.1.smithi149.stdout:9/420: truncate d23/d2b/f32 362214 0 2024-04-15T21:02:38.349 INFO:tasks.workunit.client.1.smithi149.stdout:9/421: readlink d23/d3c/d52/l72 0 2024-04-15T21:02:38.349 INFO:tasks.workunit.client.1.smithi149.stdout:6/450: dwrite da/d11/f35 [4194304,4194304] 0 2024-04-15T21:02:38.351 INFO:tasks.workunit.client.1.smithi149.stdout:2/539: creat d4/d7/d10/d6b/db6/fc4 x:0 0 0 2024-04-15T21:02:38.353 INFO:tasks.workunit.client.1.smithi149.stdout:3/486: write d1/db/d23/f2c [1171777,68190] 0 2024-04-15T21:02:38.357 INFO:tasks.workunit.client.0.smithi072.stdout:8/292: dwrite d3/de/f22 [0,4194304] 0 2024-04-15T21:02:38.358 INFO:tasks.workunit.client.1.smithi149.stdout:0/644: truncate d1/d5/d24/d50/d13/d59/f8d 934305 0 2024-04-15T21:02:38.360 INFO:tasks.workunit.client.0.smithi072.stdout:5/253: rename d0/d3/d6/d2d/f45 to d0/d3/d7/d12/f51 0 2024-04-15T21:02:38.361 INFO:tasks.workunit.client.1.smithi149.stdout:4/565: fdatasync dc/d2c/d3e/d15/d3f/f8b 0 2024-04-15T21:02:38.363 INFO:tasks.workunit.client.1.smithi149.stdout:1/383: creat d1/db/d14/d6b/f6d x:0 0 0 2024-04-15T21:02:38.368 INFO:tasks.workunit.client.0.smithi072.stdout:8/293: chown d3/d4/d3b/f3d 0 1 2024-04-15T21:02:38.368 INFO:tasks.workunit.client.0.smithi072.stdout:8/294: stat d3/de/l19 0 2024-04-15T21:02:38.369 INFO:tasks.workunit.client.1.smithi149.stdout:8/539: symlink d2/df/d10/d25/d37/lc5 0 2024-04-15T21:02:38.370 INFO:tasks.workunit.client.0.smithi072.stdout:8/295: truncate d3/d4/f1e 1549841 0 2024-04-15T21:02:38.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/466: getdents d0/d9/db 0 2024-04-15T21:02:38.371 INFO:tasks.workunit.client.0.smithi072.stdout:2/253: creat d2/d38/f54 x:0 0 0 2024-04-15T21:02:38.371 INFO:tasks.workunit.client.0.smithi072.stdout:1/199: dread d5/f9 [4194304,4194304] 0 2024-04-15T21:02:38.372 INFO:tasks.workunit.client.1.smithi149.stdout:9/422: truncate f16 636610 0 2024-04-15T21:02:38.372 INFO:tasks.workunit.client.0.smithi072.stdout:1/200: readlink d5/db/d2d/d3a/l2c 0 2024-04-15T21:02:38.372 INFO:tasks.workunit.client.0.smithi072.stdout:1/201: chown d5/db/d2d/d3a/l1d 895382 1 2024-04-15T21:02:38.373 INFO:tasks.workunit.client.1.smithi149.stdout:5/467: write d0/d6/d2d/f76 [3481700,108280] 0 2024-04-15T21:02:38.373 INFO:tasks.workunit.client.0.smithi072.stdout:7/206: rmdir d2/d7/d25/d3a 0 2024-04-15T21:02:38.373 INFO:tasks.workunit.client.0.smithi072.stdout:1/202: chown d5/db/d2d/d3a/f39 0 1 2024-04-15T21:02:38.375 INFO:tasks.workunit.client.1.smithi149.stdout:2/540: mkdir d4/d7/d10/d6b/d21/d2c/d32/d4a/dc5 0 2024-04-15T21:02:38.376 INFO:tasks.workunit.client.1.smithi149.stdout:2/541: chown d4/d7/d10/d6b/d21/d5e/dbe/da7 6 1 2024-04-15T21:02:38.378 INFO:tasks.workunit.client.0.smithi072.stdout:1/203: creat d5/db/d2d/f3e x:0 0 0 2024-04-15T21:02:38.379 INFO:tasks.workunit.client.0.smithi072.stdout:1/204: write d5/db/d27/f33 [351591,12806] 0 2024-04-15T21:02:38.379 INFO:tasks.workunit.client.1.smithi149.stdout:7/481: getdents d3/d16/d20/d36/d3d 0 2024-04-15T21:02:38.381 INFO:tasks.workunit.client.1.smithi149.stdout:4/566: mknod dc/cbb 0 2024-04-15T21:02:38.382 INFO:tasks.workunit.client.0.smithi072.stdout:1/205: mknod d5/d31/c3f 0 2024-04-15T21:02:38.382 INFO:tasks.workunit.client.0.smithi072.stdout:1/206: stat d5 0 2024-04-15T21:02:38.383 INFO:tasks.workunit.client.1.smithi149.stdout:8/540: rmdir d2/df/d10/d25/d37/d53 39 2024-04-15T21:02:38.385 INFO:tasks.workunit.client.1.smithi149.stdout:9/423: dread - d23/d3c/d87/f8a zero size 2024-04-15T21:02:38.387 INFO:tasks.workunit.client.0.smithi072.stdout:1/207: symlink d5/db/d2d/d3a/d1f/l40 0 2024-04-15T21:02:38.388 INFO:tasks.workunit.client.1.smithi149.stdout:6/451: symlink da/d18/d7d/l8c 0 2024-04-15T21:02:38.391 INFO:tasks.workunit.client.0.smithi072.stdout:1/208: mknod d5/db/d27/c41 0 2024-04-15T21:02:38.393 INFO:tasks.workunit.client.0.smithi072.stdout:1/209: write d5/db/d2d/f3e [987843,107823] 0 2024-04-15T21:02:38.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/482: mkdir d3/d16/d20/dab 0 2024-04-15T21:02:38.394 INFO:tasks.workunit.client.0.smithi072.stdout:5/254: write d0/d3/d7/d12/f1a [4986450,58335] 0 2024-04-15T21:02:38.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/483: fdatasync d3/d17/f19 0 2024-04-15T21:02:38.395 INFO:tasks.workunit.client.1.smithi149.stdout:4/567: truncate dc/d18/f1f 3291116 0 2024-04-15T21:02:38.397 INFO:tasks.workunit.client.0.smithi072.stdout:1/210: symlink d5/db/d2d/d3a/l42 0 2024-04-15T21:02:38.398 INFO:tasks.workunit.client.1.smithi149.stdout:5/468: dread d0/d9/db/f1c [0,4194304] 0 2024-04-15T21:02:38.399 INFO:tasks.workunit.client.1.smithi149.stdout:5/469: stat d0/f89 0 2024-04-15T21:02:38.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/484: truncate d3/d16/d20/d6c/fa6 1008046 0 2024-04-15T21:02:38.401 INFO:tasks.workunit.client.1.smithi149.stdout:5/470: write d0/d9/db/d12/f6e [617324,105880] 0 2024-04-15T21:02:38.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/541: mkdir d2/df/d10/d21/d50/d5d/dc6 0 2024-04-15T21:02:38.402 INFO:tasks.workunit.client.0.smithi072.stdout:7/207: dread d2/d10/d1f/d38/f22 [0,4194304] 0 2024-04-15T21:02:38.404 INFO:tasks.workunit.client.0.smithi072.stdout:5/255: chown d0/l20 0 1 2024-04-15T21:02:38.406 INFO:tasks.workunit.client.0.smithi072.stdout:1/211: mkdir d5/db/d27/d43 0 2024-04-15T21:02:38.406 INFO:tasks.workunit.client.1.smithi149.stdout:4/568: dwrite dc/d1a/f4f [0,4194304] 0 2024-04-15T21:02:38.407 INFO:tasks.workunit.client.1.smithi149.stdout:4/569: chown dc/d2c/d3e/d15/fa0 101 1 2024-04-15T21:02:38.408 INFO:tasks.workunit.client.1.smithi149.stdout:3/487: creat d1/db/d24/f8b x:0 0 0 2024-04-15T21:02:38.409 INFO:tasks.workunit.client.0.smithi072.stdout:7/208: dwrite d2/d10/f3c [0,4194304] 0 2024-04-15T21:02:38.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/452: creat da/d49/f8d x:0 0 0 2024-04-15T21:02:38.410 INFO:tasks.workunit.client.1.smithi149.stdout:1/384: write d1/d17/d52/f34 [667951,130282] 0 2024-04-15T21:02:38.414 INFO:tasks.workunit.client.1.smithi149.stdout:2/542: symlink d4/d7/d10/d6b/d21/d2c/d32/lc6 0 2024-04-15T21:02:38.414 INFO:tasks.workunit.client.0.smithi072.stdout:1/212: write d5/f9 [667521,70814] 0 2024-04-15T21:02:38.415 INFO:tasks.workunit.client.1.smithi149.stdout:3/488: dread d1/db/d24/d2b/f6c [0,4194304] 0 2024-04-15T21:02:38.416 INFO:tasks.workunit.client.0.smithi072.stdout:5/256: rename d0/d3/d6/d2d/f28 to d0/d3/d7/d12/d31/d49/f52 0 2024-04-15T21:02:38.418 INFO:tasks.workunit.client.0.smithi072.stdout:7/209: creat d2/d10/d1f/f3f x:0 0 0 2024-04-15T21:02:38.423 INFO:tasks.workunit.client.1.smithi149.stdout:1/385: dwrite d1/db/f2c [0,4194304] 0 2024-04-15T21:02:38.426 INFO:tasks.workunit.client.1.smithi149.stdout:1/386: write d1/db/dc/f10 [4284404,83551] 0 2024-04-15T21:02:38.432 INFO:tasks.workunit.client.1.smithi149.stdout:2/543: dwrite d4/d7/d10/d6b/d21/d55/f59 [0,4194304] 0 2024-04-15T21:02:38.438 INFO:tasks.workunit.client.0.smithi072.stdout:7/210: creat d2/d10/d26/f40 x:0 0 0 2024-04-15T21:02:38.438 INFO:tasks.workunit.client.0.smithi072.stdout:7/211: chown d2 7 1 2024-04-15T21:02:38.443 INFO:tasks.workunit.client.0.smithi072.stdout:1/213: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:38.444 INFO:tasks.workunit.client.1.smithi149.stdout:5/471: rename d0/d9/db to d0/d6/d82/da1 0 2024-04-15T21:02:38.446 INFO:tasks.workunit.client.0.smithi072.stdout:5/257: mknod d0/d13/c53 0 2024-04-15T21:02:38.449 INFO:tasks.workunit.client.0.smithi072.stdout:7/212: creat d2/d10/d26/f41 x:0 0 0 2024-04-15T21:02:38.450 INFO:tasks.workunit.client.1.smithi149.stdout:8/542: write d2/df/d10/d25/f26 [178624,90468] 0 2024-04-15T21:02:38.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/214: mknod d5/db/d2d/c44 0 2024-04-15T21:02:38.454 INFO:tasks.workunit.client.1.smithi149.stdout:9/424: write d23/d2b/f4a [655665,127253] 0 2024-04-15T21:02:38.455 INFO:tasks.workunit.client.0.smithi072.stdout:7/213: dwrite d2/d10/d1f/d38/ff [0,4194304] 0 2024-04-15T21:02:38.456 INFO:tasks.workunit.client.0.smithi072.stdout:5/258: creat d0/d3/d7/d12/f54 x:0 0 0 2024-04-15T21:02:38.456 INFO:tasks.workunit.client.0.smithi072.stdout:7/214: write d2/d10/f11 [1895653,3417] 0 2024-04-15T21:02:38.458 INFO:tasks.workunit.client.1.smithi149.stdout:6/453: mknod da/d18/d10/d66/c8e 0 2024-04-15T21:02:38.458 INFO:tasks.workunit.client.0.smithi072.stdout:7/215: fdatasync d2/d10/d26/f40 0 2024-04-15T21:02:38.460 INFO:tasks.workunit.client.0.smithi072.stdout:7/216: dread - d2/d10/d1f/f3f zero size 2024-04-15T21:02:38.460 INFO:tasks.workunit.client.0.smithi072.stdout:3/251: sync 2024-04-15T21:02:38.463 INFO:tasks.workunit.client.1.smithi149.stdout:1/387: mknod d1/db/dc/d38/c6e 0 2024-04-15T21:02:38.464 INFO:tasks.workunit.client.0.smithi072.stdout:3/252: creat d1/d26/f47 x:0 0 0 2024-04-15T21:02:38.465 INFO:tasks.workunit.client.1.smithi149.stdout:1/388: chown d1/d17/d52/d42/f58 10289 1 2024-04-15T21:02:38.465 INFO:tasks.workunit.client.0.smithi072.stdout:5/259: dwrite d0/d3/d7/d12/d31/f3d [0,4194304] 0 2024-04-15T21:02:38.466 INFO:tasks.workunit.client.0.smithi072.stdout:1/215: rmdir d5/db/d27/d43 0 2024-04-15T21:02:38.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/216: stat d5/db/l19 0 2024-04-15T21:02:38.468 INFO:tasks.workunit.client.0.smithi072.stdout:1/217: chown d5/db/d2d/f3e 1165755 1 2024-04-15T21:02:38.470 INFO:tasks.workunit.client.0.smithi072.stdout:7/217: rename d2/d10/d1f/d38/f33 to d2/d7/d25/f42 0 2024-04-15T21:02:38.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/472: creat d0/d9/fa2 x:0 0 0 2024-04-15T21:02:38.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/473: chown d0/d6/d82/da1/d12/d16/d28/d1b/d9c 6705726 1 2024-04-15T21:02:38.475 INFO:tasks.workunit.client.0.smithi072.stdout:7/218: dwrite d2/d10/f13 [0,4194304] 0 2024-04-15T21:02:38.477 INFO:tasks.workunit.client.1.smithi149.stdout:4/570: creat dc/d18/daa/fbc x:0 0 0 2024-04-15T21:02:38.481 INFO:tasks.workunit.client.0.smithi072.stdout:5/260: dread d0/d3/f16 [0,4194304] 0 2024-04-15T21:02:38.484 INFO:tasks.workunit.client.0.smithi072.stdout:3/253: mknod d1/d3f/c48 0 2024-04-15T21:02:38.485 INFO:tasks.workunit.client.0.smithi072.stdout:3/254: truncate d1/d15/f44 335158 0 2024-04-15T21:02:38.488 INFO:tasks.workunit.client.0.smithi072.stdout:7/219: mkdir d2/d10/d43 0 2024-04-15T21:02:38.491 INFO:tasks.workunit.client.1.smithi149.stdout:8/543: dwrite d2/df/d10/d25/d57/f80 [0,4194304] 0 2024-04-15T21:02:38.491 INFO:tasks.workunit.client.0.smithi072.stdout:1/218: dread d5/db/f1a [0,4194304] 0 2024-04-15T21:02:38.492 INFO:tasks.workunit.client.0.smithi072.stdout:1/219: write d5/db/fc [1253989,60335] 0 2024-04-15T21:02:38.493 INFO:tasks.workunit.client.0.smithi072.stdout:5/261: rename d0/d13 to d0/d3/d7/d12/d31/d55 0 2024-04-15T21:02:38.494 INFO:tasks.workunit.client.1.smithi149.stdout:8/544: truncate d2/df/d10/d25/fbf 877263 0 2024-04-15T21:02:38.495 INFO:tasks.workunit.client.1.smithi149.stdout:0/645: getdents d1/d5/d24 0 2024-04-15T21:02:38.496 INFO:tasks.workunit.client.1.smithi149.stdout:0/646: chown d1/d5/d24/d30/cd8 930 1 2024-04-15T21:02:38.499 INFO:tasks.workunit.client.0.smithi072.stdout:3/255: creat d1/f49 x:0 0 0 2024-04-15T21:02:38.503 INFO:tasks.workunit.client.0.smithi072.stdout:0/227: sync 2024-04-15T21:02:38.503 INFO:tasks.workunit.client.0.smithi072.stdout:9/228: sync 2024-04-15T21:02:38.503 INFO:tasks.workunit.client.0.smithi072.stdout:6/243: sync 2024-04-15T21:02:38.504 INFO:tasks.workunit.client.1.smithi149.stdout:2/544: mkdir d4/dc7 0 2024-04-15T21:02:38.504 INFO:tasks.workunit.client.1.smithi149.stdout:3/489: creat d1/db/d24/d8a/f8c x:0 0 0 2024-04-15T21:02:38.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/545: write d4/d7/d29/f4f [2530344,119051] 0 2024-04-15T21:02:38.506 INFO:tasks.workunit.client.0.smithi072.stdout:1/220: write d5/fe [8927496,19819] 0 2024-04-15T21:02:38.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/647: dwrite d1/d5/dc/f46 [0,4194304] 0 2024-04-15T21:02:38.507 INFO:tasks.workunit.client.0.smithi072.stdout:1/221: fdatasync d5/db/d2d/d3a/f22 0 2024-04-15T21:02:38.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/228: read d0/d6/ff [2917747,19122] 0 2024-04-15T21:02:38.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/425: unlink d23/d2b/d37/d50/l6c 0 2024-04-15T21:02:38.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/426: rename d23/d2b to d23/d2b/d44/d8b 22 2024-04-15T21:02:38.513 INFO:tasks.workunit.client.0.smithi072.stdout:1/222: dwrite d5/db/d2d/d3a/f39 [0,4194304] 0 2024-04-15T21:02:38.524 INFO:tasks.workunit.client.1.smithi149.stdout:9/427: dwrite d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:38.525 INFO:tasks.workunit.client.1.smithi149.stdout:8/545: mkdir d2/df/d10/d25/d57/dc7 0 2024-04-15T21:02:38.531 INFO:tasks.workunit.client.0.smithi072.stdout:7/220: truncate d2/fa 3379030 0 2024-04-15T21:02:38.532 INFO:tasks.workunit.client.0.smithi072.stdout:7/221: chown d2/d10/d1f/l23 19036 1 2024-04-15T21:02:38.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/490: mknod d1/db/d24/d2b/c8d 0 2024-04-15T21:02:38.534 INFO:tasks.workunit.client.0.smithi072.stdout:5/262: write d0/f35 [3991999,81397] 0 2024-04-15T21:02:38.535 INFO:tasks.workunit.client.1.smithi149.stdout:2/546: dread d4/d7/d93/f98 [0,4194304] 0 2024-04-15T21:02:38.536 INFO:tasks.workunit.client.1.smithi149.stdout:8/546: dwrite d2/df/d10/d21/fa7 [0,4194304] 0 2024-04-15T21:02:38.536 INFO:tasks.workunit.client.1.smithi149.stdout:1/389: dwrite d1/f62 [0,4194304] 0 2024-04-15T21:02:38.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/428: rename d23/d2b/l30 to d23/d2b/d37/d50/d79/l8c 0 2024-04-15T21:02:38.538 INFO:tasks.workunit.client.0.smithi072.stdout:9/229: dread d4/d1f/f24 [0,4194304] 0 2024-04-15T21:02:38.538 INFO:tasks.workunit.client.0.smithi072.stdout:3/256: stat d1/f6 0 2024-04-15T21:02:38.542 INFO:tasks.workunit.client.0.smithi072.stdout:7/222: creat d2/d7/d25/d2d/f44 x:0 0 0 2024-04-15T21:02:38.543 INFO:tasks.workunit.client.0.smithi072.stdout:7/223: fsync d2/d10/d1f/d38/ff 0 2024-04-15T21:02:38.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/390: read d1/d17/d52/f2a [1316585,85840] 0 2024-04-15T21:02:38.545 INFO:tasks.workunit.client.0.smithi072.stdout:7/224: write d2/d10/f11 [238924,28397] 0 2024-04-15T21:02:38.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/547: creat d4/d7/da/fc8 x:0 0 0 2024-04-15T21:02:38.549 INFO:tasks.workunit.client.0.smithi072.stdout:5/263: creat d0/d3/d7/d12/d31/d55/f56 x:0 0 0 2024-04-15T21:02:38.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/429: mkdir d23/d2b/d37/d50/d79/d8d 0 2024-04-15T21:02:38.556 INFO:tasks.workunit.client.0.smithi072.stdout:9/230: mkdir d4/d1f/d31/d42 0 2024-04-15T21:02:38.556 INFO:tasks.workunit.client.0.smithi072.stdout:5/264: truncate d0/d3/d7/d1f/f40 4837325 0 2024-04-15T21:02:38.556 INFO:tasks.workunit.client.0.smithi072.stdout:5/265: dread - d0/d3/d7/d12/d1d/f3e zero size 2024-04-15T21:02:38.556 INFO:tasks.workunit.client.0.smithi072.stdout:5/266: truncate d0/d3/d7/d12/d31/f3d 4327573 0 2024-04-15T21:02:38.558 INFO:tasks.workunit.client.1.smithi149.stdout:6/454: link da/d11/l3d da/d18/d10/l8f 0 2024-04-15T21:02:38.562 INFO:tasks.workunit.client.1.smithi149.stdout:9/430: mknod d23/d3c/d7a/d7c/c8e 0 2024-04-15T21:02:38.563 INFO:tasks.workunit.client.0.smithi072.stdout:2/254: sync 2024-04-15T21:02:38.563 INFO:tasks.workunit.client.0.smithi072.stdout:8/296: sync 2024-04-15T21:02:38.563 INFO:tasks.workunit.client.0.smithi072.stdout:4/229: sync 2024-04-15T21:02:38.564 INFO:tasks.workunit.client.1.smithi149.stdout:9/431: chown d23/d2b/f41 6 1 2024-04-15T21:02:38.564 INFO:tasks.workunit.client.1.smithi149.stdout:8/547: creat d2/df/d10/d25/d37/d53/daf/d92/fc8 x:0 0 0 2024-04-15T21:02:38.566 INFO:tasks.workunit.client.0.smithi072.stdout:9/231: write f3 [4477079,117099] 0 2024-04-15T21:02:38.567 INFO:tasks.workunit.client.0.smithi072.stdout:0/229: getdents d0/d17 0 2024-04-15T21:02:38.567 INFO:tasks.workunit.client.0.smithi072.stdout:1/223: dwrite d5/db/f1a [0,4194304] 0 2024-04-15T21:02:38.568 INFO:tasks.workunit.client.0.smithi072.stdout:9/232: dread - d4/d1f/d31/f3f zero size 2024-04-15T21:02:38.570 INFO:tasks.workunit.client.0.smithi072.stdout:1/224: write d5/fe [9424451,110025] 0 2024-04-15T21:02:38.572 INFO:tasks.workunit.client.1.smithi149.stdout:2/548: link d4/d7/d10/d36/f62 d4/d7/d10/d6b/d21/d5e/fc9 0 2024-04-15T21:02:38.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/549: write d4/d7/d10/d6b/d21/d55/f9e [37487,10453] 0 2024-04-15T21:02:38.581 INFO:tasks.workunit.client.0.smithi072.stdout:3/257: creat d1/d15/d32/f4a x:0 0 0 2024-04-15T21:02:38.582 INFO:tasks.workunit.client.0.smithi072.stdout:6/244: dwrite d2/d10/d18/f26 [0,4194304] 0 2024-04-15T21:02:38.583 INFO:tasks.workunit.client.0.smithi072.stdout:4/230: rmdir d7/d24 39 2024-04-15T21:02:38.584 INFO:tasks.workunit.client.0.smithi072.stdout:6/245: write d2/d10/d11/d34/f38 [4984603,128359] 0 2024-04-15T21:02:38.586 INFO:tasks.workunit.client.1.smithi149.stdout:2/550: dwrite d4/d7/d93/fad [8388608,4194304] 0 2024-04-15T21:02:38.592 INFO:tasks.workunit.client.0.smithi072.stdout:2/255: mknod d2/d8/d41/c55 0 2024-04-15T21:02:38.594 INFO:tasks.workunit.client.0.smithi072.stdout:6/246: dwrite d2/d42/f45 [0,4194304] 0 2024-04-15T21:02:38.594 INFO:tasks.workunit.client.1.smithi149.stdout:1/391: write d1/db/d16/f24 [7217119,12949] 0 2024-04-15T21:02:38.597 INFO:tasks.workunit.client.1.smithi149.stdout:6/455: dread da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:38.599 INFO:tasks.workunit.client.1.smithi149.stdout:6/456: chown c4 3655 1 2024-04-15T21:02:38.601 INFO:tasks.workunit.client.0.smithi072.stdout:0/230: rename d0/d17 to d0/d45 0 2024-04-15T21:02:38.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/432: write d23/d46/f49 [2049041,19068] 0 2024-04-15T21:02:38.608 INFO:tasks.workunit.client.1.smithi149.stdout:8/548: getdents d2/df/d10/d21/d46/d74 0 2024-04-15T21:02:38.608 INFO:tasks.workunit.client.0.smithi072.stdout:1/225: mknod d5/db/d2d/d3a/c45 0 2024-04-15T21:02:38.609 INFO:tasks.workunit.client.0.smithi072.stdout:0/231: dwrite d0/f29 [0,4194304] 0 2024-04-15T21:02:38.609 INFO:tasks.workunit.client.1.smithi149.stdout:8/549: fdatasync d2/df/d10/d25/d32/d45/f8f 0 2024-04-15T21:02:38.609 INFO:tasks.workunit.client.1.smithi149.stdout:9/433: dread d23/d2b/d44/f5c [0,4194304] 0 2024-04-15T21:02:38.610 INFO:tasks.workunit.client.0.smithi072.stdout:0/232: readlink d0/d19/l27 0 2024-04-15T21:02:38.611 INFO:tasks.workunit.client.0.smithi072.stdout:0/233: write d0/d45/f3e [4062346,9171] 0 2024-04-15T21:02:38.617 INFO:tasks.workunit.client.0.smithi072.stdout:1/226: read d5/f8 [3979825,1422] 0 2024-04-15T21:02:38.617 INFO:tasks.workunit.client.0.smithi072.stdout:4/231: dread d7/d15/f20 [0,4194304] 0 2024-04-15T21:02:38.618 INFO:tasks.workunit.client.1.smithi149.stdout:9/434: mknod d23/d2b/d37/d50/d79/c8f 0 2024-04-15T21:02:38.625 INFO:tasks.workunit.client.0.smithi072.stdout:5/267: link d0/d3/d6/f8 d0/d3/d7/f57 0 2024-04-15T21:02:38.629 INFO:tasks.workunit.client.1.smithi149.stdout:9/435: dread d23/d2b/d44/f5c [0,4194304] 0 2024-04-15T21:02:38.629 INFO:tasks.workunit.client.1.smithi149.stdout:8/550: mknod d2/d16/cc9 0 2024-04-15T21:02:38.631 INFO:tasks.workunit.client.0.smithi072.stdout:9/233: getdents d4/d1f/d31/d42 0 2024-04-15T21:02:38.632 INFO:tasks.workunit.client.1.smithi149.stdout:6/457: truncate da/d18/d10/d16/f3c 2789290 0 2024-04-15T21:02:38.634 INFO:tasks.workunit.client.1.smithi149.stdout:9/436: read f1a [226887,71598] 0 2024-04-15T21:02:38.634 INFO:tasks.workunit.client.1.smithi149.stdout:8/551: dread d2/df/d10/d25/d37/fae [0,4194304] 0 2024-04-15T21:02:38.636 INFO:tasks.workunit.client.1.smithi149.stdout:1/392: dwrite d1/db/dc/d38/d39/d43/fd [0,4194304] 0 2024-04-15T21:02:38.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/458: mkdir da/d11/d90 0 2024-04-15T21:02:38.641 INFO:tasks.workunit.client.0.smithi072.stdout:0/234: truncate d0/d6/ff 549953 0 2024-04-15T21:02:38.642 INFO:tasks.workunit.client.0.smithi072.stdout:0/235: chown d0/d3/d5/c38 622461 1 2024-04-15T21:02:38.643 INFO:tasks.workunit.client.1.smithi149.stdout:8/552: symlink d2/df/d10/d21/d50/d5d/d6d/lca 0 2024-04-15T21:02:38.644 INFO:tasks.workunit.client.0.smithi072.stdout:3/258: mknod d1/d15/d40/c4b 0 2024-04-15T21:02:38.646 INFO:tasks.workunit.client.1.smithi149.stdout:9/437: truncate d23/d3c/d87/f8a 796808 0 2024-04-15T21:02:38.648 INFO:tasks.workunit.client.0.smithi072.stdout:4/232: fdatasync d7/f1b 0 2024-04-15T21:02:38.648 INFO:tasks.workunit.client.1.smithi149.stdout:1/393: mkdir d1/d17/d36/d6f 0 2024-04-15T21:02:38.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/459: rename da/d60/c6b to da/d49/c91 0 2024-04-15T21:02:38.651 INFO:tasks.workunit.client.1.smithi149.stdout:6/460: chown da/d49/f8d 470 1 2024-04-15T21:02:38.652 INFO:tasks.workunit.client.1.smithi149.stdout:8/553: creat d2/df/d10/d25/d37/d53/daf/d85/fcb x:0 0 0 2024-04-15T21:02:38.653 INFO:tasks.workunit.client.0.smithi072.stdout:1/227: symlink d5/db/d2d/d3a/d1f/l46 0 2024-04-15T21:02:38.656 INFO:tasks.workunit.client.0.smithi072.stdout:7/225: link d2/d10/d1f/d38/c1d d2/c45 0 2024-04-15T21:02:38.657 INFO:tasks.workunit.client.1.smithi149.stdout:8/554: creat d2/df/d10/d4e/d9f/fcc x:0 0 0 2024-04-15T21:02:38.658 INFO:tasks.workunit.client.0.smithi072.stdout:7/226: chown d2/d10/d1f/d38/c1d 1280040 1 2024-04-15T21:02:38.659 INFO:tasks.workunit.client.0.smithi072.stdout:0/236: creat d0/d6/f46 x:0 0 0 2024-04-15T21:02:38.659 INFO:tasks.workunit.client.1.smithi149.stdout:1/394: mkdir d1/d17/d36/d6f/d70 0 2024-04-15T21:02:38.660 INFO:tasks.workunit.client.0.smithi072.stdout:7/227: read d2/d10/f13 [246009,63904] 0 2024-04-15T21:02:38.660 INFO:tasks.workunit.client.0.smithi072.stdout:1/228: dwrite d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:38.664 INFO:tasks.workunit.client.0.smithi072.stdout:4/233: write d7/d15/f20 [4517157,41751] 0 2024-04-15T21:02:38.664 INFO:tasks.workunit.client.1.smithi149.stdout:1/395: creat d1/d17/d36/f71 x:0 0 0 2024-04-15T21:02:38.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/396: write d1/db/f65 [1318278,84413] 0 2024-04-15T21:02:38.666 INFO:tasks.workunit.client.0.smithi072.stdout:8/297: getdents d3/d4 0 2024-04-15T21:02:38.667 INFO:tasks.workunit.client.1.smithi149.stdout:1/397: write d1/db/dc/f10 [175121,12725] 0 2024-04-15T21:02:38.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/398: stat d1/db/dc/d38/f63 0 2024-04-15T21:02:38.670 INFO:tasks.workunit.client.1.smithi149.stdout:1/399: read - d1/db/dc/d38/d39/d43/f54 zero size 2024-04-15T21:02:38.670 INFO:tasks.workunit.client.0.smithi072.stdout:6/247: creat d2/d10/d11/f4b x:0 0 0 2024-04-15T21:02:38.671 INFO:tasks.workunit.client.1.smithi149.stdout:1/400: write d1/f5 [9150165,303] 0 2024-04-15T21:02:38.674 INFO:tasks.workunit.client.0.smithi072.stdout:2/256: rename d2/d8/f2f to d2/d38/f56 0 2024-04-15T21:02:38.676 INFO:tasks.workunit.client.1.smithi149.stdout:9/438: write d23/d3c/f6b [2229344,58304] 0 2024-04-15T21:02:38.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/268: unlink d0/c2c 0 2024-04-15T21:02:38.679 INFO:tasks.workunit.client.1.smithi149.stdout:9/439: stat d23/d3c/d7a/d7c/c8e 0 2024-04-15T21:02:38.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/401: dwrite d1/f5 [8388608,4194304] 0 2024-04-15T21:02:38.682 INFO:tasks.workunit.client.0.smithi072.stdout:9/234: unlink d4/c16 0 2024-04-15T21:02:38.682 INFO:tasks.workunit.client.1.smithi149.stdout:1/402: write d1/db/dc/d11/d3f/d45/f57 [545948,25857] 0 2024-04-15T21:02:38.692 INFO:tasks.workunit.client.1.smithi149.stdout:6/461: truncate da/d18/d10/d16/f3c 1242276 0 2024-04-15T21:02:38.694 INFO:tasks.workunit.client.1.smithi149.stdout:8/555: truncate d2/df/d10/d25/d37/d53/daf/d85/d35/fa8 83943 0 2024-04-15T21:02:38.696 INFO:tasks.workunit.client.1.smithi149.stdout:9/440: unlink d23/d2b/f4f 0 2024-04-15T21:02:38.697 INFO:tasks.workunit.client.0.smithi072.stdout:3/259: mknod d1/c4c 0 2024-04-15T21:02:38.701 INFO:tasks.workunit.client.0.smithi072.stdout:8/298: creat d3/de/d1b/f57 x:0 0 0 2024-04-15T21:02:38.701 INFO:tasks.workunit.client.0.smithi072.stdout:4/234: dread d7/f1b [0,4194304] 0 2024-04-15T21:02:38.702 INFO:tasks.workunit.client.0.smithi072.stdout:4/235: read d7/d23/f29 [4056012,78210] 0 2024-04-15T21:02:38.702 INFO:tasks.workunit.client.0.smithi072.stdout:8/299: truncate d3/d4/f1e 2017267 0 2024-04-15T21:02:38.702 INFO:tasks.workunit.client.0.smithi072.stdout:4/236: chown d7/d23/f29 1442 1 2024-04-15T21:02:38.703 INFO:tasks.workunit.client.0.smithi072.stdout:4/237: write d7/d23/f2a [2127419,120204] 0 2024-04-15T21:02:38.704 INFO:tasks.workunit.client.0.smithi072.stdout:6/248: creat d2/d10/d11/d1f/f4c x:0 0 0 2024-04-15T21:02:38.705 INFO:tasks.workunit.client.0.smithi072.stdout:6/249: dread - d2/d10/d11/d34/f48 zero size 2024-04-15T21:02:38.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/250: dwrite d2/d10/d11/d1f/f32 [4194304,4194304] 0 2024-04-15T21:02:38.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/462: dread da/d18/d10/d66/f69 [0,4194304] 0 2024-04-15T21:02:38.718 INFO:tasks.workunit.client.0.smithi072.stdout:1/229: rename d5/f6 to d5/db/d27/f47 0 2024-04-15T21:02:38.718 INFO:tasks.workunit.client.0.smithi072.stdout:6/251: dwrite d2/d10/d11/d34/f48 [0,4194304] 0 2024-04-15T21:02:38.722 INFO:tasks.workunit.client.0.smithi072.stdout:5/269: mkdir d0/d3/d7/d12/d31/d55/d58 0 2024-04-15T21:02:38.725 INFO:tasks.workunit.client.0.smithi072.stdout:9/235: dread d4/d1f/d2c/f39 [0,4194304] 0 2024-04-15T21:02:38.728 INFO:tasks.workunit.client.0.smithi072.stdout:0/237: dwrite d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:38.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/403: dread d1/db/d16/f5c [0,4194304] 0 2024-04-15T21:02:38.736 INFO:tasks.workunit.client.0.smithi072.stdout:3/260: creat d1/d15/f4d x:0 0 0 2024-04-15T21:02:38.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/404: write d1/db/dc/d38/f63 [959087,52625] 0 2024-04-15T21:02:38.744 INFO:tasks.workunit.client.0.smithi072.stdout:4/238: write d7/f2e [1156396,20323] 0 2024-04-15T21:02:38.746 INFO:tasks.workunit.client.0.smithi072.stdout:2/257: symlink d2/l57 0 2024-04-15T21:02:38.755 INFO:tasks.workunit.client.1.smithi149.stdout:7/485: sync 2024-04-15T21:02:38.755 INFO:tasks.workunit.client.1.smithi149.stdout:7/486: readlink l0 0 2024-04-15T21:02:38.757 INFO:tasks.workunit.client.0.smithi072.stdout:0/238: creat d0/d45/d35/d3a/f47 x:0 0 0 2024-04-15T21:02:38.761 INFO:tasks.workunit.client.0.smithi072.stdout:3/261: mknod d1/d15/d32/d2f/c4e 0 2024-04-15T21:02:38.764 INFO:tasks.workunit.client.0.smithi072.stdout:4/239: mkdir d7/d28/d42 0 2024-04-15T21:02:38.766 INFO:tasks.workunit.client.0.smithi072.stdout:2/258: unlink d2/f4f 0 2024-04-15T21:02:38.768 INFO:tasks.workunit.client.0.smithi072.stdout:1/230: symlink d5/db/l48 0 2024-04-15T21:02:38.769 INFO:tasks.workunit.client.0.smithi072.stdout:6/252: creat d2/d40/f4d x:0 0 0 2024-04-15T21:02:38.771 INFO:tasks.workunit.client.0.smithi072.stdout:9/236: write d4/d1f/d2c/f2e [881796,59018] 0 2024-04-15T21:02:38.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/463: mknod da/d18/c92 0 2024-04-15T21:02:38.773 INFO:tasks.workunit.client.0.smithi072.stdout:0/239: mkdir d0/d6/d48 0 2024-04-15T21:02:38.774 INFO:tasks.workunit.client.1.smithi149.stdout:1/405: symlink d1/l72 0 2024-04-15T21:02:38.778 INFO:tasks.workunit.client.1.smithi149.stdout:8/556: mkdir d2/d5b/dcd 0 2024-04-15T21:02:38.780 INFO:tasks.workunit.client.0.smithi072.stdout:1/231: creat d5/d31/f49 x:0 0 0 2024-04-15T21:02:38.781 INFO:tasks.workunit.client.1.smithi149.stdout:6/464: symlink da/d18/d10/d66/l93 0 2024-04-15T21:02:38.782 INFO:tasks.workunit.client.0.smithi072.stdout:6/253: creat d2/d10/d24/f4e x:0 0 0 2024-04-15T21:02:38.783 INFO:tasks.workunit.client.0.smithi072.stdout:6/254: chown d2/d1a/c37 1 1 2024-04-15T21:02:38.783 INFO:tasks.workunit.client.1.smithi149.stdout:1/406: mkdir d1/d17/d5e/d73 0 2024-04-15T21:02:38.788 INFO:tasks.workunit.client.0.smithi072.stdout:0/240: mknod d0/d45/d35/d3a/c49 0 2024-04-15T21:02:38.788 INFO:tasks.workunit.client.1.smithi149.stdout:9/441: symlink d23/d71/l90 0 2024-04-15T21:02:38.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/407: creat d1/d17/d52/d42/f74 x:0 0 0 2024-04-15T21:02:38.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/300: link d3/de/d1b/d41/c46 d3/d4/d3b/c58 0 2024-04-15T21:02:38.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/301: chown d3/de/d1b 1151986 1 2024-04-15T21:02:38.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/302: chown c2 1594442 1 2024-04-15T21:02:38.792 INFO:tasks.workunit.client.1.smithi149.stdout:7/487: creat d3/d16/fac x:0 0 0 2024-04-15T21:02:38.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/557: getdents d2/df/d10/d25/d37/db2 0 2024-04-15T21:02:38.795 INFO:tasks.workunit.client.0.smithi072.stdout:2/259: unlink d2/d38/c34 0 2024-04-15T21:02:38.796 INFO:tasks.workunit.client.0.smithi072.stdout:6/255: unlink d2/fb 0 2024-04-15T21:02:38.797 INFO:tasks.workunit.client.1.smithi149.stdout:1/408: dwrite d1/d17/d52/d42/f58 [0,4194304] 0 2024-04-15T21:02:38.797 INFO:tasks.workunit.client.0.smithi072.stdout:3/262: dwrite d1/d15/d40/f9 [0,4194304] 0 2024-04-15T21:02:38.797 INFO:tasks.workunit.client.0.smithi072.stdout:5/270: link d0/d3/d23/f4b d0/f59 0 2024-04-15T21:02:38.798 INFO:tasks.workunit.client.1.smithi149.stdout:8/558: stat d2/f8d 0 2024-04-15T21:02:38.799 INFO:tasks.workunit.client.0.smithi072.stdout:9/237: mknod d4/c43 0 2024-04-15T21:02:38.799 INFO:tasks.workunit.client.1.smithi149.stdout:8/559: write d2/df/d10/d21/d46/d74/fc2 [1006689,46863] 0 2024-04-15T21:02:38.800 INFO:tasks.workunit.client.0.smithi072.stdout:9/238: truncate f3 5179593 0 2024-04-15T21:02:38.801 INFO:tasks.workunit.client.0.smithi072.stdout:0/241: write d0/d3/f1b [1178189,19526] 0 2024-04-15T21:02:38.801 INFO:tasks.workunit.client.1.smithi149.stdout:7/488: mkdir d3/d16/d32/d90/dad 0 2024-04-15T21:02:38.802 INFO:tasks.workunit.client.1.smithi149.stdout:7/489: chown d3/d16/d20/d36/f2f 2935 1 2024-04-15T21:02:38.804 INFO:tasks.workunit.client.0.smithi072.stdout:4/240: creat d7/f43 x:0 0 0 2024-04-15T21:02:38.806 INFO:tasks.workunit.client.0.smithi072.stdout:4/241: read d7/d15/f20 [2937792,60752] 0 2024-04-15T21:02:38.806 INFO:tasks.workunit.client.1.smithi149.stdout:9/442: getdents d23 0 2024-04-15T21:02:38.807 INFO:tasks.workunit.client.0.smithi072.stdout:2/260: dwrite d2/d3/f4c [0,4194304] 0 2024-04-15T21:02:38.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/490: fdatasync d3/f7 0 2024-04-15T21:02:38.808 INFO:tasks.workunit.client.1.smithi149.stdout:1/409: creat d1/d17/d36/d6f/d70/f75 x:0 0 0 2024-04-15T21:02:38.809 INFO:tasks.workunit.client.0.smithi072.stdout:2/261: chown d2/d8 4098139 1 2024-04-15T21:02:38.810 INFO:tasks.workunit.client.0.smithi072.stdout:6/256: creat d2/d1a/f4f x:0 0 0 2024-04-15T21:02:38.812 INFO:tasks.workunit.client.0.smithi072.stdout:6/257: write d2/d10/d11/d34/f3a [909397,39686] 0 2024-04-15T21:02:38.813 INFO:tasks.workunit.client.1.smithi149.stdout:7/491: dread d3/d16/d20/d36/f2f [0,4194304] 0 2024-04-15T21:02:38.814 INFO:tasks.workunit.client.0.smithi072.stdout:6/258: truncate d2/d10/f3c 339813 0 2024-04-15T21:02:38.814 INFO:tasks.workunit.client.0.smithi072.stdout:6/259: chown d2/d1a 1 1 2024-04-15T21:02:38.816 INFO:tasks.workunit.client.1.smithi149.stdout:1/410: creat d1/db/dc/d11/d3f/f76 x:0 0 0 2024-04-15T21:02:38.817 INFO:tasks.workunit.client.1.smithi149.stdout:1/411: readlink d1/db/dc/d38/d39/d43/l2e 0 2024-04-15T21:02:38.818 INFO:tasks.workunit.client.0.smithi072.stdout:9/239: creat d4/d1f/d31/f44 x:0 0 0 2024-04-15T21:02:38.820 INFO:tasks.workunit.client.0.smithi072.stdout:0/242: creat d0/d19/f4a x:0 0 0 2024-04-15T21:02:38.824 INFO:tasks.workunit.client.1.smithi149.stdout:1/412: symlink d1/db/d14/d6b/l77 0 2024-04-15T21:02:38.826 INFO:tasks.workunit.client.1.smithi149.stdout:1/413: write d1/db/dc/d11/d3f/d45/f57 [246482,127899] 0 2024-04-15T21:02:38.826 INFO:tasks.workunit.client.0.smithi072.stdout:3/263: mkdir d1/d3f/d4f 0 2024-04-15T21:02:38.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/414: mkdir d1/d17/d52/d78 0 2024-04-15T21:02:38.834 INFO:tasks.workunit.client.0.smithi072.stdout:2/262: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:38.834 INFO:tasks.workunit.client.0.smithi072.stdout:0/243: symlink d0/d19/d2b/l4b 0 2024-04-15T21:02:38.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/492: link d3/d16/d20/d36/c29 d3/da9/cae 0 2024-04-15T21:02:38.835 INFO:tasks.workunit.client.0.smithi072.stdout:2/263: stat d2/d8/l4a 0 2024-04-15T21:02:38.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/493: write d3/d17/f8a [4325842,59394] 0 2024-04-15T21:02:38.836 INFO:tasks.workunit.client.0.smithi072.stdout:2/264: fdatasync d2/f44 0 2024-04-15T21:02:38.839 INFO:tasks.workunit.client.0.smithi072.stdout:4/242: mkdir d7/d10/d41/d44 0 2024-04-15T21:02:38.841 INFO:tasks.workunit.client.0.smithi072.stdout:6/260: dread d2/f14 [0,4194304] 0 2024-04-15T21:02:38.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/494: creat d3/d39/faf x:0 0 0 2024-04-15T21:02:38.844 INFO:tasks.workunit.client.0.smithi072.stdout:8/303: getdents d3/de/d1b 0 2024-04-15T21:02:38.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/495: chown d3/d17/d1f/f22 33 1 2024-04-15T21:02:38.845 INFO:tasks.workunit.client.0.smithi072.stdout:8/304: write f1 [1738923,779] 0 2024-04-15T21:02:38.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/496: chown d3/d16/d20 11891 1 2024-04-15T21:02:38.846 INFO:tasks.workunit.client.0.smithi072.stdout:9/240: mkdir d4/d29/d45 0 2024-04-15T21:02:38.846 INFO:tasks.workunit.client.0.smithi072.stdout:4/243: dwrite d7/d10/f11 [4194304,4194304] 0 2024-04-15T21:02:38.848 INFO:tasks.workunit.client.0.smithi072.stdout:0/244: rename d0/d6/f46 to d0/d6/f4c 0 2024-04-15T21:02:38.849 INFO:tasks.workunit.client.1.smithi149.stdout:7/497: creat d3/d16/d32/d90/fb0 x:0 0 0 2024-04-15T21:02:38.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/498: fdatasync d3/d17/f8a 0 2024-04-15T21:02:38.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/499: stat d3/d17/f19 0 2024-04-15T21:02:38.854 INFO:tasks.workunit.client.1.smithi149.stdout:9/443: write f16 [369799,52096] 0 2024-04-15T21:02:38.855 INFO:tasks.workunit.client.0.smithi072.stdout:0/245: dwrite d0/f2d [0,4194304] 0 2024-04-15T21:02:38.860 INFO:tasks.workunit.client.1.smithi149.stdout:7/500: mknod d3/d16/d20/d6c/cb1 0 2024-04-15T21:02:38.867 INFO:tasks.workunit.client.0.smithi072.stdout:8/305: symlink d3/de/d1b/l59 0 2024-04-15T21:02:38.868 INFO:tasks.workunit.client.1.smithi149.stdout:7/501: creat d3/d16/d20/d60/fb2 x:0 0 0 2024-04-15T21:02:38.869 INFO:tasks.workunit.client.0.smithi072.stdout:9/241: stat d4/d1f/d31/c3d 0 2024-04-15T21:02:38.870 INFO:tasks.workunit.client.0.smithi072.stdout:5/271: dwrite d0/d3/d23/f4b [0,4194304] 0 2024-04-15T21:02:38.870 INFO:tasks.workunit.client.0.smithi072.stdout:5/272: stat d0/d3/d6 0 2024-04-15T21:02:38.871 INFO:tasks.workunit.client.1.smithi149.stdout:9/444: creat d23/d2b/d44/d7e/f91 x:0 0 0 2024-04-15T21:02:38.872 INFO:tasks.workunit.client.1.smithi149.stdout:1/415: write d1/db/f20 [1405681,72720] 0 2024-04-15T21:02:38.874 INFO:tasks.workunit.client.1.smithi149.stdout:1/416: truncate d1/db/dc/f55 1648484 0 2024-04-15T21:02:38.875 INFO:tasks.workunit.client.1.smithi149.stdout:1/417: fdatasync d1/d17/f1c 0 2024-04-15T21:02:38.876 INFO:tasks.workunit.client.1.smithi149.stdout:9/445: unlink d23/d3c/d52/l72 0 2024-04-15T21:02:38.879 INFO:tasks.workunit.client.1.smithi149.stdout:7/502: mknod d3/d16/d32/da7/cb3 0 2024-04-15T21:02:38.879 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:38 smithi072 ceph-mon[29079]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:38.880 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:38 smithi072 ceph-mon[29079]: [15/Apr/2024:21:02:37] ENGINE Serving on http://172.21.15.149:8765 2024-04-15T21:02:38.880 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:38 smithi072 ceph-mon[29079]: [15/Apr/2024:21:02:37] ENGINE Bus STARTED 2024-04-15T21:02:38.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/228: sync 2024-04-15T21:02:38.882 INFO:tasks.workunit.client.0.smithi072.stdout:0/246: creat d0/d19/d2b/f4d x:0 0 0 2024-04-15T21:02:38.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/418: creat d1/f79 x:0 0 0 2024-04-15T21:02:38.885 INFO:tasks.workunit.client.0.smithi072.stdout:3/264: creat d1/d15/d32/f50 x:0 0 0 2024-04-15T21:02:38.886 INFO:tasks.workunit.client.1.smithi149.stdout:9/446: symlink d23/d2b/d44/l92 0 2024-04-15T21:02:38.886 INFO:tasks.workunit.client.0.smithi072.stdout:2/265: dwrite d2/d8/f13 [0,4194304] 0 2024-04-15T21:02:38.889 INFO:tasks.workunit.client.1.smithi149.stdout:1/419: truncate d1/d17/d52/f2a 5937269 0 2024-04-15T21:02:38.890 INFO:tasks.workunit.client.1.smithi149.stdout:1/420: chown d1/d17/d52/d42/f74 73446 1 2024-04-15T21:02:38.894 INFO:tasks.workunit.client.1.smithi149.stdout:0/648: sync 2024-04-15T21:02:38.894 INFO:tasks.workunit.client.1.smithi149.stdout:4/571: sync 2024-04-15T21:02:38.894 INFO:tasks.workunit.client.1.smithi149.stdout:5/474: sync 2024-04-15T21:02:38.894 INFO:tasks.workunit.client.1.smithi149.stdout:3/491: sync 2024-04-15T21:02:38.894 INFO:tasks.workunit.client.1.smithi149.stdout:2/551: sync 2024-04-15T21:02:38.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/649: chown d1/d5/c81 1616742 1 2024-04-15T21:02:38.898 INFO:tasks.workunit.client.0.smithi072.stdout:4/244: dwrite d7/d23/f29 [0,4194304] 0 2024-04-15T21:02:38.898 INFO:tasks.workunit.client.0.smithi072.stdout:7/229: mkdir d2/d7/d25/d2d/d46 0 2024-04-15T21:02:38.899 INFO:tasks.workunit.client.1.smithi149.stdout:1/421: dwrite d1/db/f20 [0,4194304] 0 2024-04-15T21:02:38.900 INFO:tasks.workunit.client.0.smithi072.stdout:0/247: creat d0/d6/f4e x:0 0 0 2024-04-15T21:02:38.901 INFO:tasks.workunit.client.0.smithi072.stdout:0/248: chown d0/d6/f39 0 1 2024-04-15T21:02:38.902 INFO:tasks.workunit.client.1.smithi149.stdout:0/650: fsync d1/d5/d24/d30/d43/f62 0 2024-04-15T21:02:38.903 INFO:tasks.workunit.client.1.smithi149.stdout:3/492: mknod d1/db/d23/c8e 0 2024-04-15T21:02:38.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/245: dwrite d7/fc [4194304,4194304] 0 2024-04-15T21:02:38.905 INFO:tasks.workunit.client.1.smithi149.stdout:4/572: symlink dc/d2c/d3e/d7c/lbd 0 2024-04-15T21:02:38.907 INFO:tasks.workunit.client.1.smithi149.stdout:4/573: chown dc/d2c/d3e/d35/d3a/f40 20513 1 2024-04-15T21:02:38.910 INFO:tasks.workunit.client.1.smithi149.stdout:4/574: dread dc/d18/d21/d81/f8e [0,4194304] 0 2024-04-15T21:02:38.913 INFO:tasks.workunit.client.0.smithi072.stdout:6/261: write d2/d10/d11/f2e [1075994,10393] 0 2024-04-15T21:02:38.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/447: write d23/d2b/f32 [1147886,103934] 0 2024-04-15T21:02:38.926 INFO:tasks.workunit.client.1.smithi149.stdout:3/493: creat d1/db/d23/d5e/f8f x:0 0 0 2024-04-15T21:02:38.928 INFO:tasks.workunit.client.1.smithi149.stdout:3/494: rename d1/db/d40/d56 to d1/db/d40/d56/d84/d85/d90 22 2024-04-15T21:02:38.929 INFO:tasks.workunit.client.1.smithi149.stdout:3/495: chown d1/c2d 48989897 1 2024-04-15T21:02:38.929 INFO:tasks.workunit.client.0.smithi072.stdout:8/306: mknod d3/de/d1b/d44/c5a 0 2024-04-15T21:02:38.931 INFO:tasks.workunit.client.1.smithi149.stdout:1/422: link d1/db/f37 d1/d17/d52/d6c/f7a 0 2024-04-15T21:02:38.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/575: creat dc/d2c/d3e/d7c/fbe x:0 0 0 2024-04-15T21:02:38.934 INFO:tasks.workunit.client.1.smithi149.stdout:2/552: dread d4/d7/d10/d36/f62 [0,4194304] 0 2024-04-15T21:02:38.935 INFO:tasks.workunit.client.1.smithi149.stdout:2/553: chown d4/d7/d10/d6b/d21/d5e 2867277 1 2024-04-15T21:02:38.937 INFO:tasks.workunit.client.1.smithi149.stdout:0/651: write d1/d9/d64/d65/fb4 [707057,42529] 0 2024-04-15T21:02:38.939 INFO:tasks.workunit.client.0.smithi072.stdout:7/230: mkdir d2/d7/d25/d2d/d47 0 2024-04-15T21:02:38.940 INFO:tasks.workunit.client.1.smithi149.stdout:3/496: creat d1/db/d24/d4d/d63/d65/f91 x:0 0 0 2024-04-15T21:02:38.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:38 smithi149 ceph-mon[36029]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:38.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:38 smithi149 ceph-mon[36029]: [15/Apr/2024:21:02:37] ENGINE Serving on http://172.21.15.149:8765 2024-04-15T21:02:38.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:38 smithi149 ceph-mon[36029]: [15/Apr/2024:21:02:37] ENGINE Bus STARTED 2024-04-15T21:02:38.941 INFO:tasks.workunit.client.0.smithi072.stdout:0/249: creat d0/d45/d35/f4f x:0 0 0 2024-04-15T21:02:38.943 INFO:tasks.workunit.client.0.smithi072.stdout:0/250: dread d0/d6/f39 [0,4194304] 0 2024-04-15T21:02:38.944 INFO:tasks.workunit.client.1.smithi149.stdout:1/423: rename d1/db/dc/f10 to d1/db/dc/d38/d39/d43/f7b 0 2024-04-15T21:02:38.944 INFO:tasks.workunit.client.0.smithi072.stdout:0/251: write d0/d6/f20 [1315286,15387] 0 2024-04-15T21:02:38.945 INFO:tasks.workunit.client.0.smithi072.stdout:4/246: mkdir d7/d10/d41/d45 0 2024-04-15T21:02:38.945 INFO:tasks.workunit.client.1.smithi149.stdout:0/652: dwrite d1/d9/d64/d65/fb4 [0,4194304] 0 2024-04-15T21:02:38.945 INFO:tasks.workunit.client.0.smithi072.stdout:0/252: write d0/d19/d2b/f4d [328910,48220] 0 2024-04-15T21:02:38.946 INFO:tasks.workunit.client.0.smithi072.stdout:4/247: dread - d7/d15/f33 zero size 2024-04-15T21:02:38.950 INFO:tasks.workunit.client.1.smithi149.stdout:1/424: dread d1/d17/d52/f34 [0,4194304] 0 2024-04-15T21:02:38.954 INFO:tasks.workunit.client.0.smithi072.stdout:1/232: sync 2024-04-15T21:02:38.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/233: chown d5/db/d2d/d3a/l1d 62595344 1 2024-04-15T21:02:38.958 INFO:tasks.workunit.client.1.smithi149.stdout:3/497: truncate d1/db/d24/d2b/f50 3139707 0 2024-04-15T21:02:38.959 INFO:tasks.workunit.client.1.smithi149.stdout:9/448: dwrite d23/d2b/d44/f66 [0,4194304] 0 2024-04-15T21:02:38.960 INFO:tasks.workunit.client.0.smithi072.stdout:5/273: link d0/d3/d6/c47 d0/d3/d7/d12/d31/d49/c5a 0 2024-04-15T21:02:38.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/554: rename d4/d7/d10/d6b/c60 to d4/d7/da/cca 0 2024-04-15T21:02:38.961 INFO:tasks.workunit.client.0.smithi072.stdout:7/231: truncate d2/d7/f8 4624418 0 2024-04-15T21:02:38.970 INFO:tasks.workunit.client.0.smithi072.stdout:0/253: creat d0/d45/d35/d3a/f50 x:0 0 0 2024-04-15T21:02:38.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/425: creat d1/db/d16/f7c x:0 0 0 2024-04-15T21:02:38.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/426: chown d1/d17/d52/d78 0 1 2024-04-15T21:02:38.971 INFO:tasks.workunit.client.0.smithi072.stdout:3/265: creat d1/f51 x:0 0 0 2024-04-15T21:02:38.972 INFO:tasks.workunit.client.0.smithi072.stdout:3/266: chown d1/d15/d32/c39 17361 1 2024-04-15T21:02:38.973 INFO:tasks.workunit.client.0.smithi072.stdout:3/267: chown d1/d15/d32/f50 217805 1 2024-04-15T21:02:38.974 INFO:tasks.workunit.client.0.smithi072.stdout:3/268: fsync d1/d15/d32/d2f/d1a/f1d 0 2024-04-15T21:02:38.975 INFO:tasks.workunit.client.0.smithi072.stdout:1/234: rename d5/db/d2d/d3a/d1f/l40 to d5/db/d2d/d3a/d1f/l4a 0 2024-04-15T21:02:38.977 INFO:tasks.workunit.client.0.smithi072.stdout:8/307: symlink d3/de/l5b 0 2024-04-15T21:02:38.979 INFO:tasks.workunit.client.0.smithi072.stdout:8/308: dread - d3/de/d1b/f57 zero size 2024-04-15T21:02:38.979 INFO:tasks.workunit.client.0.smithi072.stdout:4/248: dread d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:38.980 INFO:tasks.workunit.client.0.smithi072.stdout:9/242: getdents d4/d1f 0 2024-04-15T21:02:38.981 INFO:tasks.workunit.client.1.smithi149.stdout:3/498: creat d1/d81/f92 x:0 0 0 2024-04-15T21:02:38.981 INFO:tasks.workunit.client.0.smithi072.stdout:4/249: write d7/d15/f33 [141635,95990] 0 2024-04-15T21:02:38.983 INFO:tasks.workunit.client.0.smithi072.stdout:5/274: creat d0/d3/d6/d14/f5b x:0 0 0 2024-04-15T21:02:38.986 INFO:tasks.workunit.client.0.smithi072.stdout:9/243: dread f3 [4194304,4194304] 0 2024-04-15T21:02:38.989 INFO:tasks.workunit.client.1.smithi149.stdout:4/576: getdents dc/d2c/d3e/d35/d3a 0 2024-04-15T21:02:38.989 INFO:tasks.workunit.client.0.smithi072.stdout:8/309: dwrite d3/de/d1b/f43 [0,4194304] 0 2024-04-15T21:02:38.990 INFO:tasks.workunit.client.0.smithi072.stdout:4/250: dread d7/f1b [0,4194304] 0 2024-04-15T21:02:38.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/499: fsync d1/db/f1c 0 2024-04-15T21:02:38.992 INFO:tasks.workunit.client.0.smithi072.stdout:6/262: creat d2/d1a/f50 x:0 0 0 2024-04-15T21:02:38.994 INFO:tasks.workunit.client.0.smithi072.stdout:1/235: dread d5/fe [4194304,4194304] 0 2024-04-15T21:02:38.995 INFO:tasks.workunit.client.0.smithi072.stdout:2/266: rename d2/c3b to d2/d38/c58 0 2024-04-15T21:02:38.995 INFO:tasks.workunit.client.0.smithi072.stdout:4/251: dread f6 [0,4194304] 0 2024-04-15T21:02:38.995 INFO:tasks.workunit.client.0.smithi072.stdout:1/236: chown d5/db/f1a 40808 1 2024-04-15T21:02:38.997 INFO:tasks.workunit.client.0.smithi072.stdout:1/237: readlink d5/db/d2d/d3a/d1f/l21 0 2024-04-15T21:02:38.997 INFO:tasks.workunit.client.0.smithi072.stdout:1/238: truncate d5/f32 1677080 0 2024-04-15T21:02:38.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/653: getdents d1/d5/d24/d30/d43 0 2024-04-15T21:02:38.999 INFO:tasks.workunit.client.0.smithi072.stdout:4/252: dread f6 [0,4194304] 0 2024-04-15T21:02:38.999 INFO:tasks.workunit.client.1.smithi149.stdout:0/654: stat d1/d5/d24/d50/d13/d38/d44/d61 0 2024-04-15T21:02:39.000 INFO:tasks.workunit.client.0.smithi072.stdout:4/253: write d7/d15/f2f [117168,29783] 0 2024-04-15T21:02:39.000 INFO:tasks.workunit.client.1.smithi149.stdout:0/655: chown d1/d29/lc1 157105 1 2024-04-15T21:02:39.000 INFO:tasks.workunit.client.0.smithi072.stdout:4/254: readlink d7/l17 0 2024-04-15T21:02:39.001 INFO:tasks.workunit.client.0.smithi072.stdout:4/255: truncate d7/f1b 4701584 0 2024-04-15T21:02:39.002 INFO:tasks.workunit.client.1.smithi149.stdout:0/656: write d1/d5/d24/d50/d13/d38/fd1 [318086,99839] 0 2024-04-15T21:02:39.003 INFO:tasks.workunit.client.0.smithi072.stdout:4/256: read d7/d15/f33 [54660,94488] 0 2024-04-15T21:02:39.004 INFO:tasks.workunit.client.1.smithi149.stdout:9/449: truncate f1a 1006547 0 2024-04-15T21:02:39.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/555: link d4/d7/d10/d6b/d21/c45 d4/d7/da/ccb 0 2024-04-15T21:02:39.007 INFO:tasks.workunit.client.1.smithi149.stdout:2/556: chown d4/d7/d46/d74/cba 2045331605 1 2024-04-15T21:02:39.007 INFO:tasks.workunit.client.0.smithi072.stdout:7/232: creat d2/d7/d25/d2d/d46/f48 x:0 0 0 2024-04-15T21:02:39.008 INFO:tasks.workunit.client.1.smithi149.stdout:4/577: fsync dc/d2c/d3e/d15/f4a 0 2024-04-15T21:02:39.010 INFO:tasks.workunit.client.1.smithi149.stdout:2/557: truncate d4/d7/d10/d6b/d21/d55/f9e 380658 0 2024-04-15T21:02:39.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/450: symlink d23/d46/l93 0 2024-04-15T21:02:39.014 INFO:tasks.workunit.client.0.smithi072.stdout:0/254: symlink d0/d6/d48/l51 0 2024-04-15T21:02:39.016 INFO:tasks.workunit.client.0.smithi072.stdout:5/275: dread d0/fa [0,4194304] 0 2024-04-15T21:02:39.017 INFO:tasks.workunit.client.1.smithi149.stdout:4/578: creat dc/d18/d21/d81/fbf x:0 0 0 2024-04-15T21:02:39.017 INFO:tasks.workunit.client.1.smithi149.stdout:9/451: dread d23/d2b/f4a [0,4194304] 0 2024-04-15T21:02:39.020 INFO:tasks.workunit.client.1.smithi149.stdout:3/500: dread d1/db/d24/d2b/f25 [0,4194304] 0 2024-04-15T21:02:39.022 INFO:tasks.workunit.client.0.smithi072.stdout:6/263: mknod d2/d10/d24/c51 0 2024-04-15T21:02:39.023 INFO:tasks.workunit.client.0.smithi072.stdout:6/264: fsync d2/d10/d24/f36 0 2024-04-15T21:02:39.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/265: chown d2/d10/d11/d1f/f30 29 1 2024-04-15T21:02:39.025 INFO:tasks.workunit.client.0.smithi072.stdout:6/266: chown d2/d1a/l2b 170 1 2024-04-15T21:02:39.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/579: dwrite dc/d1a/f4e [0,4194304] 0 2024-04-15T21:02:39.026 INFO:tasks.workunit.client.1.smithi149.stdout:0/657: dread d1/d5/d24/d50/d13/d38/d44/f47 [4194304,4194304] 0 2024-04-15T21:02:39.028 INFO:tasks.workunit.client.1.smithi149.stdout:0/658: chown d1/d5/dc/la0 464 1 2024-04-15T21:02:39.029 INFO:tasks.workunit.client.1.smithi149.stdout:0/659: write d1/d5/d24/d50/d15/fd2 [503968,19443] 0 2024-04-15T21:02:39.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/452: symlink d23/d2b/d37/d50/l94 0 2024-04-15T21:02:39.031 INFO:tasks.workunit.client.1.smithi149.stdout:0/660: write d1/d5/d24/d50/d13/d59/fd4 [639572,47790] 0 2024-04-15T21:02:39.035 INFO:tasks.workunit.client.1.smithi149.stdout:4/580: rename dc to dc/d2c/d3e/d15/dc0 22 2024-04-15T21:02:39.037 INFO:tasks.workunit.client.1.smithi149.stdout:4/581: write dc/d2c/f22 [132134,71559] 0 2024-04-15T21:02:39.037 INFO:tasks.workunit.client.1.smithi149.stdout:2/558: dread d4/d7/d10/d6b/f56 [0,4194304] 0 2024-04-15T21:02:39.042 INFO:tasks.workunit.client.0.smithi072.stdout:0/255: mkdir d0/d45/d52 0 2024-04-15T21:02:39.043 INFO:tasks.workunit.client.1.smithi149.stdout:2/559: dwrite d4/d7/da/fb3 [0,4194304] 0 2024-04-15T21:02:39.045 INFO:tasks.workunit.client.0.smithi072.stdout:7/233: dwrite d2/d10/d1f/d38/f22 [0,4194304] 0 2024-04-15T21:02:39.046 INFO:tasks.workunit.client.0.smithi072.stdout:8/310: link d3/f33 d3/de/d21/d2e/f5c 0 2024-04-15T21:02:39.048 INFO:tasks.workunit.client.1.smithi149.stdout:4/582: symlink dc/d2c/d3e/d35/d4b/d75/db3/lc1 0 2024-04-15T21:02:39.048 INFO:tasks.workunit.client.1.smithi149.stdout:4/583: fdatasync dc/d8f/d91/f97 0 2024-04-15T21:02:39.051 INFO:tasks.workunit.client.1.smithi149.stdout:2/560: write d4/d7/d10/d36/f62 [2588726,66320] 0 2024-04-15T21:02:39.053 INFO:tasks.workunit.client.1.smithi149.stdout:6/465: sync 2024-04-15T21:02:39.055 INFO:tasks.workunit.client.0.smithi072.stdout:6/267: symlink d2/d1a/l52 0 2024-04-15T21:02:39.058 INFO:tasks.workunit.client.1.smithi149.stdout:0/661: link d1/d9/d64/d65/f79 d1/d5/d24/fe3 0 2024-04-15T21:02:39.061 INFO:tasks.workunit.client.0.smithi072.stdout:1/239: rename d5/db/d2d/d3a/d1f/l4a to d5/d3d/l4b 0 2024-04-15T21:02:39.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/584: dwrite dc/d1a/f4f [0,4194304] 0 2024-04-15T21:02:39.062 INFO:tasks.workunit.client.0.smithi072.stdout:1/240: stat d5/db/d2d/d3a 0 2024-04-15T21:02:39.064 INFO:tasks.workunit.client.0.smithi072.stdout:3/269: link d1/d3f/c48 d1/d3f/c52 0 2024-04-15T21:02:39.068 INFO:tasks.workunit.client.1.smithi149.stdout:2/561: read d4/d7/d10/d6b/d21/d3b/f44 [2106661,9818] 0 2024-04-15T21:02:39.069 INFO:tasks.workunit.client.1.smithi149.stdout:6/466: mknod da/d11/d85/c94 0 2024-04-15T21:02:39.070 INFO:tasks.workunit.client.0.smithi072.stdout:4/257: mknod d7/d10/d41/d45/c46 0 2024-04-15T21:02:39.071 INFO:tasks.workunit.client.0.smithi072.stdout:4/258: write d7/d10/f3a [760537,9015] 0 2024-04-15T21:02:39.073 INFO:tasks.workunit.client.0.smithi072.stdout:9/244: creat d4/d1f/d2c/f46 x:0 0 0 2024-04-15T21:02:39.074 INFO:tasks.workunit.client.0.smithi072.stdout:9/245: write d4/f11 [1925855,115501] 0 2024-04-15T21:02:39.075 INFO:tasks.workunit.client.0.smithi072.stdout:9/246: chown d4/d1f/l26 19 1 2024-04-15T21:02:39.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/276: symlink d0/d3/d7/d1f/d4c/l5c 0 2024-04-15T21:02:39.078 INFO:tasks.workunit.client.1.smithi149.stdout:9/453: rename d23/d2b/f32 to d23/d2b/d70/d75/f95 0 2024-04-15T21:02:39.085 INFO:tasks.workunit.client.0.smithi072.stdout:2/267: truncate d2/d3/f5 2667607 0 2024-04-15T21:02:39.086 INFO:tasks.workunit.client.0.smithi072.stdout:2/268: chown d2/f44 45 1 2024-04-15T21:02:39.086 INFO:tasks.workunit.client.0.smithi072.stdout:2/269: chown d2/c53 26901575 1 2024-04-15T21:02:39.089 INFO:tasks.workunit.client.1.smithi149.stdout:9/454: creat d23/d3c/d7a/d7c/d7f/f96 x:0 0 0 2024-04-15T21:02:39.090 INFO:tasks.workunit.client.1.smithi149.stdout:2/562: dread d4/d7/da/fe [0,4194304] 0 2024-04-15T21:02:39.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/662: dread d1/d5/d24/d30/d54/fa9 [0,4194304] 0 2024-04-15T21:02:39.092 INFO:tasks.workunit.client.1.smithi149.stdout:2/563: dread - d4/d7/d10/d6b/d21/d55/d94/faf zero size 2024-04-15T21:02:39.092 INFO:tasks.workunit.client.1.smithi149.stdout:2/564: chown d4/d7/d10/c23 0 1 2024-04-15T21:02:39.093 INFO:tasks.workunit.client.0.smithi072.stdout:1/241: creat d5/d31/f4c x:0 0 0 2024-04-15T21:02:39.093 INFO:tasks.workunit.client.0.smithi072.stdout:1/242: chown d5/fe 6525 1 2024-04-15T21:02:39.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/565: write d4/d7/d10/d6b/d21/d5e/fc9 [755677,73027] 0 2024-04-15T21:02:39.098 INFO:tasks.workunit.client.0.smithi072.stdout:1/243: dread d5/f32 [0,4194304] 0 2024-04-15T21:02:39.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/455: unlink d23/d2b/d37/d50/d79/c8f 0 2024-04-15T21:02:39.098 INFO:tasks.workunit.client.0.smithi072.stdout:1/244: truncate d5/f32 2426984 0 2024-04-15T21:02:39.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/585: write dc/d18/f1f [2582204,49881] 0 2024-04-15T21:02:39.102 INFO:tasks.workunit.client.1.smithi149.stdout:6/467: truncate da/d11/f35 7827941 0 2024-04-15T21:02:39.104 INFO:tasks.workunit.client.0.smithi072.stdout:0/256: mkdir d0/d45/d52/d53 0 2024-04-15T21:02:39.107 INFO:tasks.workunit.client.1.smithi149.stdout:9/456: unlink d23/d3c/d52/l54 0 2024-04-15T21:02:39.108 INFO:tasks.workunit.client.1.smithi149.stdout:9/457: stat d23/d46/c78 0 2024-04-15T21:02:39.113 INFO:tasks.workunit.client.1.smithi149.stdout:4/586: creat dc/d2c/d3e/d15/d3f/fc2 x:0 0 0 2024-04-15T21:02:39.113 INFO:tasks.workunit.client.1.smithi149.stdout:2/566: dread d4/d7/d93/fad [4194304,4194304] 0 2024-04-15T21:02:39.116 INFO:tasks.workunit.client.0.smithi072.stdout:7/234: write d2/fa [792641,116217] 0 2024-04-15T21:02:39.120 INFO:tasks.workunit.client.1.smithi149.stdout:9/458: mknod d23/d3c/d52/c97 0 2024-04-15T21:02:39.120 INFO:tasks.workunit.client.0.smithi072.stdout:8/311: write d3/f1d [2807230,30961] 0 2024-04-15T21:02:39.120 INFO:tasks.workunit.client.1.smithi149.stdout:4/587: dwrite dc/d2c/d3e/d7c/fb2 [0,4194304] 0 2024-04-15T21:02:39.122 INFO:tasks.workunit.client.0.smithi072.stdout:8/312: truncate d3/d4/d3b/f3e 1456302 0 2024-04-15T21:02:39.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/663: link d1/cd9 d1/d5/d24/d50/d13/ce4 0 2024-04-15T21:02:39.123 INFO:tasks.workunit.client.0.smithi072.stdout:1/245: mknod d5/db/d2d/c4d 0 2024-04-15T21:02:39.124 INFO:tasks.workunit.client.1.smithi149.stdout:6/468: write da/d18/f23 [6556714,44246] 0 2024-04-15T21:02:39.124 INFO:tasks.workunit.client.0.smithi072.stdout:1/246: write d5/f3c [287853,7371] 0 2024-04-15T21:02:39.130 INFO:tasks.workunit.client.1.smithi149.stdout:0/664: symlink d1/d9/d64/le5 0 2024-04-15T21:02:39.132 INFO:tasks.workunit.client.1.smithi149.stdout:6/469: creat da/d11/d85/f95 x:0 0 0 2024-04-15T21:02:39.134 INFO:tasks.workunit.client.0.smithi072.stdout:6/268: link d2/f14 d2/d10/d11/d15/f53 0 2024-04-15T21:02:39.136 INFO:tasks.workunit.client.1.smithi149.stdout:2/567: rename d4/d7/da/ccb to d4/d7/d10/d6b/d21/d5e/dbe/da7/ccc 0 2024-04-15T21:02:39.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/459: creat d23/d2b/d37/d50/d79/d8d/f98 x:0 0 0 2024-04-15T21:02:39.141 INFO:tasks.workunit.client.0.smithi072.stdout:7/235: mknod d2/d10/d26/c49 0 2024-04-15T21:02:39.142 INFO:tasks.workunit.client.1.smithi149.stdout:2/568: dwrite d4/d7/d46/f69 [4194304,4194304] 0 2024-04-15T21:02:39.142 INFO:tasks.workunit.client.1.smithi149.stdout:6/470: unlink da/d11/f71 0 2024-04-15T21:02:39.143 INFO:tasks.workunit.client.0.smithi072.stdout:0/257: dwrite d0/d6/f39 [0,4194304] 0 2024-04-15T21:02:39.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/471: write da/d18/d33/f7e [682743,58046] 0 2024-04-15T21:02:39.150 INFO:tasks.workunit.client.1.smithi149.stdout:2/569: dread d4/d7/d10/d6b/d21/d55/f59 [0,4194304] 0 2024-04-15T21:02:39.152 INFO:tasks.workunit.client.1.smithi149.stdout:2/570: fdatasync d4/d7/d10/d6b/d21/d2c/fbc 0 2024-04-15T21:02:39.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/313: symlink d3/d4/d4c/l5d 0 2024-04-15T21:02:39.155 INFO:tasks.workunit.client.1.smithi149.stdout:9/460: symlink d23/d3c/d7a/d7c/l99 0 2024-04-15T21:02:39.160 INFO:tasks.workunit.client.1.smithi149.stdout:2/571: dwrite d4/d7/d10/d6b/d21/d2c/f4b [0,4194304] 0 2024-04-15T21:02:39.161 INFO:tasks.workunit.client.0.smithi072.stdout:1/247: rename d5/db/d27/l2f to d5/d31/l4e 0 2024-04-15T21:02:39.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/461: mkdir d23/d3c/d87/d9a 0 2024-04-15T21:02:39.174 INFO:tasks.workunit.client.0.smithi072.stdout:3/270: rename d1/d15/d40/c25 to d1/d15/d40/c53 0 2024-04-15T21:02:39.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/236: rmdir d2 39 2024-04-15T21:02:39.174 INFO:tasks.workunit.client.1.smithi149.stdout:0/665: creat d1/d5/d24/d30/fe6 x:0 0 0 2024-04-15T21:02:39.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/572: rmdir d4/d7/d29 39 2024-04-15T21:02:39.176 INFO:tasks.workunit.client.1.smithi149.stdout:2/573: fdatasync d4/d7/d10/d6b/d21/d5e/fc9 0 2024-04-15T21:02:39.178 INFO:tasks.workunit.client.0.smithi072.stdout:0/258: fdatasync d0/d45/f26 0 2024-04-15T21:02:39.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/462: creat d23/d2b/d44/d7e/f9b x:0 0 0 2024-04-15T21:02:39.179 INFO:tasks.workunit.client.1.smithi149.stdout:9/463: chown f22 965131 1 2024-04-15T21:02:39.180 INFO:tasks.workunit.client.0.smithi072.stdout:4/259: getdents d7/d15 0 2024-04-15T21:02:39.180 INFO:tasks.workunit.client.0.smithi072.stdout:4/260: write d7/f2e [1340127,51038] 0 2024-04-15T21:02:39.180 INFO:tasks.workunit.client.1.smithi149.stdout:0/666: rmdir d1/d5/d24 39 2024-04-15T21:02:39.182 INFO:tasks.workunit.client.0.smithi072.stdout:8/314: mknod d3/d4/c5e 0 2024-04-15T21:02:39.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/667: chown d1/d9/d64/d73/cb5 16 1 2024-04-15T21:02:39.183 INFO:tasks.workunit.client.0.smithi072.stdout:8/315: write d3/de/f38 [331680,108850] 0 2024-04-15T21:02:39.183 INFO:tasks.workunit.client.0.smithi072.stdout:5/277: getdents d0/d3/d33 0 2024-04-15T21:02:39.183 INFO:tasks.workunit.client.1.smithi149.stdout:2/574: dwrite d4/d7/d10/d6b/d21/d55/d94/faf [0,4194304] 0 2024-04-15T21:02:39.184 INFO:tasks.workunit.client.0.smithi072.stdout:5/278: write d0/d3/d7/f3c [73052,116371] 0 2024-04-15T21:02:39.191 INFO:tasks.workunit.client.0.smithi072.stdout:5/279: dwrite d0/d3/d7/d1f/f40 [0,4194304] 0 2024-04-15T21:02:39.199 INFO:tasks.workunit.client.0.smithi072.stdout:5/280: dwrite d0/d3/d6/f2b [0,4194304] 0 2024-04-15T21:02:39.239 INFO:tasks.workunit.client.0.smithi072.stdout:9/247: sync 2024-04-15T21:02:39.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/560: sync 2024-04-15T21:02:39.242 INFO:tasks.workunit.client.1.smithi149.stdout:8/561: stat d2/df/d10/d25/d32/d45/f5e 0 2024-04-15T21:02:39.243 INFO:tasks.workunit.client.1.smithi149.stdout:8/562: write d2/df/d10/d25/d37/d53/daf/d85/d35/f8b [4003147,47588] 0 2024-04-15T21:02:39.244 INFO:tasks.workunit.client.1.smithi149.stdout:8/563: truncate d2/df/d10/d21/d50/d8e/f9e 547322 0 2024-04-15T21:02:39.274 INFO:tasks.workunit.client.0.smithi072.stdout:2/270: getdents d2/d8/d41 0 2024-04-15T21:02:39.275 INFO:tasks.workunit.client.0.smithi072.stdout:2/271: dread d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:39.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/464: write d23/d2b/f65 [98043,5276] 0 2024-04-15T21:02:39.278 INFO:tasks.workunit.client.0.smithi072.stdout:3/271: symlink d1/d3f/l54 0 2024-04-15T21:02:39.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/465: chown d23/d2b/d37/d6d/f7d 1800773 1 2024-04-15T21:02:39.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/248: write d5/db/f28 [2022563,92806] 0 2024-04-15T21:02:39.279 INFO:tasks.workunit.client.0.smithi072.stdout:1/249: write d5/db/d2d/f3e [1146019,18782] 0 2024-04-15T21:02:39.281 INFO:tasks.workunit.client.0.smithi072.stdout:1/250: fsync d5/db/d2d/d3a/f2e 0 2024-04-15T21:02:39.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/564: dread d2/df/d10/d25/d37/fae [0,4194304] 0 2024-04-15T21:02:39.282 INFO:tasks.workunit.client.1.smithi149.stdout:0/668: symlink d1/d5/d24/d8a/le7 0 2024-04-15T21:02:39.282 INFO:tasks.workunit.client.0.smithi072.stdout:1/251: write d5/db/d2d/f3e [1445279,123847] 0 2024-04-15T21:02:39.284 INFO:tasks.workunit.client.1.smithi149.stdout:9/466: creat d23/d46/f9c x:0 0 0 2024-04-15T21:02:39.285 INFO:tasks.workunit.client.1.smithi149.stdout:9/467: write d23/d3c/d7a/d7c/d7f/f96 [680181,28697] 0 2024-04-15T21:02:39.287 INFO:tasks.workunit.client.1.smithi149.stdout:0/669: fsync d1/d9/f1b 0 2024-04-15T21:02:39.289 INFO:tasks.workunit.client.1.smithi149.stdout:0/670: truncate d1/d5/d24/d50/d13/d59/f78 13401147 0 2024-04-15T21:02:39.289 INFO:tasks.workunit.client.1.smithi149.stdout:9/468: symlink d23/d2b/d37/d50/l9d 0 2024-04-15T21:02:39.293 INFO:tasks.workunit.client.1.smithi149.stdout:9/469: chown d23/d2b/l5e 0 1 2024-04-15T21:02:39.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/565: dwrite d2/df/d10/d25/d57/f8c [0,4194304] 0 2024-04-15T21:02:39.299 INFO:tasks.workunit.client.0.smithi072.stdout:3/272: rmdir d1/d15/d32/d2f 39 2024-04-15T21:02:39.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/566: chown d2/df/d10/d25/d37/d53/daf/d85 57450360 1 2024-04-15T21:02:39.303 INFO:tasks.workunit.client.1.smithi149.stdout:8/567: truncate d2/df/d10/d25/d37/d53/daf/d92/fb0 432922 0 2024-04-15T21:02:39.304 INFO:tasks.workunit.client.1.smithi149.stdout:9/470: rename d23/d2b/d37/d50/d79/l8c to d23/d71/l9e 0 2024-04-15T21:02:39.307 INFO:tasks.workunit.client.1.smithi149.stdout:8/568: chown d2/df/d10/d25/d37/fae 53727 1 2024-04-15T21:02:39.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/471: symlink d23/d2b/d37/l9f 0 2024-04-15T21:02:39.309 INFO:tasks.workunit.client.0.smithi072.stdout:4/261: symlink d7/d28/d42/l47 0 2024-04-15T21:02:39.310 INFO:tasks.workunit.client.1.smithi149.stdout:0/671: dwrite d1/d29/f90 [4194304,4194304] 0 2024-04-15T21:02:39.312 INFO:tasks.workunit.client.1.smithi149.stdout:8/569: mkdir d2/df/d10/d21/d46/dce 0 2024-04-15T21:02:39.314 INFO:tasks.workunit.client.0.smithi072.stdout:5/281: link d0/f35 d0/d3/d7/d1f/d4c/f5d 0 2024-04-15T21:02:39.316 INFO:tasks.workunit.client.1.smithi149.stdout:9/472: creat d23/d2b/fa0 x:0 0 0 2024-04-15T21:02:39.316 INFO:tasks.workunit.client.0.smithi072.stdout:6/269: getdents d2/d10/d11/d15 0 2024-04-15T21:02:39.318 INFO:tasks.workunit.client.1.smithi149.stdout:9/473: write d23/d3c/f6b [3217486,22582] 0 2024-04-15T21:02:39.321 INFO:tasks.workunit.client.1.smithi149.stdout:8/570: dwrite d2/df/d10/d25/d37/d53/daf/d92/fb0 [0,4194304] 0 2024-04-15T21:02:39.323 INFO:tasks.workunit.client.0.smithi072.stdout:7/237: creat d2/d7/d25/d2d/d47/f4a x:0 0 0 2024-04-15T21:02:39.327 INFO:tasks.workunit.client.0.smithi072.stdout:0/259: rename d0/l16 to d0/d45/l54 0 2024-04-15T21:02:39.333 INFO:tasks.workunit.client.0.smithi072.stdout:8/316: chown d3/d4/d3b/c58 524 1 2024-04-15T21:02:39.335 INFO:tasks.workunit.client.0.smithi072.stdout:5/282: unlink d0/d3/d7/f57 0 2024-04-15T21:02:39.342 INFO:tasks.workunit.client.1.smithi149.stdout:0/672: dread d1/d9/f6f [0,4194304] 0 2024-04-15T21:02:39.348 INFO:tasks.workunit.client.1.smithi149.stdout:9/474: write d23/d2b/d70/d75/f95 [53903,85746] 0 2024-04-15T21:02:39.356 INFO:tasks.workunit.client.1.smithi149.stdout:0/673: dread d1/d5/d24/d50/d13/d38/fc2 [0,4194304] 0 2024-04-15T21:02:39.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/674: read d1/d29/d2c/f58 [252606,39104] 0 2024-04-15T21:02:39.361 INFO:tasks.workunit.client.0.smithi072.stdout:0/260: mkdir d0/d6/d55 0 2024-04-15T21:02:39.361 INFO:tasks.workunit.client.1.smithi149.stdout:0/675: link d1/d9/d64/d65/fcc d1/d5/dda/fe8 0 2024-04-15T21:02:39.362 INFO:tasks.workunit.client.0.smithi072.stdout:4/262: creat d7/d10/d41/d44/f48 x:0 0 0 2024-04-15T21:02:39.363 INFO:tasks.workunit.client.0.smithi072.stdout:3/273: getdents d1/d15/d32/d2f/d1a 0 2024-04-15T21:02:39.363 INFO:tasks.workunit.client.0.smithi072.stdout:1/252: link d5/fe d5/db/f4f 0 2024-04-15T21:02:39.364 INFO:tasks.workunit.client.0.smithi072.stdout:5/283: dwrite d0/d3/d6/d14/f5b [0,4194304] 0 2024-04-15T21:02:39.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/676: fsync d1/d5/fb8 0 2024-04-15T21:02:39.366 INFO:tasks.workunit.client.0.smithi072.stdout:8/317: symlink d3/d4/d4c/l5f 0 2024-04-15T21:02:39.366 INFO:tasks.workunit.client.0.smithi072.stdout:2/272: rename d2/l2d to d2/d37/l59 0 2024-04-15T21:02:39.367 INFO:tasks.workunit.client.0.smithi072.stdout:4/263: rmdir d7/d28/d42 39 2024-04-15T21:02:39.367 INFO:tasks.workunit.client.0.smithi072.stdout:6/270: dwrite d2/fe [0,4194304] 0 2024-04-15T21:02:39.368 INFO:tasks.workunit.client.0.smithi072.stdout:2/273: read d2/d8/f36 [1363779,20751] 0 2024-04-15T21:02:39.368 INFO:tasks.workunit.client.0.smithi072.stdout:5/284: fsync d0/d3/d6/d14/f18 0 2024-04-15T21:02:39.370 INFO:tasks.workunit.client.0.smithi072.stdout:6/271: dread - d2/d10/d11/d34/f44 zero size 2024-04-15T21:02:39.371 INFO:tasks.workunit.client.0.smithi072.stdout:4/264: dread - d7/d10/d41/d44/f48 zero size 2024-04-15T21:02:39.371 INFO:tasks.workunit.client.0.smithi072.stdout:3/274: symlink d1/d15/l55 0 2024-04-15T21:02:39.373 INFO:tasks.workunit.client.1.smithi149.stdout:0/677: dwrite d1/d5/d24/d50/d13/d59/f78 [4194304,4194304] 0 2024-04-15T21:02:39.378 INFO:tasks.workunit.client.0.smithi072.stdout:8/318: dread d3/de/d21/f51 [0,4194304] 0 2024-04-15T21:02:39.381 INFO:tasks.workunit.client.0.smithi072.stdout:0/261: rename d0/d3/f1b to d0/d45/d35/f56 0 2024-04-15T21:02:39.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/678: mkdir d1/d5/d24/d30/d43/de9 0 2024-04-15T21:02:39.385 INFO:tasks.workunit.client.1.smithi149.stdout:5/475: sync 2024-04-15T21:02:39.385 INFO:tasks.workunit.client.1.smithi149.stdout:7/503: sync 2024-04-15T21:02:39.388 INFO:tasks.workunit.client.0.smithi072.stdout:5/285: symlink d0/d3/d33/l5e 0 2024-04-15T21:02:39.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/679: symlink d1/d29/d2c/d4f/d95/lea 0 2024-04-15T21:02:39.389 INFO:tasks.workunit.client.0.smithi072.stdout:3/275: fsync d1/d15/f31 0 2024-04-15T21:02:39.390 INFO:tasks.workunit.client.0.smithi072.stdout:5/286: write d0/d3/d7/d12/d31/d55/f56 [186902,117422] 0 2024-04-15T21:02:39.391 INFO:tasks.workunit.client.1.smithi149.stdout:7/504: mknod d3/d34/cb4 0 2024-04-15T21:02:39.391 INFO:tasks.workunit.client.0.smithi072.stdout:3/276: write d1/f51 [411711,68656] 0 2024-04-15T21:02:39.394 INFO:tasks.workunit.client.0.smithi072.stdout:0/262: symlink d0/d45/d35/l57 0 2024-04-15T21:02:39.395 INFO:tasks.workunit.client.0.smithi072.stdout:0/263: fdatasync d0/d3/fe 0 2024-04-15T21:02:39.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/476: dwrite d0/d6/d82/da1/d12/d16/f58 [0,4194304] 0 2024-04-15T21:02:39.399 INFO:tasks.workunit.client.0.smithi072.stdout:8/319: dwrite d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:39.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/505: rename d3/d16/d32/da7 to d3/d16/d20/db5 0 2024-04-15T21:02:39.402 INFO:tasks.workunit.client.0.smithi072.stdout:5/287: mkdir d0/d3/d23/d5f 0 2024-04-15T21:02:39.404 INFO:tasks.workunit.client.0.smithi072.stdout:2/274: creat d2/f5a x:0 0 0 2024-04-15T21:02:39.408 INFO:tasks.workunit.client.0.smithi072.stdout:0/264: unlink d0/f14 0 2024-04-15T21:02:39.409 INFO:tasks.workunit.client.1.smithi149.stdout:7/506: getdents d3/d17 0 2024-04-15T21:02:39.409 INFO:tasks.workunit.client.0.smithi072.stdout:4/265: creat d7/d28/f49 x:0 0 0 2024-04-15T21:02:39.410 INFO:tasks.workunit.client.0.smithi072.stdout:8/320: fdatasync d3/de/d21/f51 0 2024-04-15T21:02:39.413 INFO:tasks.workunit.client.0.smithi072.stdout:6/272: getdents d2/d10/d11/d34 0 2024-04-15T21:02:39.413 INFO:tasks.workunit.client.0.smithi072.stdout:4/266: write d7/f43 [18168,97635] 0 2024-04-15T21:02:39.416 INFO:tasks.workunit.client.0.smithi072.stdout:9/248: sync 2024-04-15T21:02:39.416 INFO:tasks.workunit.client.0.smithi072.stdout:5/288: dwrite d0/d3/d23/f4b [4194304,4194304] 0 2024-04-15T21:02:39.417 INFO:tasks.workunit.client.0.smithi072.stdout:2/275: dread d2/d3/f4c [0,4194304] 0 2024-04-15T21:02:39.421 INFO:tasks.workunit.client.0.smithi072.stdout:8/321: rename d3/de/l23 to d3/de/d1b/l60 0 2024-04-15T21:02:39.421 INFO:tasks.workunit.client.0.smithi072.stdout:0/265: dwrite d0/f13 [0,4194304] 0 2024-04-15T21:02:39.424 INFO:tasks.workunit.client.0.smithi072.stdout:4/267: mknod d7/d10/d41/d45/c4a 0 2024-04-15T21:02:39.426 INFO:tasks.workunit.client.1.smithi149.stdout:0/680: write d1/d5/d24/d50/d13/d38/d44/f60 [4400654,90963] 0 2024-04-15T21:02:39.427 INFO:tasks.workunit.client.0.smithi072.stdout:9/249: dwrite d4/f13 [0,4194304] 0 2024-04-15T21:02:39.428 INFO:tasks.workunit.client.1.smithi149.stdout:0/681: readlink d1/d5/d24/d50/d15/lba 0 2024-04-15T21:02:39.429 INFO:tasks.workunit.client.0.smithi072.stdout:5/289: mkdir d0/d3/d33/d60 0 2024-04-15T21:02:39.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/682: stat d1/d5/d24/d30/d43/f97 0 2024-04-15T21:02:39.430 INFO:tasks.workunit.client.0.smithi072.stdout:6/273: mknod d2/d40/c54 0 2024-04-15T21:02:39.431 INFO:tasks.workunit.client.0.smithi072.stdout:5/290: stat d0/d3/d7/d12/d31/d49/c5a 0 2024-04-15T21:02:39.431 INFO:tasks.workunit.client.0.smithi072.stdout:8/322: mkdir d3/de/d1b/d61 0 2024-04-15T21:02:39.433 INFO:tasks.workunit.client.0.smithi072.stdout:9/250: read d4/f1e [2332052,69687] 0 2024-04-15T21:02:39.435 INFO:tasks.workunit.client.0.smithi072.stdout:8/323: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:39.436 INFO:tasks.workunit.client.0.smithi072.stdout:3/277: dread d1/f14 [0,4194304] 0 2024-04-15T21:02:39.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/683: chown d1/d9/d64/d65/f79 1 1 2024-04-15T21:02:39.438 INFO:tasks.workunit.client.0.smithi072.stdout:3/278: write d1/d15/f4d [995302,101766] 0 2024-04-15T21:02:39.441 INFO:tasks.workunit.client.0.smithi072.stdout:6/274: creat d2/d1a/f55 x:0 0 0 2024-04-15T21:02:39.441 INFO:tasks.workunit.client.0.smithi072.stdout:9/251: dwrite d4/f1e [0,4194304] 0 2024-04-15T21:02:39.442 INFO:tasks.workunit.client.0.smithi072.stdout:6/275: fdatasync d2/d10/d11/d1f/f4c 0 2024-04-15T21:02:39.443 INFO:tasks.workunit.client.0.smithi072.stdout:8/324: dread d3/de/d1b/f43 [0,4194304] 0 2024-04-15T21:02:39.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/684: mknod d1/d5/d24/d30/d43/ceb 0 2024-04-15T21:02:39.446 INFO:tasks.workunit.client.0.smithi072.stdout:0/266: getdents d0/d45/d52/d53 0 2024-04-15T21:02:39.448 INFO:tasks.workunit.client.1.smithi149.stdout:7/507: dread d3/d16/da0/fa8 [0,4194304] 0 2024-04-15T21:02:39.449 INFO:tasks.workunit.client.0.smithi072.stdout:9/252: dwrite d4/d1f/d2c/f2d [0,4194304] 0 2024-04-15T21:02:39.452 INFO:tasks.workunit.client.1.smithi149.stdout:0/685: mknod d1/d9/d64/d73/cec 0 2024-04-15T21:02:39.458 INFO:tasks.workunit.client.0.smithi072.stdout:2/276: dwrite d2/f12 [0,4194304] 0 2024-04-15T21:02:39.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/508: mkdir d3/d34/db6 0 2024-04-15T21:02:39.459 INFO:tasks.workunit.client.0.smithi072.stdout:2/277: dread - d2/d3/f46 zero size 2024-04-15T21:02:39.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/509: chown d3/d16/d32/l61 7678420 1 2024-04-15T21:02:39.464 INFO:tasks.workunit.client.1.smithi149.stdout:0/686: dwrite d1/d5/d24/d50/d13/d38/fd1 [0,4194304] 0 2024-04-15T21:02:39.466 INFO:tasks.workunit.client.0.smithi072.stdout:6/276: mkdir d2/d40/d56 0 2024-04-15T21:02:39.473 INFO:tasks.workunit.client.0.smithi072.stdout:8/325: creat d3/de/d1b/f62 x:0 0 0 2024-04-15T21:02:39.476 INFO:tasks.workunit.client.0.smithi072.stdout:8/326: chown d3/de/c53 7253 1 2024-04-15T21:02:39.477 INFO:tasks.workunit.client.1.smithi149.stdout:0/687: dread d1/d5/d24/d30/d43/f75 [0,4194304] 0 2024-04-15T21:02:39.479 INFO:tasks.workunit.client.1.smithi149.stdout:7/510: mknod d3/d17/d1f/d93/cb7 0 2024-04-15T21:02:39.479 INFO:tasks.workunit.client.0.smithi072.stdout:5/291: dwrite d0/d3/f16 [0,4194304] 0 2024-04-15T21:02:39.482 INFO:tasks.workunit.client.0.smithi072.stdout:0/267: mkdir d0/d19/d58 0 2024-04-15T21:02:39.486 INFO:tasks.workunit.client.0.smithi072.stdout:9/253: write d4/d29/f36 [1801581,98722] 0 2024-04-15T21:02:39.486 INFO:tasks.workunit.client.0.smithi072.stdout:5/292: write d0/d3/d7/d12/d31/f3d [4604898,21206] 0 2024-04-15T21:02:39.487 INFO:tasks.workunit.client.1.smithi149.stdout:7/511: dwrite d3/d17/d1f/f25 [0,4194304] 0 2024-04-15T21:02:39.490 INFO:tasks.workunit.client.0.smithi072.stdout:4/268: link d7/d15/l36 d7/d28/l4b 0 2024-04-15T21:02:39.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/327: dwrite d3/de/d21/d2e/f42 [0,4194304] 0 2024-04-15T21:02:39.491 INFO:tasks.workunit.client.0.smithi072.stdout:2/278: chown d2/c3c 18845340 1 2024-04-15T21:02:39.492 INFO:tasks.workunit.client.0.smithi072.stdout:5/293: readlink d0/d3/d7/d12/l19 0 2024-04-15T21:02:39.494 INFO:tasks.workunit.client.0.smithi072.stdout:4/269: write d7/d23/f2a [5695940,50427] 0 2024-04-15T21:02:39.494 INFO:tasks.workunit.client.1.smithi149.stdout:7/512: fdatasync d3/d17/d1f/f8e 0 2024-04-15T21:02:39.495 INFO:tasks.workunit.client.0.smithi072.stdout:0/268: dwrite d0/d6/f41 [0,4194304] 0 2024-04-15T21:02:39.497 INFO:tasks.workunit.client.0.smithi072.stdout:4/270: chown d7/d23/l27 2 1 2024-04-15T21:02:39.498 INFO:tasks.workunit.client.0.smithi072.stdout:4/271: read d7/f43 [30990,2694] 0 2024-04-15T21:02:39.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/501: sync 2024-04-15T21:02:39.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/427: sync 2024-04-15T21:02:39.504 INFO:tasks.workunit.client.1.smithi149.stdout:4/588: sync 2024-04-15T21:02:39.504 INFO:tasks.workunit.client.1.smithi149.stdout:0/688: fsync d1/d5/d24/d50/d13/d38/fd1 0 2024-04-15T21:02:39.506 INFO:tasks.workunit.client.0.smithi072.stdout:7/238: sync 2024-04-15T21:02:39.507 INFO:tasks.workunit.client.0.smithi072.stdout:2/279: mknod d2/d37/c5b 0 2024-04-15T21:02:39.507 INFO:tasks.workunit.client.0.smithi072.stdout:5/294: mkdir d0/d3/d6/d14/d61 0 2024-04-15T21:02:39.508 INFO:tasks.workunit.client.0.smithi072.stdout:7/239: fdatasync d2/d7/d25/d2d/d47/f4a 0 2024-04-15T21:02:39.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/280: read - d2/d38/f56 zero size 2024-04-15T21:02:39.510 INFO:tasks.workunit.client.1.smithi149.stdout:7/513: rename d3/d17/c99 to d3/cb8 0 2024-04-15T21:02:39.512 INFO:tasks.workunit.client.0.smithi072.stdout:9/254: mkdir d4/d1f/d2c/d47 0 2024-04-15T21:02:39.516 INFO:tasks.workunit.client.0.smithi072.stdout:0/269: unlink d0/d19/d2b/f40 0 2024-04-15T21:02:39.518 INFO:tasks.workunit.client.0.smithi072.stdout:9/255: dread d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:39.520 INFO:tasks.workunit.client.0.smithi072.stdout:9/256: read d4/d1f/d2c/f35 [810031,86063] 0 2024-04-15T21:02:39.521 INFO:tasks.workunit.client.0.smithi072.stdout:9/257: write d4/f1e [672694,58073] 0 2024-04-15T21:02:39.521 INFO:tasks.workunit.client.0.smithi072.stdout:4/272: mkdir d7/d10/d41/d4c 0 2024-04-15T21:02:39.522 INFO:tasks.workunit.client.0.smithi072.stdout:3/279: link d1/d26/c35 d1/d15/d32/c56 0 2024-04-15T21:02:39.522 INFO:tasks.workunit.client.0.smithi072.stdout:0/270: dwrite d0/f29 [4194304,4194304] 0 2024-04-15T21:02:39.523 INFO:tasks.workunit.client.0.smithi072.stdout:9/258: write d4/d1f/d2c/f35 [1973417,74629] 0 2024-04-15T21:02:39.525 INFO:tasks.workunit.client.0.smithi072.stdout:9/259: dread f3 [4194304,4194304] 0 2024-04-15T21:02:39.526 INFO:tasks.workunit.client.0.smithi072.stdout:8/328: mknod d3/de/c63 0 2024-04-15T21:02:39.527 INFO:tasks.workunit.client.0.smithi072.stdout:6/277: truncate d2/d10/d11/d34/f3a 497681 0 2024-04-15T21:02:39.529 INFO:tasks.workunit.client.1.smithi149.stdout:3/502: creat d1/db/d40/d56/d84/d85/f93 x:0 0 0 2024-04-15T21:02:39.531 INFO:tasks.workunit.client.1.smithi149.stdout:0/689: fdatasync d1/f7b 0 2024-04-15T21:02:39.535 INFO:tasks.workunit.client.0.smithi072.stdout:7/240: symlink d2/d7/d25/d2d/d47/l4b 0 2024-04-15T21:02:39.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/589: symlink dc/d2c/d3e/d35/d4b/lc3 0 2024-04-15T21:02:39.540 INFO:tasks.workunit.client.0.smithi072.stdout:7/241: dwrite d2/d7/d25/f34 [0,4194304] 0 2024-04-15T21:02:39.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/428: creat d1/db/d14/f7d x:0 0 0 2024-04-15T21:02:39.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/503: dread d1/db/d24/d2b/f1b [0,4194304] 0 2024-04-15T21:02:39.548 INFO:tasks.workunit.client.0.smithi072.stdout:1/253: sync 2024-04-15T21:02:39.549 INFO:tasks.workunit.client.0.smithi072.stdout:1/254: write d5/f17 [1272492,60137] 0 2024-04-15T21:02:39.551 INFO:tasks.workunit.client.1.smithi149.stdout:0/690: mknod d1/d5/d24/d50/ced 0 2024-04-15T21:02:39.553 INFO:tasks.workunit.client.1.smithi149.stdout:1/429: symlink d1/d17/d52/l7e 0 2024-04-15T21:02:39.553 INFO:tasks.workunit.client.1.smithi149.stdout:1/430: readlink d1/d17/l4a 0 2024-04-15T21:02:39.554 INFO:tasks.workunit.client.1.smithi149.stdout:1/431: stat d1/db/d16/l49 0 2024-04-15T21:02:39.555 INFO:tasks.workunit.client.1.smithi149.stdout:3/504: rename d1/db/f41 to d1/d81/f94 0 2024-04-15T21:02:39.556 INFO:tasks.workunit.client.1.smithi149.stdout:3/505: fsync d1/db/d28/f44 0 2024-04-15T21:02:39.556 INFO:tasks.workunit.client.1.smithi149.stdout:7/514: fdatasync d3/d17/f31 0 2024-04-15T21:02:39.560 INFO:tasks.workunit.client.1.smithi149.stdout:1/432: write d1/f3 [4537858,24674] 0 2024-04-15T21:02:39.561 INFO:tasks.workunit.client.0.smithi072.stdout:2/281: symlink d2/d38/l5c 0 2024-04-15T21:02:39.563 INFO:tasks.workunit.client.0.smithi072.stdout:5/295: rename d0/d41 to d0/d3/d7/d12/d31/d62 0 2024-04-15T21:02:39.564 INFO:tasks.workunit.client.0.smithi072.stdout:5/296: read - d0/f4a zero size 2024-04-15T21:02:39.565 INFO:tasks.workunit.client.0.smithi072.stdout:5/297: fsync d0/d3/d23/f4b 0 2024-04-15T21:02:39.569 INFO:tasks.workunit.client.1.smithi149.stdout:7/515: rename d3/d16/d20/d36/d3d/d56/f6f to d3/da9/fb9 0 2024-04-15T21:02:39.570 INFO:tasks.workunit.client.1.smithi149.stdout:1/433: chown d1/d17/d52/f2a 1951812 1 2024-04-15T21:02:39.571 INFO:tasks.workunit.client.1.smithi149.stdout:1/434: stat d1/d17/d52/f34 0 2024-04-15T21:02:39.572 INFO:tasks.workunit.client.1.smithi149.stdout:3/506: fsync d1/db/d24/f5d 0 2024-04-15T21:02:39.579 INFO:tasks.workunit.client.0.smithi072.stdout:3/280: symlink d1/d15/d32/l57 0 2024-04-15T21:02:39.580 INFO:tasks.workunit.client.1.smithi149.stdout:1/435: unlink d1/d17/d36/d6f/d70/f75 0 2024-04-15T21:02:39.582 INFO:tasks.workunit.client.0.smithi072.stdout:6/278: dwrite d2/d10/d11/d15/f53 [0,4194304] 0 2024-04-15T21:02:39.583 INFO:tasks.workunit.client.0.smithi072.stdout:0/271: mkdir d0/d45/d52/d53/d59 0 2024-04-15T21:02:39.585 INFO:tasks.workunit.client.0.smithi072.stdout:9/260: symlink d4/d1f/d2c/l48 0 2024-04-15T21:02:39.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/436: dwrite d1/f5 [8388608,4194304] 0 2024-04-15T21:02:39.586 INFO:tasks.workunit.client.1.smithi149.stdout:3/507: creat d1/db/d40/d56/f95 x:0 0 0 2024-04-15T21:02:39.588 INFO:tasks.workunit.client.0.smithi072.stdout:8/329: symlink d3/d4/d4d/l64 0 2024-04-15T21:02:39.589 INFO:tasks.workunit.client.1.smithi149.stdout:0/691: link d1/d5/d24/d8a/c94 d1/cee 0 2024-04-15T21:02:39.592 INFO:tasks.workunit.client.1.smithi149.stdout:7/516: symlink d3/d17/d1f/lba 0 2024-04-15T21:02:39.595 INFO:tasks.workunit.client.1.smithi149.stdout:1/437: symlink d1/l7f 0 2024-04-15T21:02:39.597 INFO:tasks.workunit.client.1.smithi149.stdout:1/438: write d1/db/f33 [5444082,90342] 0 2024-04-15T21:02:39.597 INFO:tasks.workunit.client.1.smithi149.stdout:3/508: write d1/d81/f94 [1409781,46426] 0 2024-04-15T21:02:39.599 INFO:tasks.workunit.client.1.smithi149.stdout:1/439: truncate d1/d17/d52/d42/f74 1033126 0 2024-04-15T21:02:39.601 INFO:tasks.workunit.client.0.smithi072.stdout:4/273: link d7/f38 d7/d28/f4d 0 2024-04-15T21:02:39.602 INFO:tasks.workunit.client.1.smithi149.stdout:7/517: symlink d3/d16/lbb 0 2024-04-15T21:02:39.602 INFO:tasks.workunit.client.0.smithi072.stdout:4/274: readlink d7/d23/l27 0 2024-04-15T21:02:39.602 INFO:tasks.workunit.client.0.smithi072.stdout:5/298: dwrite d0/d3/d7/d12/f51 [0,4194304] 0 2024-04-15T21:02:39.603 INFO:tasks.workunit.client.0.smithi072.stdout:3/281: read - d1/f43 zero size 2024-04-15T21:02:39.604 INFO:tasks.workunit.client.1.smithi149.stdout:1/440: symlink d1/l80 0 2024-04-15T21:02:39.605 INFO:tasks.workunit.client.1.smithi149.stdout:3/509: dwrite d1/db/d23/d5e/f8f [0,4194304] 0 2024-04-15T21:02:39.606 INFO:tasks.workunit.client.1.smithi149.stdout:1/441: read d1/f62 [3162762,48465] 0 2024-04-15T21:02:39.612 INFO:tasks.workunit.client.1.smithi149.stdout:7/518: creat d3/d16/d20/d9c/fbc x:0 0 0 2024-04-15T21:02:39.617 INFO:tasks.workunit.client.1.smithi149.stdout:1/442: dread d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:39.618 INFO:tasks.workunit.client.1.smithi149.stdout:1/443: fdatasync d1/d17/d52/d42/f74 0 2024-04-15T21:02:39.619 INFO:tasks.workunit.client.0.smithi072.stdout:8/330: creat d3/d4/d3b/f65 x:0 0 0 2024-04-15T21:02:39.621 INFO:tasks.workunit.client.1.smithi149.stdout:3/510: mknod d1/db/d24/d4d/c96 0 2024-04-15T21:02:39.625 INFO:tasks.workunit.client.0.smithi072.stdout:7/242: truncate d2/f16 259974 0 2024-04-15T21:02:39.626 INFO:tasks.workunit.client.0.smithi072.stdout:1/255: truncate d5/db/d27/f47 220513 0 2024-04-15T21:02:39.627 INFO:tasks.workunit.client.0.smithi072.stdout:3/282: creat d1/d26/f58 x:0 0 0 2024-04-15T21:02:39.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/444: rename d1/db/dc/d38/d39/d43/fd to d1/d17/d36/d69/f81 0 2024-04-15T21:02:39.631 INFO:tasks.workunit.client.0.smithi072.stdout:6/279: mknod d2/d42/c57 0 2024-04-15T21:02:39.631 INFO:tasks.workunit.client.0.smithi072.stdout:3/283: write d1/d26/f58 [321958,116117] 0 2024-04-15T21:02:39.632 INFO:tasks.workunit.client.0.smithi072.stdout:6/280: write d2/d40/f4d [209633,90088] 0 2024-04-15T21:02:39.634 INFO:tasks.workunit.client.0.smithi072.stdout:9/261: write d4/f1b [266487,77152] 0 2024-04-15T21:02:39.635 INFO:tasks.workunit.client.0.smithi072.stdout:8/331: mknod d3/c66 0 2024-04-15T21:02:39.636 INFO:tasks.workunit.client.0.smithi072.stdout:2/282: creat d2/d3/f5d x:0 0 0 2024-04-15T21:02:39.637 INFO:tasks.workunit.client.0.smithi072.stdout:2/283: chown d2/d8/d41/l42 60948 1 2024-04-15T21:02:39.638 INFO:tasks.workunit.client.0.smithi072.stdout:5/299: creat d0/d3/d7/d12/d31/d55/d58/f63 x:0 0 0 2024-04-15T21:02:39.639 INFO:tasks.workunit.client.0.smithi072.stdout:5/300: dread - d0/d3/d7/d12/f54 zero size 2024-04-15T21:02:39.640 INFO:tasks.workunit.client.0.smithi072.stdout:7/243: mkdir d2/d7/d25/d4c 0 2024-04-15T21:02:39.641 INFO:tasks.workunit.client.0.smithi072.stdout:7/244: fsync d2/d7/d25/f34 0 2024-04-15T21:02:39.642 INFO:tasks.workunit.client.1.smithi149.stdout:1/445: rename d1/db/dc/f55 to d1/d17/d36/d69/f82 0 2024-04-15T21:02:39.647 INFO:tasks.workunit.client.0.smithi072.stdout:7/245: dwrite d2/fa [0,4194304] 0 2024-04-15T21:02:39.649 INFO:tasks.workunit.client.0.smithi072.stdout:9/262: unlink d4/l18 0 2024-04-15T21:02:39.652 INFO:tasks.workunit.client.0.smithi072.stdout:8/332: creat d3/de/d1b/d3f/f67 x:0 0 0 2024-04-15T21:02:39.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/511: dwrite d1/db/d24/f36 [0,4194304] 0 2024-04-15T21:02:39.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/301: creat d0/d3/d7/d12/d31/d62/f64 x:0 0 0 2024-04-15T21:02:39.661 INFO:tasks.workunit.client.1.smithi149.stdout:7/519: link d3/d16/d20/d36/f2f d3/d16/d20/d36/fbd 0 2024-04-15T21:02:39.665 INFO:tasks.workunit.client.1.smithi149.stdout:1/446: link d1/db/d16/d35/c3b d1/db/dc/d11/d3e/c83 0 2024-04-15T21:02:39.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/512: dwrite d1/db/d24/d39/f70 [0,4194304] 0 2024-04-15T21:02:39.666 INFO:tasks.workunit.client.0.smithi072.stdout:0/272: truncate d0/d45/f3e 269528 0 2024-04-15T21:02:39.666 INFO:tasks.workunit.client.1.smithi149.stdout:3/513: chown d1/c54 3 1 2024-04-15T21:02:39.674 INFO:tasks.workunit.client.0.smithi072.stdout:1/256: rename d5/fe to d5/db/d2d/d3a/f50 0 2024-04-15T21:02:39.677 INFO:tasks.workunit.client.1.smithi149.stdout:7/520: rename d3/d17/d1f/d93/l98 to d3/d16/d20/dab/lbe 0 2024-04-15T21:02:39.678 INFO:tasks.workunit.client.1.smithi149.stdout:7/521: dread - d3/d16/d20/d60/f87 zero size 2024-04-15T21:02:39.679 INFO:tasks.workunit.client.1.smithi149.stdout:1/447: unlink d1/db/f2c 0 2024-04-15T21:02:39.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/448: chown d1/d17/d36/l3a 283 1 2024-04-15T21:02:39.681 INFO:tasks.workunit.client.0.smithi072.stdout:2/284: write d2/d3/f1d [875972,57900] 0 2024-04-15T21:02:39.682 INFO:tasks.workunit.client.1.smithi149.stdout:3/514: chown d1/db/ce 910 1 2024-04-15T21:02:39.682 INFO:tasks.workunit.client.1.smithi149.stdout:3/515: chown d1/db/d28 6249 1 2024-04-15T21:02:39.683 INFO:tasks.workunit.client.0.smithi072.stdout:2/285: chown d2/l57 2206299 1 2024-04-15T21:02:39.683 INFO:tasks.workunit.client.1.smithi149.stdout:3/516: stat d1/db/d24/d8a 0 2024-04-15T21:02:39.683 INFO:tasks.workunit.client.0.smithi072.stdout:9/263: mknod d4/d1f/d31/c49 0 2024-04-15T21:02:39.687 INFO:tasks.workunit.client.1.smithi149.stdout:6/472: sync 2024-04-15T21:02:39.687 INFO:tasks.workunit.client.1.smithi149.stdout:2/575: sync 2024-04-15T21:02:39.688 INFO:tasks.workunit.client.0.smithi072.stdout:5/302: creat d0/d3/d7/d12/d31/d55/d58/f65 x:0 0 0 2024-04-15T21:02:39.689 INFO:tasks.workunit.client.1.smithi149.stdout:1/449: chown d1/db/dc/d11/d3f/d45/c60 1529 1 2024-04-15T21:02:39.696 INFO:tasks.workunit.client.1.smithi149.stdout:7/522: creat d3/d16/d20/d36/d3d/da4/fbf x:0 0 0 2024-04-15T21:02:39.698 INFO:tasks.workunit.client.1.smithi149.stdout:7/523: stat d3/d16/d20/d60/f7e 0 2024-04-15T21:02:39.698 INFO:tasks.workunit.client.1.smithi149.stdout:1/450: dread d1/db/dc/d38/d39/d43/f1f [0,4194304] 0 2024-04-15T21:02:39.699 INFO:tasks.workunit.client.1.smithi149.stdout:1/451: stat d1/d17/d52/d42 0 2024-04-15T21:02:39.699 INFO:tasks.workunit.client.0.smithi072.stdout:7/246: dwrite d2/d10/f13 [4194304,4194304] 0 2024-04-15T21:02:39.700 INFO:tasks.workunit.client.0.smithi072.stdout:1/257: mkdir d5/d31/d51 0 2024-04-15T21:02:39.701 INFO:tasks.workunit.client.1.smithi149.stdout:1/452: chown d1/d17/f1c 63202888 1 2024-04-15T21:02:39.704 INFO:tasks.workunit.client.0.smithi072.stdout:6/281: creat d2/d10/f58 x:0 0 0 2024-04-15T21:02:39.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/524: dwrite d3/d39/f89 [0,4194304] 0 2024-04-15T21:02:39.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/282: dwrite d2/d42/f46 [0,4194304] 0 2024-04-15T21:02:39.711 INFO:tasks.workunit.client.1.smithi149.stdout:2/576: dread d4/d7/d10/d6b/d21/d5e/dbe/da7/d6c/f8f [0,4194304] 0 2024-04-15T21:02:39.715 INFO:tasks.workunit.client.0.smithi072.stdout:5/303: creat d0/d3/d7/d12/d31/d55/d58/f66 x:0 0 0 2024-04-15T21:02:39.720 INFO:tasks.workunit.client.0.smithi072.stdout:3/284: rename d1/fd to d1/d26/f59 0 2024-04-15T21:02:39.722 INFO:tasks.workunit.client.0.smithi072.stdout:3/285: write d1/d15/d32/d2f/d1a/f1d [1133615,24901] 0 2024-04-15T21:02:39.723 INFO:tasks.workunit.client.0.smithi072.stdout:7/247: symlink d2/d10/l4d 0 2024-04-15T21:02:39.728 INFO:tasks.workunit.client.0.smithi072.stdout:1/258: dwrite d5/f32 [0,4194304] 0 2024-04-15T21:02:39.729 INFO:tasks.workunit.client.0.smithi072.stdout:5/304: symlink d0/d3/d7/d12/d31/d55/l67 0 2024-04-15T21:02:39.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/259: chown d5/db/d2d/d3a/c45 1271365126 1 2024-04-15T21:02:39.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/260: stat d5/d31/f4c 0 2024-04-15T21:02:39.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/248: creat d2/d7/f4e x:0 0 0 2024-04-15T21:02:39.733 INFO:tasks.workunit.client.0.smithi072.stdout:2/286: creat d2/d3/f5e x:0 0 0 2024-04-15T21:02:39.735 INFO:tasks.workunit.client.0.smithi072.stdout:6/283: fsync d2/d1a/f1b 0 2024-04-15T21:02:39.735 INFO:tasks.workunit.client.1.smithi149.stdout:3/517: mkdir d1/db/d24/d39/d79/d97 0 2024-04-15T21:02:39.736 INFO:tasks.workunit.client.0.smithi072.stdout:5/305: symlink d0/d3/d23/d24/l68 0 2024-04-15T21:02:39.737 INFO:tasks.workunit.client.1.smithi149.stdout:3/518: truncate d1/db/d24/d8a/f8c 520385 0 2024-04-15T21:02:39.740 INFO:tasks.workunit.client.0.smithi072.stdout:7/249: symlink d2/d7/d25/l4f 0 2024-04-15T21:02:39.740 INFO:tasks.workunit.client.0.smithi072.stdout:1/261: dwrite d5/db/d2d/d3a/f39 [0,4194304] 0 2024-04-15T21:02:39.741 INFO:tasks.workunit.client.1.smithi149.stdout:7/525: readlink d3/d34/l50 0 2024-04-15T21:02:39.741 INFO:tasks.workunit.client.0.smithi072.stdout:1/262: write d5/f32 [128057,121921] 0 2024-04-15T21:02:39.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/519: getdents d1/db/d28/d87 0 2024-04-15T21:02:39.748 INFO:tasks.workunit.client.0.smithi072.stdout:3/286: creat d1/d15/d32/f5a x:0 0 0 2024-04-15T21:02:39.752 INFO:tasks.workunit.client.1.smithi149.stdout:1/453: getdents d1/db/d14 0 2024-04-15T21:02:39.753 INFO:tasks.workunit.client.0.smithi072.stdout:6/284: dread d2/fc [4194304,4194304] 0 2024-04-15T21:02:39.754 INFO:tasks.workunit.client.0.smithi072.stdout:7/250: symlink d2/d7/d25/d2d/l50 0 2024-04-15T21:02:39.755 INFO:tasks.workunit.client.0.smithi072.stdout:7/251: truncate d2/d10/f2e 570522 0 2024-04-15T21:02:39.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/520: creat d1/db/d24/d39/d79/d97/f98 x:0 0 0 2024-04-15T21:02:39.756 INFO:tasks.workunit.client.0.smithi072.stdout:7/252: readlink d2/d7/d25/d2d/l50 0 2024-04-15T21:02:39.756 INFO:tasks.workunit.client.1.smithi149.stdout:1/454: creat d1/d17/d52/f84 x:0 0 0 2024-04-15T21:02:39.758 INFO:tasks.workunit.client.1.smithi149.stdout:1/455: chown d1/db/dc/d11/d3f/d45/f57 22104 1 2024-04-15T21:02:39.758 INFO:tasks.workunit.client.1.smithi149.stdout:1/456: readlink d1/d17/d36/l3a 0 2024-04-15T21:02:39.758 INFO:tasks.workunit.client.0.smithi072.stdout:2/287: mkdir d2/d3/d5f 0 2024-04-15T21:02:39.759 INFO:tasks.workunit.client.0.smithi072.stdout:4/275: sync 2024-04-15T21:02:39.761 INFO:tasks.workunit.client.0.smithi072.stdout:9/264: write d4/d1f/f24 [3612896,66947] 0 2024-04-15T21:02:39.763 INFO:tasks.workunit.client.0.smithi072.stdout:8/333: truncate d3/d4/f1e 37194 0 2024-04-15T21:02:39.766 INFO:tasks.workunit.client.0.smithi072.stdout:4/276: chown d7/d24/f1e 144309902 1 2024-04-15T21:02:39.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/306: dread d0/d3/d6/f2b [4194304,4194304] 0 2024-04-15T21:02:39.767 INFO:tasks.workunit.client.0.smithi072.stdout:2/288: dwrite d2/d8/f3a [0,4194304] 0 2024-04-15T21:02:39.767 INFO:tasks.workunit.client.0.smithi072.stdout:3/287: mkdir d1/d5b 0 2024-04-15T21:02:39.769 INFO:tasks.workunit.client.0.smithi072.stdout:4/277: chown d7/d24/f35 15362847 1 2024-04-15T21:02:39.769 INFO:tasks.workunit.client.0.smithi072.stdout:5/307: write d0/f59 [6478743,69838] 0 2024-04-15T21:02:39.769 INFO:tasks.workunit.client.0.smithi072.stdout:6/285: symlink d2/d10/d11/l59 0 2024-04-15T21:02:39.771 INFO:tasks.workunit.client.0.smithi072.stdout:4/278: fsync d7/fc 0 2024-04-15T21:02:39.771 INFO:tasks.workunit.client.0.smithi072.stdout:1/263: creat d5/db/f52 x:0 0 0 2024-04-15T21:02:39.771 INFO:tasks.workunit.client.0.smithi072.stdout:2/289: write d2/d8/f3a [3799225,43040] 0 2024-04-15T21:02:39.773 INFO:tasks.workunit.client.0.smithi072.stdout:2/290: chown d2/d3/d5f 1 1 2024-04-15T21:02:39.773 INFO:tasks.workunit.client.0.smithi072.stdout:1/264: write d5/f3c [314538,27703] 0 2024-04-15T21:02:39.775 INFO:tasks.workunit.client.0.smithi072.stdout:2/291: fsync d2/d8/f13 0 2024-04-15T21:02:39.777 INFO:tasks.workunit.client.0.smithi072.stdout:2/292: dread - d2/d3/f43 zero size 2024-04-15T21:02:39.777 INFO:tasks.workunit.client.0.smithi072.stdout:0/273: dwrite d0/d45/f26 [0,4194304] 0 2024-04-15T21:02:39.777 INFO:tasks.workunit.client.0.smithi072.stdout:5/308: creat d0/d3/d23/f69 x:0 0 0 2024-04-15T21:02:39.788 INFO:tasks.workunit.client.0.smithi072.stdout:1/265: creat d5/db/d2d/d3a/d1f/f53 x:0 0 0 2024-04-15T21:02:39.791 INFO:tasks.workunit.client.0.smithi072.stdout:9/265: rename d4/cf to d4/c4a 0 2024-04-15T21:02:39.793 INFO:tasks.workunit.client.0.smithi072.stdout:0/274: creat d0/d19/d58/f5a x:0 0 0 2024-04-15T21:02:39.794 INFO:tasks.workunit.client.0.smithi072.stdout:4/279: dwrite d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:39.795 INFO:tasks.workunit.client.0.smithi072.stdout:9/266: chown d4/d1f/f24 9805133 1 2024-04-15T21:02:39.796 INFO:tasks.workunit.client.0.smithi072.stdout:2/293: dwrite d2/d38/f48 [0,4194304] 0 2024-04-15T21:02:39.798 INFO:tasks.workunit.client.0.smithi072.stdout:5/309: symlink d0/d3/d7/d1f/d50/l6a 0 2024-04-15T21:02:39.799 INFO:tasks.workunit.client.0.smithi072.stdout:6/286: getdents d2 0 2024-04-15T21:02:39.800 INFO:tasks.workunit.client.0.smithi072.stdout:1/266: rename d5/db/d2d/d3a/c15 to d5/d31/d51/c54 0 2024-04-15T21:02:39.801 INFO:tasks.workunit.client.0.smithi072.stdout:2/294: dread - d2/d3/f43 zero size 2024-04-15T21:02:39.801 INFO:tasks.workunit.client.0.smithi072.stdout:9/267: symlink d4/d1f/l4b 0 2024-04-15T21:02:39.802 INFO:tasks.workunit.client.0.smithi072.stdout:0/275: creat d0/d45/d52/f5b x:0 0 0 2024-04-15T21:02:39.802 INFO:tasks.workunit.client.0.smithi072.stdout:6/287: write d2/f2a [5312940,5375] 0 2024-04-15T21:02:39.802 INFO:tasks.workunit.client.0.smithi072.stdout:7/253: dread d2/d10/f2a [4194304,4194304] 0 2024-04-15T21:02:39.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/521: write d1/db/d23/f3a [547663,77816] 0 2024-04-15T21:02:39.806 INFO:tasks.workunit.client.0.smithi072.stdout:6/288: read - d2/d10/f58 zero size 2024-04-15T21:02:39.807 INFO:tasks.workunit.client.0.smithi072.stdout:6/289: readlink d2/d10/l35 0 2024-04-15T21:02:39.810 INFO:tasks.workunit.client.0.smithi072.stdout:1/267: dwrite d5/f9 [0,4194304] 0 2024-04-15T21:02:39.810 INFO:tasks.workunit.client.0.smithi072.stdout:4/280: symlink d7/d10/d41/d4c/l4e 0 2024-04-15T21:02:39.810 INFO:tasks.workunit.client.0.smithi072.stdout:4/281: readlink d7/d23/l27 0 2024-04-15T21:02:39.811 INFO:tasks.workunit.client.0.smithi072.stdout:1/268: fdatasync d5/db/d2d/d3a/f2e 0 2024-04-15T21:02:39.815 INFO:tasks.workunit.client.0.smithi072.stdout:1/269: dread d5/f3c [0,4194304] 0 2024-04-15T21:02:39.815 INFO:tasks.workunit.client.0.smithi072.stdout:6/290: read d2/d10/d11/d34/f38 [2329818,116654] 0 2024-04-15T21:02:39.817 INFO:tasks.workunit.client.0.smithi072.stdout:5/310: mknod d0/c6b 0 2024-04-15T21:02:39.818 INFO:tasks.workunit.client.1.smithi149.stdout:3/522: rename d1/c48 to d1/c99 0 2024-04-15T21:02:39.818 INFO:tasks.workunit.client.0.smithi072.stdout:7/254: fdatasync d2/d7/d25/f42 0 2024-04-15T21:02:39.819 INFO:tasks.workunit.client.1.smithi149.stdout:3/523: fdatasync d1/db/d23/f3a 0 2024-04-15T21:02:39.821 INFO:tasks.workunit.client.0.smithi072.stdout:0/276: creat d0/d19/d58/f5c x:0 0 0 2024-04-15T21:02:39.821 INFO:tasks.workunit.client.0.smithi072.stdout:3/288: write d1/f2e [289301,104691] 0 2024-04-15T21:02:39.822 INFO:tasks.workunit.client.0.smithi072.stdout:9/268: truncate d4/d1f/d2c/f35 1160130 0 2024-04-15T21:02:39.824 INFO:tasks.workunit.client.0.smithi072.stdout:3/289: stat d1/f51 0 2024-04-15T21:02:39.824 INFO:tasks.workunit.client.0.smithi072.stdout:0/277: fdatasync d0/d45/d52/f5b 0 2024-04-15T21:02:39.824 INFO:tasks.workunit.client.0.smithi072.stdout:2/295: creat d2/d3/d5f/f60 x:0 0 0 2024-04-15T21:02:39.825 INFO:tasks.workunit.client.1.smithi149.stdout:3/524: mknod d1/db/d24/d4d/d63/d65/c9a 0 2024-04-15T21:02:39.826 INFO:tasks.workunit.client.0.smithi072.stdout:0/278: chown d0/d19/d2b 837239019 1 2024-04-15T21:02:39.827 INFO:tasks.workunit.client.0.smithi072.stdout:4/282: readlink d7/d28/l4b 0 2024-04-15T21:02:39.827 INFO:tasks.workunit.client.0.smithi072.stdout:2/296: chown d2/d8/l25 650693 1 2024-04-15T21:02:39.828 INFO:tasks.workunit.client.0.smithi072.stdout:8/334: dwrite d3/d4/f2c [0,4194304] 0 2024-04-15T21:02:39.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/270: rmdir d5/db/d27 39 2024-04-15T21:02:39.830 INFO:tasks.workunit.client.1.smithi149.stdout:3/525: mknod d1/c9b 0 2024-04-15T21:02:39.830 INFO:tasks.workunit.client.0.smithi072.stdout:1/271: write d5/d31/f4c [879604,104769] 0 2024-04-15T21:02:39.832 INFO:tasks.workunit.client.0.smithi072.stdout:9/269: mkdir d4/d29/d4c 0 2024-04-15T21:02:39.833 INFO:tasks.workunit.client.0.smithi072.stdout:7/255: dwrite d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:02:39.834 INFO:tasks.workunit.client.1.smithi149.stdout:3/526: creat d1/db/d24/d4d/d63/d65/f9c x:0 0 0 2024-04-15T21:02:39.835 INFO:tasks.workunit.client.1.smithi149.stdout:3/527: readlink d1/db/l7b 0 2024-04-15T21:02:39.836 INFO:tasks.workunit.client.0.smithi072.stdout:3/290: creat d1/d15/d32/d2f/f5c x:0 0 0 2024-04-15T21:02:39.836 INFO:tasks.workunit.client.0.smithi072.stdout:8/335: chown d3/de/l19 68776956 1 2024-04-15T21:02:39.838 INFO:tasks.workunit.client.0.smithi072.stdout:2/297: rmdir d2/d37 39 2024-04-15T21:02:39.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/270: fsync d4/d1f/d2c/f2e 0 2024-04-15T21:02:39.838 INFO:tasks.workunit.client.0.smithi072.stdout:1/272: chown d5/d31/c3f 11104 1 2024-04-15T21:02:39.839 INFO:tasks.workunit.client.0.smithi072.stdout:7/256: read d2/d10/d1f/d38/ff [741207,29140] 0 2024-04-15T21:02:39.841 INFO:tasks.workunit.client.0.smithi072.stdout:0/279: truncate d0/d45/f1d 591406 0 2024-04-15T21:02:39.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/283: dwrite d7/d23/f2a [0,4194304] 0 2024-04-15T21:02:39.843 INFO:tasks.workunit.client.0.smithi072.stdout:0/280: fsync d0/d6/f31 0 2024-04-15T21:02:39.849 INFO:tasks.workunit.client.0.smithi072.stdout:5/311: mknod d0/c6c 0 2024-04-15T21:02:39.849 INFO:tasks.workunit.client.0.smithi072.stdout:2/298: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-15T21:02:39.852 INFO:tasks.workunit.client.0.smithi072.stdout:2/299: chown d2/d3/d5f/f60 5 1 2024-04-15T21:02:39.857 INFO:tasks.workunit.client.0.smithi072.stdout:8/336: mknod d3/de/d1b/c68 0 2024-04-15T21:02:39.859 INFO:tasks.workunit.client.0.smithi072.stdout:2/300: dwrite d2/d3/f46 [0,4194304] 0 2024-04-15T21:02:39.861 INFO:tasks.workunit.client.0.smithi072.stdout:2/301: write d2/d8/f30 [1796734,101333] 0 2024-04-15T21:02:39.864 INFO:tasks.workunit.client.1.smithi149.stdout:3/528: truncate d1/db/d23/f3a 493226 0 2024-04-15T21:02:39.867 INFO:tasks.workunit.client.0.smithi072.stdout:0/281: mkdir d0/d3/d5/d5d 0 2024-04-15T21:02:39.869 INFO:tasks.workunit.client.1.smithi149.stdout:3/529: creat d1/db/d24/d4d/f9d x:0 0 0 2024-04-15T21:02:39.872 INFO:tasks.workunit.client.0.smithi072.stdout:0/282: dread - d0/d45/d52/f5b zero size 2024-04-15T21:02:39.872 INFO:tasks.workunit.client.0.smithi072.stdout:2/302: dwrite d2/d3/f5e [0,4194304] 0 2024-04-15T21:02:39.873 INFO:tasks.workunit.client.0.smithi072.stdout:6/291: dread d2/d42/f45 [0,4194304] 0 2024-04-15T21:02:39.874 INFO:tasks.workunit.client.0.smithi072.stdout:2/303: chown d2/d3/d5f/f60 44155 1 2024-04-15T21:02:39.874 INFO:tasks.workunit.client.0.smithi072.stdout:0/283: write d0/d19/d2b/f43 [795026,86758] 0 2024-04-15T21:02:39.878 INFO:tasks.workunit.client.0.smithi072.stdout:7/257: creat d2/d10/d43/f51 x:0 0 0 2024-04-15T21:02:39.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/258: dread - d2/d7/d25/d2d/d46/f48 zero size 2024-04-15T21:02:39.884 INFO:tasks.workunit.client.1.smithi149.stdout:3/530: getdents d1/db/d24/d4d/d63/d65 0 2024-04-15T21:02:39.886 INFO:tasks.workunit.client.0.smithi072.stdout:8/337: dwrite d3/f3c [0,4194304] 0 2024-04-15T21:02:39.891 INFO:tasks.workunit.client.1.smithi149.stdout:3/531: dwrite d1/d81/f94 [0,4194304] 0 2024-04-15T21:02:39.895 INFO:tasks.workunit.client.0.smithi072.stdout:3/291: dread d1/d15/d32/d2f/f33 [0,4194304] 0 2024-04-15T21:02:39.899 INFO:tasks.workunit.client.0.smithi072.stdout:9/271: truncate d4/d1f/f24 3276196 0 2024-04-15T21:02:39.903 INFO:tasks.workunit.client.0.smithi072.stdout:1/273: creat d5/db/f55 x:0 0 0 2024-04-15T21:02:39.906 INFO:tasks.workunit.client.0.smithi072.stdout:6/292: rename d2/d1a/l52 to d2/d10/d24/l5a 0 2024-04-15T21:02:39.906 INFO:tasks.workunit.client.0.smithi072.stdout:9/272: dwrite d4/d1f/d2c/f46 [0,4194304] 0 2024-04-15T21:02:39.906 INFO:tasks.workunit.client.0.smithi072.stdout:0/284: mknod d0/d45/d52/c5e 0 2024-04-15T21:02:39.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/293: dread - d2/d10/d11/d1f/f4c zero size 2024-04-15T21:02:39.909 INFO:tasks.workunit.client.0.smithi072.stdout:0/285: chown d0/d3/d5/f15 1622 1 2024-04-15T21:02:39.910 INFO:tasks.workunit.client.0.smithi072.stdout:3/292: mknod d1/d15/d32/d2f/d1a/c5d 0 2024-04-15T21:02:39.912 INFO:tasks.workunit.client.0.smithi072.stdout:2/304: symlink d2/d3/l61 0 2024-04-15T21:02:39.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:39 smithi072 ceph-mon[29079]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:39.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:39 smithi072 ceph-mon[29079]: mgrmap e23: smithi149.qgbaiy(active, since 2s) 2024-04-15T21:02:39.914 INFO:tasks.workunit.client.0.smithi072.stdout:8/338: rename d3/de/d1b/c49 to d3/d4/d3b/c69 0 2024-04-15T21:02:39.915 INFO:tasks.workunit.client.0.smithi072.stdout:1/274: write d5/db/d2d/d3a/f13 [2478877,72742] 0 2024-04-15T21:02:39.915 INFO:tasks.workunit.client.0.smithi072.stdout:4/284: getdents d7/d28/d37 0 2024-04-15T21:02:39.918 INFO:tasks.workunit.client.0.smithi072.stdout:5/312: getdents d0 0 2024-04-15T21:02:39.918 INFO:tasks.workunit.client.0.smithi072.stdout:6/294: mknod d2/d10/d11/d15/c5b 0 2024-04-15T21:02:39.920 INFO:tasks.workunit.client.0.smithi072.stdout:3/293: creat d1/d15/f5e x:0 0 0 2024-04-15T21:02:39.920 INFO:tasks.workunit.client.0.smithi072.stdout:1/275: readlink d5/db/d2d/d3a/d1f/l46 0 2024-04-15T21:02:39.920 INFO:tasks.workunit.client.0.smithi072.stdout:9/273: dwrite d4/f5 [8388608,4194304] 0 2024-04-15T21:02:39.924 INFO:tasks.workunit.client.1.smithi149.stdout:9/475: sync 2024-04-15T21:02:39.924 INFO:tasks.workunit.client.1.smithi149.stdout:8/571: sync 2024-04-15T21:02:39.924 INFO:tasks.workunit.client.0.smithi072.stdout:9/274: stat d4/d29/l38 0 2024-04-15T21:02:39.925 INFO:tasks.workunit.client.0.smithi072.stdout:5/313: write d0/d3/d7/d12/f51 [4768308,436] 0 2024-04-15T21:02:39.926 INFO:tasks.workunit.client.0.smithi072.stdout:1/276: chown d5/db/d2d/c4d 2993 1 2024-04-15T21:02:39.927 INFO:tasks.workunit.client.0.smithi072.stdout:7/259: write d2/f5 [809135,103791] 0 2024-04-15T21:02:39.928 INFO:tasks.workunit.client.0.smithi072.stdout:2/305: symlink d2/l62 0 2024-04-15T21:02:39.929 INFO:tasks.workunit.client.1.smithi149.stdout:3/532: dread d1/db/f1d [0,4194304] 0 2024-04-15T21:02:39.930 INFO:tasks.workunit.client.0.smithi072.stdout:0/286: dwrite d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:39.930 INFO:tasks.workunit.client.0.smithi072.stdout:7/260: chown d2/d10/f3c 42748424 1 2024-04-15T21:02:39.932 INFO:tasks.workunit.client.0.smithi072.stdout:0/287: chown d0/d45/d35/d3a 91106 1 2024-04-15T21:02:39.932 INFO:tasks.workunit.client.0.smithi072.stdout:7/261: read - d2/d10/d26/f40 zero size 2024-04-15T21:02:39.933 INFO:tasks.workunit.client.0.smithi072.stdout:0/288: dread - d0/d6/f4c zero size 2024-04-15T21:02:39.933 INFO:tasks.workunit.client.0.smithi072.stdout:8/339: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:39.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/340: chown d3/d4/c5e 1 1 2024-04-15T21:02:39.935 INFO:tasks.workunit.client.0.smithi072.stdout:8/341: stat d3 0 2024-04-15T21:02:39.936 INFO:tasks.workunit.client.1.smithi149.stdout:9/476: symlink d23/d3c/d87/d9a/la1 0 2024-04-15T21:02:39.938 INFO:tasks.workunit.client.0.smithi072.stdout:6/295: rename d2/d1a/f50 to d2/d10/d11/d34/f5c 0 2024-04-15T21:02:39.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/533: symlink d1/db/d24/d4d/d63/d65/l9e 0 2024-04-15T21:02:39.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:39 smithi149 ceph-mon[36029]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:39.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:39 smithi149 ceph-mon[36029]: mgrmap e23: smithi149.qgbaiy(active, since 2s) 2024-04-15T21:02:39.941 INFO:tasks.workunit.client.0.smithi072.stdout:7/262: dwrite d2/d10/f2e [0,4194304] 0 2024-04-15T21:02:39.942 INFO:tasks.workunit.client.0.smithi072.stdout:3/294: mknod d1/d15/d32/d2f/c5f 0 2024-04-15T21:02:39.943 INFO:tasks.workunit.client.1.smithi149.stdout:8/572: mknod d2/df/d10/d21/dc1/ccf 0 2024-04-15T21:02:39.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/534: creat d1/db/d40/d56/d84/f9f x:0 0 0 2024-04-15T21:02:39.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/277: dwrite d5/db/d27/f34 [0,4194304] 0 2024-04-15T21:02:39.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/535: stat d1/c9b 0 2024-04-15T21:02:39.960 INFO:tasks.workunit.client.1.smithi149.stdout:9/477: link d23/d2b/d37/d6d/f74 d23/d2b/d37/d50/fa2 0 2024-04-15T21:02:39.961 INFO:tasks.workunit.client.1.smithi149.stdout:3/536: mkdir d1/db/d40/da0 0 2024-04-15T21:02:39.962 INFO:tasks.workunit.client.0.smithi072.stdout:8/342: rmdir d3 39 2024-04-15T21:02:39.969 INFO:tasks.workunit.client.0.smithi072.stdout:5/314: rename d0/c6c to d0/d3/d7/d12/d31/d55/c6d 0 2024-04-15T21:02:39.971 INFO:tasks.workunit.client.0.smithi072.stdout:4/285: truncate d7/d23/f29 2177207 0 2024-04-15T21:02:39.974 INFO:tasks.workunit.client.1.smithi149.stdout:3/537: creat d1/db/d24/d39/fa1 x:0 0 0 2024-04-15T21:02:39.975 INFO:tasks.workunit.client.0.smithi072.stdout:7/263: mkdir d2/d7/d25/d2d/d52 0 2024-04-15T21:02:39.977 INFO:tasks.workunit.client.1.smithi149.stdout:8/573: dwrite d2/df/d10/d25/d32/f44 [0,4194304] 0 2024-04-15T21:02:39.980 INFO:tasks.workunit.client.0.smithi072.stdout:4/286: dread d7/d23/f25 [0,4194304] 0 2024-04-15T21:02:39.980 INFO:tasks.workunit.client.1.smithi149.stdout:8/574: dread - d2/df/d10/d25/d37/d53/daf/d85/fcb zero size 2024-04-15T21:02:39.981 INFO:tasks.workunit.client.0.smithi072.stdout:1/278: mkdir d5/db/d2d/d56 0 2024-04-15T21:02:39.981 INFO:tasks.workunit.client.0.smithi072.stdout:4/287: chown d7/d15/l36 4884468 1 2024-04-15T21:02:39.983 INFO:tasks.workunit.client.1.smithi149.stdout:3/538: truncate d1/db/d28/f32 2647617 0 2024-04-15T21:02:39.984 INFO:tasks.workunit.client.0.smithi072.stdout:2/306: getdents d2/d8/d41 0 2024-04-15T21:02:39.991 INFO:tasks.workunit.client.1.smithi149.stdout:8/575: dwrite d2/df/d10/f90 [4194304,4194304] 0 2024-04-15T21:02:39.992 INFO:tasks.workunit.client.0.smithi072.stdout:0/289: rename d0/d19/d58/f5c to d0/d6/d55/f5f 0 2024-04-15T21:02:39.992 INFO:tasks.workunit.client.1.smithi149.stdout:9/478: dread f22 [0,4194304] 0 2024-04-15T21:02:39.993 INFO:tasks.workunit.client.1.smithi149.stdout:8/576: chown d2/df/d10/d20/f91 345647 1 2024-04-15T21:02:39.994 INFO:tasks.workunit.client.1.smithi149.stdout:8/577: write d2/df/d10/f23 [8515294,50481] 0 2024-04-15T21:02:39.996 INFO:tasks.workunit.client.0.smithi072.stdout:9/275: dwrite d4/f7 [0,4194304] 0 2024-04-15T21:02:39.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/295: creat d1/d5b/f60 x:0 0 0 2024-04-15T21:02:39.998 INFO:tasks.workunit.client.0.smithi072.stdout:7/264: creat d2/d10/d43/f53 x:0 0 0 2024-04-15T21:02:39.999 INFO:tasks.workunit.client.0.smithi072.stdout:3/296: fdatasync d1/d15/d40/f1c 0 2024-04-15T21:02:40.000 INFO:tasks.workunit.client.1.smithi149.stdout:9/479: symlink d23/d2b/d37/d50/la3 0 2024-04-15T21:02:40.004 INFO:tasks.workunit.client.0.smithi072.stdout:6/296: truncate d2/d40/f4d 181461 0 2024-04-15T21:02:40.004 INFO:tasks.workunit.client.1.smithi149.stdout:8/578: chown d2/fe 501252324 1 2024-04-15T21:02:40.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/539: truncate d1/db/f21 620029 0 2024-04-15T21:02:40.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/540: readlink d1/db/d24/d4d/d63/l69 0 2024-04-15T21:02:40.006 INFO:tasks.workunit.client.1.smithi149.stdout:9/480: mkdir d23/d2b/d37/d6d/da4 0 2024-04-15T21:02:40.007 INFO:tasks.workunit.client.1.smithi149.stdout:3/541: fsync d1/db/d24/d2b/f73 0 2024-04-15T21:02:40.007 INFO:tasks.workunit.client.1.smithi149.stdout:8/579: mknod d2/d16/cd0 0 2024-04-15T21:02:40.009 INFO:tasks.workunit.client.0.smithi072.stdout:8/343: write d3/d4/d3b/f3e [231059,56165] 0 2024-04-15T21:02:40.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/542: symlink d1/db/d40/d56/d84/la2 0 2024-04-15T21:02:40.013 INFO:tasks.workunit.client.0.smithi072.stdout:5/315: dread - d0/d3/d7/d12/d31/d62/f64 zero size 2024-04-15T21:02:40.014 INFO:tasks.workunit.client.1.smithi149.stdout:3/543: symlink d1/db/d23/d5e/la3 0 2024-04-15T21:02:40.015 INFO:tasks.workunit.client.0.smithi072.stdout:0/290: creat d0/d3/d5/f60 x:0 0 0 2024-04-15T21:02:40.016 INFO:tasks.workunit.client.0.smithi072.stdout:9/276: mkdir d4/d1f/d31/d4d 0 2024-04-15T21:02:40.017 INFO:tasks.workunit.client.0.smithi072.stdout:9/277: read d4/f7 [1539821,111383] 0 2024-04-15T21:02:40.018 INFO:tasks.workunit.client.0.smithi072.stdout:3/297: fdatasync d1/f10 0 2024-04-15T21:02:40.019 INFO:tasks.workunit.client.0.smithi072.stdout:9/278: write d4/f7 [448499,117519] 0 2024-04-15T21:02:40.020 INFO:tasks.workunit.client.1.smithi149.stdout:8/580: dread d2/df/d10/f11 [0,4194304] 0 2024-04-15T21:02:40.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/581: chown d2/df/d10/d21/c4f 6205 1 2024-04-15T21:02:40.022 INFO:tasks.workunit.client.0.smithi072.stdout:6/297: creat d2/d42/f5d x:0 0 0 2024-04-15T21:02:40.023 INFO:tasks.workunit.client.1.smithi149.stdout:5/477: sync 2024-04-15T21:02:40.023 INFO:tasks.workunit.client.0.smithi072.stdout:6/298: readlink d2/l9 0 2024-04-15T21:02:40.023 INFO:tasks.workunit.client.0.smithi072.stdout:3/298: chown d1/d15/d32/d2f/d1a/f1b 4118979 1 2024-04-15T21:02:40.024 INFO:tasks.workunit.client.0.smithi072.stdout:0/291: dwrite d0/d6/f31 [0,4194304] 0 2024-04-15T21:02:40.024 INFO:tasks.workunit.client.0.smithi072.stdout:8/344: unlink d3/d4/d4d/c50 0 2024-04-15T21:02:40.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/299: dread - d2/d10/f58 zero size 2024-04-15T21:02:40.025 INFO:tasks.workunit.client.0.smithi072.stdout:3/299: chown d1/d26/f47 26756223 1 2024-04-15T21:02:40.030 INFO:tasks.workunit.client.1.smithi149.stdout:8/582: dwrite d2/df/d10/d25/d37/d53/daf/d92/fc4 [0,4194304] 0 2024-04-15T21:02:40.033 INFO:tasks.workunit.client.0.smithi072.stdout:3/300: dwrite d1/f49 [0,4194304] 0 2024-04-15T21:02:40.034 INFO:tasks.workunit.client.0.smithi072.stdout:3/301: fsync d1/d15/d40/f1c 0 2024-04-15T21:02:40.035 INFO:tasks.workunit.client.1.smithi149.stdout:8/583: dread d2/df/d10/d21/d50/d8e/f9e [0,4194304] 0 2024-04-15T21:02:40.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/302: dread d1/d15/d32/d2f/d1a/f1b [0,4194304] 0 2024-04-15T21:02:40.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/303: chown d1/d3f 574 1 2024-04-15T21:02:40.045 INFO:tasks.workunit.client.1.smithi149.stdout:3/544: dread d1/db/f21 [0,4194304] 0 2024-04-15T21:02:40.046 INFO:tasks.workunit.client.0.smithi072.stdout:7/265: symlink d2/d7/d25/d4c/l54 0 2024-04-15T21:02:40.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/545: chown d1/db/l11 803929 1 2024-04-15T21:02:40.047 INFO:tasks.workunit.client.0.smithi072.stdout:4/288: chown d7/d23/f29 2 1 2024-04-15T21:02:40.048 INFO:tasks.workunit.client.0.smithi072.stdout:7/266: dread - d2/d10/d26/f41 zero size 2024-04-15T21:02:40.048 INFO:tasks.workunit.client.0.smithi072.stdout:4/289: stat d7/d24/c31 0 2024-04-15T21:02:40.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/584: fdatasync d2/d16/f2a 0 2024-04-15T21:02:40.056 INFO:tasks.workunit.client.0.smithi072.stdout:2/307: creat d2/d3/f63 x:0 0 0 2024-04-15T21:02:40.057 INFO:tasks.workunit.client.1.smithi149.stdout:8/585: write d2/df/d10/d21/d46/d74/fb6 [338835,12686] 0 2024-04-15T21:02:40.058 INFO:tasks.workunit.client.0.smithi072.stdout:0/292: mkdir d0/d6/d48/d61 0 2024-04-15T21:02:40.058 INFO:tasks.workunit.client.1.smithi149.stdout:8/586: dread - d2/df/d10/d21/d46/d74/fba zero size 2024-04-15T21:02:40.062 INFO:tasks.workunit.client.0.smithi072.stdout:8/345: mknod d3/de/d1b/d44/c6a 0 2024-04-15T21:02:40.064 INFO:tasks.workunit.client.0.smithi072.stdout:6/300: symlink d2/d10/d11/d1f/l5e 0 2024-04-15T21:02:40.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/546: creat d1/db/fa4 x:0 0 0 2024-04-15T21:02:40.067 INFO:tasks.workunit.client.1.smithi149.stdout:8/587: dwrite d2/df/d10/d25/fbf [0,4194304] 0 2024-04-15T21:02:40.072 INFO:tasks.workunit.client.0.smithi072.stdout:7/267: dread d2/d10/f3c [0,4194304] 0 2024-04-15T21:02:40.072 INFO:tasks.workunit.client.1.smithi149.stdout:5/478: dwrite d0/f4f [0,4194304] 0 2024-04-15T21:02:40.074 INFO:tasks.workunit.client.1.smithi149.stdout:3/547: write d1/db/d24/d39/f47 [2583111,115221] 0 2024-04-15T21:02:40.075 INFO:tasks.workunit.client.1.smithi149.stdout:3/548: fsync d1/db/d24/d2b/f22 0 2024-04-15T21:02:40.076 INFO:tasks.workunit.client.1.smithi149.stdout:3/549: readlink d1/db/d40/l64 0 2024-04-15T21:02:40.077 INFO:tasks.workunit.client.1.smithi149.stdout:3/550: chown d1/db/d24/f8b 1 1 2024-04-15T21:02:40.079 INFO:tasks.workunit.client.1.smithi149.stdout:8/588: chown d2/df/d10/d34/l81 5660 1 2024-04-15T21:02:40.079 INFO:tasks.workunit.client.0.smithi072.stdout:7/268: dwrite d2/d10/d26/f29 [0,4194304] 0 2024-04-15T21:02:40.080 INFO:tasks.workunit.client.1.smithi149.stdout:8/589: write d2/df/d10/d25/d37/f5f [812192,104471] 0 2024-04-15T21:02:40.081 INFO:tasks.workunit.client.0.smithi072.stdout:1/279: link d5/db/d2d/d3a/d1f/c2a d5/db/d2d/d56/c57 0 2024-04-15T21:02:40.083 INFO:tasks.workunit.client.1.smithi149.stdout:3/551: symlink d1/db/d40/la5 0 2024-04-15T21:02:40.088 INFO:tasks.workunit.client.1.smithi149.stdout:8/590: rename d2/df/d10/d21 to d2/df/d10/d25/d57/dd1 0 2024-04-15T21:02:40.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/304: symlink d1/d3f/d4f/l61 0 2024-04-15T21:02:40.100 INFO:tasks.workunit.client.1.smithi149.stdout:3/552: getdents d1/db/d24/d2b 0 2024-04-15T21:02:40.101 INFO:tasks.workunit.client.0.smithi072.stdout:7/269: creat d2/d7/f55 x:0 0 0 2024-04-15T21:02:40.102 INFO:tasks.workunit.client.0.smithi072.stdout:1/280: mknod d5/db/d27/c58 0 2024-04-15T21:02:40.103 INFO:tasks.workunit.client.1.smithi149.stdout:3/553: creat d1/db/d24/d4d/d63/fa6 x:0 0 0 2024-04-15T21:02:40.104 INFO:tasks.workunit.client.0.smithi072.stdout:2/308: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:40.105 INFO:tasks.workunit.client.0.smithi072.stdout:5/316: rename d0/c6b to d0/c6e 0 2024-04-15T21:02:40.106 INFO:tasks.workunit.client.1.smithi149.stdout:5/479: dread d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:40.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/591: read d2/df/d10/d25/d37/f5f [353854,43381] 0 2024-04-15T21:02:40.107 INFO:tasks.workunit.client.1.smithi149.stdout:3/554: truncate d1/db/d24/d39/d79/d97/f98 33105 0 2024-04-15T21:02:40.107 INFO:tasks.workunit.client.0.smithi072.stdout:2/309: read d2/d3/f15 [3444251,109072] 0 2024-04-15T21:02:40.108 INFO:tasks.workunit.client.1.smithi149.stdout:5/480: truncate d0/d6/d82/da1/d12/d2b/f9e 621817 0 2024-04-15T21:02:40.109 INFO:tasks.workunit.client.0.smithi072.stdout:5/317: dread - d0/d3/d7/d12/d31/d55/d58/f66 zero size 2024-04-15T21:02:40.109 INFO:tasks.workunit.client.0.smithi072.stdout:3/305: creat d1/d5b/f62 x:0 0 0 2024-04-15T21:02:40.111 INFO:tasks.workunit.client.0.smithi072.stdout:4/290: creat d7/f4f x:0 0 0 2024-04-15T21:02:40.112 INFO:tasks.workunit.client.0.smithi072.stdout:0/293: rename d0/d6/f31 to d0/d45/f62 0 2024-04-15T21:02:40.113 INFO:tasks.workunit.client.1.smithi149.stdout:3/555: chown d1/db/d40/d56/c6f 394 1 2024-04-15T21:02:40.114 INFO:tasks.workunit.client.1.smithi149.stdout:3/556: chown d1/db/l71 0 1 2024-04-15T21:02:40.115 INFO:tasks.workunit.client.0.smithi072.stdout:7/270: dread d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:02:40.115 INFO:tasks.workunit.client.0.smithi072.stdout:4/291: read d7/d10/f34 [3121048,87290] 0 2024-04-15T21:02:40.117 INFO:tasks.workunit.client.0.smithi072.stdout:1/281: dwrite d5/db/f12 [0,4194304] 0 2024-04-15T21:02:40.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/481: rename d0/d9/cf to d0/d6/d82/da1/d12/d16/d28/d1b/d60/ca3 0 2024-04-15T21:02:40.118 INFO:tasks.workunit.client.0.smithi072.stdout:7/271: fdatasync d2/d7/d25/d2d/d46/f48 0 2024-04-15T21:02:40.121 INFO:tasks.workunit.client.0.smithi072.stdout:1/282: write d5/f14 [597645,20210] 0 2024-04-15T21:02:40.123 INFO:tasks.workunit.client.0.smithi072.stdout:8/346: write d3/d4/f1e [1080242,61381] 0 2024-04-15T21:02:40.124 INFO:tasks.workunit.client.0.smithi072.stdout:1/283: chown d5/db/d2d/c4d 22 1 2024-04-15T21:02:40.125 INFO:tasks.workunit.client.0.smithi072.stdout:1/284: truncate d5/db/f55 588042 0 2024-04-15T21:02:40.126 INFO:tasks.workunit.client.0.smithi072.stdout:8/347: write d3/de/d1b/f62 [198208,28077] 0 2024-04-15T21:02:40.129 INFO:tasks.workunit.client.0.smithi072.stdout:6/301: rename d2/d42/f46 to d2/d1a/f5f 0 2024-04-15T21:02:40.132 INFO:tasks.workunit.client.0.smithi072.stdout:0/294: readlink d0/d45/d35/d3a/l44 0 2024-04-15T21:02:40.133 INFO:tasks.workunit.client.1.smithi149.stdout:8/592: dwrite d2/f1b [4194304,4194304] 0 2024-04-15T21:02:40.135 INFO:tasks.workunit.client.1.smithi149.stdout:8/593: dread - d2/df/d10/d4e/d9f/fa5 zero size 2024-04-15T21:02:40.135 INFO:tasks.workunit.client.0.smithi072.stdout:7/272: unlink d2/d10/d1f/d38/ff 0 2024-04-15T21:02:40.135 INFO:tasks.workunit.client.0.smithi072.stdout:2/310: dread d2/f44 [0,4194304] 0 2024-04-15T21:02:40.136 INFO:tasks.workunit.client.0.smithi072.stdout:6/302: read d2/d1a/f1b [668739,60054] 0 2024-04-15T21:02:40.136 INFO:tasks.workunit.client.0.smithi072.stdout:5/318: dread d0/d3/d6/f2b [0,4194304] 0 2024-04-15T21:02:40.138 INFO:tasks.workunit.client.0.smithi072.stdout:0/295: truncate d0/d45/d35/d3a/f50 912316 0 2024-04-15T21:02:40.139 INFO:tasks.workunit.client.0.smithi072.stdout:2/311: chown d2/d8/f13 57966 1 2024-04-15T21:02:40.140 INFO:tasks.workunit.client.1.smithi149.stdout:8/594: creat d2/df/d10/d25/d37/db2/fd2 x:0 0 0 2024-04-15T21:02:40.140 INFO:tasks.workunit.client.1.smithi149.stdout:3/557: write d1/db/d28/f32 [3118116,68651] 0 2024-04-15T21:02:40.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/595: stat d2/df/d10/d25/d37/d53/daf/d85/d35/f8b 0 2024-04-15T21:02:40.143 INFO:tasks.workunit.client.1.smithi149.stdout:8/596: stat d2/df/d10/d25/d57/dd1/d50/c60 0 2024-04-15T21:02:40.144 INFO:tasks.workunit.client.0.smithi072.stdout:8/348: mknod d3/d4/d4c/c6b 0 2024-04-15T21:02:40.144 INFO:tasks.workunit.client.0.smithi072.stdout:7/273: mknod d2/d7/c56 0 2024-04-15T21:02:40.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/274: chown d2/d7/d25 1287031 1 2024-04-15T21:02:40.145 INFO:tasks.workunit.client.1.smithi149.stdout:5/482: write d0/d6/d82/da1/f7f [1654977,8671] 0 2024-04-15T21:02:40.146 INFO:tasks.workunit.client.0.smithi072.stdout:7/275: stat d2/d7/d25/l31 0 2024-04-15T21:02:40.146 INFO:tasks.workunit.client.0.smithi072.stdout:7/276: chown d2 169146 1 2024-04-15T21:02:40.149 INFO:tasks.workunit.client.1.smithi149.stdout:8/597: creat d2/d16/fd3 x:0 0 0 2024-04-15T21:02:40.151 INFO:tasks.workunit.client.0.smithi072.stdout:5/319: symlink d0/d3/d7/d12/d31/d49/l6f 0 2024-04-15T21:02:40.151 INFO:tasks.workunit.client.0.smithi072.stdout:3/306: write d1/f6 [936561,100208] 0 2024-04-15T21:02:40.152 INFO:tasks.workunit.client.0.smithi072.stdout:0/296: mkdir d0/d19/d2b/d63 0 2024-04-15T21:02:40.154 INFO:tasks.workunit.client.0.smithi072.stdout:2/312: dwrite d2/d38/f56 [0,4194304] 0 2024-04-15T21:02:40.154 INFO:tasks.workunit.client.0.smithi072.stdout:8/349: creat d3/d4/d4c/f6c x:0 0 0 2024-04-15T21:02:40.155 INFO:tasks.workunit.client.0.smithi072.stdout:0/297: dread - d0/d45/d52/f5b zero size 2024-04-15T21:02:40.155 INFO:tasks.workunit.client.0.smithi072.stdout:5/320: dread - d0/d3/d7/d12/d31/d55/d58/f63 zero size 2024-04-15T21:02:40.156 INFO:tasks.workunit.client.1.smithi149.stdout:8/598: symlink d2/df/d10/d25/d37/ld4 0 2024-04-15T21:02:40.157 INFO:tasks.workunit.client.0.smithi072.stdout:7/277: symlink d2/d7/d25/d2d/l57 0 2024-04-15T21:02:40.161 INFO:tasks.workunit.client.0.smithi072.stdout:8/350: dwrite d3/de/f24 [0,4194304] 0 2024-04-15T21:02:40.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/321: creat d0/d3/d7/d12/d31/f70 x:0 0 0 2024-04-15T21:02:40.164 INFO:tasks.workunit.client.0.smithi072.stdout:5/322: stat d0/d3/d7/d12/d31/d55/f56 0 2024-04-15T21:02:40.165 INFO:tasks.workunit.client.0.smithi072.stdout:5/323: chown d0/d3/d7/d12/f54 707 1 2024-04-15T21:02:40.166 INFO:tasks.workunit.client.0.smithi072.stdout:5/324: chown d0/d3/d6/d14/f5b 0 1 2024-04-15T21:02:40.166 INFO:tasks.workunit.client.1.smithi149.stdout:3/558: write d1/db/d24/d2b/f25 [899213,105861] 0 2024-04-15T21:02:40.166 INFO:tasks.workunit.client.0.smithi072.stdout:7/278: creat d2/d10/d1f/f58 x:0 0 0 2024-04-15T21:02:40.169 INFO:tasks.workunit.client.0.smithi072.stdout:3/307: mknod d1/d15/d32/c63 0 2024-04-15T21:02:40.173 INFO:tasks.workunit.client.1.smithi149.stdout:4/590: sync 2024-04-15T21:02:40.174 INFO:tasks.workunit.client.1.smithi149.stdout:0/692: sync 2024-04-15T21:02:40.176 INFO:tasks.workunit.client.0.smithi072.stdout:0/298: creat d0/d6/d48/d61/f64 x:0 0 0 2024-04-15T21:02:40.176 INFO:tasks.workunit.client.1.smithi149.stdout:5/483: truncate d0/d6/d79/d95/f7e 1918532 0 2024-04-15T21:02:40.177 INFO:tasks.workunit.client.0.smithi072.stdout:0/299: write d0/d19/d2b/f4d [395106,55111] 0 2024-04-15T21:02:40.177 INFO:tasks.workunit.client.1.smithi149.stdout:8/599: link d2/df/d10/l79 d2/df/d10/d25/d57/dd1/d50/d8e/ld5 0 2024-04-15T21:02:40.178 INFO:tasks.workunit.client.1.smithi149.stdout:3/559: dwrite d1/db/d23/d5e/f86 [0,4194304] 0 2024-04-15T21:02:40.180 INFO:tasks.workunit.client.1.smithi149.stdout:3/560: readlink d1/db/d40/l64 0 2024-04-15T21:02:40.181 INFO:tasks.workunit.client.0.smithi072.stdout:5/325: rmdir d0/d3/d7/d12/d1d 39 2024-04-15T21:02:40.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/279: rename d2/f14 to d2/d7/d25/d4c/f59 0 2024-04-15T21:02:40.189 INFO:tasks.workunit.client.0.smithi072.stdout:6/303: truncate d2/d10/d18/f39 741318 0 2024-04-15T21:02:40.190 INFO:tasks.workunit.client.1.smithi149.stdout:5/484: dwrite d0/d6/d82/da1/d12/d16/d28/d1b/d9c/fa0 [0,4194304] 0 2024-04-15T21:02:40.191 INFO:tasks.workunit.client.1.smithi149.stdout:5/485: readlink d0/d9/d3f/l5c 0 2024-04-15T21:02:40.191 INFO:tasks.workunit.client.1.smithi149.stdout:0/693: rename d1/fbe to d1/d29/fef 0 2024-04-15T21:02:40.192 INFO:tasks.workunit.client.1.smithi149.stdout:5/486: readlink d0/d6/d82/da1/d12/d16/l35 0 2024-04-15T21:02:40.193 INFO:tasks.workunit.client.1.smithi149.stdout:0/694: chown d1/d29/dbb/fc3 263671147 1 2024-04-15T21:02:40.200 INFO:tasks.workunit.client.1.smithi149.stdout:8/600: mkdir d2/d5b/dd6 0 2024-04-15T21:02:40.200 INFO:tasks.workunit.client.1.smithi149.stdout:8/601: fdatasync d2/df/d10/d20/f91 0 2024-04-15T21:02:40.200 INFO:tasks.workunit.client.1.smithi149.stdout:3/561: symlink d1/db/d40/d56/d84/d85/la7 0 2024-04-15T21:02:40.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/300: creat d0/d45/d52/f65 x:0 0 0 2024-04-15T21:02:40.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/301: read - d0/d19/f4a zero size 2024-04-15T21:02:40.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/302: chown d0/d6/f39 18 1 2024-04-15T21:02:40.203 INFO:tasks.workunit.client.0.smithi072.stdout:7/280: mkdir d2/d7/d25/d2d/d46/d5a 0 2024-04-15T21:02:40.204 INFO:tasks.workunit.client.0.smithi072.stdout:8/351: dread d3/de/d21/f4a [0,4194304] 0 2024-04-15T21:02:40.204 INFO:tasks.workunit.client.0.smithi072.stdout:7/281: dread - d2/d7/d25/d2d/d47/f4a zero size 2024-04-15T21:02:40.204 INFO:tasks.workunit.client.0.smithi072.stdout:5/326: mknod d0/d3/d7/d12/c71 0 2024-04-15T21:02:40.205 INFO:tasks.workunit.client.1.smithi149.stdout:0/695: mkdir d1/d9/d64/df0 0 2024-04-15T21:02:40.206 INFO:tasks.workunit.client.1.smithi149.stdout:0/696: chown d1/d5/d24/f9e 442 1 2024-04-15T21:02:40.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/487: rename d0/d6/d79/d95/c41 to d0/d6/d9f/ca4 0 2024-04-15T21:02:40.209 INFO:tasks.workunit.client.0.smithi072.stdout:0/303: dread d0/d3/f33 [0,4194304] 0 2024-04-15T21:02:40.212 INFO:tasks.workunit.client.0.smithi072.stdout:8/352: dwrite d3/de/f25 [4194304,4194304] 0 2024-04-15T21:02:40.213 INFO:tasks.workunit.client.0.smithi072.stdout:7/282: dwrite d2/d7/d25/f34 [0,4194304] 0 2024-04-15T21:02:40.214 INFO:tasks.workunit.client.0.smithi072.stdout:8/353: chown d3/de/d1b/f43 1742498 1 2024-04-15T21:02:40.215 INFO:tasks.workunit.client.0.smithi072.stdout:0/304: mknod d0/d45/d35/d3a/c66 0 2024-04-15T21:02:40.218 INFO:tasks.workunit.client.1.smithi149.stdout:5/488: unlink d0/d6/d2d/c75 0 2024-04-15T21:02:40.219 INFO:tasks.workunit.client.0.smithi072.stdout:7/283: mknod d2/d7/d25/c5b 0 2024-04-15T21:02:40.220 INFO:tasks.workunit.client.1.smithi149.stdout:8/602: creat d2/d5b/dd6/fd7 x:0 0 0 2024-04-15T21:02:40.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/603: write d2/df/d10/d25/d57/dd1/fa7 [2885187,43923] 0 2024-04-15T21:02:40.222 INFO:tasks.workunit.client.0.smithi072.stdout:8/354: unlink d3/d4/d3b/c52 0 2024-04-15T21:02:40.223 INFO:tasks.workunit.client.0.smithi072.stdout:8/355: chown d3/de/d1b/d44/c6a 237759 1 2024-04-15T21:02:40.225 INFO:tasks.workunit.client.0.smithi072.stdout:0/305: creat d0/d3/f67 x:0 0 0 2024-04-15T21:02:40.226 INFO:tasks.workunit.client.1.smithi149.stdout:0/697: creat d1/d9/d64/d65/dca/ff1 x:0 0 0 2024-04-15T21:02:40.227 INFO:tasks.workunit.client.0.smithi072.stdout:7/284: creat d2/d7/d25/d2d/d47/f5c x:0 0 0 2024-04-15T21:02:40.230 INFO:tasks.workunit.client.0.smithi072.stdout:8/356: dwrite d3/de/f20 [0,4194304] 0 2024-04-15T21:02:40.232 INFO:tasks.workunit.client.0.smithi072.stdout:8/357: fsync d3/de/d1b/f57 0 2024-04-15T21:02:40.235 INFO:tasks.workunit.client.1.smithi149.stdout:3/562: link d1/db/d24/d39/fa1 d1/db/fa8 0 2024-04-15T21:02:40.237 INFO:tasks.workunit.client.0.smithi072.stdout:0/306: rename d0/d45/d52/f5b to d0/d6/d55/f68 0 2024-04-15T21:02:40.237 INFO:tasks.workunit.client.1.smithi149.stdout:8/604: truncate d2/df/d10/d25/d32/f39 2661802 0 2024-04-15T21:02:40.238 INFO:tasks.workunit.client.1.smithi149.stdout:8/605: readlink d2/df/d10/d25/d37/lc5 0 2024-04-15T21:02:40.239 INFO:tasks.workunit.client.0.smithi072.stdout:8/358: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:40.239 INFO:tasks.workunit.client.0.smithi072.stdout:7/285: creat d2/d10/d1f/f5d x:0 0 0 2024-04-15T21:02:40.240 INFO:tasks.workunit.client.1.smithi149.stdout:8/606: write d2/df/d10/d25/d57/dd1/d46/d74/fba [1036049,51327] 0 2024-04-15T21:02:40.240 INFO:tasks.workunit.client.0.smithi072.stdout:7/286: dread - d2/d10/d1f/f3e zero size 2024-04-15T21:02:40.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/698: creat d1/d29/d2c/d4f/d95/ff2 x:0 0 0 2024-04-15T21:02:40.243 INFO:tasks.workunit.client.1.smithi149.stdout:3/563: mkdir d1/db/d24/d2b/da9 0 2024-04-15T21:02:40.247 INFO:tasks.workunit.client.1.smithi149.stdout:8/607: rename d2/df/d10/d25/d37/db2 to d2/df/d10/d4e/d9f/dd8 0 2024-04-15T21:02:40.248 INFO:tasks.workunit.client.0.smithi072.stdout:0/307: write d0/d45/d35/f56 [1543914,94865] 0 2024-04-15T21:02:40.250 INFO:tasks.workunit.client.1.smithi149.stdout:0/699: truncate d1/d5/d24/d50/d13/d59/f76 2184525 0 2024-04-15T21:02:40.251 INFO:tasks.workunit.client.0.smithi072.stdout:8/359: mkdir d3/de/d1b/d6d 0 2024-04-15T21:02:40.259 INFO:tasks.workunit.client.0.smithi072.stdout:0/308: creat d0/d19/d2b/f69 x:0 0 0 2024-04-15T21:02:40.264 INFO:tasks.workunit.client.0.smithi072.stdout:8/360: dread d3/de/f22 [0,4194304] 0 2024-04-15T21:02:40.268 INFO:tasks.workunit.client.0.smithi072.stdout:0/309: link d0/d6/f41 d0/d6/f6a 0 2024-04-15T21:02:40.269 INFO:tasks.workunit.client.1.smithi149.stdout:8/608: getdents d2/df/d10/d4e 0 2024-04-15T21:02:40.269 INFO:tasks.workunit.client.0.smithi072.stdout:0/310: write d0/f2d [57908,5917] 0 2024-04-15T21:02:40.270 INFO:tasks.workunit.client.0.smithi072.stdout:7/287: dread d2/d10/d1f/d38/f39 [0,4194304] 0 2024-04-15T21:02:40.272 INFO:tasks.workunit.client.0.smithi072.stdout:0/311: rmdir d0/d3/d5 39 2024-04-15T21:02:40.274 INFO:tasks.workunit.client.1.smithi149.stdout:8/609: write d2/df/d10/d25/d37/d53/daf/db4/fbe [562028,113500] 0 2024-04-15T21:02:40.278 INFO:tasks.workunit.client.0.smithi072.stdout:0/312: symlink d0/d45/d35/l6b 0 2024-04-15T21:02:40.279 INFO:tasks.workunit.client.1.smithi149.stdout:8/610: mknod d2/df/d10/d25/cd9 0 2024-04-15T21:02:40.279 INFO:tasks.workunit.client.1.smithi149.stdout:3/564: truncate d1/db/d23/d5e/f86 1436645 0 2024-04-15T21:02:40.280 INFO:tasks.workunit.client.0.smithi072.stdout:8/361: dread d3/d4/d3b/f55 [0,4194304] 0 2024-04-15T21:02:40.283 INFO:tasks.workunit.client.1.smithi149.stdout:8/611: rename d2/df/d10/d25/d37/d95 to d2/df/d10/d25/d57/dd1/d46/dce/dda 0 2024-04-15T21:02:40.287 INFO:tasks.workunit.client.0.smithi072.stdout:8/362: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:40.288 INFO:tasks.workunit.client.0.smithi072.stdout:0/313: unlink d0/d3/d5/f11 0 2024-04-15T21:02:40.288 INFO:tasks.workunit.client.1.smithi149.stdout:5/489: dwrite d0/d6/d79/d95/f7e [0,4194304] 0 2024-04-15T21:02:40.295 INFO:tasks.workunit.client.0.smithi072.stdout:0/314: dwrite d0/d19/d58/f5a [0,4194304] 0 2024-04-15T21:02:40.296 INFO:tasks.workunit.client.0.smithi072.stdout:0/315: write d0/d3/d5/f60 [136547,130240] 0 2024-04-15T21:02:40.298 INFO:tasks.workunit.client.0.smithi072.stdout:0/316: truncate d0/d45/d35/d3a/f28 1678441 0 2024-04-15T21:02:40.300 INFO:tasks.workunit.client.0.smithi072.stdout:8/363: creat d3/d4/d3b/f6e x:0 0 0 2024-04-15T21:02:40.306 INFO:tasks.workunit.client.0.smithi072.stdout:7/288: dwrite d2/f16 [0,4194304] 0 2024-04-15T21:02:40.306 INFO:tasks.workunit.client.0.smithi072.stdout:0/317: rename d0/d3/f4 to d0/d45/d35/d3a/f6c 0 2024-04-15T21:02:40.313 INFO:tasks.workunit.client.1.smithi149.stdout:5/490: creat d0/d9/d71/fa5 x:0 0 0 2024-04-15T21:02:40.316 INFO:tasks.workunit.client.0.smithi072.stdout:0/318: mkdir d0/d6/d6d 0 2024-04-15T21:02:40.316 INFO:tasks.workunit.client.0.smithi072.stdout:0/319: chown d0/d19/d2b/f43 2045113 1 2024-04-15T21:02:40.317 INFO:tasks.workunit.client.0.smithi072.stdout:0/320: chown d0/d45/f62 20632 1 2024-04-15T21:02:40.319 INFO:tasks.workunit.client.0.smithi072.stdout:7/289: rename d2/d10/d1f/d38/f22 to d2/d10/f5e 0 2024-04-15T21:02:40.320 INFO:tasks.workunit.client.1.smithi149.stdout:8/612: dwrite d2/f69 [0,4194304] 0 2024-04-15T21:02:40.320 INFO:tasks.workunit.client.0.smithi072.stdout:7/290: write d2/d10/d43/f51 [860535,30258] 0 2024-04-15T21:02:40.322 INFO:tasks.workunit.client.1.smithi149.stdout:5/491: unlink d0/d6/d82/da1/d12/d2b/f78 0 2024-04-15T21:02:40.324 INFO:tasks.workunit.client.1.smithi149.stdout:5/492: dread - d0/d6/d82/da1/d12/d16/d28/d1b/d83/f90 zero size 2024-04-15T21:02:40.326 INFO:tasks.workunit.client.1.smithi149.stdout:8/613: truncate d2/d16/f65 818809 0 2024-04-15T21:02:40.337 INFO:tasks.workunit.client.1.smithi149.stdout:8/614: link d2/df/d10/d25/d37/ld4 d2/d5b/ldb 0 2024-04-15T21:02:40.340 INFO:tasks.workunit.client.0.smithi072.stdout:7/291: write d2/d10/f3c [3345377,128056] 0 2024-04-15T21:02:40.341 INFO:tasks.workunit.client.0.smithi072.stdout:0/321: write d0/d6/ff [381527,52073] 0 2024-04-15T21:02:40.342 INFO:tasks.workunit.client.0.smithi072.stdout:7/292: dread - d2/d10/d1f/f3f zero size 2024-04-15T21:02:40.343 INFO:tasks.workunit.client.0.smithi072.stdout:7/293: write d2/d10/f2e [1414979,73108] 0 2024-04-15T21:02:40.346 INFO:tasks.workunit.client.0.smithi072.stdout:0/322: unlink d0/d45/l54 0 2024-04-15T21:02:40.346 INFO:tasks.workunit.client.1.smithi149.stdout:5/493: dwrite d0/d6/d82/da1/d12/d16/d28/f46 [0,4194304] 0 2024-04-15T21:02:40.347 INFO:tasks.workunit.client.0.smithi072.stdout:7/294: write d2/d7/d25/d4c/f59 [3589555,53881] 0 2024-04-15T21:02:40.347 INFO:tasks.workunit.client.1.smithi149.stdout:5/494: stat d0/d6/d82 0 2024-04-15T21:02:40.353 INFO:tasks.workunit.client.0.smithi072.stdout:7/295: rename d2/d10 to d2/d7/d25/d2d/d46/d5a/d5f 0 2024-04-15T21:02:40.355 INFO:tasks.workunit.client.0.smithi072.stdout:7/296: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f 119168 0 2024-04-15T21:02:40.357 INFO:tasks.workunit.client.1.smithi149.stdout:5/495: getdents d0/d6/d79/d95 0 2024-04-15T21:02:40.357 INFO:tasks.workunit.client.1.smithi149.stdout:5/496: chown d0/d9/d71/fa5 95 1 2024-04-15T21:02:40.359 INFO:tasks.workunit.client.1.smithi149.stdout:5/497: dread - d0/d9/d3f/d47/f7a zero size 2024-04-15T21:02:40.359 INFO:tasks.workunit.client.0.smithi072.stdout:7/297: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f39 151453 0 2024-04-15T21:02:40.360 INFO:tasks.workunit.client.1.smithi149.stdout:5/498: write d0/d6/d82/da1/d12/d16/f8c [1359031,109511] 0 2024-04-15T21:02:40.360 INFO:tasks.workunit.client.0.smithi072.stdout:7/298: write d2/fa [4361341,94001] 0 2024-04-15T21:02:40.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/499: chown d0/d6/d82/da1/f7f 146003 1 2024-04-15T21:02:40.364 INFO:tasks.workunit.client.0.smithi072.stdout:7/299: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 x:0 0 0 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.1.smithi149.stdout:2/577: sync 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.1.smithi149.stdout:1/457: sync 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.1.smithi149.stdout:6/473: sync 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.1.smithi149.stdout:9/481: sync 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.1.smithi149.stdout:7/526: sync 2024-04-15T21:02:40.368 INFO:tasks.workunit.client.0.smithi072.stdout:7/300: symlink d2/d7/d25/d2d/d52/l61 0 2024-04-15T21:02:40.370 INFO:tasks.workunit.client.0.smithi072.stdout:7/301: rmdir d2 39 2024-04-15T21:02:40.371 INFO:tasks.workunit.client.1.smithi149.stdout:8/615: dread d2/df/d10/d25/d57/dd1/f41 [0,4194304] 0 2024-04-15T21:02:40.371 INFO:tasks.workunit.client.1.smithi149.stdout:6/474: write da/d18/f23 [603125,11853] 0 2024-04-15T21:02:40.374 INFO:tasks.workunit.client.1.smithi149.stdout:9/482: mkdir d23/d3c/d7a/da5 0 2024-04-15T21:02:40.375 INFO:tasks.workunit.client.0.smithi072.stdout:7/302: read d2/d7/d25/d4c/f59 [3982026,72899] 0 2024-04-15T21:02:40.376 INFO:tasks.workunit.client.1.smithi149.stdout:1/458: rename d1/db/d14/c5a to d1/d17/d36/d6f/c85 0 2024-04-15T21:02:40.376 INFO:tasks.workunit.client.0.smithi072.stdout:0/323: dread d0/f29 [0,4194304] 0 2024-04-15T21:02:40.377 INFO:tasks.workunit.client.0.smithi072.stdout:7/303: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 315 1 2024-04-15T21:02:40.379 INFO:tasks.workunit.client.0.smithi072.stdout:0/324: fsync d0/d45/d35/f36 0 2024-04-15T21:02:40.381 INFO:tasks.workunit.client.1.smithi149.stdout:6/475: symlink da/d18/d10/d3f/l96 0 2024-04-15T21:02:40.383 INFO:tasks.workunit.client.0.smithi072.stdout:0/325: dread d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:40.384 INFO:tasks.workunit.client.1.smithi149.stdout:5/500: dwrite d0/d6/d2d/f67 [0,4194304] 0 2024-04-15T21:02:40.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/459: mkdir d1/db/d16/d86 0 2024-04-15T21:02:40.388 INFO:tasks.workunit.client.0.smithi072.stdout:0/326: write d0/d45/f62 [4769660,118278] 0 2024-04-15T21:02:40.394 INFO:tasks.workunit.client.0.smithi072.stdout:0/327: symlink d0/d6/d48/l6e 0 2024-04-15T21:02:40.395 INFO:tasks.workunit.client.1.smithi149.stdout:8/616: creat d2/df/d10/d25/d57/dd1/d50/d5d/dc6/fdc x:0 0 0 2024-04-15T21:02:40.396 INFO:tasks.workunit.client.1.smithi149.stdout:8/617: read d2/f2b [442157,77720] 0 2024-04-15T21:02:40.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/501: chown d0/d9/l32 92 1 2024-04-15T21:02:40.398 INFO:tasks.workunit.client.0.smithi072.stdout:7/304: dread d2/f1c [0,4194304] 0 2024-04-15T21:02:40.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/527: truncate d3/d34/f6d 5091662 0 2024-04-15T21:02:40.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/528: chown d3/d34 0 1 2024-04-15T21:02:40.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/529: readlink d3/d16/d20/dab/lbe 0 2024-04-15T21:02:40.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/578: link d4/d7/d10/d6b/d21/d2c/d32/d4a/c8d d4/dc7/ccd 0 2024-04-15T21:02:40.405 INFO:tasks.workunit.client.1.smithi149.stdout:5/502: dwrite d0/d6/d82/da1/f2e [0,4194304] 0 2024-04-15T21:02:40.406 INFO:tasks.workunit.client.0.smithi072.stdout:7/305: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/l62 0 2024-04-15T21:02:40.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/483: creat d23/d3c/fa6 x:0 0 0 2024-04-15T21:02:40.408 INFO:tasks.workunit.client.1.smithi149.stdout:8/618: creat d2/df/d10/d25/d37/d53/daf/d85/fdd x:0 0 0 2024-04-15T21:02:40.408 INFO:tasks.workunit.client.0.smithi072.stdout:7/306: rmdir d2/d7/d25/d2d/d52 39 2024-04-15T21:02:40.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/307: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e 561900 0 2024-04-15T21:02:40.411 INFO:tasks.workunit.client.0.smithi072.stdout:7/308: stat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 0 2024-04-15T21:02:40.413 INFO:tasks.workunit.client.1.smithi149.stdout:5/503: stat d0/d6/d9f/ca4 0 2024-04-15T21:02:40.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/484: rename d23/d2b/d37/d50/l94 to d23/d2b/d37/d50/d79/d8d/la7 0 2024-04-15T21:02:40.415 INFO:tasks.workunit.client.0.smithi072.stdout:7/309: mknod d2/d7/d25/d2d/d46/d5a/d5f/d43/c63 0 2024-04-15T21:02:40.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/619: creat d2/df/d10/d4e/d9f/fde x:0 0 0 2024-04-15T21:02:40.416 INFO:tasks.workunit.client.1.smithi149.stdout:2/579: mknod d4/d7/d10/d6b/d21/d2c/d32/cce 0 2024-04-15T21:02:40.420 INFO:tasks.workunit.client.1.smithi149.stdout:8/620: rename d2/df/c3c to d2/df/d10/d25/d57/dc7/cdf 0 2024-04-15T21:02:40.421 INFO:tasks.workunit.client.0.smithi072.stdout:7/310: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:40.421 INFO:tasks.workunit.client.1.smithi149.stdout:8/621: stat d2/df/d10/d25/d32/d45/d77/fb3 0 2024-04-15T21:02:40.421 INFO:tasks.workunit.client.1.smithi149.stdout:2/580: unlink d4/d7/d10/d6b/d21/d2c/d32/la8 0 2024-04-15T21:02:40.425 INFO:tasks.workunit.client.1.smithi149.stdout:7/530: dread d3/d17/d1f/f22 [0,4194304] 0 2024-04-15T21:02:40.426 INFO:tasks.workunit.client.1.smithi149.stdout:2/581: creat d4/d7/d10/d6b/d21/d55/d94/fcf x:0 0 0 2024-04-15T21:02:40.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/582: stat d4/d7/d10/d6b/d21/d2c/d3e/l48 0 2024-04-15T21:02:40.427 INFO:tasks.workunit.client.1.smithi149.stdout:7/531: symlink d3/d16/d20/db5/lc0 0 2024-04-15T21:02:40.428 INFO:tasks.workunit.client.1.smithi149.stdout:7/532: readlink d3/d34/l7f 0 2024-04-15T21:02:40.429 INFO:tasks.workunit.client.1.smithi149.stdout:7/533: chown d3/f78 87643442 1 2024-04-15T21:02:40.430 INFO:tasks.workunit.client.0.smithi072.stdout:7/311: getdents d2/d7/d25/d2d/d46/d5a/d5f/d1f 0 2024-04-15T21:02:40.433 INFO:tasks.workunit.client.1.smithi149.stdout:7/534: creat d3/d16/d32/d90/fc1 x:0 0 0 2024-04-15T21:02:40.434 INFO:tasks.workunit.client.0.smithi072.stdout:7/312: rename d2/d7/d25/d2d/d46/f48 to d2/d7/d25/d2d/d47/f64 0 2024-04-15T21:02:40.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/535: creat d3/d17/d1f/fc2 x:0 0 0 2024-04-15T21:02:40.438 INFO:tasks.workunit.client.0.smithi072.stdout:7/313: dread d2/d7/d25/d4c/f59 [0,4194304] 0 2024-04-15T21:02:40.438 INFO:tasks.workunit.client.1.smithi149.stdout:7/536: link d3/d34/c59 d3/d16/d20/d60/cc3 0 2024-04-15T21:02:40.440 INFO:tasks.workunit.client.0.smithi072.stdout:7/314: dread d2/d7/d25/d4c/f59 [4194304,4194304] 0 2024-04-15T21:02:40.442 INFO:tasks.workunit.client.0.smithi072.stdout:9/279: sync 2024-04-15T21:02:40.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/537: dwrite d3/d16/f86 [0,4194304] 0 2024-04-15T21:02:40.443 INFO:tasks.workunit.client.0.smithi072.stdout:7/315: dread d2/f1c [0,4194304] 0 2024-04-15T21:02:40.450 INFO:tasks.workunit.client.0.smithi072.stdout:9/280: creat d4/f4e x:0 0 0 2024-04-15T21:02:40.451 INFO:tasks.workunit.client.0.smithi072.stdout:7/316: fsync d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f39 0 2024-04-15T21:02:40.452 INFO:tasks.workunit.client.0.smithi072.stdout:7/317: readlink d2/d7/l9 0 2024-04-15T21:02:40.453 INFO:tasks.workunit.client.0.smithi072.stdout:7/318: read - d2/d7/d25/d2d/d47/f64 zero size 2024-04-15T21:02:40.464 INFO:tasks.workunit.client.0.smithi072.stdout:9/281: dread d4/f11 [0,4194304] 0 2024-04-15T21:02:40.467 INFO:tasks.workunit.client.0.smithi072.stdout:9/282: creat d4/d1f/d2c/f4f x:0 0 0 2024-04-15T21:02:40.469 INFO:tasks.workunit.client.0.smithi072.stdout:9/283: creat d4/d1f/d31/d42/f50 x:0 0 0 2024-04-15T21:02:40.471 INFO:tasks.workunit.client.0.smithi072.stdout:9/284: mknod d4/d1f/d2c/c51 0 2024-04-15T21:02:40.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/591: sync 2024-04-15T21:02:40.493 INFO:tasks.workunit.client.1.smithi149.stdout:0/700: sync 2024-04-15T21:02:40.493 INFO:tasks.workunit.client.1.smithi149.stdout:3/565: sync 2024-04-15T21:02:40.494 INFO:tasks.workunit.client.1.smithi149.stdout:0/701: write d1/d9/fce [94182,526] 0 2024-04-15T21:02:40.497 INFO:tasks.workunit.client.1.smithi149.stdout:3/566: link d1/f7f d1/db/d24/d4d/d63/faa 0 2024-04-15T21:02:40.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/567: mknod d1/db/d24/d2b/da9/cab 0 2024-04-15T21:02:40.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/568: rename d1/db/d23/f76 to d1/db/d24/d2b/da9/fac 0 2024-04-15T21:02:40.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/569: fdatasync d1/db/d23/f3a 0 2024-04-15T21:02:40.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/570: unlink d1/db/d23/d5e/la3 0 2024-04-15T21:02:40.505 INFO:tasks.workunit.client.1.smithi149.stdout:3/571: unlink d1/d81/f92 0 2024-04-15T21:02:40.509 INFO:tasks.workunit.client.1.smithi149.stdout:3/572: dread d1/db/d24/d39/f70 [0,4194304] 0 2024-04-15T21:02:40.509 INFO:tasks.workunit.client.1.smithi149.stdout:3/573: readlink d1/db/d40/l64 0 2024-04-15T21:02:40.511 INFO:tasks.workunit.client.1.smithi149.stdout:3/574: creat d1/db/d24/d4d/d63/d65/fad x:0 0 0 2024-04-15T21:02:40.513 INFO:tasks.workunit.client.1.smithi149.stdout:3/575: readlink d1/db/d24/l78 0 2024-04-15T21:02:40.513 INFO:tasks.workunit.client.1.smithi149.stdout:3/576: dread - d1/db/d24/d4d/d63/d65/fad zero size 2024-04-15T21:02:40.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/476: write da/d11/f22 [567764,65808] 0 2024-04-15T21:02:40.539 INFO:tasks.workunit.client.1.smithi149.stdout:6/477: rename da/d11/d85 to da/d18/d10/d16/d97 0 2024-04-15T21:02:40.541 INFO:tasks.workunit.client.1.smithi149.stdout:1/460: dwrite d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:40.542 INFO:tasks.workunit.client.1.smithi149.stdout:6/478: truncate da/d2e/f52 1237765 0 2024-04-15T21:02:40.544 INFO:tasks.workunit.client.1.smithi149.stdout:0/702: dread d1/d5/d24/d50/d15/fd2 [0,4194304] 0 2024-04-15T21:02:40.547 INFO:tasks.workunit.client.1.smithi149.stdout:1/461: symlink d1/db/l87 0 2024-04-15T21:02:40.552 INFO:tasks.workunit.client.1.smithi149.stdout:1/462: mkdir d1/db/dc/d38/d39/d88 0 2024-04-15T21:02:40.552 INFO:tasks.workunit.client.1.smithi149.stdout:5/504: write d0/f8 [97942,31211] 0 2024-04-15T21:02:40.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/703: symlink d1/d5/d24/d30/lf3 0 2024-04-15T21:02:40.556 INFO:tasks.workunit.client.1.smithi149.stdout:5/505: chown d0/d6/d82/da1/d12/d2b/f72 201 1 2024-04-15T21:02:40.556 INFO:tasks.workunit.client.1.smithi149.stdout:6/479: rmdir da/d49/d70/d8a 0 2024-04-15T21:02:40.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/704: chown d1/d5/d24/d50/d15/d86/cbf 322 1 2024-04-15T21:02:40.559 INFO:tasks.workunit.client.1.smithi149.stdout:1/463: mknod d1/db/dc/d38/d39/d88/c89 0 2024-04-15T21:02:40.561 INFO:tasks.workunit.client.1.smithi149.stdout:0/705: write d1/d5/dc/f84 [702947,124527] 0 2024-04-15T21:02:40.561 INFO:tasks.workunit.client.1.smithi149.stdout:9/485: dwrite d23/f5a [0,4194304] 0 2024-04-15T21:02:40.563 INFO:tasks.workunit.client.1.smithi149.stdout:5/506: unlink d0/d6/d82/da1/d12/l31 0 2024-04-15T21:02:40.568 INFO:tasks.workunit.client.1.smithi149.stdout:9/486: symlink d23/d3c/d87/la8 0 2024-04-15T21:02:40.569 INFO:tasks.workunit.client.0.smithi072.stdout:7/319: getdents d2/d7/d25/d2d/d46 0 2024-04-15T21:02:40.569 INFO:tasks.workunit.client.1.smithi149.stdout:8/622: dwrite d2/df/d10/d25/f28 [0,4194304] 0 2024-04-15T21:02:40.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/487: write f4 [5061257,78698] 0 2024-04-15T21:02:40.576 INFO:tasks.workunit.client.1.smithi149.stdout:0/706: creat d1/d9/d64/d73/ff4 x:0 0 0 2024-04-15T21:02:40.576 INFO:tasks.workunit.client.1.smithi149.stdout:2/583: dwrite d4/d7/da/f1c [0,4194304] 0 2024-04-15T21:02:40.579 INFO:tasks.workunit.client.1.smithi149.stdout:5/507: creat d0/d6/d82/fa6 x:0 0 0 2024-04-15T21:02:40.580 INFO:tasks.workunit.client.1.smithi149.stdout:5/508: fsync d0/d9/f39 0 2024-04-15T21:02:40.583 INFO:tasks.workunit.client.1.smithi149.stdout:9/488: rmdir d23/d3c/d7a 39 2024-04-15T21:02:40.589 INFO:tasks.workunit.client.1.smithi149.stdout:0/707: rename d1/d5/d24/d50/d13/d38/fc2 to d1/d5/d24/d30/d92/ff5 0 2024-04-15T21:02:40.589 INFO:tasks.workunit.client.1.smithi149.stdout:7/538: dwrite d3/d16/d20/d36/d3d/f80 [0,4194304] 0 2024-04-15T21:02:40.589 INFO:tasks.workunit.client.0.smithi072.stdout:4/292: sync 2024-04-15T21:02:40.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/285: truncate d4/d1f/f2b 3514521 0 2024-04-15T21:02:40.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/286: write d4/f1e [325685,124666] 0 2024-04-15T21:02:40.595 INFO:tasks.workunit.client.0.smithi072.stdout:4/293: symlink d7/d10/d41/d45/l50 0 2024-04-15T21:02:40.597 INFO:tasks.workunit.client.1.smithi149.stdout:4/592: write dc/fe [862201,12080] 0 2024-04-15T21:02:40.601 INFO:tasks.workunit.client.0.smithi072.stdout:7/320: link d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c1d d2/d7/d25/d2d/d52/c65 0 2024-04-15T21:02:40.611 INFO:tasks.workunit.client.0.smithi072.stdout:4/294: rename d7/d10/f3a to d7/d10/d41/f51 0 2024-04-15T21:02:40.612 INFO:tasks.workunit.client.1.smithi149.stdout:7/539: fsync d3/d17/f31 0 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:1/285: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:3/308: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:5/327: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:2/313: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:6/304: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:8/364: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.0.smithi072.stdout:0/328: sync 2024-04-15T21:02:40.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/540: dread - d3/d16/d20/d6c/f9f zero size 2024-04-15T21:02:40.614 INFO:tasks.workunit.client.1.smithi149.stdout:3/577: write d1/db/d24/d2b/f50 [3675911,14942] 0 2024-04-15T21:02:40.616 INFO:tasks.workunit.client.0.smithi072.stdout:9/287: creat d4/d29/d4c/f52 x:0 0 0 2024-04-15T21:02:40.616 INFO:tasks.workunit.client.1.smithi149.stdout:2/584: dread d4/d7/d10/d6b/d21/d5e/dbe/da7/fbf [0,4194304] 0 2024-04-15T21:02:40.617 INFO:tasks.workunit.client.1.smithi149.stdout:5/509: getdents d0/d6/d82/da1/d12/d16/d28/d9b 0 2024-04-15T21:02:40.619 INFO:tasks.workunit.client.1.smithi149.stdout:5/510: readlink d0/d6/d82/da1/d12/d2b/l5d 0 2024-04-15T21:02:40.620 INFO:tasks.workunit.client.1.smithi149.stdout:4/593: write dc/d2c/d3e/d15/d3f/f6e [3977236,86524] 0 2024-04-15T21:02:40.621 INFO:tasks.workunit.client.0.smithi072.stdout:1/286: dwrite d5/f17 [0,4194304] 0 2024-04-15T21:02:40.623 INFO:tasks.workunit.client.1.smithi149.stdout:0/708: mknod d1/d5/d24/d30/cf6 0 2024-04-15T21:02:40.624 INFO:tasks.workunit.client.0.smithi072.stdout:5/328: dwrite d0/d3/d7/d12/d31/d55/d58/f66 [0,4194304] 0 2024-04-15T21:02:40.628 INFO:tasks.workunit.client.1.smithi149.stdout:7/541: fsync d3/d16/da0/fa8 0 2024-04-15T21:02:40.631 INFO:tasks.workunit.client.1.smithi149.stdout:0/709: dwrite d1/d5/d24/d50/d15/f5d [0,4194304] 0 2024-04-15T21:02:40.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/489: mknod d23/d3c/d7a/da5/ca9 0 2024-04-15T21:02:40.633 INFO:tasks.workunit.client.0.smithi072.stdout:1/287: dwrite d5/db/f1a [0,4194304] 0 2024-04-15T21:02:40.635 INFO:tasks.workunit.client.0.smithi072.stdout:1/288: chown d5/db/d2d/d56/c57 885230683 1 2024-04-15T21:02:40.639 INFO:tasks.workunit.client.0.smithi072.stdout:2/314: write d2/d3/f17 [175657,18473] 0 2024-04-15T21:02:40.641 INFO:tasks.workunit.client.0.smithi072.stdout:2/315: read d2/d38/f56 [172484,24876] 0 2024-04-15T21:02:40.641 INFO:tasks.workunit.client.0.smithi072.stdout:1/289: dwrite d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:40.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/585: rename d4/d7/d10/d6b/d21/d2c/d58/f8e to d4/d7/d10/d6b/d21/d2c/d58/fd0 0 2024-04-15T21:02:40.645 INFO:tasks.workunit.client.1.smithi149.stdout:1/464: dwrite d1/f6 [4194304,4194304] 0 2024-04-15T21:02:40.646 INFO:tasks.workunit.client.1.smithi149.stdout:6/480: truncate da/d18/d10/f8b 837718 0 2024-04-15T21:02:40.656 INFO:tasks.workunit.client.1.smithi149.stdout:5/511: unlink d0/d6/d2d/f76 0 2024-04-15T21:02:40.657 INFO:tasks.workunit.client.0.smithi072.stdout:9/288: readlink d4/l40 0 2024-04-15T21:02:40.660 INFO:tasks.workunit.client.0.smithi072.stdout:5/329: dread d0/d3/f16 [0,4194304] 0 2024-04-15T21:02:40.662 INFO:tasks.workunit.client.1.smithi149.stdout:8/623: dwrite d2/df/d10/d25/d57/dd1/d50/d5d/f96 [0,4194304] 0 2024-04-15T21:02:40.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/594: dread dc/d18/d21/d81/fa7 [0,4194304] 0 2024-04-15T21:02:40.674 INFO:tasks.workunit.client.0.smithi072.stdout:7/321: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f39 [762936,78627] 0 2024-04-15T21:02:40.676 INFO:tasks.workunit.client.0.smithi072.stdout:0/329: mknod d0/d19/d2b/d63/c6f 0 2024-04-15T21:02:40.682 INFO:tasks.workunit.client.1.smithi149.stdout:9/490: creat d23/d2b/d70/d75/faa x:0 0 0 2024-04-15T21:02:40.683 INFO:tasks.workunit.client.1.smithi149.stdout:9/491: readlink d23/d46/l62 0 2024-04-15T21:02:40.683 INFO:tasks.workunit.client.1.smithi149.stdout:9/492: readlink d23/d46/l60 0 2024-04-15T21:02:40.684 INFO:tasks.workunit.client.0.smithi072.stdout:4/295: dwrite d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:40.686 INFO:tasks.workunit.client.1.smithi149.stdout:3/578: write d1/db/d24/d4d/d63/faa [933278,112756] 0 2024-04-15T21:02:40.687 INFO:tasks.workunit.client.1.smithi149.stdout:6/481: chown da/d49/d55/l73 95743 1 2024-04-15T21:02:40.688 INFO:tasks.workunit.client.1.smithi149.stdout:3/579: dread - d1/db/d24/d2b/f6b zero size 2024-04-15T21:02:40.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/290: unlink d5/db/d2d/c44 0 2024-04-15T21:02:40.700 INFO:tasks.workunit.client.0.smithi072.stdout:5/330: creat d0/d3/d7/d12/d31/d55/d58/f72 x:0 0 0 2024-04-15T21:02:40.703 INFO:tasks.workunit.client.1.smithi149.stdout:9/493: fsync d23/d2b/d70/d75/faa 0 2024-04-15T21:02:40.703 INFO:tasks.workunit.client.0.smithi072.stdout:7/322: symlink d2/d7/d25/d4c/l66 0 2024-04-15T21:02:40.706 INFO:tasks.workunit.client.0.smithi072.stdout:0/330: rename d0/d45/d52/d53 to d0/d3/d5/d70 0 2024-04-15T21:02:40.706 INFO:tasks.workunit.client.0.smithi072.stdout:4/296: rename d7 to d7/d10/d52 22 2024-04-15T21:02:40.706 INFO:tasks.workunit.client.0.smithi072.stdout:7/323: rename d2 to d2/d7/d25/d2d/d52/d67 22 2024-04-15T21:02:40.707 INFO:tasks.workunit.client.1.smithi149.stdout:4/595: creat dc/d2c/d3e/d35/d4b/d75/d80/fc4 x:0 0 0 2024-04-15T21:02:40.709 INFO:tasks.workunit.client.1.smithi149.stdout:7/542: mkdir d3/d16/d32/d90/dad/dc4 0 2024-04-15T21:02:40.710 INFO:tasks.workunit.client.0.smithi072.stdout:3/309: rename d1/f51 to d1/f64 0 2024-04-15T21:02:40.712 INFO:tasks.workunit.client.0.smithi072.stdout:8/365: sync 2024-04-15T21:02:40.713 INFO:tasks.workunit.client.0.smithi072.stdout:2/316: mkdir d2/d64 0 2024-04-15T21:02:40.715 INFO:tasks.workunit.client.0.smithi072.stdout:8/366: dread d3/de/f25 [0,4194304] 0 2024-04-15T21:02:40.716 INFO:tasks.workunit.client.1.smithi149.stdout:6/482: unlink da/d18/d10/d66/f5d 0 2024-04-15T21:02:40.720 INFO:tasks.workunit.client.0.smithi072.stdout:9/289: fdatasync d4/d1f/d2c/f35 0 2024-04-15T21:02:40.721 INFO:tasks.workunit.client.0.smithi072.stdout:9/290: chown d4/d1f/l3c 463737 1 2024-04-15T21:02:40.723 INFO:tasks.workunit.client.1.smithi149.stdout:1/465: dwrite d1/db/d14/f7d [0,4194304] 0 2024-04-15T21:02:40.725 INFO:tasks.workunit.client.1.smithi149.stdout:1/466: read d1/db/dc/d38/d39/d43/f67 [3636464,54990] 0 2024-04-15T21:02:40.726 INFO:tasks.workunit.client.0.smithi072.stdout:0/331: mkdir d0/d19/d71 0 2024-04-15T21:02:40.727 INFO:tasks.workunit.client.0.smithi072.stdout:0/332: readlink d0/d6/l1a 0 2024-04-15T21:02:40.729 INFO:tasks.workunit.client.0.smithi072.stdout:4/297: creat d7/d28/d37/f53 x:0 0 0 2024-04-15T21:02:40.731 INFO:tasks.workunit.client.0.smithi072.stdout:7/324: mknod d2/d7/d25/c68 0 2024-04-15T21:02:40.742 INFO:tasks.workunit.client.0.smithi072.stdout:8/367: fdatasync d3/d4/d4c/f2a 0 2024-04-15T21:02:40.743 INFO:tasks.workunit.client.0.smithi072.stdout:8/368: dread - d3/d4/d3b/f6e zero size 2024-04-15T21:02:40.745 INFO:tasks.workunit.client.0.smithi072.stdout:6/305: getdents d2/d10/d11/d34 0 2024-04-15T21:02:40.745 INFO:tasks.workunit.client.0.smithi072.stdout:8/369: dread d3/de/d1b/f62 [0,4194304] 0 2024-04-15T21:02:40.746 INFO:tasks.workunit.client.0.smithi072.stdout:8/370: readlink d3/ld 0 2024-04-15T21:02:40.748 INFO:tasks.workunit.client.0.smithi072.stdout:5/331: write d0/d3/d7/d1f/d4c/f5d [1359818,124917] 0 2024-04-15T21:02:40.749 INFO:tasks.workunit.client.0.smithi072.stdout:9/291: creat d4/d1f/d31/d42/f53 x:0 0 0 2024-04-15T21:02:40.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/580: dwrite d1/db/d24/f5d [0,4194304] 0 2024-04-15T21:02:40.753 INFO:tasks.workunit.client.0.smithi072.stdout:0/333: symlink d0/d3/d5/l72 0 2024-04-15T21:02:40.759 INFO:tasks.workunit.client.0.smithi072.stdout:0/334: dwrite d0/d19/f4a [0,4194304] 0 2024-04-15T21:02:40.761 INFO:tasks.workunit.client.0.smithi072.stdout:6/306: dread d2/d10/d11/d1f/f32 [4194304,4194304] 0 2024-04-15T21:02:40.762 INFO:tasks.workunit.client.0.smithi072.stdout:7/325: write d2/d7/d25/d2d/d46/d5a/d5f/f5e [4502619,117579] 0 2024-04-15T21:02:40.763 INFO:tasks.workunit.client.0.smithi072.stdout:7/326: read - d2/d7/d25/d2d/d46/d5a/d5f/d26/f41 zero size 2024-04-15T21:02:40.767 INFO:tasks.workunit.client.0.smithi072.stdout:1/291: creat d5/db/f59 x:0 0 0 2024-04-15T21:02:40.768 INFO:tasks.workunit.client.0.smithi072.stdout:1/292: write d5/f9 [5469535,40715] 0 2024-04-15T21:02:40.775 INFO:tasks.workunit.client.0.smithi072.stdout:8/371: mknod d3/de/d1b/d44/c6f 0 2024-04-15T21:02:40.777 INFO:tasks.workunit.client.0.smithi072.stdout:5/332: write d0/f35 [2898833,51970] 0 2024-04-15T21:02:40.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/292: creat d4/d1f/f54 x:0 0 0 2024-04-15T21:02:40.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/293: fdatasync d4/f13 0 2024-04-15T21:02:40.780 INFO:tasks.workunit.client.1.smithi149.stdout:9/494: mknod d23/d3c/d7a/d7c/d7f/cab 0 2024-04-15T21:02:40.780 INFO:tasks.workunit.client.0.smithi072.stdout:9/294: write d4/d1f/d31/f44 [817175,56606] 0 2024-04-15T21:02:40.782 INFO:tasks.workunit.client.0.smithi072.stdout:8/372: dread d3/d4/d3b/f55 [0,4194304] 0 2024-04-15T21:02:40.783 INFO:tasks.workunit.client.0.smithi072.stdout:8/373: chown d3/de/d1b/d6d 7 1 2024-04-15T21:02:40.784 INFO:tasks.workunit.client.0.smithi072.stdout:3/310: creat d1/d15/d32/f65 x:0 0 0 2024-04-15T21:02:40.785 INFO:tasks.workunit.client.0.smithi072.stdout:8/374: write d3/de/d21/d2e/f42 [3603375,47756] 0 2024-04-15T21:02:40.786 INFO:tasks.workunit.client.1.smithi149.stdout:0/710: rename d1/d5/d24/d8a to d1/d5/d24/d30/df7 0 2024-04-15T21:02:40.789 INFO:tasks.workunit.client.0.smithi072.stdout:1/293: mknod d5/db/d27/c5a 0 2024-04-15T21:02:40.790 INFO:tasks.workunit.client.0.smithi072.stdout:3/311: dwrite d1/d15/f4d [0,4194304] 0 2024-04-15T21:02:40.790 INFO:tasks.workunit.client.0.smithi072.stdout:1/294: readlink d5/db/l20 0 2024-04-15T21:02:40.806 INFO:tasks.workunit.client.0.smithi072.stdout:4/298: creat d7/f54 x:0 0 0 2024-04-15T21:02:40.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/299: readlink d7/d15/l18 0 2024-04-15T21:02:40.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/300: chown d7/d28/d37/l39 746556633 1 2024-04-15T21:02:40.808 INFO:tasks.workunit.client.0.smithi072.stdout:4/301: stat d7/d10/d41/f51 0 2024-04-15T21:02:40.813 INFO:tasks.workunit.client.1.smithi149.stdout:2/586: rename d4/d7/d10/d6b/d21/d5e/dbe/da7/fbf to d4/d7/d29/fd1 0 2024-04-15T21:02:40.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/512: write d0/d6/d2d/f4a [440118,101695] 0 2024-04-15T21:02:40.817 INFO:tasks.workunit.client.1.smithi149.stdout:4/596: write dc/d2c/d3e/d15/d3f/f8b [415731,43785] 0 2024-04-15T21:02:40.818 INFO:tasks.workunit.client.0.smithi072.stdout:6/307: write d2/d10/d11/d34/f3a [29315,78457] 0 2024-04-15T21:02:40.819 INFO:tasks.workunit.client.0.smithi072.stdout:2/317: link d2/d8/l4a d2/d38/l65 0 2024-04-15T21:02:40.821 INFO:tasks.workunit.client.1.smithi149.stdout:0/711: dwrite d1/d29/fef [0,4194304] 0 2024-04-15T21:02:40.822 INFO:tasks.workunit.client.1.smithi149.stdout:3/581: dread d1/db/d23/f49 [0,4194304] 0 2024-04-15T21:02:40.823 INFO:tasks.workunit.client.0.smithi072.stdout:3/312: mknod d1/d15/c66 0 2024-04-15T21:02:40.825 INFO:tasks.workunit.client.0.smithi072.stdout:1/295: symlink d5/db/d27/l5b 0 2024-04-15T21:02:40.829 INFO:tasks.workunit.client.0.smithi072.stdout:3/313: dread d1/d26/f30 [0,4194304] 0 2024-04-15T21:02:40.832 INFO:tasks.workunit.client.0.smithi072.stdout:3/314: dread d1/d15/d32/d2f/f33 [0,4194304] 0 2024-04-15T21:02:40.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/483: dwrite da/d32/f43 [0,4194304] 0 2024-04-15T21:02:40.836 INFO:tasks.workunit.client.0.smithi072.stdout:7/327: getdents d2/d7/d25/d2d/d46 0 2024-04-15T21:02:40.837 INFO:tasks.workunit.client.0.smithi072.stdout:7/328: read - d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3d zero size 2024-04-15T21:02:40.839 INFO:tasks.workunit.client.0.smithi072.stdout:6/308: mkdir d2/d10/d11/d1f/d60 0 2024-04-15T21:02:40.841 INFO:tasks.workunit.client.1.smithi149.stdout:3/582: mknod d1/db/d40/d56/d84/d85/cae 0 2024-04-15T21:02:40.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/467: dwrite d1/d17/d52/f2a [4194304,4194304] 0 2024-04-15T21:02:40.852 INFO:tasks.workunit.client.1.smithi149.stdout:5/513: creat d0/d6/d82/da1/d12/d16/d28/d9b/fa7 x:0 0 0 2024-04-15T21:02:40.853 INFO:tasks.workunit.client.0.smithi072.stdout:1/296: mkdir d5/db/d27/d5c 0 2024-04-15T21:02:40.858 INFO:tasks.workunit.client.1.smithi149.stdout:9/495: dwrite d23/d2b/d37/d50/fa2 [0,4194304] 0 2024-04-15T21:02:40.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/597: link dc/d2c/d3e/d35/d4b/f7d dc/d2c/d3e/d15/d5b/fc5 0 2024-04-15T21:02:40.860 INFO:tasks.workunit.client.1.smithi149.stdout:5/514: dread - d0/d6/d79/f9d zero size 2024-04-15T21:02:40.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/295: creat d4/d1f/d2c/f55 x:0 0 0 2024-04-15T21:02:40.865 INFO:tasks.workunit.client.1.smithi149.stdout:3/583: mkdir d1/db/d24/d39/d79/d97/daf 0 2024-04-15T21:02:40.865 INFO:tasks.workunit.client.0.smithi072.stdout:3/315: creat d1/d3f/f67 x:0 0 0 2024-04-15T21:02:40.865 INFO:tasks.workunit.client.1.smithi149.stdout:2/587: write d4/f12 [2538146,92920] 0 2024-04-15T21:02:40.866 INFO:tasks.workunit.client.1.smithi149.stdout:0/712: dread d1/d5/d24/d50/d15/f57 [0,4194304] 0 2024-04-15T21:02:40.869 INFO:tasks.workunit.client.1.smithi149.stdout:7/543: dwrite d3/d34/f6d [4194304,4194304] 0 2024-04-15T21:02:40.870 INFO:tasks.workunit.client.1.smithi149.stdout:8/624: sync 2024-04-15T21:02:40.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/468: dwrite d1/d17/d52/f84 [0,4194304] 0 2024-04-15T21:02:40.874 INFO:tasks.workunit.client.0.smithi072.stdout:6/309: truncate d2/fc 3028327 0 2024-04-15T21:02:40.874 INFO:tasks.workunit.client.0.smithi072.stdout:3/316: dread d1/d26/f58 [0,4194304] 0 2024-04-15T21:02:40.875 INFO:tasks.workunit.client.0.smithi072.stdout:3/317: dread - d1/d5b/f60 zero size 2024-04-15T21:02:40.875 INFO:tasks.workunit.client.1.smithi149.stdout:9/496: write d23/d2b/d37/d6d/f74 [2395578,61258] 0 2024-04-15T21:02:40.876 INFO:tasks.workunit.client.1.smithi149.stdout:9/497: readlink l1c 0 2024-04-15T21:02:40.876 INFO:tasks.workunit.client.1.smithi149.stdout:5/515: fdatasync d0/d6/fe 0 2024-04-15T21:02:40.878 INFO:tasks.workunit.client.1.smithi149.stdout:1/469: chown d1/db/dc/d38/d39/l53 3428880 1 2024-04-15T21:02:40.879 INFO:tasks.workunit.client.1.smithi149.stdout:5/516: dread - d0/d9/d71/fa5 zero size 2024-04-15T21:02:40.884 INFO:tasks.workunit.client.0.smithi072.stdout:6/310: dwrite d2/d10/d11/d34/f3a [0,4194304] 0 2024-04-15T21:02:40.884 INFO:tasks.workunit.client.0.smithi072.stdout:3/318: dwrite d1/f6 [0,4194304] 0 2024-04-15T21:02:40.886 INFO:tasks.workunit.client.0.smithi072.stdout:1/297: mknod d5/d31/d51/c5d 0 2024-04-15T21:02:40.887 INFO:tasks.workunit.client.1.smithi149.stdout:6/484: rmdir da/d49/d70 0 2024-04-15T21:02:40.888 INFO:tasks.workunit.client.0.smithi072.stdout:5/333: getdents d0/d3/d23/d24 0 2024-04-15T21:02:40.890 INFO:tasks.workunit.client.1.smithi149.stdout:0/713: rmdir d1/d9 39 2024-04-15T21:02:40.892 INFO:tasks.workunit.client.0.smithi072.stdout:5/334: rename d0/d3/d7/d12/d31/d49 to d0/d3/d7/d12/d31/d49/d73 22 2024-04-15T21:02:40.892 INFO:tasks.workunit.client.1.smithi149.stdout:6/485: dread da/d32/f43 [0,4194304] 0 2024-04-15T21:02:40.894 INFO:tasks.workunit.client.0.smithi072.stdout:5/335: write d0/d3/d7/d12/d31/f3d [5502843,23028] 0 2024-04-15T21:02:40.895 INFO:tasks.workunit.client.1.smithi149.stdout:7/544: creat d3/d16/d20/d6c/d91/fc5 x:0 0 0 2024-04-15T21:02:40.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/470: dread d1/db/f37 [0,4194304] 0 2024-04-15T21:02:40.896 INFO:tasks.workunit.client.0.smithi072.stdout:3/319: dwrite d1/d15/d40/f9 [0,4194304] 0 2024-04-15T21:02:40.899 INFO:tasks.workunit.client.1.smithi149.stdout:2/588: truncate d4/f5d 4252205 0 2024-04-15T21:02:40.900 INFO:tasks.workunit.client.0.smithi072.stdout:4/302: creat d7/f55 x:0 0 0 2024-04-15T21:02:40.906 INFO:tasks.workunit.client.1.smithi149.stdout:9/498: symlink d23/d2b/d37/d50/lac 0 2024-04-15T21:02:40.909 INFO:tasks.workunit.client.1.smithi149.stdout:7/545: fsync d3/d16/d20/d36/d3d/f73 0 2024-04-15T21:02:40.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/471: dwrite d1/db/dc/d38/d39/d43/f54 [0,4194304] 0 2024-04-15T21:02:40.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/517: creat d0/d6/d82/da1/d12/d16/d28/d1b/d60/fa8 x:0 0 0 2024-04-15T21:02:40.923 INFO:tasks.workunit.client.1.smithi149.stdout:6/486: creat da/d18/d10/d16/d97/f98 x:0 0 0 2024-04-15T21:02:40.925 INFO:tasks.workunit.client.1.smithi149.stdout:3/584: dread d1/db/d28/f44 [0,4194304] 0 2024-04-15T21:02:40.927 INFO:tasks.workunit.client.1.smithi149.stdout:8/625: dwrite d2/df/d10/f11 [8388608,4194304] 0 2024-04-15T21:02:40.929 INFO:tasks.workunit.client.1.smithi149.stdout:2/589: stat d4/d7/d10/d6b/d21/d2c/d63/l7e 0 2024-04-15T21:02:40.929 INFO:tasks.workunit.client.0.smithi072.stdout:4/303: dread d7/d24/f1e [0,4194304] 0 2024-04-15T21:02:40.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/499: dwrite d23/d2b/d44/d7e/f9b [0,4194304] 0 2024-04-15T21:02:40.935 INFO:tasks.workunit.client.0.smithi072.stdout:0/335: sync 2024-04-15T21:02:40.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/590: read d4/d7/d10/d6b/d21/d2c/f80 [159382,123829] 0 2024-04-15T21:02:40.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/336: write d0/d45/d35/f56 [2920849,41131] 0 2024-04-15T21:02:40.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/337: fsync d0/d3/d5/f60 0 2024-04-15T21:02:40.941 INFO:tasks.workunit.client.0.smithi072.stdout:7/329: write d2/d7/f8 [1874995,45510] 0 2024-04-15T21:02:40.941 INFO:tasks.workunit.client.1.smithi149.stdout:8/626: dwrite d2/df/d10/d25/d57/dd1/d50/d5d/dc6/fdc [0,4194304] 0 2024-04-15T21:02:40.942 INFO:tasks.workunit.client.0.smithi072.stdout:1/298: mkdir d5/d3d/d5e 0 2024-04-15T21:02:40.945 INFO:tasks.workunit.client.0.smithi072.stdout:0/338: dwrite d0/f1 [0,4194304] 0 2024-04-15T21:02:40.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/518: rename d0/d6/d82/da1/d12/d16/d28 to d0/d6/d82/da1/d12/d16/da9 0 2024-04-15T21:02:40.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/591: dwrite d4/d7/d29/f4f [0,4194304] 0 2024-04-15T21:02:40.954 INFO:tasks.workunit.client.1.smithi149.stdout:3/585: creat d1/db/d24/d39/d79/fb0 x:0 0 0 2024-04-15T21:02:40.956 INFO:tasks.workunit.client.0.smithi072.stdout:3/320: unlink d1/d15/d40/l16 0 2024-04-15T21:02:40.956 INFO:tasks.workunit.client.1.smithi149.stdout:3/586: write d1/db/d24/f89 [13007,69997] 0 2024-04-15T21:02:40.962 INFO:tasks.workunit.client.1.smithi149.stdout:9/500: mkdir d23/d3c/d87/d9a/dad 0 2024-04-15T21:02:40.962 INFO:tasks.workunit.client.1.smithi149.stdout:4/598: getdents dc/d2c/d3e/d35/db4 0 2024-04-15T21:02:40.963 INFO:tasks.workunit.client.1.smithi149.stdout:9/501: readlink ld 0 2024-04-15T21:02:40.968 INFO:tasks.workunit.client.1.smithi149.stdout:1/472: mkdir d1/d17/d5e/d64/d8a 0 2024-04-15T21:02:40.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/714: dwrite d1/d9/f35 [0,4194304] 0 2024-04-15T21:02:40.976 INFO:tasks.workunit.client.0.smithi072.stdout:2/318: getdents d2/d3/d5f 0 2024-04-15T21:02:40.976 INFO:tasks.workunit.client.1.smithi149.stdout:8/627: symlink d2/d5b/dd6/le0 0 2024-04-15T21:02:40.977 INFO:tasks.workunit.client.0.smithi072.stdout:2/319: write d2/f5a [311030,17453] 0 2024-04-15T21:02:40.977 INFO:tasks.workunit.client.0.smithi072.stdout:6/311: creat d2/d10/d11/d1f/d60/f61 x:0 0 0 2024-04-15T21:02:40.980 INFO:tasks.workunit.client.1.smithi149.stdout:5/519: symlink d0/d6/d9f/laa 0 2024-04-15T21:02:40.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/520: write d0/f56 [664609,17264] 0 2024-04-15T21:02:40.985 INFO:tasks.workunit.client.0.smithi072.stdout:9/296: link d4/d1f/l3c d4/d29/d45/l56 0 2024-04-15T21:02:40.986 INFO:tasks.workunit.client.1.smithi149.stdout:3/587: rename d1/db/f21 to d1/db/d24/d4d/d63/d65/fb1 0 2024-04-15T21:02:40.987 INFO:tasks.workunit.client.0.smithi072.stdout:5/336: getdents d0/d3/d23/d5f 0 2024-04-15T21:02:40.988 INFO:tasks.workunit.client.1.smithi149.stdout:9/502: creat d23/d2b/d70/fae x:0 0 0 2024-04-15T21:02:40.989 INFO:tasks.workunit.client.1.smithi149.stdout:8/628: dwrite d2/df/d10/d4e/d9f/fcc [0,4194304] 0 2024-04-15T21:02:40.991 INFO:tasks.workunit.client.1.smithi149.stdout:3/588: read d1/db/d23/f49 [1665397,121206] 0 2024-04-15T21:02:40.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/503: dread - d23/d2b/d70/d75/faa zero size 2024-04-15T21:02:40.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/473: rmdir d1 39 2024-04-15T21:02:40.998 INFO:tasks.workunit.client.1.smithi149.stdout:3/589: truncate d1/db/d24/d4d/f82 424055 0 2024-04-15T21:02:41.002 INFO:tasks.workunit.client.1.smithi149.stdout:5/521: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [0,4194304] 0 2024-04-15T21:02:41.005 INFO:tasks.workunit.client.1.smithi149.stdout:7/546: creat d3/d17/fc6 x:0 0 0 2024-04-15T21:02:41.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/487: creat da/d18/d10/f99 x:0 0 0 2024-04-15T21:02:41.011 INFO:tasks.workunit.client.1.smithi149.stdout:0/715: dread d1/f22 [8388608,4194304] 0 2024-04-15T21:02:41.011 INFO:tasks.workunit.client.0.smithi072.stdout:0/339: mknod d0/d45/c73 0 2024-04-15T21:02:41.015 INFO:tasks.workunit.client.0.smithi072.stdout:9/297: fdatasync d4/d1f/d2c/f35 0 2024-04-15T21:02:41.017 INFO:tasks.workunit.client.1.smithi149.stdout:4/599: creat dc/d2c/d3e/d7c/dba/fc6 x:0 0 0 2024-04-15T21:02:41.019 INFO:tasks.workunit.client.0.smithi072.stdout:3/321: link d1/d15/d32/d2f/d1a/f37 d1/d3f/d4f/f68 0 2024-04-15T21:02:41.020 INFO:tasks.workunit.client.1.smithi149.stdout:9/504: creat d23/d2b/d37/d50/faf x:0 0 0 2024-04-15T21:02:41.020 INFO:tasks.workunit.client.0.smithi072.stdout:0/340: dwrite d0/d3/d5/f3c [0,4194304] 0 2024-04-15T21:02:41.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/505: truncate d23/d2b/d37/d6d/f7d 1135183 0 2024-04-15T21:02:41.022 INFO:tasks.workunit.client.0.smithi072.stdout:1/299: dwrite d5/db/d2d/d3a/f50 [4194304,4194304] 0 2024-04-15T21:02:41.022 INFO:tasks.workunit.client.0.smithi072.stdout:2/320: mkdir d2/d66 0 2024-04-15T21:02:41.023 INFO:tasks.workunit.client.1.smithi149.stdout:2/592: write d4/d7/f31 [4915456,47844] 0 2024-04-15T21:02:41.023 INFO:tasks.workunit.client.0.smithi072.stdout:2/321: read - d2/d3/f63 zero size 2024-04-15T21:02:41.029 INFO:tasks.workunit.client.0.smithi072.stdout:1/300: dwrite d5/db/f52 [0,4194304] 0 2024-04-15T21:02:41.034 INFO:tasks.workunit.client.1.smithi149.stdout:5/522: symlink d0/d6/d82/da1/d12/d16/da9/d1b/d9c/lab 0 2024-04-15T21:02:41.037 INFO:tasks.workunit.client.0.smithi072.stdout:5/337: creat d0/d3/d7/d12/d1d/f74 x:0 0 0 2024-04-15T21:02:41.040 INFO:tasks.workunit.client.0.smithi072.stdout:8/375: sync 2024-04-15T21:02:41.040 INFO:tasks.workunit.client.1.smithi149.stdout:1/474: dwrite d1/f62 [4194304,4194304] 0 2024-04-15T21:02:41.041 INFO:tasks.workunit.client.1.smithi149.stdout:7/547: rename d3/d16/d20/d60/f87 to d3/d16/d20/d6c/fc7 0 2024-04-15T21:02:41.044 INFO:tasks.workunit.client.1.smithi149.stdout:3/590: write d1/db/d23/f49 [3038479,71800] 0 2024-04-15T21:02:41.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/488: creat da/d18/d10/d16/f9a x:0 0 0 2024-04-15T21:02:41.047 INFO:tasks.workunit.client.1.smithi149.stdout:0/716: mknod d1/d29/d2c/d4f/d95/cf8 0 2024-04-15T21:02:41.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/591: write d1/db/f6e [1238769,47217] 0 2024-04-15T21:02:41.047 INFO:tasks.workunit.client.0.smithi072.stdout:0/341: mkdir d0/d74 0 2024-04-15T21:02:41.048 INFO:tasks.workunit.client.1.smithi149.stdout:3/592: chown d1/db/d23/d5e/f8f 2 1 2024-04-15T21:02:41.049 INFO:tasks.workunit.client.0.smithi072.stdout:0/342: truncate d0/d6/d55/f5f 854472 0 2024-04-15T21:02:41.049 INFO:tasks.workunit.client.1.smithi149.stdout:4/600: creat dc/d2c/d3e/d15/d3f/fc7 x:0 0 0 2024-04-15T21:02:41.050 INFO:tasks.workunit.client.0.smithi072.stdout:6/312: truncate d2/d10/d11/d34/f38 609670 0 2024-04-15T21:02:41.051 INFO:tasks.workunit.client.1.smithi149.stdout:4/601: write dc/d2c/f22 [4717892,30104] 0 2024-04-15T21:02:41.052 INFO:tasks.workunit.client.1.smithi149.stdout:9/506: symlink d23/d2b/d37/d50/lb0 0 2024-04-15T21:02:41.055 INFO:tasks.workunit.client.0.smithi072.stdout:7/330: getdents d2/d7/d25/d2d/d46/d5a/d5f 0 2024-04-15T21:02:41.056 INFO:tasks.workunit.client.0.smithi072.stdout:1/301: symlink d5/db/d2d/d3a/l5f 0 2024-04-15T21:02:41.058 INFO:tasks.workunit.client.1.smithi149.stdout:8/629: link d2/df/d10/d4e/d9f/fa5 d2/df/d10/d25/d57/dd1/d50/d5d/d6d/fe1 0 2024-04-15T21:02:41.061 INFO:tasks.workunit.client.0.smithi072.stdout:8/376: rmdir d3/de/d1b/d41 39 2024-04-15T21:02:41.071 INFO:tasks.workunit.client.1.smithi149.stdout:6/489: truncate da/d18/d10/f68 261017 0 2024-04-15T21:02:41.072 INFO:tasks.workunit.client.1.smithi149.stdout:2/593: write d4/d7/d10/d6b/f56 [773810,123682] 0 2024-04-15T21:02:41.075 INFO:tasks.workunit.client.1.smithi149.stdout:4/602: mkdir dc/d1a/dc8 0 2024-04-15T21:02:41.078 INFO:tasks.workunit.client.1.smithi149.stdout:9/507: creat d23/d3c/d7a/d7c/fb1 x:0 0 0 2024-04-15T21:02:41.079 INFO:tasks.workunit.client.0.smithi072.stdout:5/338: mkdir d0/d3/d7/d12/d75 0 2024-04-15T21:02:41.080 INFO:tasks.workunit.client.0.smithi072.stdout:6/313: dread d2/d10/d11/d34/f48 [0,4194304] 0 2024-04-15T21:02:41.080 INFO:tasks.workunit.client.0.smithi072.stdout:2/322: truncate d2/d3/f46 1647126 0 2024-04-15T21:02:41.080 INFO:tasks.workunit.client.0.smithi072.stdout:2/323: chown d2/d38/f56 551739 1 2024-04-15T21:02:41.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/298: rename d4/d1f/d31/d42/f50 to d4/d1f/d2c/f57 0 2024-04-15T21:02:41.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/343: getdents d0/d74 0 2024-04-15T21:02:41.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/344: stat d0/lb 0 2024-04-15T21:02:41.086 INFO:tasks.workunit.client.1.smithi149.stdout:6/490: mkdir da/d60/d9b 0 2024-04-15T21:02:41.087 INFO:tasks.workunit.client.1.smithi149.stdout:4/603: rmdir dc/d2c/d3e/d15/d3f 39 2024-04-15T21:02:41.090 INFO:tasks.workunit.client.1.smithi149.stdout:9/508: symlink d23/d2b/d37/d6d/lb2 0 2024-04-15T21:02:41.091 INFO:tasks.workunit.client.1.smithi149.stdout:9/509: read d23/d2b/d44/f5c [4178047,83172] 0 2024-04-15T21:02:41.093 INFO:tasks.workunit.client.0.smithi072.stdout:5/339: readlink d0/l3f 0 2024-04-15T21:02:41.095 INFO:tasks.workunit.client.1.smithi149.stdout:1/475: link d1/db/dc/d11/d3e/l4f d1/l8b 0 2024-04-15T21:02:41.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/314: rmdir d2/d10/d11/d15 39 2024-04-15T21:02:41.097 INFO:tasks.workunit.client.1.smithi149.stdout:5/523: rename d0/d6/d82/da1/d12/d16/da9/d1b/f1f to d0/d6/d82/da1/d12/d16/da9/fac 0 2024-04-15T21:02:41.099 INFO:tasks.workunit.client.0.smithi072.stdout:2/324: symlink d2/d3/d5f/l67 0 2024-04-15T21:02:41.100 INFO:tasks.workunit.client.0.smithi072.stdout:6/315: dwrite d2/d10/d11/f4b [0,4194304] 0 2024-04-15T21:02:41.102 INFO:tasks.workunit.client.0.smithi072.stdout:9/299: mkdir d4/d1f/d58 0 2024-04-15T21:02:41.102 INFO:tasks.workunit.client.0.smithi072.stdout:3/322: getdents d1/d26 0 2024-04-15T21:02:41.102 INFO:tasks.workunit.client.0.smithi072.stdout:9/300: dread - d4/d1f/d31/f3f zero size 2024-04-15T21:02:41.105 INFO:tasks.workunit.client.1.smithi149.stdout:1/476: mkdir d1/db/dc/d38/d39/d8c 0 2024-04-15T21:02:41.105 INFO:tasks.workunit.client.0.smithi072.stdout:0/345: creat d0/d45/d35/d3a/f75 x:0 0 0 2024-04-15T21:02:41.106 INFO:tasks.workunit.client.1.smithi149.stdout:5/524: dwrite d0/d6/d2d/f4a [0,4194304] 0 2024-04-15T21:02:41.110 INFO:tasks.workunit.client.0.smithi072.stdout:1/302: link d5/db/d27/c41 d5/db/d2d/d56/c60 0 2024-04-15T21:02:41.117 INFO:tasks.workunit.client.0.smithi072.stdout:8/377: rmdir d3/de/d1b/d61 0 2024-04-15T21:02:41.120 INFO:tasks.workunit.client.1.smithi149.stdout:8/630: getdents d2/df/d10/d4e/d9f/dd8 0 2024-04-15T21:02:41.121 INFO:tasks.workunit.client.0.smithi072.stdout:3/323: creat d1/d5b/f69 x:0 0 0 2024-04-15T21:02:41.121 INFO:tasks.workunit.client.0.smithi072.stdout:9/301: creat d4/d29/f59 x:0 0 0 2024-04-15T21:02:41.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/717: rename d1/d5/d24/d50/d13/d38/d44/c3a to d1/d5/d24/d30/df7/cf9 0 2024-04-15T21:02:41.126 INFO:tasks.workunit.client.0.smithi072.stdout:8/378: chown d3/d4/l14 85137 1 2024-04-15T21:02:41.127 INFO:tasks.workunit.client.1.smithi149.stdout:9/510: dread d23/d3c/f4e [0,4194304] 0 2024-04-15T21:02:41.127 INFO:tasks.workunit.client.0.smithi072.stdout:8/379: chown d3/de/d1b/f43 512914433 1 2024-04-15T21:02:41.127 INFO:tasks.workunit.client.0.smithi072.stdout:2/325: creat d2/d66/f68 x:0 0 0 2024-04-15T21:02:41.128 INFO:tasks.workunit.client.0.smithi072.stdout:2/326: truncate d2/d38/f54 1036180 0 2024-04-15T21:02:41.128 INFO:tasks.workunit.client.0.smithi072.stdout:6/316: symlink d2/d10/d11/l62 0 2024-04-15T21:02:41.129 INFO:tasks.workunit.client.0.smithi072.stdout:2/327: fdatasync d2/d38/f54 0 2024-04-15T21:02:41.131 INFO:tasks.workunit.client.1.smithi149.stdout:8/631: rmdir d2/df/d10/d4e/d9f 39 2024-04-15T21:02:41.131 INFO:tasks.workunit.client.0.smithi072.stdout:4/304: sync 2024-04-15T21:02:41.133 INFO:tasks.workunit.client.1.smithi149.stdout:9/511: dwrite d23/d3c/f6b [0,4194304] 0 2024-04-15T21:02:41.134 INFO:tasks.workunit.client.0.smithi072.stdout:6/317: dwrite d2/f2a [4194304,4194304] 0 2024-04-15T21:02:41.140 INFO:tasks.workunit.client.1.smithi149.stdout:7/548: rename d3/d17/d1f/fc2 to d3/d16/d32/d90/dad/fc8 0 2024-04-15T21:02:41.142 INFO:tasks.workunit.client.1.smithi149.stdout:4/604: link dc/d2c/d3e/d15/d3f/l8c dc/d2c/d3e/d35/lc9 0 2024-04-15T21:02:41.145 INFO:tasks.workunit.client.0.smithi072.stdout:1/303: link d5/f17 d5/db/d2d/d3a/f61 0 2024-04-15T21:02:41.146 INFO:tasks.workunit.client.0.smithi072.stdout:1/304: chown d5/db/d2d/d3a/d1f/l21 2172 1 2024-04-15T21:02:41.146 INFO:tasks.workunit.client.0.smithi072.stdout:8/380: symlink d3/l70 0 2024-04-15T21:02:41.147 INFO:tasks.workunit.client.0.smithi072.stdout:8/381: chown d3/de/c63 1487 1 2024-04-15T21:02:41.151 INFO:tasks.workunit.client.1.smithi149.stdout:1/477: creat d1/db/f8d x:0 0 0 2024-04-15T21:02:41.153 INFO:tasks.workunit.client.1.smithi149.stdout:0/718: symlink d1/d5/d24/d30/lfa 0 2024-04-15T21:02:41.154 INFO:tasks.workunit.client.1.smithi149.stdout:1/478: stat d1/d17/d52/d6c/f7a 0 2024-04-15T21:02:41.154 INFO:tasks.workunit.client.1.smithi149.stdout:6/491: dwrite da/d18/d10/f8b [0,4194304] 0 2024-04-15T21:02:41.155 INFO:tasks.workunit.client.0.smithi072.stdout:2/328: mkdir d2/d66/d69 0 2024-04-15T21:02:41.156 INFO:tasks.workunit.client.1.smithi149.stdout:6/492: write da/d18/d10/d3f/f5c [1763387,128611] 0 2024-04-15T21:02:41.159 INFO:tasks.workunit.client.1.smithi149.stdout:6/493: dread - da/d18/d10/d16/f9a zero size 2024-04-15T21:02:41.159 INFO:tasks.workunit.client.1.smithi149.stdout:6/494: chown da/d11/l34 380 1 2024-04-15T21:02:41.161 INFO:tasks.workunit.client.0.smithi072.stdout:9/302: symlink d4/d1f/d31/d4d/l5a 0 2024-04-15T21:02:41.162 INFO:tasks.workunit.client.0.smithi072.stdout:9/303: readlink d4/d29/d45/l56 0 2024-04-15T21:02:41.163 INFO:tasks.workunit.client.1.smithi149.stdout:7/549: fdatasync d3/f10 0 2024-04-15T21:02:41.163 INFO:tasks.workunit.client.1.smithi149.stdout:7/550: chown d3/d16/d20/d36/l28 6 1 2024-04-15T21:02:41.163 INFO:tasks.workunit.client.1.smithi149.stdout:5/525: dwrite d0/d6/d82/da1/d12/d2b/f53 [0,4194304] 0 2024-04-15T21:02:41.164 INFO:tasks.workunit.client.1.smithi149.stdout:7/551: chown d3/d16/d20/d36/d3d/d56 210799618 1 2024-04-15T21:02:41.166 INFO:tasks.workunit.client.1.smithi149.stdout:2/594: rename d4/d7/d10/d6b/d21/f5f to d4/d7/d93/fd2 0 2024-04-15T21:02:41.168 INFO:tasks.workunit.client.0.smithi072.stdout:0/346: truncate d0/f29 166123 0 2024-04-15T21:02:41.172 INFO:tasks.workunit.client.1.smithi149.stdout:4/605: mkdir dc/d2c/d3e/d35/d4b/d75/dca 0 2024-04-15T21:02:41.173 INFO:tasks.workunit.client.0.smithi072.stdout:1/305: creat d5/db/d27/f62 x:0 0 0 2024-04-15T21:02:41.174 INFO:tasks.workunit.client.0.smithi072.stdout:1/306: dread - d5/db/f59 zero size 2024-04-15T21:02:41.174 INFO:tasks.workunit.client.0.smithi072.stdout:1/307: chown d5/db/d2d/d56 40166 1 2024-04-15T21:02:41.179 INFO:tasks.workunit.client.1.smithi149.stdout:1/479: unlink d1/db/dc/d38/d39/d88/c89 0 2024-04-15T21:02:41.181 INFO:tasks.workunit.client.0.smithi072.stdout:3/324: link d1/f2b d1/d5b/f6a 0 2024-04-15T21:02:41.182 INFO:tasks.workunit.client.0.smithi072.stdout:9/304: chown d4/c6 8351 1 2024-04-15T21:02:41.184 INFO:tasks.workunit.client.0.smithi072.stdout:6/318: unlink d2/d10/d11/d15/l2c 0 2024-04-15T21:02:41.184 INFO:tasks.workunit.client.0.smithi072.stdout:6/319: chown d2/d10/d11/d15/c3b 4308 1 2024-04-15T21:02:41.185 INFO:tasks.workunit.client.0.smithi072.stdout:6/320: dread - d2/d10/d11/d1f/f4c zero size 2024-04-15T21:02:41.185 INFO:tasks.workunit.client.1.smithi149.stdout:6/495: creat da/d60/f9c x:0 0 0 2024-04-15T21:02:41.189 INFO:tasks.workunit.client.0.smithi072.stdout:1/308: mkdir d5/db/d2d/d3a/d1f/d63 0 2024-04-15T21:02:41.190 INFO:tasks.workunit.client.1.smithi149.stdout:5/526: symlink d0/d6/d2d/lad 0 2024-04-15T21:02:41.191 INFO:tasks.workunit.client.0.smithi072.stdout:8/382: mknod d3/de/c71 0 2024-04-15T21:02:41.192 INFO:tasks.workunit.client.1.smithi149.stdout:7/552: rmdir d3/d16/da0 39 2024-04-15T21:02:41.193 INFO:tasks.workunit.client.0.smithi072.stdout:2/329: symlink d2/d64/l6a 0 2024-04-15T21:02:41.194 INFO:tasks.workunit.client.0.smithi072.stdout:2/330: stat d2/d8/d41/c55 0 2024-04-15T21:02:41.195 INFO:tasks.workunit.client.1.smithi149.stdout:8/632: rename d2/df/d10/f11 to d2/df/d10/d25/d32/d45/d77/fe2 0 2024-04-15T21:02:41.196 INFO:tasks.workunit.client.0.smithi072.stdout:3/325: mknod d1/d3f/d4f/c6b 0 2024-04-15T21:02:41.198 INFO:tasks.workunit.client.0.smithi072.stdout:9/305: mknod d4/d29/c5b 0 2024-04-15T21:02:41.199 INFO:tasks.workunit.client.0.smithi072.stdout:6/321: mkdir d2/d10/d11/d1f/d60/d63 0 2024-04-15T21:02:41.199 INFO:tasks.workunit.client.0.smithi072.stdout:2/331: dwrite d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:41.200 INFO:tasks.workunit.client.1.smithi149.stdout:0/719: mkdir d1/d5/dfb 0 2024-04-15T21:02:41.202 INFO:tasks.workunit.client.1.smithi149.stdout:1/480: symlink d1/db/d16/d35/l8e 0 2024-04-15T21:02:41.203 INFO:tasks.workunit.client.1.smithi149.stdout:1/481: stat d1/d17/d52/l25 0 2024-04-15T21:02:41.204 INFO:tasks.workunit.client.1.smithi149.stdout:1/482: chown d1/db/d16/d86 0 1 2024-04-15T21:02:41.205 INFO:tasks.workunit.client.1.smithi149.stdout:1/483: write d1/d17/f1c [3940962,35586] 0 2024-04-15T21:02:41.208 INFO:tasks.workunit.client.1.smithi149.stdout:5/527: mknod d0/d6/d82/da1/cae 0 2024-04-15T21:02:41.210 INFO:tasks.workunit.client.1.smithi149.stdout:7/553: dread d3/d39/f89 [0,4194304] 0 2024-04-15T21:02:41.215 INFO:tasks.workunit.client.1.smithi149.stdout:1/484: dwrite d1/d17/d52/f2a [4194304,4194304] 0 2024-04-15T21:02:41.216 INFO:tasks.workunit.client.0.smithi072.stdout:7/331: sync 2024-04-15T21:02:41.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/512: rename d23/d2b/d37/d6d/da4 to d23/d2b/d37/d50/db3 0 2024-04-15T21:02:41.226 INFO:tasks.workunit.client.0.smithi072.stdout:9/306: rename d4/d1f/d2c/f55 to d4/d1f/d31/d4d/f5c 0 2024-04-15T21:02:41.226 INFO:tasks.workunit.client.1.smithi149.stdout:1/485: dwrite d1/d17/d52/d42/f58 [0,4194304] 0 2024-04-15T21:02:41.228 INFO:tasks.workunit.client.1.smithi149.stdout:8/633: write d2/df/d10/d4e/d9f/fcc [594344,123685] 0 2024-04-15T21:02:41.230 INFO:tasks.workunit.client.1.smithi149.stdout:1/486: readlink d1/db/dc/d38/d39/l53 0 2024-04-15T21:02:41.230 INFO:tasks.workunit.client.0.smithi072.stdout:2/332: symlink d2/d8/d41/l6b 0 2024-04-15T21:02:41.231 INFO:tasks.workunit.client.0.smithi072.stdout:0/347: truncate d0/f1 3170177 0 2024-04-15T21:02:41.231 INFO:tasks.workunit.client.1.smithi149.stdout:2/595: symlink d4/d7/d10/d6b/d21/d3b/ld3 0 2024-04-15T21:02:41.232 INFO:tasks.workunit.client.0.smithi072.stdout:0/348: write d0/d6/f4e [645967,101949] 0 2024-04-15T21:02:41.233 INFO:tasks.workunit.client.1.smithi149.stdout:2/596: readlink d4/d7/d10/d6b/d21/d5e/dbe/da7/l53 0 2024-04-15T21:02:41.233 INFO:tasks.workunit.client.0.smithi072.stdout:6/322: creat d2/d10/d11/d1f/d60/f64 x:0 0 0 2024-04-15T21:02:41.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/383: write d3/de/d21/d2e/f5c [945351,67796] 0 2024-04-15T21:02:41.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/384: stat d3/d4/f2c 0 2024-04-15T21:02:41.237 INFO:tasks.workunit.client.0.smithi072.stdout:1/309: link d5/db/d27/f62 d5/db/d27/d5c/f64 0 2024-04-15T21:02:41.237 INFO:tasks.workunit.client.0.smithi072.stdout:8/385: fdatasync d3/ff 0 2024-04-15T21:02:41.242 INFO:tasks.workunit.client.0.smithi072.stdout:7/332: mknod d2/d7/d25/d2d/d47/c69 0 2024-04-15T21:02:41.242 INFO:tasks.workunit.client.0.smithi072.stdout:7/333: readlink d2/d7/d25/d2d/d52/l61 0 2024-04-15T21:02:41.244 INFO:tasks.workunit.client.0.smithi072.stdout:7/334: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f5d 325624 0 2024-04-15T21:02:41.244 INFO:tasks.workunit.client.0.smithi072.stdout:7/335: fdatasync d2/d7/f55 0 2024-04-15T21:02:41.245 INFO:tasks.workunit.client.0.smithi072.stdout:7/336: chown d2/d7/d25/d2d/d52 8278329 1 2024-04-15T21:02:41.246 INFO:tasks.workunit.client.1.smithi149.stdout:5/528: dread d0/d6/d82/da1/f2e [0,4194304] 0 2024-04-15T21:02:41.246 INFO:tasks.workunit.client.0.smithi072.stdout:9/307: fdatasync d4/d1f/d2c/f57 0 2024-04-15T21:02:41.250 INFO:tasks.workunit.client.1.smithi149.stdout:4/606: truncate dc/f8a 1936604 0 2024-04-15T21:02:41.251 INFO:tasks.workunit.client.0.smithi072.stdout:5/340: sync 2024-04-15T21:02:41.251 INFO:tasks.workunit.client.0.smithi072.stdout:4/305: sync 2024-04-15T21:02:41.252 INFO:tasks.workunit.client.0.smithi072.stdout:5/341: readlink d0/d3/d7/d12/d31/d49/l6f 0 2024-04-15T21:02:41.253 INFO:tasks.workunit.client.1.smithi149.stdout:6/496: rename da/d18/f19 to da/d32/f9d 0 2024-04-15T21:02:41.255 INFO:tasks.workunit.client.1.smithi149.stdout:9/513: mkdir d23/d3c/d7a/db4 0 2024-04-15T21:02:41.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/487: rmdir d1/d17 39 2024-04-15T21:02:41.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/634: dread - d2/df/d10/d25/d37/d53/daf/d85/d35/f8a zero size 2024-04-15T21:02:41.268 INFO:tasks.workunit.client.0.smithi072.stdout:0/349: link d0/d3/f33 d0/d19/d71/f76 0 2024-04-15T21:02:41.269 INFO:tasks.workunit.client.1.smithi149.stdout:7/554: creat d3/d16/d32/d90/dad/dc4/fc9 x:0 0 0 2024-04-15T21:02:41.270 INFO:tasks.workunit.client.0.smithi072.stdout:6/323: getdents d2/d10/d11/d34/d49 0 2024-04-15T21:02:41.270 INFO:tasks.workunit.client.0.smithi072.stdout:6/324: read d2/d10/d11/d34/f3a [931983,95697] 0 2024-04-15T21:02:41.271 INFO:tasks.workunit.client.0.smithi072.stdout:6/325: dread - d2/d10/d11/d34/f44 zero size 2024-04-15T21:02:41.271 INFO:tasks.workunit.client.1.smithi149.stdout:5/529: dread - d0/d6/d82/da1/d12/d16/da9/d1b/d83/f97 zero size 2024-04-15T21:02:41.272 INFO:tasks.workunit.client.0.smithi072.stdout:4/306: symlink d7/d10/d41/d4c/l56 0 2024-04-15T21:02:41.273 INFO:tasks.workunit.client.1.smithi149.stdout:5/530: fsync d0/d6/f99 0 2024-04-15T21:02:41.273 INFO:tasks.workunit.client.1.smithi149.stdout:1/488: dread d1/db/f65 [0,4194304] 0 2024-04-15T21:02:41.274 INFO:tasks.workunit.client.0.smithi072.stdout:5/342: mkdir d0/d3/d33/d76 0 2024-04-15T21:02:41.275 INFO:tasks.workunit.client.1.smithi149.stdout:4/607: rename dc/d2c/d3e/d35/d4b/d6c/d70/f8d to dc/d2c/d3e/d7c/dba/fcb 0 2024-04-15T21:02:41.276 INFO:tasks.workunit.client.0.smithi072.stdout:1/310: mknod d5/d3d/d5e/c65 0 2024-04-15T21:02:41.277 INFO:tasks.workunit.client.0.smithi072.stdout:6/326: dwrite d2/d10/d11/d1f/f30 [0,4194304] 0 2024-04-15T21:02:41.277 INFO:tasks.workunit.client.0.smithi072.stdout:1/311: fsync d5/db/d2d/d3a/f39 0 2024-04-15T21:02:41.277 INFO:tasks.workunit.client.0.smithi072.stdout:8/386: rename d3/d4/c27 to d3/c72 0 2024-04-15T21:02:41.278 INFO:tasks.workunit.client.0.smithi072.stdout:6/327: fsync d2/d1a/f4f 0 2024-04-15T21:02:41.278 INFO:tasks.workunit.client.0.smithi072.stdout:3/326: link d1/d15/d40/c53 d1/d15/c6c 0 2024-04-15T21:02:41.279 INFO:tasks.workunit.client.0.smithi072.stdout:6/328: read - d2/d1a/f41 zero size 2024-04-15T21:02:41.280 INFO:tasks.workunit.client.0.smithi072.stdout:3/327: chown d1/d26/f47 7 1 2024-04-15T21:02:41.281 INFO:tasks.workunit.client.0.smithi072.stdout:3/328: read d1/d26/f58 [24811,40963] 0 2024-04-15T21:02:41.281 INFO:tasks.workunit.client.0.smithi072.stdout:9/308: symlink d4/l5d 0 2024-04-15T21:02:41.285 INFO:tasks.workunit.client.1.smithi149.stdout:5/531: rmdir d0/d6/d82/da1/d12 39 2024-04-15T21:02:41.286 INFO:tasks.workunit.client.0.smithi072.stdout:4/307: mknod d7/d28/d37/c57 0 2024-04-15T21:02:41.287 INFO:tasks.workunit.client.1.smithi149.stdout:1/489: creat d1/db/dc/d38/d39/d43/f8f x:0 0 0 2024-04-15T21:02:41.288 INFO:tasks.workunit.client.0.smithi072.stdout:8/387: dwrite d3/de/f38 [0,4194304] 0 2024-04-15T21:02:41.290 INFO:tasks.workunit.client.0.smithi072.stdout:8/388: truncate d3/d4/d3b/f65 476434 0 2024-04-15T21:02:41.290 INFO:tasks.workunit.client.0.smithi072.stdout:0/350: dwrite d0/d3/fa [0,4194304] 0 2024-04-15T21:02:41.291 INFO:tasks.workunit.client.0.smithi072.stdout:7/337: rename d2/d7/c17 to d2/d7/d25/d2d/d46/d5a/d5f/d26/c6a 0 2024-04-15T21:02:41.291 INFO:tasks.workunit.client.1.smithi149.stdout:9/514: mkdir d23/d3c/db5 0 2024-04-15T21:02:41.293 INFO:tasks.workunit.client.0.smithi072.stdout:0/351: write d0/d6/ff [261997,118936] 0 2024-04-15T21:02:41.293 INFO:tasks.workunit.client.1.smithi149.stdout:4/608: mkdir dc/d2c/d3e/d35/d4b/d75/db3/dcc 0 2024-04-15T21:02:41.296 INFO:tasks.workunit.client.0.smithi072.stdout:7/338: write d2/d7/d25/d2d/d46/d5a/d5f/f2e [509873,99803] 0 2024-04-15T21:02:41.297 INFO:tasks.workunit.client.0.smithi072.stdout:0/352: fdatasync d0/d19/d2b/f4d 0 2024-04-15T21:02:41.299 INFO:tasks.workunit.client.0.smithi072.stdout:7/339: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e [184696,84524] 0 2024-04-15T21:02:41.301 INFO:tasks.workunit.client.1.smithi149.stdout:0/720: link d1/d5/d24/d30/df7/c94 d1/d5/d24/d30/d43/de9/cfc 0 2024-04-15T21:02:41.301 INFO:tasks.workunit.client.0.smithi072.stdout:0/353: write d0/d6/f39 [3832314,8766] 0 2024-04-15T21:02:41.303 INFO:tasks.workunit.client.0.smithi072.stdout:0/354: write d0/d3/fa [1484861,125799] 0 2024-04-15T21:02:41.304 INFO:tasks.workunit.client.0.smithi072.stdout:2/333: getdents d2/d8 0 2024-04-15T21:02:41.309 INFO:tasks.workunit.client.1.smithi149.stdout:8/635: rename d2/l55 to d2/df/d10/d25/d57/dc7/le3 0 2024-04-15T21:02:41.310 INFO:tasks.workunit.client.1.smithi149.stdout:9/515: creat d23/d2b/d44/d7e/fb6 x:0 0 0 2024-04-15T21:02:41.312 INFO:tasks.workunit.client.0.smithi072.stdout:4/308: mkdir d7/d15/d58 0 2024-04-15T21:02:41.312 INFO:tasks.workunit.client.1.smithi149.stdout:9/516: dread - d23/d3c/d7a/d7c/fb1 zero size 2024-04-15T21:02:41.312 INFO:tasks.workunit.client.0.smithi072.stdout:9/309: dread d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:41.313 INFO:tasks.workunit.client.0.smithi072.stdout:4/309: write d7/f1b [5399117,25568] 0 2024-04-15T21:02:41.313 INFO:tasks.workunit.client.1.smithi149.stdout:2/597: link d4/d7/d10/d6b/d21/d2c/d32/d4a/f88 d4/d7/d10/d6b/d21/d2c/d32/fd4 0 2024-04-15T21:02:41.314 INFO:tasks.workunit.client.0.smithi072.stdout:9/310: read d4/d1f/d2c/f2e [77038,82795] 0 2024-04-15T21:02:41.315 INFO:tasks.workunit.client.0.smithi072.stdout:1/312: mknod d5/db/d2d/d56/c66 0 2024-04-15T21:02:41.315 INFO:tasks.workunit.client.1.smithi149.stdout:0/721: fdatasync d1/d9/f19 0 2024-04-15T21:02:41.315 INFO:tasks.workunit.client.0.smithi072.stdout:1/313: chown d5/db/d27 38196120 1 2024-04-15T21:02:41.316 INFO:tasks.workunit.client.0.smithi072.stdout:8/389: truncate d3/de/d1b/f62 477633 0 2024-04-15T21:02:41.317 INFO:tasks.workunit.client.1.smithi149.stdout:8/636: dwrite d2/df/d10/d4e/d9f/fcc [0,4194304] 0 2024-04-15T21:02:41.317 INFO:tasks.workunit.client.0.smithi072.stdout:3/329: dread d1/d15/d40/fb [0,4194304] 0 2024-04-15T21:02:41.318 INFO:tasks.workunit.client.0.smithi072.stdout:8/390: write d3/d4/d3b/f3d [1336482,117704] 0 2024-04-15T21:02:41.321 INFO:tasks.workunit.client.1.smithi149.stdout:5/532: stat d0/d6/d82/da1/d12/d16/da9/d1b/d60/ca3 0 2024-04-15T21:02:41.322 INFO:tasks.workunit.client.1.smithi149.stdout:1/490: mknod d1/db/d14/c90 0 2024-04-15T21:02:41.327 INFO:tasks.workunit.client.1.smithi149.stdout:4/609: link dc/fa2 dc/d2c/d3e/d35/fcd 0 2024-04-15T21:02:41.328 INFO:tasks.workunit.client.1.smithi149.stdout:9/517: creat d23/d3c/d7a/d7c/d7f/d86/fb7 x:0 0 0 2024-04-15T21:02:41.329 INFO:tasks.workunit.client.1.smithi149.stdout:9/518: chown d23/d3c/d87/d9a 417253 1 2024-04-15T21:02:41.330 INFO:tasks.workunit.client.1.smithi149.stdout:2/598: symlink d4/d7/d10/d6b/d21/d5e/dbe/da7/d6c/ld5 0 2024-04-15T21:02:41.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/519: truncate d23/d2b/d44/d7e/f9b 5209247 0 2024-04-15T21:02:41.332 INFO:tasks.workunit.client.0.smithi072.stdout:0/355: mknod d0/d6/c77 0 2024-04-15T21:02:41.334 INFO:tasks.workunit.client.1.smithi149.stdout:7/555: link d3/c49 d3/d16/d20/d36/d3d/da4/cca 0 2024-04-15T21:02:41.336 INFO:tasks.workunit.client.0.smithi072.stdout:4/310: unlink d7/d10/d41/d4c/l56 0 2024-04-15T21:02:41.337 INFO:tasks.workunit.client.1.smithi149.stdout:5/533: mknod d0/d9/d3f/d47/caf 0 2024-04-15T21:02:41.340 INFO:tasks.workunit.client.0.smithi072.stdout:8/391: rename d3/d4/f2c to d3/d4/d4d/f73 0 2024-04-15T21:02:41.343 INFO:tasks.workunit.client.0.smithi072.stdout:1/314: dread d5/db/d2d/d3a/f22 [0,4194304] 0 2024-04-15T21:02:41.343 INFO:tasks.workunit.client.1.smithi149.stdout:4/610: mkdir dc/d18/dce 0 2024-04-15T21:02:41.343 INFO:tasks.workunit.client.0.smithi072.stdout:1/315: write d5/f9 [8191307,111028] 0 2024-04-15T21:02:41.345 INFO:tasks.workunit.client.0.smithi072.stdout:7/340: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c6b 0 2024-04-15T21:02:41.349 INFO:tasks.workunit.client.0.smithi072.stdout:1/316: dwrite d5/db/f4f [0,4194304] 0 2024-04-15T21:02:41.349 INFO:tasks.workunit.client.0.smithi072.stdout:1/317: fsync d5/db/d2d/d3a/f2e 0 2024-04-15T21:02:41.351 INFO:tasks.workunit.client.1.smithi149.stdout:2/599: dwrite d4/d7/d46/f57 [4194304,4194304] 0 2024-04-15T21:02:41.360 INFO:tasks.workunit.client.0.smithi072.stdout:7/341: symlink d2/d7/d25/d2d/d47/l6c 0 2024-04-15T21:02:41.360 INFO:tasks.workunit.client.0.smithi072.stdout:6/329: write d2/d40/f4d [1069960,98694] 0 2024-04-15T21:02:41.361 INFO:tasks.workunit.client.1.smithi149.stdout:4/611: mknod dc/d2c/d3e/d15/d3f/db0/ccf 0 2024-04-15T21:02:41.362 INFO:tasks.workunit.client.0.smithi072.stdout:0/356: mknod d0/d6/d6d/c78 0 2024-04-15T21:02:41.363 INFO:tasks.workunit.client.1.smithi149.stdout:8/637: link d2/df/d10/d25/d32/d45/cbd d2/df/d10/d25/d37/d53/daf/d85/ce4 0 2024-04-15T21:02:41.364 INFO:tasks.workunit.client.1.smithi149.stdout:8/638: write d2/df/d10/d25/fbf [3693027,129781] 0 2024-04-15T21:02:41.365 INFO:tasks.workunit.client.0.smithi072.stdout:4/311: link d7/d10/f11 d7/d24/f59 0 2024-04-15T21:02:41.370 INFO:tasks.workunit.client.1.smithi149.stdout:0/722: write d1/f7b [151577,126690] 0 2024-04-15T21:02:41.373 INFO:tasks.workunit.client.0.smithi072.stdout:7/342: mkdir d2/d7/d25/d2d/d52/d6d 0 2024-04-15T21:02:41.374 INFO:tasks.workunit.client.0.smithi072.stdout:7/343: chown d2/d7/d25/d4c 107 1 2024-04-15T21:02:41.374 INFO:tasks.workunit.client.1.smithi149.stdout:4/612: truncate dc/d18/d21/f63 1287503 0 2024-04-15T21:02:41.376 INFO:tasks.workunit.client.1.smithi149.stdout:1/491: write d1/db/d16/f5c [520912,34627] 0 2024-04-15T21:02:41.377 INFO:tasks.workunit.client.0.smithi072.stdout:0/357: symlink d0/d45/d35/l79 0 2024-04-15T21:02:41.380 INFO:tasks.workunit.client.0.smithi072.stdout:7/344: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:41.380 INFO:tasks.workunit.client.0.smithi072.stdout:7/345: stat d2/d7 0 2024-04-15T21:02:41.382 INFO:tasks.workunit.client.0.smithi072.stdout:7/346: write d2/d7/f8 [3853603,18963] 0 2024-04-15T21:02:41.384 INFO:tasks.workunit.client.1.smithi149.stdout:7/556: link d3/d16/d20/d36/d3d/da4/fbf d3/d16/d20/d36/fcb 0 2024-04-15T21:02:41.385 INFO:tasks.workunit.client.0.smithi072.stdout:7/347: readlink d2/d7/d25/d2d/d52/l61 0 2024-04-15T21:02:41.386 INFO:tasks.workunit.client.0.smithi072.stdout:6/330: creat d2/d10/d11/d34/d49/f65 x:0 0 0 2024-04-15T21:02:41.388 INFO:tasks.workunit.client.0.smithi072.stdout:6/331: chown d2/f2a 252 1 2024-04-15T21:02:41.389 INFO:tasks.workunit.client.0.smithi072.stdout:4/312: dwrite d7/d10/d41/f51 [0,4194304] 0 2024-04-15T21:02:41.394 INFO:tasks.workunit.client.0.smithi072.stdout:1/318: dread d5/f8 [0,4194304] 0 2024-04-15T21:02:41.396 INFO:tasks.workunit.client.0.smithi072.stdout:7/348: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 [0,4194304] 0 2024-04-15T21:02:41.398 INFO:tasks.workunit.client.1.smithi149.stdout:8/639: dread d2/fe [4194304,4194304] 0 2024-04-15T21:02:41.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/600: write d4/d7/d10/d6b/f24 [711365,74614] 0 2024-04-15T21:02:41.400 INFO:tasks.workunit.client.0.smithi072.stdout:1/319: dread d5/f8 [0,4194304] 0 2024-04-15T21:02:41.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/640: dread - d2/df/d10/d25/d57/dd1/d50/d5d/d6d/fe1 zero size 2024-04-15T21:02:41.401 INFO:tasks.workunit.client.1.smithi149.stdout:3/593: sync 2024-04-15T21:02:41.401 INFO:tasks.workunit.client.0.smithi072.stdout:6/332: mkdir d2/d40/d66 0 2024-04-15T21:02:41.401 INFO:tasks.workunit.client.0.smithi072.stdout:6/333: readlink d2/l21 0 2024-04-15T21:02:41.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/320: write d5/d31/f49 [1008151,47125] 0 2024-04-15T21:02:41.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/641: chown d2/df/d10/d34/l81 2409 1 2024-04-15T21:02:41.406 INFO:tasks.workunit.client.1.smithi149.stdout:5/534: getdents d0/d9 0 2024-04-15T21:02:41.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/535: chown d0/d6/d82/da1/d12/d16/da9/f46 3 1 2024-04-15T21:02:41.413 INFO:tasks.workunit.client.0.smithi072.stdout:0/358: rename d0/d3/d5 to d0/d45/d7a 0 2024-04-15T21:02:41.416 INFO:tasks.workunit.client.0.smithi072.stdout:1/321: mknod d5/d31/c67 0 2024-04-15T21:02:41.418 INFO:tasks.workunit.client.0.smithi072.stdout:6/334: symlink d2/d10/d18/d47/l67 0 2024-04-15T21:02:41.421 INFO:tasks.workunit.client.1.smithi149.stdout:0/723: dwrite d1/d29/f74 [0,4194304] 0 2024-04-15T21:02:41.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/313: rename d7/d24/c21 to d7/d23/c5a 0 2024-04-15T21:02:41.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/314: stat d7/f2e 0 2024-04-15T21:02:41.427 INFO:tasks.workunit.client.1.smithi149.stdout:1/492: dwrite d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:41.427 INFO:tasks.workunit.client.1.smithi149.stdout:1/493: stat d1/f5 0 2024-04-15T21:02:41.427 INFO:tasks.workunit.client.0.smithi072.stdout:4/315: fsync d7/f55 0 2024-04-15T21:02:41.427 INFO:tasks.workunit.client.0.smithi072.stdout:5/343: sync 2024-04-15T21:02:41.427 INFO:tasks.workunit.client.0.smithi072.stdout:5/344: dread - d0/d3/d7/d12/d31/d55/d58/f63 zero size 2024-04-15T21:02:41.428 INFO:tasks.workunit.client.1.smithi149.stdout:7/557: truncate d3/d16/d20/d60/f7e 1604227 0 2024-04-15T21:02:41.437 INFO:tasks.workunit.client.1.smithi149.stdout:4/613: dwrite dc/d2c/d3e/d7c/dba/fcb [0,4194304] 0 2024-04-15T21:02:41.443 INFO:tasks.workunit.client.0.smithi072.stdout:6/335: dread d2/d10/d11/f2e [0,4194304] 0 2024-04-15T21:02:41.447 INFO:tasks.workunit.client.1.smithi149.stdout:5/536: mkdir d0/d6/d82/db0 0 2024-04-15T21:02:41.447 INFO:tasks.workunit.client.1.smithi149.stdout:3/594: creat d1/db/d40/da0/fb2 x:0 0 0 2024-04-15T21:02:41.447 INFO:tasks.workunit.client.1.smithi149.stdout:0/724: truncate d1/d29/fa7 1133757 0 2024-04-15T21:02:41.447 INFO:tasks.workunit.client.0.smithi072.stdout:4/316: mknod d7/d10/d41/d45/c5b 0 2024-04-15T21:02:41.448 INFO:tasks.workunit.client.1.smithi149.stdout:1/494: chown d1/d17/d5e 0 1 2024-04-15T21:02:41.449 INFO:tasks.workunit.client.0.smithi072.stdout:4/317: readlink d7/d10/d41/d45/l50 0 2024-04-15T21:02:41.450 INFO:tasks.workunit.client.1.smithi149.stdout:1/495: chown d1/db/dc/d11/c12 412882449 1 2024-04-15T21:02:41.451 INFO:tasks.workunit.client.0.smithi072.stdout:6/336: dwrite d2/d10/f1d [0,4194304] 0 2024-04-15T21:02:41.453 INFO:tasks.workunit.client.0.smithi072.stdout:7/349: getdents d2 0 2024-04-15T21:02:41.457 INFO:tasks.workunit.client.0.smithi072.stdout:6/337: creat d2/d40/f68 x:0 0 0 2024-04-15T21:02:41.458 INFO:tasks.workunit.client.0.smithi072.stdout:4/318: dwrite d7/d28/f3c [0,4194304] 0 2024-04-15T21:02:41.458 INFO:tasks.workunit.client.0.smithi072.stdout:4/319: stat d7/l17 0 2024-04-15T21:02:41.459 INFO:tasks.workunit.client.1.smithi149.stdout:5/537: dwrite d0/d6/d2d/f67 [0,4194304] 0 2024-04-15T21:02:41.459 INFO:tasks.workunit.client.0.smithi072.stdout:7/350: mknod d2/d7/d25/c6e 0 2024-04-15T21:02:41.460 INFO:tasks.workunit.client.0.smithi072.stdout:7/351: chown d2/f1c 13359 1 2024-04-15T21:02:41.461 INFO:tasks.workunit.client.0.smithi072.stdout:1/322: getdents d5/d3d 0 2024-04-15T21:02:41.461 INFO:tasks.workunit.client.1.smithi149.stdout:2/601: dread d4/d7/d10/f37 [0,4194304] 0 2024-04-15T21:02:41.461 INFO:tasks.workunit.client.1.smithi149.stdout:1/496: write d1/db/dc/d38/d39/d43/f7b [1143844,23410] 0 2024-04-15T21:02:41.463 INFO:tasks.workunit.client.1.smithi149.stdout:0/725: creat d1/d5/d24/d30/d43/de9/ffd x:0 0 0 2024-04-15T21:02:41.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/497: fsync d1/db/f65 0 2024-04-15T21:02:41.480 INFO:tasks.workunit.client.1.smithi149.stdout:1/498: read d1/db/dc/d11/d3f/d45/f57 [223347,116805] 0 2024-04-15T21:02:41.481 INFO:tasks.workunit.client.1.smithi149.stdout:1/499: write d1/d17/f1c [3529342,104484] 0 2024-04-15T21:02:41.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/538: dread d0/d6/d82/da1/d12/d16/da9/f81 [0,4194304] 0 2024-04-15T21:02:41.484 INFO:tasks.workunit.client.1.smithi149.stdout:8/642: write d2/df/d10/f14 [5662827,110777] 0 2024-04-15T21:02:41.486 INFO:tasks.workunit.client.0.smithi072.stdout:0/359: dwrite d0/d45/f3e [0,4194304] 0 2024-04-15T21:02:41.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/539: chown d0/d6/d82/da1/d12/d16/da9/d1b/d61/f80 733 1 2024-04-15T21:02:41.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/643: chown d2/df/d10/d20/f91 13 1 2024-04-15T21:02:41.487 INFO:tasks.workunit.client.0.smithi072.stdout:4/320: truncate d7/f38 1312739 0 2024-04-15T21:02:41.487 INFO:tasks.workunit.client.0.smithi072.stdout:0/360: chown d0/d45/d35/d3a/f50 55948 1 2024-04-15T21:02:41.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/726: creat d1/d9/d64/d65/ffe x:0 0 0 2024-04-15T21:02:41.491 INFO:tasks.workunit.client.1.smithi149.stdout:7/558: dwrite d3/d16/d20/d60/f7e [0,4194304] 0 2024-04-15T21:02:41.493 INFO:tasks.workunit.client.0.smithi072.stdout:7/352: mknod d2/d7/d25/d2d/c6f 0 2024-04-15T21:02:41.493 INFO:tasks.workunit.client.1.smithi149.stdout:5/540: chown d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 652991 1 2024-04-15T21:02:41.494 INFO:tasks.workunit.client.0.smithi072.stdout:7/353: dread - d2/d7/d25/d2d/d47/f4a zero size 2024-04-15T21:02:41.496 INFO:tasks.workunit.client.1.smithi149.stdout:4/614: getdents dc/d2c/d3e/d35/d4b/d6c/d70 0 2024-04-15T21:02:41.497 INFO:tasks.workunit.client.0.smithi072.stdout:1/323: creat d5/db/d2d/d3a/d1f/d63/f68 x:0 0 0 2024-04-15T21:02:41.499 INFO:tasks.workunit.client.1.smithi149.stdout:2/602: unlink d4/d7/d10/laa 0 2024-04-15T21:02:41.500 INFO:tasks.workunit.client.0.smithi072.stdout:6/338: write d2/d10/d24/f36 [705312,8440] 0 2024-04-15T21:02:41.503 INFO:tasks.workunit.client.0.smithi072.stdout:5/345: dread d0/d3/f4 [0,4194304] 0 2024-04-15T21:02:41.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/324: dread d5/db/d2d/d3a/f22 [0,4194304] 0 2024-04-15T21:02:41.503 INFO:tasks.workunit.client.0.smithi072.stdout:6/339: write d2/d10/d11/d1f/d60/f61 [296915,60931] 0 2024-04-15T21:02:41.504 INFO:tasks.workunit.client.0.smithi072.stdout:0/361: mkdir d0/d45/d52/d7b 0 2024-04-15T21:02:41.505 INFO:tasks.workunit.client.0.smithi072.stdout:7/354: mknod d2/c70 0 2024-04-15T21:02:41.507 INFO:tasks.workunit.client.1.smithi149.stdout:3/595: getdents d1/db/d40/da0 0 2024-04-15T21:02:41.508 INFO:tasks.workunit.client.1.smithi149.stdout:3/596: dread - d1/db/d24/d4d/f9d zero size 2024-04-15T21:02:41.508 INFO:tasks.workunit.client.0.smithi072.stdout:1/325: rmdir d5/db/d27 39 2024-04-15T21:02:41.509 INFO:tasks.workunit.client.1.smithi149.stdout:1/500: symlink d1/d17/d36/l91 0 2024-04-15T21:02:41.512 INFO:tasks.workunit.client.1.smithi149.stdout:5/541: mknod d0/d6/d82/cb1 0 2024-04-15T21:02:41.512 INFO:tasks.workunit.client.0.smithi072.stdout:0/362: dwrite d0/d19/d2b/f37 [0,4194304] 0 2024-04-15T21:02:41.513 INFO:tasks.workunit.client.0.smithi072.stdout:4/321: creat d7/f5c x:0 0 0 2024-04-15T21:02:41.515 INFO:tasks.workunit.client.0.smithi072.stdout:0/363: read d0/d45/d35/d3a/f28 [170011,58231] 0 2024-04-15T21:02:41.516 INFO:tasks.workunit.client.0.smithi072.stdout:0/364: dread - d0/d45/d35/d3a/f47 zero size 2024-04-15T21:02:41.517 INFO:tasks.workunit.client.1.smithi149.stdout:0/727: truncate d1/d5/d24/d50/d13/d59/f66 407999 0 2024-04-15T21:02:41.522 INFO:tasks.workunit.client.1.smithi149.stdout:4/615: unlink dc/d2c/d3e/d35/d4b/d75/c84 0 2024-04-15T21:02:41.525 INFO:tasks.workunit.client.0.smithi072.stdout:6/340: getdents d2/d40/d56 0 2024-04-15T21:02:41.526 INFO:tasks.workunit.client.1.smithi149.stdout:8/644: dread d2/df/d10/d25/d57/f8c [0,4194304] 0 2024-04-15T21:02:41.528 INFO:tasks.workunit.client.1.smithi149.stdout:2/603: creat d4/d7/d10/d6b/d21/d6d/fd6 x:0 0 0 2024-04-15T21:02:41.529 INFO:tasks.workunit.client.1.smithi149.stdout:6/497: sync 2024-04-15T21:02:41.532 INFO:tasks.workunit.client.1.smithi149.stdout:2/604: read d4/d7/d10/d6b/d21/d5e/dbe/fab [2712358,84872] 0 2024-04-15T21:02:41.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/597: creat d1/db/d24/d4d/d63/fb3 x:0 0 0 2024-04-15T21:02:41.534 INFO:tasks.workunit.client.1.smithi149.stdout:2/605: chown d4/d7/d10/d6b/d21/d2c 1012 1 2024-04-15T21:02:41.534 INFO:tasks.workunit.client.0.smithi072.stdout:4/322: symlink d7/d10/d41/d4c/l5d 0 2024-04-15T21:02:41.537 INFO:tasks.workunit.client.1.smithi149.stdout:1/501: mkdir d1/d17/d52/d92 0 2024-04-15T21:02:41.538 INFO:tasks.workunit.client.1.smithi149.stdout:6/498: dwrite da/d60/f9c [0,4194304] 0 2024-04-15T21:02:41.539 INFO:tasks.workunit.client.1.smithi149.stdout:1/502: fdatasync d1/d17/d52/f2a 0 2024-04-15T21:02:41.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/503: stat d1/d17/d5e/d73 0 2024-04-15T21:02:41.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/341: fsync d2/d10/d11/d34/f3a 0 2024-04-15T21:02:41.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/342: stat d2/fe 0 2024-04-15T21:02:41.542 INFO:tasks.workunit.client.0.smithi072.stdout:6/343: fdatasync d2/d10/d11/d34/f44 0 2024-04-15T21:02:41.544 INFO:tasks.workunit.client.0.smithi072.stdout:5/346: rename d0/d3/d7/d1f/d4c/l5c to d0/d3/d7/l77 0 2024-04-15T21:02:41.550 INFO:tasks.workunit.client.0.smithi072.stdout:6/344: dwrite d2/d10/d11/d15/f53 [0,4194304] 0 2024-04-15T21:02:41.552 INFO:tasks.workunit.client.0.smithi072.stdout:2/334: sync 2024-04-15T21:02:41.555 INFO:tasks.workunit.client.0.smithi072.stdout:0/365: unlink d0/d45/f3e 0 2024-04-15T21:02:41.556 INFO:tasks.workunit.client.1.smithi149.stdout:7/559: write d3/d16/d20/d36/fbd [4217727,35324] 0 2024-04-15T21:02:41.556 INFO:tasks.workunit.client.0.smithi072.stdout:0/366: stat d0/d3/f33 0 2024-04-15T21:02:41.556 INFO:tasks.workunit.client.1.smithi149.stdout:7/560: fdatasync d3/d17/d1f/f25 0 2024-04-15T21:02:41.558 INFO:tasks.workunit.client.1.smithi149.stdout:3/598: rename d1/db/d23/f2c to d1/db/d24/d2b/fb4 0 2024-04-15T21:02:41.559 INFO:tasks.workunit.client.1.smithi149.stdout:3/599: dread - d1/db/d24/d4d/d63/d65/f9c zero size 2024-04-15T21:02:41.561 INFO:tasks.workunit.client.0.smithi072.stdout:0/367: dread d0/d19/d71/f76 [0,4194304] 0 2024-04-15T21:02:41.561 INFO:tasks.workunit.client.1.smithi149.stdout:4/616: dread dc/d18/d21/f67 [0,4194304] 0 2024-04-15T21:02:41.562 INFO:tasks.workunit.client.0.smithi072.stdout:0/368: fsync d0/d19/d2b/f69 0 2024-04-15T21:02:41.562 INFO:tasks.workunit.client.1.smithi149.stdout:8/645: write d2/df/d10/d25/d37/f3e [1252668,97697] 0 2024-04-15T21:02:41.563 INFO:tasks.workunit.client.0.smithi072.stdout:7/355: write d2/d7/d25/d2d/d47/f64 [781914,50901] 0 2024-04-15T21:02:41.564 INFO:tasks.workunit.client.1.smithi149.stdout:6/499: symlink da/d11/l9e 0 2024-04-15T21:02:41.565 INFO:tasks.workunit.client.1.smithi149.stdout:6/500: chown da/d60/c88 26181944 1 2024-04-15T21:02:41.565 INFO:tasks.workunit.client.1.smithi149.stdout:6/501: stat da/d60/f9c 0 2024-04-15T21:02:41.566 INFO:tasks.workunit.client.1.smithi149.stdout:1/504: symlink d1/d17/d36/d6f/d70/l93 0 2024-04-15T21:02:41.567 INFO:tasks.workunit.client.0.smithi072.stdout:4/323: mkdir d7/d24/d3e/d5e 0 2024-04-15T21:02:41.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/505: read d1/d17/d52/d42/f58 [409501,120209] 0 2024-04-15T21:02:41.568 INFO:tasks.workunit.client.0.smithi072.stdout:6/345: mknod d2/d10/d18/c69 0 2024-04-15T21:02:41.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/506: read - d1/d17/d4d/f6a zero size 2024-04-15T21:02:41.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/346: stat d2/d1a/f1b 0 2024-04-15T21:02:41.570 INFO:tasks.workunit.client.0.smithi072.stdout:2/335: chown d2/d37/l51 2532 1 2024-04-15T21:02:41.571 INFO:tasks.workunit.client.0.smithi072.stdout:5/347: dwrite d0/d3/d6/d14/f5b [0,4194304] 0 2024-04-15T21:02:41.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/520: sync 2024-04-15T21:02:41.573 INFO:tasks.workunit.client.1.smithi149.stdout:1/507: dread d1/db/dc/d38/f63 [0,4194304] 0 2024-04-15T21:02:41.580 INFO:tasks.workunit.client.1.smithi149.stdout:7/561: creat d3/d16/d20/fcc x:0 0 0 2024-04-15T21:02:41.581 INFO:tasks.workunit.client.1.smithi149.stdout:7/562: read - d3/d16/d32/d90/fb0 zero size 2024-04-15T21:02:41.582 INFO:tasks.workunit.client.1.smithi149.stdout:2/606: mknod d4/d7/d10/d6b/d21/d6d/db4/cd7 0 2024-04-15T21:02:41.584 INFO:tasks.workunit.client.1.smithi149.stdout:7/563: read d3/da9/fb9 [3963192,123817] 0 2024-04-15T21:02:41.586 INFO:tasks.workunit.client.1.smithi149.stdout:4/617: mkdir dc/d2c/d3e/d7c/dd0 0 2024-04-15T21:02:41.589 INFO:tasks.workunit.client.1.smithi149.stdout:5/542: creat d0/d6/d82/da1/fb2 x:0 0 0 2024-04-15T21:02:41.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/543: chown d0/d9/f22 415304 1 2024-04-15T21:02:41.592 INFO:tasks.workunit.client.1.smithi149.stdout:2/607: dread - d4/d7/da/fa2 zero size 2024-04-15T21:02:41.593 INFO:tasks.workunit.client.1.smithi149.stdout:2/608: chown d4/d7/d10/d6b/d21/d55/d94/fcf 54929859 1 2024-04-15T21:02:41.594 INFO:tasks.workunit.client.0.smithi072.stdout:7/356: fdatasync d2/d7/d25/d2d/f44 0 2024-04-15T21:02:41.594 INFO:tasks.workunit.client.1.smithi149.stdout:8/646: unlink d2/df/d10/d25/d57/dd1/d50/d8e/ld5 0 2024-04-15T21:02:41.594 INFO:tasks.workunit.client.0.smithi072.stdout:4/324: unlink d7/d24/c3b 0 2024-04-15T21:02:41.595 INFO:tasks.workunit.client.0.smithi072.stdout:5/348: chown d0/f35 1377490 1 2024-04-15T21:02:41.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/728: getdents d1/d5/d24/d30/df7 0 2024-04-15T21:02:41.596 INFO:tasks.workunit.client.1.smithi149.stdout:2/609: write d4/d7/d10/d6b/d21/d55/fb7 [177720,99954] 0 2024-04-15T21:02:41.596 INFO:tasks.workunit.client.1.smithi149.stdout:5/544: mkdir d0/d6/d9f/db3 0 2024-04-15T21:02:41.600 INFO:tasks.workunit.client.1.smithi149.stdout:8/647: symlink d2/df/d10/d25/d57/dd1/d50/le5 0 2024-04-15T21:02:41.602 INFO:tasks.workunit.client.0.smithi072.stdout:6/347: dwrite d2/f14 [0,4194304] 0 2024-04-15T21:02:41.602 INFO:tasks.workunit.client.1.smithi149.stdout:8/648: truncate d2/df/d10/d25/d57/dd1/d50/d8e/f9e 1332284 0 2024-04-15T21:02:41.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/545: mkdir d0/d9/d6c/db4 0 2024-04-15T21:02:41.603 INFO:tasks.workunit.client.0.smithi072.stdout:4/325: creat d7/d28/d37/f5f x:0 0 0 2024-04-15T21:02:41.605 INFO:tasks.workunit.client.0.smithi072.stdout:6/348: fsync d2/d42/f5d 0 2024-04-15T21:02:41.605 INFO:tasks.workunit.client.1.smithi149.stdout:0/729: mknod d1/cff 0 2024-04-15T21:02:41.606 INFO:tasks.workunit.client.1.smithi149.stdout:9/521: getdents d23/d2b/d44 0 2024-04-15T21:02:41.607 INFO:tasks.workunit.client.0.smithi072.stdout:1/326: dwrite d5/db/d27/f47 [0,4194304] 0 2024-04-15T21:02:41.607 INFO:tasks.workunit.client.0.smithi072.stdout:2/336: dwrite d2/f12 [0,4194304] 0 2024-04-15T21:02:41.609 INFO:tasks.workunit.client.0.smithi072.stdout:2/337: chown d2/d37/f49 11170621 1 2024-04-15T21:02:41.611 INFO:tasks.workunit.client.0.smithi072.stdout:1/327: mknod d5/db/d2d/d3a/c69 0 2024-04-15T21:02:41.612 INFO:tasks.workunit.client.0.smithi072.stdout:1/328: readlink d5/db/d2d/d3a/l2c 0 2024-04-15T21:02:41.613 INFO:tasks.workunit.client.1.smithi149.stdout:5/546: read d0/d6/d82/da1/f5e [1275613,111044] 0 2024-04-15T21:02:41.613 INFO:tasks.workunit.client.0.smithi072.stdout:2/338: mkdir d2/d8/d6c 0 2024-04-15T21:02:41.613 INFO:tasks.workunit.client.0.smithi072.stdout:6/349: mkdir d2/d40/d56/d6a 0 2024-04-15T21:02:41.614 INFO:tasks.workunit.client.0.smithi072.stdout:5/349: write d0/d3/d7/d12/d31/d49/f52 [859514,97003] 0 2024-04-15T21:02:41.614 INFO:tasks.workunit.client.0.smithi072.stdout:2/339: readlink d2/d8/lc 0 2024-04-15T21:02:41.616 INFO:tasks.workunit.client.1.smithi149.stdout:0/730: dwrite d1/d5/d24/d50/d15/fd2 [0,4194304] 0 2024-04-15T21:02:41.619 INFO:tasks.workunit.client.0.smithi072.stdout:1/329: creat d5/d3d/f6a x:0 0 0 2024-04-15T21:02:41.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/731: chown d1/d5/d24/d50/d13/d38/d44/f47 0 1 2024-04-15T21:02:41.622 INFO:tasks.workunit.client.0.smithi072.stdout:1/330: chown d5/db/f55 3 1 2024-04-15T21:02:41.623 INFO:tasks.workunit.client.1.smithi149.stdout:5/547: getdents d0/d6/d79 0 2024-04-15T21:02:41.624 INFO:tasks.workunit.client.0.smithi072.stdout:6/350: dwrite d2/d10/d11/d1f/d60/f61 [0,4194304] 0 2024-04-15T21:02:41.626 INFO:tasks.workunit.client.1.smithi149.stdout:0/732: mkdir d1/d5/d24/d100 0 2024-04-15T21:02:41.630 INFO:tasks.workunit.client.0.smithi072.stdout:5/350: mknod d0/c78 0 2024-04-15T21:02:41.630 INFO:tasks.workunit.client.0.smithi072.stdout:1/331: symlink d5/db/d2d/d3a/l6b 0 2024-04-15T21:02:41.630 INFO:tasks.workunit.client.0.smithi072.stdout:5/351: write d0/d3/d7/d12/f54 [859755,47054] 0 2024-04-15T21:02:41.632 INFO:tasks.workunit.client.0.smithi072.stdout:5/352: chown d0/d3/d23/f4b 374128 1 2024-04-15T21:02:41.632 INFO:tasks.workunit.client.1.smithi149.stdout:0/733: read - d1/d5/d24/d30/d92/fb3 zero size 2024-04-15T21:02:41.634 INFO:tasks.workunit.client.0.smithi072.stdout:4/326: dread d7/d23/f29 [0,4194304] 0 2024-04-15T21:02:41.635 INFO:tasks.workunit.client.1.smithi149.stdout:2/610: dread d4/d7/d10/d6b/d21/d2c/f80 [0,4194304] 0 2024-04-15T21:02:41.637 INFO:tasks.workunit.client.1.smithi149.stdout:2/611: dread - d4/d7/d10/d6b/d21/d55/d94/fcf zero size 2024-04-15T21:02:41.639 INFO:tasks.workunit.client.0.smithi072.stdout:5/353: mkdir d0/d3/d6/d2d/d79 0 2024-04-15T21:02:41.642 INFO:tasks.workunit.client.1.smithi149.stdout:0/734: truncate d1/d5/d24/d50/d15/f57 1410076 0 2024-04-15T21:02:41.645 INFO:tasks.workunit.client.1.smithi149.stdout:0/735: dread d1/d5/d24/f9e [0,4194304] 0 2024-04-15T21:02:41.647 INFO:tasks.workunit.client.1.smithi149.stdout:4/618: dwrite dc/f8a [0,4194304] 0 2024-04-15T21:02:41.648 INFO:tasks.workunit.client.0.smithi072.stdout:6/351: link d2/l3e d2/d1a/l6b 0 2024-04-15T21:02:41.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/619: readlink dc/d2c/l5c 0 2024-04-15T21:02:41.649 INFO:tasks.workunit.client.1.smithi149.stdout:2/612: write d4/d7/d10/d6b/d21/d3b/f43 [4407514,50802] 0 2024-04-15T21:02:41.652 INFO:tasks.workunit.client.0.smithi072.stdout:5/354: rename d0/d3/d7/d12/l19 to d0/d3/d7/d12/d31/d55/d58/l7a 0 2024-04-15T21:02:41.652 INFO:tasks.workunit.client.1.smithi149.stdout:0/736: dread d1/d5/d24/d50/d15/fd2 [0,4194304] 0 2024-04-15T21:02:41.655 INFO:tasks.workunit.client.0.smithi072.stdout:6/352: creat d2/d40/d56/f6c x:0 0 0 2024-04-15T21:02:41.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/353: dread d2/d10/d11/f4b [0,4194304] 0 2024-04-15T21:02:41.660 INFO:tasks.workunit.client.1.smithi149.stdout:2/613: dwrite d4/d7/d10/d6b/d21/d2c/fbc [0,4194304] 0 2024-04-15T21:02:41.661 INFO:tasks.workunit.client.0.smithi072.stdout:6/354: dread - d2/d1a/f4f zero size 2024-04-15T21:02:41.661 INFO:tasks.workunit.client.0.smithi072.stdout:7/357: dread d2/d7/d25/d2d/d46/d5a/d5f/f13 [0,4194304] 0 2024-04-15T21:02:41.662 INFO:tasks.workunit.client.0.smithi072.stdout:6/355: chown d2/d10/d11/d15 363759951 1 2024-04-15T21:02:41.667 INFO:tasks.workunit.client.0.smithi072.stdout:7/358: creat d2/d7/d25/f71 x:0 0 0 2024-04-15T21:02:41.668 INFO:tasks.workunit.client.1.smithi149.stdout:2/614: truncate d4/f65 588322 0 2024-04-15T21:02:41.669 INFO:tasks.workunit.client.0.smithi072.stdout:6/356: dwrite d2/d10/d11/d34/f44 [0,4194304] 0 2024-04-15T21:02:41.672 INFO:tasks.workunit.client.0.smithi072.stdout:3/330: sync 2024-04-15T21:02:41.672 INFO:tasks.workunit.client.0.smithi072.stdout:8/392: sync 2024-04-15T21:02:41.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/311: sync 2024-04-15T21:02:41.675 INFO:tasks.workunit.client.1.smithi149.stdout:2/615: dread d4/d7/d10/d6b/d21/d2c/fbc [0,4194304] 0 2024-04-15T21:02:41.675 INFO:tasks.workunit.client.1.smithi149.stdout:2/616: chown d4/d7/d93 2152 1 2024-04-15T21:02:41.676 INFO:tasks.workunit.client.0.smithi072.stdout:4/327: dread d7/f12 [0,4194304] 0 2024-04-15T21:02:41.677 INFO:tasks.workunit.client.1.smithi149.stdout:2/617: dread - d4/d7/d10/d6b/d21/d2c/d58/f96 zero size 2024-04-15T21:02:41.677 INFO:tasks.workunit.client.0.smithi072.stdout:4/328: write d7/f55 [398677,46902] 0 2024-04-15T21:02:41.679 INFO:tasks.workunit.client.1.smithi149.stdout:4/620: getdents dc/d2c/d3e/d7c/dba 0 2024-04-15T21:02:41.680 INFO:tasks.workunit.client.0.smithi072.stdout:3/331: fdatasync d1/d26/f58 0 2024-04-15T21:02:41.685 INFO:tasks.workunit.client.1.smithi149.stdout:2/618: dread d4/d7/d10/d36/f47 [0,4194304] 0 2024-04-15T21:02:41.686 INFO:tasks.workunit.client.0.smithi072.stdout:1/332: dwrite d5/db/d27/f62 [0,4194304] 0 2024-04-15T21:02:41.687 INFO:tasks.workunit.client.0.smithi072.stdout:1/333: stat d5/db/d2d/d3a/c45 0 2024-04-15T21:02:41.688 INFO:tasks.workunit.client.1.smithi149.stdout:4/621: rmdir dc/d2c/d3e/d35/d4b/d6c 39 2024-04-15T21:02:41.690 INFO:tasks.workunit.client.0.smithi072.stdout:6/357: read d2/d10/d11/d1f/f32 [704564,7662] 0 2024-04-15T21:02:41.692 INFO:tasks.workunit.client.0.smithi072.stdout:9/312: rename d4/d1f/d2c/f2e to d4/d1f/d31/d4d/f5e 0 2024-04-15T21:02:41.694 INFO:tasks.workunit.client.0.smithi072.stdout:1/334: dwrite d5/db/d2d/d3a/f50 [0,4194304] 0 2024-04-15T21:02:41.695 INFO:tasks.workunit.client.0.smithi072.stdout:9/313: dread d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:41.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/314: dwrite d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:02:41.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:41 smithi072 ceph-mon[29079]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:41.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:41 smithi072 ceph-mon[29079]: mgrmap e24: smithi149.qgbaiy(active, since 4s) 2024-04-15T21:02:41.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/622: creat dc/d2c/d3e/d35/d4b/d75/d80/fd1 x:0 0 0 2024-04-15T21:02:41.782 INFO:tasks.workunit.client.1.smithi149.stdout:0/737: write d1/d29/dbb/fc3 [483674,35020] 0 2024-04-15T21:02:41.784 INFO:tasks.workunit.client.0.smithi072.stdout:4/329: creat d7/d10/d41/f60 x:0 0 0 2024-04-15T21:02:41.786 INFO:tasks.workunit.client.0.smithi072.stdout:4/330: truncate d7/f55 1000955 0 2024-04-15T21:02:41.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/619: unlink d4/d7/d10/d6b/d21/d2c/d58/fd0 0 2024-04-15T21:02:41.787 INFO:tasks.workunit.client.1.smithi149.stdout:2/620: readlink d4/d7/d10/d36/l8c 0 2024-04-15T21:02:41.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/393: mkdir d3/de/d1b/d41/d74 0 2024-04-15T21:02:41.797 INFO:tasks.workunit.client.0.smithi072.stdout:6/358: mkdir d2/d10/d18/d47/d6d 0 2024-04-15T21:02:41.798 INFO:tasks.workunit.client.0.smithi072.stdout:6/359: write d2/d40/f4d [1139871,62495] 0 2024-04-15T21:02:41.799 INFO:tasks.workunit.client.0.smithi072.stdout:3/332: rename d1/d15/l55 to d1/d15/d32/d2f/d1a/l6d 0 2024-04-15T21:02:41.802 INFO:tasks.workunit.client.0.smithi072.stdout:1/335: symlink d5/d31/d51/l6c 0 2024-04-15T21:02:41.806 INFO:tasks.workunit.client.0.smithi072.stdout:8/394: creat d3/de/d1b/d3f/f75 x:0 0 0 2024-04-15T21:02:41.808 INFO:tasks.workunit.client.0.smithi072.stdout:3/333: symlink d1/d3f/d4f/l6e 0 2024-04-15T21:02:41.809 INFO:tasks.workunit.client.0.smithi072.stdout:7/359: getdents d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38 0 2024-04-15T21:02:41.811 INFO:tasks.workunit.client.0.smithi072.stdout:7/360: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f5d [0,4194304] 0 2024-04-15T21:02:41.812 INFO:tasks.workunit.client.0.smithi072.stdout:9/315: creat d4/d1f/d2c/d47/f5f x:0 0 0 2024-04-15T21:02:41.813 INFO:tasks.workunit.client.0.smithi072.stdout:4/331: mknod d7/d28/d42/c61 0 2024-04-15T21:02:41.817 INFO:tasks.workunit.client.0.smithi072.stdout:7/361: dwrite d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:41.827 INFO:tasks.workunit.client.0.smithi072.stdout:4/332: rmdir d7/d28/d42 39 2024-04-15T21:02:41.831 INFO:tasks.workunit.client.0.smithi072.stdout:8/395: mkdir d3/d4/d76 0 2024-04-15T21:02:41.832 INFO:tasks.workunit.client.0.smithi072.stdout:8/396: fsync d3/de/d21/d2e/f5c 0 2024-04-15T21:02:41.837 INFO:tasks.workunit.client.0.smithi072.stdout:9/316: getdents d4/d1f/d58 0 2024-04-15T21:02:41.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/317: read - d4/d1f/f54 zero size 2024-04-15T21:02:41.840 INFO:tasks.workunit.client.1.smithi149.stdout:4/623: creat dc/d2c/d3e/d35/d4b/d75/db3/dcc/fd2 x:0 0 0 2024-04-15T21:02:41.840 INFO:tasks.workunit.client.1.smithi149.stdout:2/621: dwrite d4/d7/d10/d6b/d21/d5e/fb9 [0,4194304] 0 2024-04-15T21:02:41.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/622: readlink d4/l6e 0 2024-04-15T21:02:41.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/336: dwrite d5/f8 [0,4194304] 0 2024-04-15T21:02:41.843 INFO:tasks.workunit.client.0.smithi072.stdout:1/337: stat d5/db/d2d/d3a/l42 0 2024-04-15T21:02:41.845 INFO:tasks.workunit.client.0.smithi072.stdout:0/369: sync 2024-04-15T21:02:41.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/623: creat d4/d7/d10/d6b/d21/d2c/d3e/fd8 x:0 0 0 2024-04-15T21:02:41.851 INFO:tasks.workunit.client.0.smithi072.stdout:3/334: write d1/d15/f44 [202966,63846] 0 2024-04-15T21:02:41.852 INFO:tasks.workunit.client.0.smithi072.stdout:9/318: truncate d4/d1f/d2c/f39 261075 0 2024-04-15T21:02:41.855 INFO:tasks.workunit.client.0.smithi072.stdout:1/338: mknod d5/db/d2d/d3a/d1f/d63/c6d 0 2024-04-15T21:02:41.856 INFO:tasks.workunit.client.0.smithi072.stdout:1/339: write d5/f8 [5151039,34740] 0 2024-04-15T21:02:41.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/600: sync 2024-04-15T21:02:41.858 INFO:tasks.workunit.client.0.smithi072.stdout:0/370: unlink d0/d19/d2b/f69 0 2024-04-15T21:02:41.859 INFO:tasks.workunit.client.0.smithi072.stdout:1/340: rename d5/db/d2d/d3a/d1f to d5/db/d2d/d3a/d1f/d6e 22 2024-04-15T21:02:41.859 INFO:tasks.workunit.client.0.smithi072.stdout:9/319: dread d4/f11 [0,4194304] 0 2024-04-15T21:02:41.859 INFO:tasks.workunit.client.0.smithi072.stdout:0/371: dread - d0/d6/f2c zero size 2024-04-15T21:02:41.861 INFO:tasks.workunit.client.1.smithi149.stdout:2/624: dwrite d4/d7/d93/fd2 [0,4194304] 0 2024-04-15T21:02:41.864 INFO:tasks.workunit.client.1.smithi149.stdout:3/601: write d1/db/d24/d2b/f6c [2612153,108087] 0 2024-04-15T21:02:41.864 INFO:tasks.workunit.client.1.smithi149.stdout:0/738: write d1/d5/fb8 [904627,14355] 0 2024-04-15T21:02:41.865 INFO:tasks.workunit.client.0.smithi072.stdout:6/360: getdents d2 0 2024-04-15T21:02:41.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/739: write d1/d5/d24/d30/d92/ff5 [2860887,122119] 0 2024-04-15T21:02:41.869 INFO:tasks.workunit.client.1.smithi149.stdout:2/625: read d4/d7/da/fe [1166689,1157] 0 2024-04-15T21:02:41.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/602: rename d1/db/d24/d2b/fb4 to d1/db/d23/d5e/fb5 0 2024-04-15T21:02:41.876 INFO:tasks.workunit.client.0.smithi072.stdout:9/320: rename d4/d1f/l23 to d4/d1f/d31/d42/l60 0 2024-04-15T21:02:41.877 INFO:tasks.workunit.client.1.smithi149.stdout:2/626: dread d4/f7a [0,4194304] 0 2024-04-15T21:02:41.878 INFO:tasks.workunit.client.0.smithi072.stdout:4/333: getdents d7 0 2024-04-15T21:02:41.879 INFO:tasks.workunit.client.1.smithi149.stdout:2/627: write d4/d7/da/f1c [4874368,50] 0 2024-04-15T21:02:41.879 INFO:tasks.workunit.client.0.smithi072.stdout:4/334: write d7/d15/f2f [423969,130346] 0 2024-04-15T21:02:41.880 INFO:tasks.workunit.client.1.smithi149.stdout:0/740: mknod d1/d5/d24/d50/d13/d38/d44/d61/c101 0 2024-04-15T21:02:41.880 INFO:tasks.workunit.client.1.smithi149.stdout:4/624: dwrite f2 [0,4194304] 0 2024-04-15T21:02:41.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/741: read - d1/d5/d24/d30/d92/fb3 zero size 2024-04-15T21:02:41.884 INFO:tasks.workunit.client.0.smithi072.stdout:9/321: dwrite d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:41.885 INFO:tasks.workunit.client.1.smithi149.stdout:3/603: mkdir d1/db/d24/d4d/d63/db6 0 2024-04-15T21:02:41.886 INFO:tasks.workunit.client.0.smithi072.stdout:9/322: chown d4/d1f/d31/f44 0 1 2024-04-15T21:02:41.886 INFO:tasks.workunit.client.0.smithi072.stdout:1/341: dread d5/db/d27/f34 [0,4194304] 0 2024-04-15T21:02:41.887 INFO:tasks.workunit.client.0.smithi072.stdout:1/342: stat d5/db/f4f 0 2024-04-15T21:02:41.887 INFO:tasks.workunit.client.1.smithi149.stdout:3/604: write d1/db/d40/da0/fb2 [658848,111831] 0 2024-04-15T21:02:41.887 INFO:tasks.workunit.client.0.smithi072.stdout:8/397: truncate d3/d4/d3b/f3e 1403198 0 2024-04-15T21:02:41.887 INFO:tasks.workunit.client.0.smithi072.stdout:1/343: chown d5/db/l20 12831605 1 2024-04-15T21:02:41.892 INFO:tasks.workunit.client.1.smithi149.stdout:4/625: rmdir dc/d18/d21 39 2024-04-15T21:02:41.894 INFO:tasks.workunit.client.1.smithi149.stdout:4/626: write dc/d2c/d3e/d15/fac [1038698,47222] 0 2024-04-15T21:02:41.905 INFO:tasks.workunit.client.1.smithi149.stdout:3/605: mknod d1/db/d24/d4d/d63/d65/cb7 0 2024-04-15T21:02:41.906 INFO:tasks.workunit.client.0.smithi072.stdout:0/372: getdents d0/d45/d7a/d70/d59 0 2024-04-15T21:02:41.908 INFO:tasks.workunit.client.0.smithi072.stdout:1/344: dread d5/f9 [0,4194304] 0 2024-04-15T21:02:41.909 INFO:tasks.workunit.client.0.smithi072.stdout:6/361: rename d2/d10/d24 to d2/d40/d6e 0 2024-04-15T21:02:41.913 INFO:tasks.workunit.client.1.smithi149.stdout:3/606: creat d1/db/d23/d5e/fb8 x:0 0 0 2024-04-15T21:02:41.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/607: chown d1/db/d40/d56/f95 23016882 1 2024-04-15T21:02:41.915 INFO:tasks.workunit.client.1.smithi149.stdout:2/628: rename d4/d7/d93/f98 to d4/fd9 0 2024-04-15T21:02:41.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/608: fdatasync d1/db/d24/d39/d79/d97/f98 0 2024-04-15T21:02:41.917 INFO:tasks.workunit.client.1.smithi149.stdout:2/629: write d4/f12 [760205,113184] 0 2024-04-15T21:02:41.918 INFO:tasks.workunit.client.1.smithi149.stdout:3/609: write d1/db/d24/f4b [211402,97238] 0 2024-04-15T21:02:41.919 INFO:tasks.workunit.client.1.smithi149.stdout:2/630: chown d4/d7/d10/d6b/d21/d2c/d58/l8b 0 1 2024-04-15T21:02:41.922 INFO:tasks.workunit.client.0.smithi072.stdout:8/398: symlink d3/d4/d4c/l77 0 2024-04-15T21:02:41.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/399: dread d3/f1d [0,4194304] 0 2024-04-15T21:02:41.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/627: dread dc/d2c/d3e/d7c/fb2 [0,4194304] 0 2024-04-15T21:02:41.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/345: creat d5/d31/d51/f6f x:0 0 0 2024-04-15T21:02:41.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/346: fsync d5/db/d2d/d3a/d1f/f53 0 2024-04-15T21:02:41.930 INFO:tasks.workunit.client.1.smithi149.stdout:4/628: stat dc/d2c/d3e/d15/d3f/db0 0 2024-04-15T21:02:41.932 INFO:tasks.workunit.client.0.smithi072.stdout:0/373: rename d0/f2d to d0/d19/d2b/d63/f7c 0 2024-04-15T21:02:41.934 INFO:tasks.workunit.client.0.smithi072.stdout:6/362: rmdir d2/d10/d18/d47 39 2024-04-15T21:02:41.936 INFO:tasks.workunit.client.1.smithi149.stdout:0/742: getdents d1 0 2024-04-15T21:02:41.937 INFO:tasks.workunit.client.0.smithi072.stdout:4/335: mkdir d7/d15/d58/d62 0 2024-04-15T21:02:41.938 INFO:tasks.workunit.client.1.smithi149.stdout:3/610: dread d1/d81/f94 [0,4194304] 0 2024-04-15T21:02:41.939 INFO:tasks.workunit.client.0.smithi072.stdout:9/323: fsync d4/f1b 0 2024-04-15T21:02:41.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/611: dread d1/db/d24/d39/d79/d97/f98 [0,4194304] 0 2024-04-15T21:02:41.940 INFO:tasks.workunit.client.0.smithi072.stdout:9/324: write d4/d1f/d2c/f4f [949214,126494] 0 2024-04-15T21:02:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:41 smithi149 ceph-mon[36029]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail 2024-04-15T21:02:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:41 smithi149 ceph-mon[36029]: mgrmap e24: smithi149.qgbaiy(active, since 4s) 2024-04-15T21:02:41.941 INFO:tasks.workunit.client.1.smithi149.stdout:4/629: rename dc/d1a/c76 to dc/d18/dce/cd3 0 2024-04-15T21:02:41.943 INFO:tasks.workunit.client.1.smithi149.stdout:2/631: write d4/d7/d46/f54 [1689189,27015] 0 2024-04-15T21:02:41.943 INFO:tasks.workunit.client.0.smithi072.stdout:9/325: dread d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:02:41.944 INFO:tasks.workunit.client.0.smithi072.stdout:8/400: creat d3/de/d1b/d44/f78 x:0 0 0 2024-04-15T21:02:41.949 INFO:tasks.workunit.client.1.smithi149.stdout:4/630: symlink dc/d2c/d3e/d35/ld4 0 2024-04-15T21:02:41.950 INFO:tasks.workunit.client.1.smithi149.stdout:2/632: symlink d4/d7/d10/d6b/d21/d2c/d58/lda 0 2024-04-15T21:02:41.953 INFO:tasks.workunit.client.1.smithi149.stdout:0/743: link d1/d29/dbb/fc3 d1/d29/f102 0 2024-04-15T21:02:41.953 INFO:tasks.workunit.client.0.smithi072.stdout:6/363: dread d2/d10/d11/d34/f3a [0,4194304] 0 2024-04-15T21:02:41.954 INFO:tasks.workunit.client.0.smithi072.stdout:1/347: dwrite d5/db/d2d/d3a/f61 [0,4194304] 0 2024-04-15T21:02:41.956 INFO:tasks.workunit.client.0.smithi072.stdout:1/348: fsync d5/db/d27/d5c/f64 0 2024-04-15T21:02:41.957 INFO:tasks.workunit.client.0.smithi072.stdout:9/326: symlink d4/d29/l61 0 2024-04-15T21:02:41.957 INFO:tasks.workunit.client.1.smithi149.stdout:2/633: dwrite d4/d7/d10/d6b/d21/d5e/fb9 [0,4194304] 0 2024-04-15T21:02:41.958 INFO:tasks.workunit.client.0.smithi072.stdout:1/349: truncate d5/d31/f37 754908 0 2024-04-15T21:02:41.960 INFO:tasks.workunit.client.0.smithi072.stdout:6/364: dread d2/d40/f4d [0,4194304] 0 2024-04-15T21:02:41.964 INFO:tasks.workunit.client.0.smithi072.stdout:9/327: dwrite d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:41.965 INFO:tasks.workunit.client.1.smithi149.stdout:0/744: dwrite d1/d9/d64/d65/ffe [0,4194304] 0 2024-04-15T21:02:41.965 INFO:tasks.workunit.client.1.smithi149.stdout:3/612: rename d1/db/d24/d39/d79/fb0 to d1/db/d24/d39/fb9 0 2024-04-15T21:02:41.966 INFO:tasks.workunit.client.0.smithi072.stdout:8/401: rename d3/de/d1b/d44/c5a to d3/de/d21/d2e/c79 0 2024-04-15T21:02:41.966 INFO:tasks.workunit.client.0.smithi072.stdout:8/402: readlink d3/de/d21/l40 0 2024-04-15T21:02:41.972 INFO:tasks.workunit.client.0.smithi072.stdout:2/340: sync 2024-04-15T21:02:41.973 INFO:tasks.workunit.client.0.smithi072.stdout:4/336: mknod d7/d15/d58/d62/c63 0 2024-04-15T21:02:41.977 INFO:tasks.workunit.client.0.smithi072.stdout:2/341: dread d2/d37/f49 [0,4194304] 0 2024-04-15T21:02:41.977 INFO:tasks.workunit.client.0.smithi072.stdout:2/342: chown d2/d3/d5f 0 1 2024-04-15T21:02:41.980 INFO:tasks.workunit.client.1.smithi149.stdout:6/502: sync 2024-04-15T21:02:41.983 INFO:tasks.workunit.client.0.smithi072.stdout:6/365: mknod d2/d10/d11/d1f/c6f 0 2024-04-15T21:02:41.985 INFO:tasks.workunit.client.1.smithi149.stdout:0/745: creat d1/d9/d64/d65/dc5/f103 x:0 0 0 2024-04-15T21:02:41.986 INFO:tasks.workunit.client.1.smithi149.stdout:4/631: link dc/d2c/d3e/d35/d4b/d6c/d70/lb9 dc/d2c/d3e/d7c/dd0/ld5 0 2024-04-15T21:02:41.989 INFO:tasks.workunit.client.0.smithi072.stdout:8/403: write d3/d4/d3b/f55 [5234500,27492] 0 2024-04-15T21:02:41.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/503: dwrite da/d18/d10/f8b [0,4194304] 0 2024-04-15T21:02:41.991 INFO:tasks.workunit.client.0.smithi072.stdout:0/374: link d0/d6/d48/l51 d0/d45/d7a/d70/d59/l7d 0 2024-04-15T21:02:41.991 INFO:tasks.workunit.client.0.smithi072.stdout:0/375: dread d0/d45/d7a/f15 [0,4194304] 0 2024-04-15T21:02:41.992 INFO:tasks.workunit.client.1.smithi149.stdout:3/613: creat d1/fba x:0 0 0 2024-04-15T21:02:41.993 INFO:tasks.workunit.client.1.smithi149.stdout:6/504: stat da/d18/d10/d66/f80 0 2024-04-15T21:02:41.994 INFO:tasks.workunit.client.1.smithi149.stdout:3/614: truncate d1/db/fa4 1015689 0 2024-04-15T21:02:41.994 INFO:tasks.workunit.client.1.smithi149.stdout:0/746: mkdir d1/d9/d64/d65/d104 0 2024-04-15T21:02:41.996 INFO:tasks.workunit.client.0.smithi072.stdout:4/337: truncate d7/d15/f20 346597 0 2024-04-15T21:02:41.997 INFO:tasks.workunit.client.0.smithi072.stdout:4/338: fdatasync d7/d23/f2a 0 2024-04-15T21:02:41.998 INFO:tasks.workunit.client.0.smithi072.stdout:4/339: readlink d7/d10/d41/d4c/l4e 0 2024-04-15T21:02:41.999 INFO:tasks.workunit.client.0.smithi072.stdout:4/340: chown d7/d10/d41/d44 6669 1 2024-04-15T21:02:42.000 INFO:tasks.workunit.client.1.smithi149.stdout:2/634: write d4/d7/d10/d6b/d21/d2c/f80 [402238,76656] 0 2024-04-15T21:02:42.001 INFO:tasks.workunit.client.0.smithi072.stdout:0/376: dread d0/d45/d7a/f60 [0,4194304] 0 2024-04-15T21:02:42.003 INFO:tasks.workunit.client.0.smithi072.stdout:4/341: dread d7/d15/f33 [0,4194304] 0 2024-04-15T21:02:42.003 INFO:tasks.workunit.client.0.smithi072.stdout:2/343: rename d2/d37/c5b to d2/d3/d5f/c6d 0 2024-04-15T21:02:42.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/615: dwrite d1/db/d40/d56/d84/f9f [0,4194304] 0 2024-04-15T21:02:42.006 INFO:tasks.workunit.client.0.smithi072.stdout:3/335: sync 2024-04-15T21:02:42.006 INFO:tasks.workunit.client.0.smithi072.stdout:7/362: sync 2024-04-15T21:02:42.006 INFO:tasks.workunit.client.0.smithi072.stdout:5/355: sync 2024-04-15T21:02:42.007 INFO:tasks.workunit.client.1.smithi149.stdout:6/505: rename da/d18/d10/d16/d97/l89 to da/d18/d10/d16/d97/l9f 0 2024-04-15T21:02:42.008 INFO:tasks.workunit.client.0.smithi072.stdout:9/328: truncate d4/f1b 2429352 0 2024-04-15T21:02:42.008 INFO:tasks.workunit.client.0.smithi072.stdout:3/336: chown d1/d15/d32/d2f/f5c 224 1 2024-04-15T21:02:42.008 INFO:tasks.workunit.client.0.smithi072.stdout:7/363: dread - d2/d7/d25/d2d/d47/f4a zero size 2024-04-15T21:02:42.013 INFO:tasks.workunit.client.1.smithi149.stdout:0/747: symlink d1/d5/d24/d50/de2/l105 0 2024-04-15T21:02:42.014 INFO:tasks.workunit.client.1.smithi149.stdout:0/748: fsync d1/d9/d64/d65/dca/ff1 0 2024-04-15T21:02:42.014 INFO:tasks.workunit.client.0.smithi072.stdout:8/404: symlink d3/de/d21/d2e/l7a 0 2024-04-15T21:02:42.016 INFO:tasks.workunit.client.0.smithi072.stdout:8/405: write d3/de/d1b/d3f/f75 [620126,17066] 0 2024-04-15T21:02:42.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/635: unlink d4/d7/da/fb3 0 2024-04-15T21:02:42.021 INFO:tasks.workunit.client.1.smithi149.stdout:3/616: creat d1/db/d40/da0/fbb x:0 0 0 2024-04-15T21:02:42.022 INFO:tasks.workunit.client.0.smithi072.stdout:6/366: dread d2/fe [0,4194304] 0 2024-04-15T21:02:42.023 INFO:tasks.workunit.client.1.smithi149.stdout:8/649: sync 2024-04-15T21:02:42.023 INFO:tasks.workunit.client.1.smithi149.stdout:7/564: sync 2024-04-15T21:02:42.023 INFO:tasks.workunit.client.1.smithi149.stdout:5/548: sync 2024-04-15T21:02:42.023 INFO:tasks.workunit.client.1.smithi149.stdout:1/508: sync 2024-04-15T21:02:42.024 INFO:tasks.workunit.client.1.smithi149.stdout:9/522: sync 2024-04-15T21:02:42.024 INFO:tasks.workunit.client.1.smithi149.stdout:1/509: chown d1/f62 96 1 2024-04-15T21:02:42.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/749: rmdir d1/d5/d24/d30 39 2024-04-15T21:02:42.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/523: chown d23/d3c/d87/d9a 179 1 2024-04-15T21:02:42.029 INFO:tasks.workunit.client.0.smithi072.stdout:2/344: rmdir d2/d38 39 2024-04-15T21:02:42.029 INFO:tasks.workunit.client.1.smithi149.stdout:1/510: chown d1/d17/d36/l50 0 1 2024-04-15T21:02:42.029 INFO:tasks.workunit.client.0.smithi072.stdout:2/345: write d2/d8/f13 [2176384,117057] 0 2024-04-15T21:02:42.032 INFO:tasks.workunit.client.1.smithi149.stdout:2/636: mknod d4/d7/d10/d6b/d21/d55/cdb 0 2024-04-15T21:02:42.034 INFO:tasks.workunit.client.0.smithi072.stdout:4/342: rename d7/d24/c31 to d7/d10/d41/d4c/c64 0 2024-04-15T21:02:42.036 INFO:tasks.workunit.client.0.smithi072.stdout:1/350: creat d5/f70 x:0 0 0 2024-04-15T21:02:42.039 INFO:tasks.workunit.client.1.smithi149.stdout:2/637: write d4/f12 [2308049,52917] 0 2024-04-15T21:02:42.039 INFO:tasks.workunit.client.1.smithi149.stdout:5/549: dwrite d0/f4f [0,4194304] 0 2024-04-15T21:02:42.039 INFO:tasks.workunit.client.1.smithi149.stdout:9/524: dwrite f16 [0,4194304] 0 2024-04-15T21:02:42.040 INFO:tasks.workunit.client.0.smithi072.stdout:1/351: read d5/db/f1a [3107104,5846] 0 2024-04-15T21:02:42.041 INFO:tasks.workunit.client.0.smithi072.stdout:1/352: write d5/db/f1a [4263639,85370] 0 2024-04-15T21:02:42.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/632: getdents dc/d2c/d3e/d15/d3f/db0 0 2024-04-15T21:02:42.047 INFO:tasks.workunit.client.0.smithi072.stdout:3/337: creat d1/d15/f6f x:0 0 0 2024-04-15T21:02:42.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/338: dread - d1/d5b/f60 zero size 2024-04-15T21:02:42.051 INFO:tasks.workunit.client.1.smithi149.stdout:3/617: dread d1/db/d24/d2b/f50 [0,4194304] 0 2024-04-15T21:02:42.053 INFO:tasks.workunit.client.0.smithi072.stdout:1/353: dread d5/f32 [0,4194304] 0 2024-04-15T21:02:42.054 INFO:tasks.workunit.client.0.smithi072.stdout:7/364: mkdir d2/d7/d25/d72 0 2024-04-15T21:02:42.059 INFO:tasks.workunit.client.1.smithi149.stdout:7/565: rmdir d3/d17/d1f/d93 39 2024-04-15T21:02:42.059 INFO:tasks.workunit.client.1.smithi149.stdout:3/618: dwrite d1/db/d24/d2b/f22 [4194304,4194304] 0 2024-04-15T21:02:42.061 INFO:tasks.workunit.client.1.smithi149.stdout:3/619: truncate d1/db/fa8 188054 0 2024-04-15T21:02:42.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/750: stat d1/d5/d24/d30/d43/c45 0 2024-04-15T21:02:42.063 INFO:tasks.workunit.client.1.smithi149.stdout:8/650: symlink d2/df/d10/d25/d57/dd1/le6 0 2024-04-15T21:02:42.065 INFO:tasks.workunit.client.0.smithi072.stdout:0/377: creat d0/d45/d52/d7b/f7e x:0 0 0 2024-04-15T21:02:42.070 INFO:tasks.workunit.client.1.smithi149.stdout:8/651: dread d2/df/d10/d25/d57/dd1/d50/d5d/d6d/f75 [0,4194304] 0 2024-04-15T21:02:42.073 INFO:tasks.workunit.client.0.smithi072.stdout:5/356: rename d0/d3/d6/d2d/l44 to d0/d3/d33/d76/l7b 0 2024-04-15T21:02:42.075 INFO:tasks.workunit.client.1.smithi149.stdout:8/652: write d2/df/d10/d4e/d9f/dd8/fd2 [858597,122592] 0 2024-04-15T21:02:42.075 INFO:tasks.workunit.client.1.smithi149.stdout:6/506: dwrite da/d18/d10/f68 [0,4194304] 0 2024-04-15T21:02:42.075 INFO:tasks.workunit.client.1.smithi149.stdout:9/525: mkdir d23/d2b/d37/d6d/db8 0 2024-04-15T21:02:42.081 INFO:tasks.workunit.client.1.smithi149.stdout:6/507: write da/d18/d33/f7e [527783,59165] 0 2024-04-15T21:02:42.082 INFO:tasks.workunit.client.0.smithi072.stdout:9/329: mkdir d4/d1f/d2c/d62 0 2024-04-15T21:02:42.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/638: rmdir d4/d7 39 2024-04-15T21:02:42.086 INFO:tasks.workunit.client.1.smithi149.stdout:0/751: dread d1/d5/d24/d30/d54/fa9 [0,4194304] 0 2024-04-15T21:02:42.087 INFO:tasks.workunit.client.1.smithi149.stdout:7/566: creat d3/d16/d20/d60/fcd x:0 0 0 2024-04-15T21:02:42.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/526: dread - d23/d2b/d44/d7e/fb6 zero size 2024-04-15T21:02:42.088 INFO:tasks.workunit.client.1.smithi149.stdout:9/527: stat d23/d2b/d44/f63 0 2024-04-15T21:02:42.088 INFO:tasks.workunit.client.1.smithi149.stdout:3/620: unlink d1/db/d24/d2b/l3c 0 2024-04-15T21:02:42.093 INFO:tasks.workunit.client.0.smithi072.stdout:8/406: mknod d3/de/c7b 0 2024-04-15T21:02:42.098 INFO:tasks.workunit.client.0.smithi072.stdout:6/367: rmdir d2/d10/d18/d47 39 2024-04-15T21:02:42.098 INFO:tasks.workunit.client.0.smithi072.stdout:0/378: dread d0/d45/d7a/f2a [0,4194304] 0 2024-04-15T21:02:42.100 INFO:tasks.workunit.client.0.smithi072.stdout:2/346: symlink d2/d66/d69/l6e 0 2024-04-15T21:02:42.107 INFO:tasks.workunit.client.0.smithi072.stdout:4/343: creat d7/d28/d42/f65 x:0 0 0 2024-04-15T21:02:42.114 INFO:tasks.workunit.client.0.smithi072.stdout:9/330: creat d4/d1f/d31/f63 x:0 0 0 2024-04-15T21:02:42.116 INFO:tasks.workunit.client.1.smithi149.stdout:5/550: creat d0/d6/d82/da1/d12/d16/da9/fb5 x:0 0 0 2024-04-15T21:02:42.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/752: write d1/d9/d64/d65/faf [699327,21685] 0 2024-04-15T21:02:42.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/639: unlink d4/d7/d10/f37 0 2024-04-15T21:02:42.122 INFO:tasks.workunit.client.0.smithi072.stdout:7/365: symlink d2/d7/d25/d2d/d52/d6d/l73 0 2024-04-15T21:02:42.122 INFO:tasks.workunit.client.1.smithi149.stdout:2/640: stat d4/d7/d10/l5b 0 2024-04-15T21:02:42.123 INFO:tasks.workunit.client.1.smithi149.stdout:8/653: dwrite d2/df/d10/d25/d32/d45/d77/fb3 [0,4194304] 0 2024-04-15T21:02:42.125 INFO:tasks.workunit.client.1.smithi149.stdout:7/567: mknod d3/cce 0 2024-04-15T21:02:42.128 INFO:tasks.workunit.client.0.smithi072.stdout:7/366: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:42.129 INFO:tasks.workunit.client.0.smithi072.stdout:6/368: write d2/d10/f27 [3976683,7745] 0 2024-04-15T21:02:42.130 INFO:tasks.workunit.client.1.smithi149.stdout:1/511: getdents d1/db/dc/d38/d39/d43 0 2024-04-15T21:02:42.130 INFO:tasks.workunit.client.0.smithi072.stdout:6/369: fsync d2/d40/f68 0 2024-04-15T21:02:42.132 INFO:tasks.workunit.client.0.smithi072.stdout:3/339: dwrite d1/f28 [0,4194304] 0 2024-04-15T21:02:42.134 INFO:tasks.workunit.client.0.smithi072.stdout:4/344: creat d7/d15/f66 x:0 0 0 2024-04-15T21:02:42.134 INFO:tasks.workunit.client.1.smithi149.stdout:5/551: rename d0/d6/d79/d95 to d0/d9/db6 0 2024-04-15T21:02:42.136 INFO:tasks.workunit.client.0.smithi072.stdout:4/345: truncate d7/d23/f25 2192233 0 2024-04-15T21:02:42.136 INFO:tasks.workunit.client.1.smithi149.stdout:5/552: write d0/d6/d2d/f4a [1979704,50846] 0 2024-04-15T21:02:42.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/354: link c0 d5/db/d2d/c71 0 2024-04-15T21:02:42.138 INFO:tasks.workunit.client.0.smithi072.stdout:4/346: chown d7/fc 20329 1 2024-04-15T21:02:42.139 INFO:tasks.workunit.client.0.smithi072.stdout:4/347: stat d7/d28/d37 0 2024-04-15T21:02:42.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/407: fdatasync d3/de/d1b/f62 0 2024-04-15T21:02:42.142 INFO:tasks.workunit.client.0.smithi072.stdout:4/348: truncate d7/d10/d41/d44/f48 997349 0 2024-04-15T21:02:42.143 INFO:tasks.workunit.client.0.smithi072.stdout:9/331: dwrite d4/d1f/d31/d4d/f5c [0,4194304] 0 2024-04-15T21:02:42.152 INFO:tasks.workunit.client.0.smithi072.stdout:5/357: creat d0/f7c x:0 0 0 2024-04-15T21:02:42.152 INFO:tasks.workunit.client.0.smithi072.stdout:9/332: dwrite d4/d1f/d2c/f46 [4194304,4194304] 0 2024-04-15T21:02:42.156 INFO:tasks.workunit.client.1.smithi149.stdout:1/512: symlink d1/db/dc/d11/d3f/l94 0 2024-04-15T21:02:42.157 INFO:tasks.workunit.client.1.smithi149.stdout:1/513: fdatasync d1/db/dc/d38/d39/d43/f7b 0 2024-04-15T21:02:42.164 INFO:tasks.workunit.client.1.smithi149.stdout:4/633: link dc/d18/d21/d81/caf dc/d2c/d3e/d35/cd6 0 2024-04-15T21:02:42.166 INFO:tasks.workunit.client.1.smithi149.stdout:4/634: stat dc/fa8 0 2024-04-15T21:02:42.166 INFO:tasks.workunit.client.1.smithi149.stdout:5/553: mkdir d0/d6/d82/da1/d12/d16/da9/d9b/db7 0 2024-04-15T21:02:42.167 INFO:tasks.workunit.client.1.smithi149.stdout:1/514: dwrite d1/f5 [8388608,4194304] 0 2024-04-15T21:02:42.170 INFO:tasks.workunit.client.1.smithi149.stdout:1/515: stat d1/db/d14 0 2024-04-15T21:02:42.170 INFO:tasks.workunit.client.1.smithi149.stdout:5/554: fsync d0/d6/d82/da1/d12/d16/da9/d1b/d83/f90 0 2024-04-15T21:02:42.172 INFO:tasks.workunit.client.0.smithi072.stdout:0/379: creat d0/d45/f7f x:0 0 0 2024-04-15T21:02:42.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/528: getdents d23/d2b/d37/d50/d79/d8d 0 2024-04-15T21:02:42.175 INFO:tasks.workunit.client.0.smithi072.stdout:4/349: dread d7/fc [0,4194304] 0 2024-04-15T21:02:42.177 INFO:tasks.workunit.client.0.smithi072.stdout:3/340: write d1/d26/f58 [808389,83063] 0 2024-04-15T21:02:42.177 INFO:tasks.workunit.client.1.smithi149.stdout:4/635: dwrite dc/d2c/d3e/d15/d5b/f6d [0,4194304] 0 2024-04-15T21:02:42.179 INFO:tasks.workunit.client.0.smithi072.stdout:9/333: write d4/f11 [3606382,92637] 0 2024-04-15T21:02:42.186 INFO:tasks.workunit.client.0.smithi072.stdout:7/367: rename d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c1d to d2/d7/d25/d2d/d46/c74 0 2024-04-15T21:02:42.188 INFO:tasks.workunit.client.1.smithi149.stdout:3/621: getdents d1/db/d24/d2b 0 2024-04-15T21:02:42.194 INFO:tasks.workunit.client.0.smithi072.stdout:1/355: mknod d5/db/c72 0 2024-04-15T21:02:42.195 INFO:tasks.workunit.client.1.smithi149.stdout:0/753: dwrite d1/d5/f7d [0,4194304] 0 2024-04-15T21:02:42.197 INFO:tasks.workunit.client.1.smithi149.stdout:8/654: link d2/df/d10/d25/d57/dd1/l61 d2/d16/le7 0 2024-04-15T21:02:42.198 INFO:tasks.workunit.client.1.smithi149.stdout:4/636: dwrite dc/d2c/fa1 [0,4194304] 0 2024-04-15T21:02:42.200 INFO:tasks.workunit.client.1.smithi149.stdout:0/754: write d1/d5/dc/f46 [4110770,106888] 0 2024-04-15T21:02:42.201 INFO:tasks.workunit.client.1.smithi149.stdout:2/641: link d4/d7/d46/d74/fb1 d4/d7/d10/d6b/d21/d2c/d32/d4a/dbd/fdc 0 2024-04-15T21:02:42.202 INFO:tasks.workunit.client.0.smithi072.stdout:1/356: dwrite d5/db/f59 [0,4194304] 0 2024-04-15T21:02:42.202 INFO:tasks.workunit.client.0.smithi072.stdout:4/350: symlink d7/d10/l67 0 2024-04-15T21:02:42.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/347: getdents d2/d66 0 2024-04-15T21:02:42.204 INFO:tasks.workunit.client.0.smithi072.stdout:9/334: fdatasync d4/f7 0 2024-04-15T21:02:42.205 INFO:tasks.workunit.client.0.smithi072.stdout:1/357: write d5/f8 [3257478,65380] 0 2024-04-15T21:02:42.207 INFO:tasks.workunit.client.0.smithi072.stdout:1/358: dread - d5/db/d2d/d3a/d1f/d63/f68 zero size 2024-04-15T21:02:42.208 INFO:tasks.workunit.client.1.smithi149.stdout:7/568: creat d3/d16/d20/d36/fcf x:0 0 0 2024-04-15T21:02:42.209 INFO:tasks.workunit.client.0.smithi072.stdout:6/370: rename d2/d10/d11/d34 to d2/d40/d56/d6a/d70 0 2024-04-15T21:02:42.209 INFO:tasks.workunit.client.0.smithi072.stdout:8/408: rename d3/de to d3/de/d1b/d6d/d7c 22 2024-04-15T21:02:42.210 INFO:tasks.workunit.client.0.smithi072.stdout:4/351: dwrite d7/f1b [0,4194304] 0 2024-04-15T21:02:42.211 INFO:tasks.workunit.client.0.smithi072.stdout:6/371: chown d2/d10/d11/d15/c25 93602995 1 2024-04-15T21:02:42.215 INFO:tasks.workunit.client.1.smithi149.stdout:3/622: creat d1/d81/fbc x:0 0 0 2024-04-15T21:02:42.221 INFO:tasks.workunit.client.1.smithi149.stdout:2/642: dread d4/d7/d93/fd2 [0,4194304] 0 2024-04-15T21:02:42.224 INFO:tasks.workunit.client.1.smithi149.stdout:1/516: write d1/db/f37 [966453,89679] 0 2024-04-15T21:02:42.224 INFO:tasks.workunit.client.1.smithi149.stdout:9/529: dread f21 [0,4194304] 0 2024-04-15T21:02:42.229 INFO:tasks.workunit.client.0.smithi072.stdout:2/348: symlink d2/d3/d5f/l6f 0 2024-04-15T21:02:42.229 INFO:tasks.workunit.client.1.smithi149.stdout:7/569: dwrite d3/d16/d32/fa1 [0,4194304] 0 2024-04-15T21:02:42.230 INFO:tasks.workunit.client.0.smithi072.stdout:2/349: fdatasync d2/d8/f30 0 2024-04-15T21:02:42.232 INFO:tasks.workunit.client.1.smithi149.stdout:8/655: dread - d2/df/d10/d25/d57/dd1/fad zero size 2024-04-15T21:02:42.234 INFO:tasks.workunit.client.1.smithi149.stdout:0/755: mknod d1/d9/d64/d65/c106 0 2024-04-15T21:02:42.235 INFO:tasks.workunit.client.0.smithi072.stdout:1/359: unlink d5/d31/d51/c5d 0 2024-04-15T21:02:42.235 INFO:tasks.workunit.client.0.smithi072.stdout:1/360: dread - d5/f70 zero size 2024-04-15T21:02:42.243 INFO:tasks.workunit.client.0.smithi072.stdout:8/409: write d3/f30 [4428960,74116] 0 2024-04-15T21:02:42.243 INFO:tasks.workunit.client.0.smithi072.stdout:4/352: mknod d7/d10/d41/c68 0 2024-04-15T21:02:42.245 INFO:tasks.workunit.client.0.smithi072.stdout:5/358: truncate d0/d3/d6/d14/f1b 3539051 0 2024-04-15T21:02:42.249 INFO:tasks.workunit.client.1.smithi149.stdout:3/623: rename d1/db/d23/d5e to d1/db/d28/d87/dbd 0 2024-04-15T21:02:42.250 INFO:tasks.workunit.client.1.smithi149.stdout:6/508: sync 2024-04-15T21:02:42.250 INFO:tasks.workunit.client.0.smithi072.stdout:0/380: write d0/f1 [2576665,91729] 0 2024-04-15T21:02:42.251 INFO:tasks.workunit.client.0.smithi072.stdout:6/372: truncate d2/d40/f4d 339569 0 2024-04-15T21:02:42.252 INFO:tasks.workunit.client.0.smithi072.stdout:6/373: read d2/d10/d11/d15/f20 [6529255,62780] 0 2024-04-15T21:02:42.255 INFO:tasks.workunit.client.1.smithi149.stdout:2/643: creat d4/d7/d10/d36/fdd x:0 0 0 2024-04-15T21:02:42.256 INFO:tasks.workunit.client.1.smithi149.stdout:1/517: creat d1/db/d16/d35/f95 x:0 0 0 2024-04-15T21:02:42.257 INFO:tasks.workunit.client.1.smithi149.stdout:4/637: write dc/d2c/d3e/d35/f5e [1497719,32187] 0 2024-04-15T21:02:42.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/656: dread d2/df/d10/d25/f4a [0,4194304] 0 2024-04-15T21:02:42.260 INFO:tasks.workunit.client.1.smithi149.stdout:3/624: dwrite d1/db/d28/f44 [0,4194304] 0 2024-04-15T21:02:42.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/555: rmdir d0/d6/d9f/db3 0 2024-04-15T21:02:42.268 INFO:tasks.workunit.client.1.smithi149.stdout:1/518: dwrite d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:42.273 INFO:tasks.workunit.client.1.smithi149.stdout:4/638: dread f2 [0,4194304] 0 2024-04-15T21:02:42.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/519: dwrite d1/d17/d36/f71 [0,4194304] 0 2024-04-15T21:02:42.283 INFO:tasks.workunit.client.1.smithi149.stdout:0/756: rename d1/d9/d64/d65/ffe to d1/d9/d64/d73/da3/f107 0 2024-04-15T21:02:42.287 INFO:tasks.workunit.client.1.smithi149.stdout:1/520: chown d1/l7f 20858415 1 2024-04-15T21:02:42.289 INFO:tasks.workunit.client.1.smithi149.stdout:8/657: mkdir d2/df/d10/d25/d57/dd1/d50/d5d/dc6/de8 0 2024-04-15T21:02:42.290 INFO:tasks.workunit.client.1.smithi149.stdout:3/625: creat d1/db/d24/d8a/fbe x:0 0 0 2024-04-15T21:02:42.291 INFO:tasks.workunit.client.1.smithi149.stdout:9/530: dwrite d23/d3c/d52/f58 [0,4194304] 0 2024-04-15T21:02:42.291 INFO:tasks.workunit.client.1.smithi149.stdout:5/556: mkdir d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8 0 2024-04-15T21:02:42.292 INFO:tasks.workunit.client.1.smithi149.stdout:3/626: stat d1/db/d24/d4d/d63 0 2024-04-15T21:02:42.294 INFO:tasks.workunit.client.1.smithi149.stdout:9/531: write d23/d2b/d44/d7e/f9b [829534,126864] 0 2024-04-15T21:02:42.297 INFO:tasks.workunit.client.1.smithi149.stdout:4/639: mkdir dc/d18/dce/dd7 0 2024-04-15T21:02:42.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/640: chown dc/d2c/d3e/d35/d3a/c58 1402335 1 2024-04-15T21:02:42.304 INFO:tasks.workunit.client.1.smithi149.stdout:0/757: creat d1/d5/d24/d50/d13/f108 x:0 0 0 2024-04-15T21:02:42.305 INFO:tasks.workunit.client.1.smithi149.stdout:3/627: dwrite d1/db/d24/d39/d79/f83 [0,4194304] 0 2024-04-15T21:02:42.306 INFO:tasks.workunit.client.1.smithi149.stdout:1/521: creat d1/db/d16/d35/f96 x:0 0 0 2024-04-15T21:02:42.308 INFO:tasks.workunit.client.1.smithi149.stdout:3/628: write d1/db/d24/d4d/d63/d65/f91 [481070,8249] 0 2024-04-15T21:02:42.308 INFO:tasks.workunit.client.1.smithi149.stdout:8/658: unlink d2/d16/f83 0 2024-04-15T21:02:42.312 INFO:tasks.workunit.client.1.smithi149.stdout:0/758: stat d1/d5/d24/d30/d43/c45 0 2024-04-15T21:02:42.313 INFO:tasks.workunit.client.1.smithi149.stdout:5/557: mknod d0/d9/d71/cb9 0 2024-04-15T21:02:42.314 INFO:tasks.workunit.client.1.smithi149.stdout:3/629: write d1/db/d24/f5d [3999322,57883] 0 2024-04-15T21:02:42.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/509: write da/d18/d10/d3f/f41 [1368110,115214] 0 2024-04-15T21:02:42.319 INFO:tasks.workunit.client.1.smithi149.stdout:2/644: write d4/d7/d10/d6b/d21/d5e/dbe/da7/d6c/f8f [2152655,22331] 0 2024-04-15T21:02:42.321 INFO:tasks.workunit.client.1.smithi149.stdout:7/570: getdents d3/d39/d92 0 2024-04-15T21:02:42.325 INFO:tasks.workunit.client.1.smithi149.stdout:0/759: creat d1/d29/dbb/f109 x:0 0 0 2024-04-15T21:02:42.328 INFO:tasks.workunit.client.1.smithi149.stdout:8/659: symlink d2/df/d10/d34/le9 0 2024-04-15T21:02:42.330 INFO:tasks.workunit.client.1.smithi149.stdout:6/510: dwrite da/d18/d10/f99 [0,4194304] 0 2024-04-15T21:02:42.331 INFO:tasks.workunit.client.1.smithi149.stdout:5/558: dread d0/d6/d82/da1/d12/d16/da9/f81 [0,4194304] 0 2024-04-15T21:02:42.334 INFO:tasks.workunit.client.1.smithi149.stdout:6/511: truncate da/d49/f8d 144711 0 2024-04-15T21:02:42.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/641: dread dc/d18/d21/f6b [0,4194304] 0 2024-04-15T21:02:42.347 INFO:tasks.workunit.client.1.smithi149.stdout:4/642: write dc/d2c/d3e/d7c/dba/fcb [419972,114231] 0 2024-04-15T21:02:42.348 INFO:tasks.workunit.client.1.smithi149.stdout:5/559: dwrite d0/f8 [0,4194304] 0 2024-04-15T21:02:42.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/512: dwrite da/d11/f22 [4194304,4194304] 0 2024-04-15T21:02:42.364 INFO:tasks.workunit.client.0.smithi072.stdout:6/374: write d2/d10/d11/d15/f53 [3130541,112456] 0 2024-04-15T21:02:42.364 INFO:tasks.workunit.client.0.smithi072.stdout:9/335: mknod d4/d1f/d2c/c64 0 2024-04-15T21:02:42.365 INFO:tasks.workunit.client.0.smithi072.stdout:1/361: symlink d5/db/d2d/d3a/d1f/d63/l73 0 2024-04-15T21:02:42.365 INFO:tasks.workunit.client.0.smithi072.stdout:8/410: mknod d3/d4/d4c/c7d 0 2024-04-15T21:02:42.367 INFO:tasks.workunit.client.0.smithi072.stdout:4/353: mknod d7/d24/c69 0 2024-04-15T21:02:42.367 INFO:tasks.workunit.client.1.smithi149.stdout:6/513: dwrite da/d18/d10/f8b [0,4194304] 0 2024-04-15T21:02:42.371 INFO:tasks.workunit.client.1.smithi149.stdout:6/514: write da/d2e/f52 [1580883,98582] 0 2024-04-15T21:02:42.371 INFO:tasks.workunit.client.1.smithi149.stdout:6/515: fdatasync da/f75 0 2024-04-15T21:02:42.372 INFO:tasks.workunit.client.1.smithi149.stdout:6/516: write da/d18/d10/d16/d97/f98 [376890,122923] 0 2024-04-15T21:02:42.373 INFO:tasks.workunit.client.1.smithi149.stdout:6/517: stat da/d49/d55/d82 0 2024-04-15T21:02:42.373 INFO:tasks.workunit.client.0.smithi072.stdout:1/362: dwrite d5/db/f52 [0,4194304] 0 2024-04-15T21:02:42.374 INFO:tasks.workunit.client.1.smithi149.stdout:6/518: chown da/d32/c53 119 1 2024-04-15T21:02:42.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/368: sync 2024-04-15T21:02:42.410 INFO:tasks.workunit.client.0.smithi072.stdout:3/341: sync 2024-04-15T21:02:42.411 INFO:tasks.workunit.client.0.smithi072.stdout:3/342: write d1/d3f/f67 [491919,56444] 0 2024-04-15T21:02:42.411 INFO:tasks.workunit.client.0.smithi072.stdout:3/343: chown d1/f10 0 1 2024-04-15T21:02:42.416 INFO:tasks.workunit.client.0.smithi072.stdout:9/336: dread d4/d1f/d2c/f39 [0,4194304] 0 2024-04-15T21:02:42.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/532: rmdir d23/d3c/d7a/db4 0 2024-04-15T21:02:42.419 INFO:tasks.workunit.client.0.smithi072.stdout:6/375: fdatasync d2/d1a/f1b 0 2024-04-15T21:02:42.420 INFO:tasks.workunit.client.1.smithi149.stdout:0/760: fsync d1/d5/d24/d50/d13/d59/dd7/f87 0 2024-04-15T21:02:42.424 INFO:tasks.workunit.client.1.smithi149.stdout:7/571: unlink d3/d16/d20/d36/d3d/da4/fbf 0 2024-04-15T21:02:42.430 INFO:tasks.workunit.client.1.smithi149.stdout:8/660: dread d2/df/d10/d25/d32/d45/f5e [4194304,4194304] 0 2024-04-15T21:02:42.434 INFO:tasks.workunit.client.0.smithi072.stdout:4/354: symlink d7/d15/l6a 0 2024-04-15T21:02:42.435 INFO:tasks.workunit.client.0.smithi072.stdout:4/355: truncate d7/d28/f40 745472 0 2024-04-15T21:02:42.442 INFO:tasks.workunit.client.1.smithi149.stdout:1/522: sync 2024-04-15T21:02:42.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/643: rmdir dc/d2c/d3e/d35/d4b/d6c 39 2024-04-15T21:02:42.443 INFO:tasks.workunit.client.1.smithi149.stdout:1/523: chown d1/d17/d52/f40 29 1 2024-04-15T21:02:42.444 INFO:tasks.workunit.client.1.smithi149.stdout:4/644: write dc/d8f/d91/fad [632182,4799] 0 2024-04-15T21:02:42.444 INFO:tasks.workunit.client.0.smithi072.stdout:7/369: creat d2/d7/d25/f75 x:0 0 0 2024-04-15T21:02:42.461 INFO:tasks.workunit.client.1.smithi149.stdout:3/630: link d1/db/f52 d1/db/d28/fbf 0 2024-04-15T21:02:42.462 INFO:tasks.workunit.client.1.smithi149.stdout:5/560: dread d0/d6/d82/da1/d12/d2b/f72 [0,4194304] 0 2024-04-15T21:02:42.462 INFO:tasks.workunit.client.1.smithi149.stdout:3/631: chown d1/db/d24/d39/f47 977421 1 2024-04-15T21:02:42.465 INFO:tasks.workunit.client.1.smithi149.stdout:9/533: symlink d23/d46/lb9 0 2024-04-15T21:02:42.468 INFO:tasks.workunit.client.0.smithi072.stdout:7/370: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f76 x:0 0 0 2024-04-15T21:02:42.471 INFO:tasks.workunit.client.1.smithi149.stdout:3/632: dwrite d1/db/d24/d2b/f6c [4194304,4194304] 0 2024-04-15T21:02:42.472 INFO:tasks.workunit.client.1.smithi149.stdout:6/519: dread da/d18/d10/d66/f57 [0,4194304] 0 2024-04-15T21:02:42.477 INFO:tasks.workunit.client.1.smithi149.stdout:7/572: mknod d3/d39/d92/cd0 0 2024-04-15T21:02:42.479 INFO:tasks.workunit.client.0.smithi072.stdout:4/356: mkdir d7/d24/d3e/d5e/d6b 0 2024-04-15T21:02:42.482 INFO:tasks.workunit.client.0.smithi072.stdout:7/371: mknod d2/d7/d25/d2d/d47/c77 0 2024-04-15T21:02:42.483 INFO:tasks.workunit.client.0.smithi072.stdout:7/372: read - d2/d7/d25/f71 zero size 2024-04-15T21:02:42.484 INFO:tasks.workunit.client.1.smithi149.stdout:4/645: fdatasync dc/d2c/d3e/d15/fa0 0 2024-04-15T21:02:42.485 INFO:tasks.workunit.client.0.smithi072.stdout:7/373: write d2/d7/d25/d2d/d47/f4a [921142,102640] 0 2024-04-15T21:02:42.486 INFO:tasks.workunit.client.0.smithi072.stdout:7/374: fdatasync d2/d7/d25/d2d/d46/d5a/d5f/f11 0 2024-04-15T21:02:42.488 INFO:tasks.workunit.client.1.smithi149.stdout:5/561: creat d0/d6/d9f/fba x:0 0 0 2024-04-15T21:02:42.492 INFO:tasks.workunit.client.1.smithi149.stdout:4/646: dread dc/d18/f1d [0,4194304] 0 2024-04-15T21:02:42.497 INFO:tasks.workunit.client.1.smithi149.stdout:6/520: read da/d18/d10/f42 [616081,17371] 0 2024-04-15T21:02:42.497 INFO:tasks.workunit.client.0.smithi072.stdout:7/375: mkdir d2/d78 0 2024-04-15T21:02:42.498 INFO:tasks.workunit.client.1.smithi149.stdout:4/647: dwrite f1 [0,4194304] 0 2024-04-15T21:02:42.501 INFO:tasks.workunit.client.1.smithi149.stdout:8/661: mknod d2/df/d10/d20/d6b/cea 0 2024-04-15T21:02:42.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/524: mkdir d1/d17/d5e/d64/d8a/d97 0 2024-04-15T21:02:42.509 INFO:tasks.workunit.client.0.smithi072.stdout:7/376: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 [0,4194304] 0 2024-04-15T21:02:42.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/645: getdents d4/d7/da 0 2024-04-15T21:02:42.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/562: creat d0/d6/d79/fbb x:0 0 0 2024-04-15T21:02:42.512 INFO:tasks.workunit.client.1.smithi149.stdout:1/525: dwrite d1/db/dc/d38/d39/d43/f7b [0,4194304] 0 2024-04-15T21:02:42.515 INFO:tasks.workunit.client.1.smithi149.stdout:0/761: link d1/d5/dda/fe8 d1/d5/dc/f10a 0 2024-04-15T21:02:42.516 INFO:tasks.workunit.client.0.smithi072.stdout:7/377: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d26/f41 [0,4194304] 0 2024-04-15T21:02:42.517 INFO:tasks.workunit.client.0.smithi072.stdout:2/350: sync 2024-04-15T21:02:42.522 INFO:tasks.workunit.client.1.smithi149.stdout:7/573: link d3/d16/d20/f24 d3/d34/fd1 0 2024-04-15T21:02:42.522 INFO:tasks.workunit.client.1.smithi149.stdout:5/563: dwrite d0/d6/d82/da1/fb2 [0,4194304] 0 2024-04-15T21:02:42.523 INFO:tasks.workunit.client.1.smithi149.stdout:5/564: chown d0/c77 591823058 1 2024-04-15T21:02:42.540 INFO:tasks.workunit.client.1.smithi149.stdout:5/565: read d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [3397851,43664] 0 2024-04-15T21:02:42.542 INFO:tasks.workunit.client.1.smithi149.stdout:8/662: creat d2/df/d10/d25/d37/d53/daf/d85/d35/feb x:0 0 0 2024-04-15T21:02:42.544 INFO:tasks.workunit.client.1.smithi149.stdout:8/663: write d2/df/d10/d25/d57/dd1/d46/fbc [328340,123479] 0 2024-04-15T21:02:42.548 INFO:tasks.workunit.client.0.smithi072.stdout:2/351: mknod d2/d8/d6c/c70 0 2024-04-15T21:02:42.548 INFO:tasks.workunit.client.0.smithi072.stdout:2/352: stat d2/d37/l52 0 2024-04-15T21:02:42.550 INFO:tasks.workunit.client.1.smithi149.stdout:2/646: creat d4/d7/d93/fde x:0 0 0 2024-04-15T21:02:42.554 INFO:tasks.workunit.client.1.smithi149.stdout:0/762: creat d1/d29/dbb/f10b x:0 0 0 2024-04-15T21:02:42.555 INFO:tasks.workunit.client.0.smithi072.stdout:7/378: getdents d2/d7/d25/d2d/d46/d5a 0 2024-04-15T21:02:42.558 INFO:tasks.workunit.client.0.smithi072.stdout:8/411: sync 2024-04-15T21:02:42.559 INFO:tasks.workunit.client.0.smithi072.stdout:7/379: creat d2/d7/d25/d2d/d46/f79 x:0 0 0 2024-04-15T21:02:42.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/566: mknod d0/d9/db6/cbc 0 2024-04-15T21:02:42.563 INFO:tasks.workunit.client.0.smithi072.stdout:7/380: stat d2/l15 0 2024-04-15T21:02:42.566 INFO:tasks.workunit.client.1.smithi149.stdout:8/664: rename d2/df/d10/d25/d37/d53/daf/d85/fdd to d2/d16/fec 0 2024-04-15T21:02:42.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/526: mknod d1/d17/d52/d92/c98 0 2024-04-15T21:02:42.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/665: read d2/df/d10/d25/d32/d45/d77/fb3 [420199,49523] 0 2024-04-15T21:02:42.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/527: fsync d1/db/d14/f7d 0 2024-04-15T21:02:42.569 INFO:tasks.workunit.client.0.smithi072.stdout:7/381: mknod d2/d7/d25/d2d/d52/d6d/c7a 0 2024-04-15T21:02:42.571 INFO:tasks.workunit.client.1.smithi149.stdout:0/763: symlink d1/d29/l10c 0 2024-04-15T21:02:42.572 INFO:tasks.workunit.client.1.smithi149.stdout:0/764: truncate d1/d29/dbb/f10b 756753 0 2024-04-15T21:02:42.574 INFO:tasks.workunit.client.0.smithi072.stdout:7/382: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d43/d7b 0 2024-04-15T21:02:42.576 INFO:tasks.workunit.client.1.smithi149.stdout:5/567: unlink d0/d9/d3f/c96 0 2024-04-15T21:02:42.578 INFO:tasks.workunit.client.0.smithi072.stdout:2/353: dread d2/d3/f15 [0,4194304] 0 2024-04-15T21:02:42.579 INFO:tasks.workunit.client.1.smithi149.stdout:2/647: rename d4/d7/d10/d6b/d21/d3b/c68 to d4/d7/d29/cdf 0 2024-04-15T21:02:42.582 INFO:tasks.workunit.client.0.smithi072.stdout:2/354: symlink d2/d66/l71 0 2024-04-15T21:02:42.584 INFO:tasks.workunit.client.1.smithi149.stdout:8/666: chown d2/df/d10/d25/d37/ld4 696 1 2024-04-15T21:02:42.586 INFO:tasks.workunit.client.1.smithi149.stdout:2/648: dwrite d4/d7/d10/d6b/d21/d5e/fb9 [0,4194304] 0 2024-04-15T21:02:42.588 INFO:tasks.workunit.client.0.smithi072.stdout:2/355: creat d2/d8/f72 x:0 0 0 2024-04-15T21:02:42.595 INFO:tasks.workunit.client.0.smithi072.stdout:2/356: dwrite d2/d8/f30 [4194304,4194304] 0 2024-04-15T21:02:42.601 INFO:tasks.workunit.client.1.smithi149.stdout:4/648: unlink dc/d18/d21/c38 0 2024-04-15T21:02:42.609 INFO:tasks.workunit.client.1.smithi149.stdout:2/649: dread d4/d7/d10/d6b/d21/fc2 [0,4194304] 0 2024-04-15T21:02:42.610 INFO:tasks.workunit.client.1.smithi149.stdout:2/650: readlink d4/d7/da/lb5 0 2024-04-15T21:02:42.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/765: mknod d1/c10d 0 2024-04-15T21:02:42.623 INFO:tasks.workunit.client.0.smithi072.stdout:0/381: truncate d0/d6/f20 915846 0 2024-04-15T21:02:42.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/651: dread d4/d7/d10/d6b/d21/d3b/f43 [8388608,4194304] 0 2024-04-15T21:02:42.635 INFO:tasks.workunit.client.1.smithi149.stdout:2/652: rename d4/d7/d10/d6b/d21/d2c/d32/d4a/l9f to d4/d7/d46/d74/le0 0 2024-04-15T21:02:42.635 INFO:tasks.workunit.client.0.smithi072.stdout:9/337: dwrite d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:42.636 INFO:tasks.workunit.client.0.smithi072.stdout:9/338: write d4/d1f/d2c/f35 [3853979,60572] 0 2024-04-15T21:02:42.637 INFO:tasks.workunit.client.0.smithi072.stdout:9/339: chown d4/l40 2 1 2024-04-15T21:02:42.641 INFO:tasks.workunit.client.0.smithi072.stdout:9/340: symlink d4/d1f/d2c/d47/l65 0 2024-04-15T21:02:42.641 INFO:tasks.workunit.client.0.smithi072.stdout:1/363: truncate d5/db/d2d/f3e 1502292 0 2024-04-15T21:02:42.642 INFO:tasks.workunit.client.1.smithi149.stdout:9/534: symlink d23/lba 0 2024-04-15T21:02:42.646 INFO:tasks.workunit.client.0.smithi072.stdout:9/341: getdents d4/d1f/d58 0 2024-04-15T21:02:42.664 INFO:tasks.workunit.client.0.smithi072.stdout:1/364: dread d5/db/d2d/d3a/f13 [0,4194304] 0 2024-04-15T21:02:42.664 INFO:tasks.workunit.client.0.smithi072.stdout:1/365: dread - d5/f70 zero size 2024-04-15T21:02:42.666 INFO:tasks.workunit.client.0.smithi072.stdout:3/344: rename d1/d15/d32/d2f/c4e to d1/c70 0 2024-04-15T21:02:42.670 INFO:tasks.workunit.client.0.smithi072.stdout:1/366: dwrite d5/db/f59 [0,4194304] 0 2024-04-15T21:02:42.671 INFO:tasks.workunit.client.0.smithi072.stdout:1/367: truncate d5/d31/f37 1396043 0 2024-04-15T21:02:42.671 INFO:tasks.workunit.client.0.smithi072.stdout:6/376: rename d2/d10/d11/d1f/c6f to d2/d10/d18/c71 0 2024-04-15T21:02:42.673 INFO:tasks.workunit.client.0.smithi072.stdout:3/345: creat d1/d15/d40/f71 x:0 0 0 2024-04-15T21:02:42.674 INFO:tasks.workunit.client.0.smithi072.stdout:3/346: read - d1/d15/d32/f50 zero size 2024-04-15T21:02:42.675 INFO:tasks.workunit.client.0.smithi072.stdout:1/368: creat d5/d31/d51/f74 x:0 0 0 2024-04-15T21:02:42.676 INFO:tasks.workunit.client.0.smithi072.stdout:4/357: rename d7/d28/d37 to d7/d23/d6c 0 2024-04-15T21:02:42.677 INFO:tasks.workunit.client.0.smithi072.stdout:4/358: fdatasync d7/f55 0 2024-04-15T21:02:42.681 INFO:tasks.workunit.client.1.smithi149.stdout:6/521: unlink da/d18/d10/c3a 0 2024-04-15T21:02:42.684 INFO:tasks.workunit.client.1.smithi149.stdout:7/574: symlink d3/d16/ld2 0 2024-04-15T21:02:42.686 INFO:tasks.workunit.client.1.smithi149.stdout:6/522: mkdir da/d49/d55/da0 0 2024-04-15T21:02:42.688 INFO:tasks.workunit.client.1.smithi149.stdout:6/523: truncate da/d18/d10/d16/d97/f98 712317 0 2024-04-15T21:02:42.688 INFO:tasks.workunit.client.0.smithi072.stdout:4/359: unlink d7/d23/d6c/f53 0 2024-04-15T21:02:42.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/347: getdents d1/d26 0 2024-04-15T21:02:42.692 INFO:tasks.workunit.client.1.smithi149.stdout:6/524: creat da/d49/d55/da0/fa1 x:0 0 0 2024-04-15T21:02:42.693 INFO:tasks.workunit.client.0.smithi072.stdout:0/382: creat d0/d6/f80 x:0 0 0 2024-04-15T21:02:42.694 INFO:tasks.workunit.client.0.smithi072.stdout:1/369: link d5/d3d/f6a d5/d3d/f75 0 2024-04-15T21:02:42.696 INFO:tasks.workunit.client.1.smithi149.stdout:6/525: mknod da/d18/ca2 0 2024-04-15T21:02:42.698 INFO:tasks.workunit.client.0.smithi072.stdout:3/348: mknod d1/d15/d32/d2f/c72 0 2024-04-15T21:02:42.699 INFO:tasks.workunit.client.0.smithi072.stdout:0/383: dwrite d0/d45/d52/d7b/f7e [0,4194304] 0 2024-04-15T21:02:42.700 INFO:tasks.workunit.client.0.smithi072.stdout:3/349: write d1/d15/d40/f27 [855056,32891] 0 2024-04-15T21:02:42.700 INFO:tasks.workunit.client.0.smithi072.stdout:1/370: mknod d5/d3d/d5e/c76 0 2024-04-15T21:02:42.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/633: sync 2024-04-15T21:02:42.702 INFO:tasks.workunit.client.0.smithi072.stdout:4/360: mkdir d7/d28/d6d 0 2024-04-15T21:02:42.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/634: chown d1/db/d24/d2b/f2e 509 1 2024-04-15T21:02:42.705 INFO:tasks.workunit.client.0.smithi072.stdout:3/350: mkdir d1/d3f/d4f/d73 0 2024-04-15T21:02:42.709 INFO:tasks.workunit.client.1.smithi149.stdout:3/635: rmdir d1/db/d40/d56/d84 39 2024-04-15T21:02:42.710 INFO:tasks.workunit.client.0.smithi072.stdout:1/371: mkdir d5/d3d/d77 0 2024-04-15T21:02:42.717 INFO:tasks.workunit.client.0.smithi072.stdout:1/372: creat d5/db/d2d/d3a/d1f/f78 x:0 0 0 2024-04-15T21:02:42.719 INFO:tasks.workunit.client.0.smithi072.stdout:0/384: creat d0/d45/d7a/d70/d59/f81 x:0 0 0 2024-04-15T21:02:42.719 INFO:tasks.workunit.client.1.smithi149.stdout:1/528: dwrite d1/db/dc/d38/f63 [0,4194304] 0 2024-04-15T21:02:42.720 INFO:tasks.workunit.client.0.smithi072.stdout:0/385: rename d0/d45/d7a to d0/d45/d7a/d5d/d82 22 2024-04-15T21:02:42.721 INFO:tasks.workunit.client.1.smithi149.stdout:8/667: write d2/df/d10/d4e/d9f/fa5 [664044,128174] 0 2024-04-15T21:02:42.723 INFO:tasks.workunit.client.0.smithi072.stdout:1/373: creat d5/db/d2d/d3a/d1f/f79 x:0 0 0 2024-04-15T21:02:42.726 INFO:tasks.workunit.client.0.smithi072.stdout:8/412: sync 2024-04-15T21:02:42.726 INFO:tasks.workunit.client.0.smithi072.stdout:7/383: sync 2024-04-15T21:02:42.728 INFO:tasks.workunit.client.0.smithi072.stdout:1/374: dwrite d5/db/d27/f33 [0,4194304] 0 2024-04-15T21:02:42.730 INFO:tasks.workunit.client.0.smithi072.stdout:0/386: creat d0/d6/d6d/f83 x:0 0 0 2024-04-15T21:02:42.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/375: truncate d5/db/d2d/d3a/d1f/f78 65587 0 2024-04-15T21:02:42.731 INFO:tasks.workunit.client.1.smithi149.stdout:5/568: truncate d0/d6/d82/da1/d12/d16/da9/d1b/d83/f85 1159492 0 2024-04-15T21:02:42.732 INFO:tasks.workunit.client.1.smithi149.stdout:5/569: chown d0/d6/d82/da1/d12/f6e 75529 1 2024-04-15T21:02:42.732 INFO:tasks.workunit.client.0.smithi072.stdout:3/351: link d1/d5b/f60 d1/f74 0 2024-04-15T21:02:42.733 INFO:tasks.workunit.client.0.smithi072.stdout:3/352: chown d1/d5b/f62 935308 1 2024-04-15T21:02:42.737 INFO:tasks.workunit.client.0.smithi072.stdout:8/413: mkdir d3/d7e 0 2024-04-15T21:02:42.738 INFO:tasks.workunit.client.0.smithi072.stdout:8/414: chown d3/d4/d3b/c47 15158 1 2024-04-15T21:02:42.738 INFO:tasks.workunit.client.0.smithi072.stdout:2/357: dwrite d2/d38/f2a [4194304,4194304] 0 2024-04-15T21:02:42.740 INFO:tasks.workunit.client.0.smithi072.stdout:8/415: truncate d3/de/d21/d2e/f42 4235609 0 2024-04-15T21:02:42.740 INFO:tasks.workunit.client.0.smithi072.stdout:7/384: creat d2/d7/d25/d2d/d46/d5a/f7c x:0 0 0 2024-04-15T21:02:42.741 INFO:tasks.workunit.client.0.smithi072.stdout:7/385: write d2/d7/f4e [247654,92435] 0 2024-04-15T21:02:42.753 INFO:tasks.workunit.client.0.smithi072.stdout:3/353: creat d1/d5b/f75 x:0 0 0 2024-04-15T21:02:42.754 INFO:tasks.workunit.client.0.smithi072.stdout:3/354: chown d1/d5b/f60 32426 1 2024-04-15T21:02:42.754 INFO:tasks.workunit.client.0.smithi072.stdout:5/359: creat d0/f7d x:0 0 0 2024-04-15T21:02:42.755 INFO:tasks.workunit.client.0.smithi072.stdout:3/355: read d1/d15/d32/f24 [658322,47749] 0 2024-04-15T21:02:42.758 INFO:tasks.workunit.client.0.smithi072.stdout:7/386: chown d2/f5 1932760 1 2024-04-15T21:02:42.759 INFO:tasks.workunit.client.1.smithi149.stdout:4/649: sync 2024-04-15T21:02:42.760 INFO:tasks.workunit.client.0.smithi072.stdout:5/360: dwrite d0/d3/d7/d12/f54 [0,4194304] 0 2024-04-15T21:02:42.761 INFO:tasks.workunit.client.1.smithi149.stdout:2/653: creat d4/d7/d10/d6b/d21/fe1 x:0 0 0 2024-04-15T21:02:42.769 INFO:tasks.workunit.client.1.smithi149.stdout:2/654: dwrite d4/d7/d10/d6b/d21/d5e/fb9 [0,4194304] 0 2024-04-15T21:02:42.772 INFO:tasks.workunit.client.0.smithi072.stdout:9/342: truncate f3 2143741 0 2024-04-15T21:02:42.773 INFO:tasks.workunit.client.0.smithi072.stdout:2/358: dread d2/d3/f46 [0,4194304] 0 2024-04-15T21:02:42.776 INFO:tasks.workunit.client.0.smithi072.stdout:3/356: stat d1/d15/l46 0 2024-04-15T21:02:42.777 INFO:tasks.workunit.client.0.smithi072.stdout:8/416: dread d3/de/f24 [0,4194304] 0 2024-04-15T21:02:42.781 INFO:tasks.workunit.client.0.smithi072.stdout:5/361: dread d0/d3/d7/d12/f51 [0,4194304] 0 2024-04-15T21:02:42.782 INFO:tasks.workunit.client.0.smithi072.stdout:7/387: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d x:0 0 0 2024-04-15T21:02:42.783 INFO:tasks.workunit.client.0.smithi072.stdout:3/357: dwrite d1/d26/f58 [0,4194304] 0 2024-04-15T21:02:42.783 INFO:tasks.workunit.client.0.smithi072.stdout:5/362: read - d0/d3/d23/d24/f2a zero size 2024-04-15T21:02:42.790 INFO:tasks.workunit.client.0.smithi072.stdout:4/361: rmdir d7/d23/d6c 39 2024-04-15T21:02:42.790 INFO:tasks.workunit.client.0.smithi072.stdout:3/358: dwrite d1/d15/d32/f50 [0,4194304] 0 2024-04-15T21:02:42.792 INFO:tasks.workunit.client.0.smithi072.stdout:0/387: link d0/d6/f25 d0/d45/d7a/f84 0 2024-04-15T21:02:42.792 INFO:tasks.workunit.client.0.smithi072.stdout:3/359: fsync d1/d15/d32/f4a 0 2024-04-15T21:02:42.794 INFO:tasks.workunit.client.1.smithi149.stdout:8/668: symlink d2/df/d10/d25/d37/d53/daf/led 0 2024-04-15T21:02:42.798 INFO:tasks.workunit.client.0.smithi072.stdout:6/377: write d2/fa [807423,125805] 0 2024-04-15T21:02:42.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/570: unlink d0/d6/d82/da1/d12/d16/da9/f46 0 2024-04-15T21:02:42.803 INFO:tasks.workunit.client.1.smithi149.stdout:5/571: write d0/d6/d82/da1/d12/d16/da9/fb5 [344551,43556] 0 2024-04-15T21:02:42.804 INFO:tasks.workunit.client.1.smithi149.stdout:2/655: dread d4/d7/d46/f57 [4194304,4194304] 0 2024-04-15T21:02:42.810 INFO:tasks.workunit.client.0.smithi072.stdout:2/359: rmdir d2/d38 39 2024-04-15T21:02:42.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/572: dread d0/d6/d82/da1/d12/d16/da9/fb5 [0,4194304] 0 2024-04-15T21:02:42.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/573: stat d0 0 2024-04-15T21:02:42.815 INFO:tasks.workunit.client.1.smithi149.stdout:4/650: chown dc/d2c/d3e/d35/d4b/d6c/fa9 58048014 1 2024-04-15T21:02:42.816 INFO:tasks.workunit.client.0.smithi072.stdout:8/417: symlink d3/d4/d3b/l7f 0 2024-04-15T21:02:42.818 INFO:tasks.workunit.client.0.smithi072.stdout:7/388: mkdir d2/d7/d25/d2d/d47/d7e 0 2024-04-15T21:02:42.821 INFO:tasks.workunit.client.1.smithi149.stdout:9/535: dread - d23/d2b/d70/fae zero size 2024-04-15T21:02:42.821 INFO:tasks.workunit.client.0.smithi072.stdout:1/376: getdents d5/db 0 2024-04-15T21:02:42.822 INFO:tasks.workunit.client.1.smithi149.stdout:9/536: write d23/d2b/d37/d50/fa2 [1387007,6952] 0 2024-04-15T21:02:42.823 INFO:tasks.workunit.client.0.smithi072.stdout:1/377: chown d5/db/d2d/d3a/d1f/d63/c6d 4528 1 2024-04-15T21:02:42.823 INFO:tasks.workunit.client.1.smithi149.stdout:6/526: dwrite f8 [0,4194304] 0 2024-04-15T21:02:42.828 INFO:tasks.workunit.client.1.smithi149.stdout:6/527: dread da/d11/f22 [4194304,4194304] 0 2024-04-15T21:02:42.829 INFO:tasks.workunit.client.1.smithi149.stdout:6/528: stat da/d18/d10/d66/f69 0 2024-04-15T21:02:42.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/363: rename d0/d3/d7/d12/c4e to d0/d3/d23/c7e 0 2024-04-15T21:02:42.832 INFO:tasks.workunit.client.0.smithi072.stdout:8/418: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:42.833 INFO:tasks.workunit.client.1.smithi149.stdout:3/636: mkdir d1/db/d24/d39/dc0 0 2024-04-15T21:02:42.839 INFO:tasks.workunit.client.0.smithi072.stdout:4/362: mknod d7/d15/d58/c6e 0 2024-04-15T21:02:42.839 INFO:tasks.workunit.client.0.smithi072.stdout:5/364: dwrite d0/d3/d7/f3c [0,4194304] 0 2024-04-15T21:02:42.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/360: mknod d1/d5b/c76 0 2024-04-15T21:02:42.842 INFO:tasks.workunit.client.0.smithi072.stdout:8/419: dwrite d3/de/d21/f51 [0,4194304] 0 2024-04-15T21:02:42.843 INFO:tasks.workunit.client.0.smithi072.stdout:8/420: readlink d3/de/d1b/d3f/l3a 0 2024-04-15T21:02:42.843 INFO:tasks.workunit.client.0.smithi072.stdout:3/361: chown d1/d15/d32/d2f/l3c 4 1 2024-04-15T21:02:42.844 INFO:tasks.workunit.client.0.smithi072.stdout:6/378: creat d2/d40/d56/d6a/f72 x:0 0 0 2024-04-15T21:02:42.845 INFO:tasks.workunit.client.0.smithi072.stdout:8/421: write d3/d4/d4c/f6c [266711,37021] 0 2024-04-15T21:02:42.847 INFO:tasks.workunit.client.1.smithi149.stdout:2/656: unlink d4/d7/d10/d6b/ca0 0 2024-04-15T21:02:42.848 INFO:tasks.workunit.client.1.smithi149.stdout:2/657: chown d4/d7/da/fa2 951 1 2024-04-15T21:02:42.852 INFO:tasks.workunit.client.1.smithi149.stdout:7/575: mknod d3/d16/d20/d36/cd3 0 2024-04-15T21:02:42.853 INFO:tasks.workunit.client.0.smithi072.stdout:2/360: rmdir d2/d37 39 2024-04-15T21:02:42.856 INFO:tasks.workunit.client.1.smithi149.stdout:0/766: fdatasync d1/d5/d24/d30/d43/f6a 0 2024-04-15T21:02:42.863 INFO:tasks.workunit.client.0.smithi072.stdout:1/378: fsync d5/f9 0 2024-04-15T21:02:42.863 INFO:tasks.workunit.client.0.smithi072.stdout:1/379: chown d5/db/d27/f33 13732 1 2024-04-15T21:02:42.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/574: mkdir d0/d6/d82/da1/d12/d16/da9/d1b/d61/dbd 0 2024-04-15T21:02:42.863 INFO:tasks.workunit.client.1.smithi149.stdout:4/651: mkdir dc/d18/dce/dd8 0 2024-04-15T21:02:42.867 INFO:tasks.workunit.client.0.smithi072.stdout:5/365: readlink d0/l1e 0 2024-04-15T21:02:42.873 INFO:tasks.workunit.client.0.smithi072.stdout:3/362: unlink d1/d5b/f69 0 2024-04-15T21:02:42.874 INFO:tasks.workunit.client.1.smithi149.stdout:6/529: rmdir da 39 2024-04-15T21:02:42.878 INFO:tasks.workunit.client.0.smithi072.stdout:6/379: creat d2/d42/f73 x:0 0 0 2024-04-15T21:02:42.878 INFO:tasks.workunit.client.0.smithi072.stdout:6/380: fdatasync d2/d40/d6e/f36 0 2024-04-15T21:02:42.880 INFO:tasks.workunit.client.0.smithi072.stdout:6/381: chown d2/d10/d11/d15/c5b 0 1 2024-04-15T21:02:42.880 INFO:tasks.workunit.client.0.smithi072.stdout:2/361: write d2/d3/f4c [3235254,108285] 0 2024-04-15T21:02:42.881 INFO:tasks.workunit.client.0.smithi072.stdout:6/382: write d2/d10/f27 [1595173,71708] 0 2024-04-15T21:02:42.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/576: rmdir d3/d17/d1f 39 2024-04-15T21:02:42.887 INFO:tasks.workunit.client.0.smithi072.stdout:6/383: dwrite d2/f4a [0,4194304] 0 2024-04-15T21:02:42.890 INFO:tasks.workunit.client.1.smithi149.stdout:0/767: rmdir d1/d5/d24/d50/d13/d59/dd7 39 2024-04-15T21:02:42.892 INFO:tasks.workunit.client.1.smithi149.stdout:5/575: mknod d0/d9/d3f/cbe 0 2024-04-15T21:02:42.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/537: mknod d23/d3c/d7a/d7c/d7f/d86/cbb 0 2024-04-15T21:02:42.902 INFO:tasks.workunit.client.1.smithi149.stdout:3/637: symlink d1/db/d24/lc1 0 2024-04-15T21:02:42.903 INFO:tasks.workunit.client.1.smithi149.stdout:3/638: truncate d1/db/d24/f89 169460 0 2024-04-15T21:02:42.905 INFO:tasks.workunit.client.1.smithi149.stdout:8/669: rename d2/df/d10/d25/d57/dd1/d46/d74/fba to d2/df/d10/fee 0 2024-04-15T21:02:42.908 INFO:tasks.workunit.client.0.smithi072.stdout:5/366: mknod d0/d3/d7/d12/c7f 0 2024-04-15T21:02:42.909 INFO:tasks.workunit.client.1.smithi149.stdout:7/577: mkdir d3/d16/d20/dab/dd4 0 2024-04-15T21:02:42.909 INFO:tasks.workunit.client.1.smithi149.stdout:7/578: readlink d3/d34/l3c 0 2024-04-15T21:02:42.911 INFO:tasks.workunit.client.1.smithi149.stdout:0/768: creat d1/d5/d24/d30/df7/f10e x:0 0 0 2024-04-15T21:02:42.913 INFO:tasks.workunit.client.1.smithi149.stdout:5/576: write d0/d9/db6/f7e [2312460,97038] 0 2024-04-15T21:02:42.914 INFO:tasks.workunit.client.1.smithi149.stdout:4/652: mkdir dc/d1a/dc8/dd9 0 2024-04-15T21:02:42.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/653: chown dc/d2c/d3e/d15/d3f/f6e 160 1 2024-04-15T21:02:42.921 INFO:tasks.workunit.client.0.smithi072.stdout:6/384: symlink d2/d40/d66/l74 0 2024-04-15T21:02:42.923 INFO:tasks.workunit.client.1.smithi149.stdout:3/639: mknod d1/db/d28/d87/dbd/cc2 0 2024-04-15T21:02:42.925 INFO:tasks.workunit.client.1.smithi149.stdout:2/658: creat d4/d7/d46/fe2 x:0 0 0 2024-04-15T21:02:42.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/529: truncate d1/db/dc/d11/f47 1405098 0 2024-04-15T21:02:42.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/422: getdents d3/de/d1b/d3f 0 2024-04-15T21:02:42.928 INFO:tasks.workunit.client.0.smithi072.stdout:8/423: write d3/d4/d3b/f65 [260324,75178] 0 2024-04-15T21:02:42.928 INFO:tasks.workunit.client.1.smithi149.stdout:1/530: stat d1/db/dc/d11/d3e/l4f 0 2024-04-15T21:02:42.929 INFO:tasks.workunit.client.0.smithi072.stdout:2/362: mkdir d2/d38/d73 0 2024-04-15T21:02:42.930 INFO:tasks.workunit.client.1.smithi149.stdout:8/670: dread d2/df/d10/d25/d37/d53/daf/d85/d35/fa8 [0,4194304] 0 2024-04-15T21:02:42.931 INFO:tasks.workunit.client.0.smithi072.stdout:2/363: read d2/d3/f5e [1093476,42209] 0 2024-04-15T21:02:42.931 INFO:tasks.workunit.client.0.smithi072.stdout:2/364: fsync d2/f5a 0 2024-04-15T21:02:42.931 INFO:tasks.workunit.client.1.smithi149.stdout:3/640: dwrite d1/db/d24/d8a/fbe [0,4194304] 0 2024-04-15T21:02:42.932 INFO:tasks.workunit.client.0.smithi072.stdout:2/365: write d2/d8/f3a [5022731,61276] 0 2024-04-15T21:02:42.934 INFO:tasks.workunit.client.1.smithi149.stdout:8/671: readlink d2/df/d10/d25/d37/lc5 0 2024-04-15T21:02:42.935 INFO:tasks.workunit.client.0.smithi072.stdout:6/385: fsync d2/d1a/f5f 0 2024-04-15T21:02:42.936 INFO:tasks.workunit.client.0.smithi072.stdout:6/386: dread - d2/d1a/f55 zero size 2024-04-15T21:02:42.937 INFO:tasks.workunit.client.1.smithi149.stdout:5/577: fdatasync d0/d6/f6f 0 2024-04-15T21:02:42.937 INFO:tasks.workunit.client.0.smithi072.stdout:6/387: write d2/d40/f68 [667670,21349] 0 2024-04-15T21:02:42.938 INFO:tasks.workunit.client.0.smithi072.stdout:9/343: truncate d4/d1f/d31/f44 1187560 0 2024-04-15T21:02:42.939 INFO:tasks.workunit.client.1.smithi149.stdout:3/641: dread d1/db/d23/f3a [0,4194304] 0 2024-04-15T21:02:42.941 INFO:tasks.workunit.client.0.smithi072.stdout:3/363: rename d1/fa to d1/d15/d32/f77 0 2024-04-15T21:02:42.946 INFO:tasks.workunit.client.1.smithi149.stdout:2/659: unlink d4/d7/d10/d36/f62 0 2024-04-15T21:02:42.951 INFO:tasks.workunit.client.0.smithi072.stdout:5/367: creat d0/f80 x:0 0 0 2024-04-15T21:02:42.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/368: write d0/d3/d6/d14/f18 [3744224,47097] 0 2024-04-15T21:02:42.956 INFO:tasks.workunit.client.0.smithi072.stdout:4/363: dwrite d7/d15/f33 [0,4194304] 0 2024-04-15T21:02:42.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/769: rename d1/d5/d24/d30/d92/fb3 to d1/d9/d64/df0/f10f 0 2024-04-15T21:02:42.962 INFO:tasks.workunit.client.0.smithi072.stdout:9/344: creat d4/d1f/d31/d42/f66 x:0 0 0 2024-04-15T21:02:42.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/672: symlink d2/df/d10/d25/d57/dd1/d50/d5d/d6d/lef 0 2024-04-15T21:02:42.965 INFO:tasks.workunit.client.0.smithi072.stdout:8/424: symlink d3/d4/d76/l80 0 2024-04-15T21:02:42.966 INFO:tasks.workunit.client.1.smithi149.stdout:9/538: rmdir d23/d3c/d7a/d7c/d7f 39 2024-04-15T21:02:42.967 INFO:tasks.workunit.client.0.smithi072.stdout:8/425: write d3/de/d1b/d3f/f75 [1181828,45763] 0 2024-04-15T21:02:42.967 INFO:tasks.workunit.client.0.smithi072.stdout:8/426: chown d3/l29 3946516 1 2024-04-15T21:02:42.967 INFO:tasks.workunit.client.0.smithi072.stdout:3/364: dread d1/d26/f30 [0,4194304] 0 2024-04-15T21:02:42.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/642: rmdir d1/db/d24/d4d/d63 39 2024-04-15T21:02:42.971 INFO:tasks.workunit.client.0.smithi072.stdout:0/388: sync 2024-04-15T21:02:42.973 INFO:tasks.workunit.client.0.smithi072.stdout:0/389: fdatasync d0/d45/d35/d3a/f50 0 2024-04-15T21:02:42.975 INFO:tasks.workunit.client.0.smithi072.stdout:8/427: dwrite d3/de/d21/f51 [0,4194304] 0 2024-04-15T21:02:42.975 INFO:tasks.workunit.client.1.smithi149.stdout:6/530: creat da/d18/d10/fa3 x:0 0 0 2024-04-15T21:02:42.977 INFO:tasks.workunit.client.0.smithi072.stdout:6/388: dread d2/fc [0,4194304] 0 2024-04-15T21:02:42.978 INFO:tasks.workunit.client.0.smithi072.stdout:4/364: mkdir d7/d15/d58/d62/d6f 0 2024-04-15T21:02:42.979 INFO:tasks.workunit.client.0.smithi072.stdout:5/369: dread d0/d3/d6/d14/f18 [0,4194304] 0 2024-04-15T21:02:42.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/660: creat d4/d7/d29/fe3 x:0 0 0 2024-04-15T21:02:42.985 INFO:tasks.workunit.client.0.smithi072.stdout:6/389: dwrite d2/d40/d6e/f4e [0,4194304] 0 2024-04-15T21:02:42.997 INFO:tasks.workunit.client.0.smithi072.stdout:6/390: dread d2/d40/d6e/f36 [0,4194304] 0 2024-04-15T21:02:42.999 INFO:tasks.workunit.client.1.smithi149.stdout:5/578: mkdir d0/d6/d82/da1/d12/d16/da9/d9b/db7/dbf 0 2024-04-15T21:02:43.001 INFO:tasks.workunit.client.1.smithi149.stdout:9/539: symlink d23/d2b/d37/d50/db3/lbc 0 2024-04-15T21:02:43.010 INFO:tasks.workunit.client.1.smithi149.stdout:1/531: link d1/db/dc/d11/d3f/c46 d1/db/dc/d38/d39/d88/c99 0 2024-04-15T21:02:43.010 INFO:tasks.workunit.client.0.smithi072.stdout:1/380: sync 2024-04-15T21:02:43.011 INFO:tasks.workunit.client.0.smithi072.stdout:7/389: sync 2024-04-15T21:02:43.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/531: dwrite da/d18/f86 [0,4194304] 0 2024-04-15T21:02:43.013 INFO:tasks.workunit.client.1.smithi149.stdout:6/532: read da/d18/f23 [5777280,84214] 0 2024-04-15T21:02:43.013 INFO:tasks.workunit.client.0.smithi072.stdout:5/370: rename d0/d3/d23/d24 to d0/d3/d33/d60/d81 0 2024-04-15T21:02:43.015 INFO:tasks.workunit.client.0.smithi072.stdout:5/371: truncate d0/d3/d7/d12/d1d/f3e 501235 0 2024-04-15T21:02:43.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/579: link d3/da9/cae d3/d16/d20/d6c/d91/cd5 0 2024-04-15T21:02:43.015 INFO:tasks.workunit.client.1.smithi149.stdout:6/533: write da/d18/d10/f99 [2818451,95125] 0 2024-04-15T21:02:43.018 INFO:tasks.workunit.client.0.smithi072.stdout:6/391: creat d2/d1a/f75 x:0 0 0 2024-04-15T21:02:43.019 INFO:tasks.workunit.client.0.smithi072.stdout:2/366: write d2/d37/f49 [4350596,110980] 0 2024-04-15T21:02:43.020 INFO:tasks.workunit.client.0.smithi072.stdout:0/390: mknod d0/d74/c85 0 2024-04-15T21:02:43.022 INFO:tasks.workunit.client.0.smithi072.stdout:8/428: mkdir d3/de/d81 0 2024-04-15T21:02:43.023 INFO:tasks.workunit.client.0.smithi072.stdout:0/391: fsync d0/d19/d2b/f43 0 2024-04-15T21:02:43.024 INFO:tasks.workunit.client.0.smithi072.stdout:5/372: dwrite d0/f80 [0,4194304] 0 2024-04-15T21:02:43.025 INFO:tasks.workunit.client.0.smithi072.stdout:4/365: fdatasync d7/f38 0 2024-04-15T21:02:43.026 INFO:tasks.workunit.client.1.smithi149.stdout:5/579: fsync d0/d6/d82/da1/d12/d16/f54 0 2024-04-15T21:02:43.027 INFO:tasks.workunit.client.0.smithi072.stdout:5/373: write d0/d3/d7/d1f/d4c/f5d [2170908,56216] 0 2024-04-15T21:02:43.028 INFO:tasks.workunit.client.0.smithi072.stdout:9/345: link d4/c27 d4/d1f/d2c/d62/c67 0 2024-04-15T21:02:43.028 INFO:tasks.workunit.client.0.smithi072.stdout:5/374: chown d0/d3/f4 21 1 2024-04-15T21:02:43.030 INFO:tasks.workunit.client.1.smithi149.stdout:9/540: mkdir d23/d3c/d7a/da5/dbd 0 2024-04-15T21:02:43.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/365: write d1/f2e [924275,109113] 0 2024-04-15T21:02:43.031 INFO:tasks.workunit.client.0.smithi072.stdout:1/381: creat d5/d31/d51/f7a x:0 0 0 2024-04-15T21:02:43.034 INFO:tasks.workunit.client.0.smithi072.stdout:3/366: dread d1/d26/f58 [0,4194304] 0 2024-04-15T21:02:43.034 INFO:tasks.workunit.client.1.smithi149.stdout:3/643: mkdir d1/db/d24/d4d/d63/d65/dc3 0 2024-04-15T21:02:43.036 INFO:tasks.workunit.client.1.smithi149.stdout:4/654: link dc/d1a/c72 dc/d18/cda 0 2024-04-15T21:02:43.036 INFO:tasks.workunit.client.0.smithi072.stdout:3/367: truncate d1/d15/d32/d2f/f5c 1003038 0 2024-04-15T21:02:43.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/368: write d1/f28 [2654960,50765] 0 2024-04-15T21:02:43.038 INFO:tasks.workunit.client.1.smithi149.stdout:2/661: getdents d4/d7/da 0 2024-04-15T21:02:43.045 INFO:tasks.workunit.client.0.smithi072.stdout:6/392: read d2/d10/d18/f39 [332526,32214] 0 2024-04-15T21:02:43.046 INFO:tasks.workunit.client.1.smithi149.stdout:6/534: readlink da/l1e 0 2024-04-15T21:02:43.047 INFO:tasks.workunit.client.0.smithi072.stdout:7/390: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f2a [4194304,4194304] 0 2024-04-15T21:02:43.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/580: mkdir d3/d16/d32/d90/dad/dc4/dd6 0 2024-04-15T21:02:43.051 INFO:tasks.workunit.client.0.smithi072.stdout:2/367: dread d2/d38/f48 [0,4194304] 0 2024-04-15T21:02:43.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/392: fdatasync d0/d6/d55/f5f 0 2024-04-15T21:02:43.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/393: chown d0/d45/d7a/d70/d59 74297 1 2024-04-15T21:02:43.058 INFO:tasks.workunit.client.1.smithi149.stdout:8/673: dwrite d2/df/d10/d25/d32/f39 [0,4194304] 0 2024-04-15T21:02:43.059 INFO:tasks.workunit.client.0.smithi072.stdout:1/382: dread d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:43.062 INFO:tasks.workunit.client.1.smithi149.stdout:5/580: creat d0/d6/d82/da1/d12/d16/da9/d1b/d60/fc0 x:0 0 0 2024-04-15T21:02:43.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/581: chown d0/d9/f22 754889711 1 2024-04-15T21:02:43.064 INFO:tasks.workunit.client.1.smithi149.stdout:9/541: dread d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:43.065 INFO:tasks.workunit.client.1.smithi149.stdout:5/582: chown d0/d9/d3f/d47/caf 1 1 2024-04-15T21:02:43.065 INFO:tasks.workunit.client.1.smithi149.stdout:9/542: dread - d23/d2b/d44/f5b zero size 2024-04-15T21:02:43.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/583: stat d0/d6/d82/da1/d12/d16/da9/d9b 0 2024-04-15T21:02:43.066 INFO:tasks.workunit.client.1.smithi149.stdout:9/543: write d23/d3c/f67 [1818981,74729] 0 2024-04-15T21:02:43.073 INFO:tasks.workunit.client.1.smithi149.stdout:4/655: mknod dc/d18/d21/cdb 0 2024-04-15T21:02:43.074 INFO:tasks.workunit.client.0.smithi072.stdout:0/394: dread d0/d45/d35/d3a/f6c [0,4194304] 0 2024-04-15T21:02:43.074 INFO:tasks.workunit.client.1.smithi149.stdout:1/532: dwrite d1/db/f65 [0,4194304] 0 2024-04-15T21:02:43.075 INFO:tasks.workunit.client.1.smithi149.stdout:1/533: chown d1/d17/d52/d42 16059 1 2024-04-15T21:02:43.076 INFO:tasks.workunit.client.0.smithi072.stdout:4/366: creat d7/d28/d42/f70 x:0 0 0 2024-04-15T21:02:43.076 INFO:tasks.workunit.client.0.smithi072.stdout:4/367: readlink d7/l13 0 2024-04-15T21:02:43.077 INFO:tasks.workunit.client.0.smithi072.stdout:5/375: write d0/f59 [3488393,93020] 0 2024-04-15T21:02:43.079 INFO:tasks.workunit.client.0.smithi072.stdout:5/376: write d0/d3/d7/d12/f1a [5692967,91818] 0 2024-04-15T21:02:43.084 INFO:tasks.workunit.client.1.smithi149.stdout:0/770: link d1/d9/d64/d65/fcc d1/d5/d24/d50/d13/d38/f110 0 2024-04-15T21:02:43.085 INFO:tasks.workunit.client.1.smithi149.stdout:8/674: symlink d2/df/d10/d25/d32/d45/d77/lf0 0 2024-04-15T21:02:43.086 INFO:tasks.workunit.client.0.smithi072.stdout:6/393: creat d2/d40/d56/f76 x:0 0 0 2024-04-15T21:02:43.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/429: mkdir d3/d4/d82 0 2024-04-15T21:02:43.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/430: stat d3/de 0 2024-04-15T21:02:43.090 INFO:tasks.workunit.client.0.smithi072.stdout:2/368: creat d2/d66/f74 x:0 0 0 2024-04-15T21:02:43.092 INFO:tasks.workunit.client.1.smithi149.stdout:5/584: chown d0/d6/d82/da1/f7f 19 1 2024-04-15T21:02:43.093 INFO:tasks.workunit.client.0.smithi072.stdout:1/383: mknod d5/d31/d51/c7b 0 2024-04-15T21:02:43.095 INFO:tasks.workunit.client.0.smithi072.stdout:1/384: fsync d5/db/d27/d5c/f64 0 2024-04-15T21:02:43.096 INFO:tasks.workunit.client.1.smithi149.stdout:4/656: creat dc/d2c/d3e/d35/fdc x:0 0 0 2024-04-15T21:02:43.096 INFO:tasks.workunit.client.0.smithi072.stdout:2/369: dwrite d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:43.101 INFO:tasks.workunit.client.0.smithi072.stdout:4/368: mkdir d7/d71 0 2024-04-15T21:02:43.102 INFO:tasks.workunit.client.1.smithi149.stdout:3/644: dwrite d1/db/d23/f3a [0,4194304] 0 2024-04-15T21:02:43.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/771: rename d1/d5/d24/d50/d15/f5d to d1/d9/d64/d73/f111 0 2024-04-15T21:02:43.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/675: creat d2/df/d10/d25/d57/dd1/d50/d5d/dc6/ff1 x:0 0 0 2024-04-15T21:02:43.107 INFO:tasks.workunit.client.0.smithi072.stdout:3/369: mkdir d1/d15/d32/d78 0 2024-04-15T21:02:43.108 INFO:tasks.workunit.client.1.smithi149.stdout:9/544: truncate d23/f3a 1811123 0 2024-04-15T21:02:43.112 INFO:tasks.workunit.client.1.smithi149.stdout:7/581: dread d3/d17/d1f/f8e [0,4194304] 0 2024-04-15T21:02:43.114 INFO:tasks.workunit.client.1.smithi149.stdout:5/585: creat d0/d9/d3f/fc1 x:0 0 0 2024-04-15T21:02:43.117 INFO:tasks.workunit.client.1.smithi149.stdout:9/545: dread d23/d3c/d52/f58 [0,4194304] 0 2024-04-15T21:02:43.121 INFO:tasks.workunit.client.0.smithi072.stdout:7/391: creat d2/d78/f7f x:0 0 0 2024-04-15T21:02:43.121 INFO:tasks.workunit.client.0.smithi072.stdout:6/394: unlink d2/d40/d56/d6a/d70/f3a 0 2024-04-15T21:02:43.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/535: dread da/d11/f35 [4194304,4194304] 0 2024-04-15T21:02:43.124 INFO:tasks.workunit.client.0.smithi072.stdout:0/395: symlink d0/d3/l86 0 2024-04-15T21:02:43.126 INFO:tasks.workunit.client.0.smithi072.stdout:0/396: fsync d0/d45/d52/d7b/f7e 0 2024-04-15T21:02:43.126 INFO:tasks.workunit.client.1.smithi149.stdout:4/657: rename dc/d2c/d3e/d35/d4b/d75/fa4 to dc/d2c/fdd 0 2024-04-15T21:02:43.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/658: stat dc/d2c/d3e/d35/d4b/f57 0 2024-04-15T21:02:43.128 INFO:tasks.workunit.client.1.smithi149.stdout:0/772: symlink d1/d5/d24/d50/de2/l112 0 2024-04-15T21:02:43.131 INFO:tasks.workunit.client.0.smithi072.stdout:5/377: creat d0/d3/d6/d14/d61/f82 x:0 0 0 2024-04-15T21:02:43.134 INFO:tasks.workunit.client.0.smithi072.stdout:6/395: fsync d2/d42/f45 0 2024-04-15T21:02:43.135 INFO:tasks.workunit.client.1.smithi149.stdout:2/662: getdents d4/d7/d10/d6b/db6 0 2024-04-15T21:02:43.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/546: mkdir d23/d2b/d37/d50/dbe 0 2024-04-15T21:02:43.139 INFO:tasks.workunit.client.1.smithi149.stdout:9/547: dread - d23/d2b/fa0 zero size 2024-04-15T21:02:43.139 INFO:tasks.workunit.client.1.smithi149.stdout:6/536: creat da/d49/fa4 x:0 0 0 2024-04-15T21:02:43.141 INFO:tasks.workunit.client.1.smithi149.stdout:6/537: write da/d49/fa4 [341933,130301] 0 2024-04-15T21:02:43.141 INFO:tasks.workunit.client.0.smithi072.stdout:0/397: mkdir d0/d6/d6d/d87 0 2024-04-15T21:02:43.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/431: dread f1 [0,4194304] 0 2024-04-15T21:02:43.142 INFO:tasks.workunit.client.0.smithi072.stdout:0/398: chown d0/d45/d7a/f15 60 1 2024-04-15T21:02:43.142 INFO:tasks.workunit.client.1.smithi149.stdout:6/538: dread da/d49/f8d [0,4194304] 0 2024-04-15T21:02:43.142 INFO:tasks.workunit.client.1.smithi149.stdout:1/534: link d1/d17/d36/l50 d1/d17/d36/d69/l9a 0 2024-04-15T21:02:43.146 INFO:tasks.workunit.client.1.smithi149.stdout:3/645: rename d1/db/l11 to d1/db/d24/d4d/d63/lc4 0 2024-04-15T21:02:43.147 INFO:tasks.workunit.client.1.smithi149.stdout:3/646: dread - d1/db/d24/d2b/f66 zero size 2024-04-15T21:02:43.149 INFO:tasks.workunit.client.0.smithi072.stdout:8/432: dwrite d3/f33 [0,4194304] 0 2024-04-15T21:02:43.149 INFO:tasks.workunit.client.0.smithi072.stdout:4/369: link d7/d15/f2f d7/d15/d58/d62/f72 0 2024-04-15T21:02:43.149 INFO:tasks.workunit.client.1.smithi149.stdout:4/659: fsync dc/d2c/d3e/d35/d3a/f65 0 2024-04-15T21:02:43.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/396: dread d2/f14 [0,4194304] 0 2024-04-15T21:02:43.154 INFO:tasks.workunit.client.1.smithi149.stdout:8/676: mknod d2/df/d10/cf2 0 2024-04-15T21:02:43.157 INFO:tasks.workunit.client.0.smithi072.stdout:7/392: rename d2/d7/d25/l27 to d2/d7/d25/d2d/d52/d6d/l80 0 2024-04-15T21:02:43.160 INFO:tasks.workunit.client.1.smithi149.stdout:7/582: fdatasync d3/d34/fa2 0 2024-04-15T21:02:43.163 INFO:tasks.workunit.client.1.smithi149.stdout:9/548: read d23/f24 [4896281,30468] 0 2024-04-15T21:02:43.164 INFO:tasks.workunit.client.0.smithi072.stdout:4/370: creat d7/d10/d41/d44/f73 x:0 0 0 2024-04-15T21:02:43.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/397: creat d2/d40/d56/f77 x:0 0 0 2024-04-15T21:02:43.169 INFO:tasks.workunit.client.1.smithi149.stdout:1/535: read d1/d17/d52/d42/f58 [1136180,54311] 0 2024-04-15T21:02:43.171 INFO:tasks.workunit.client.1.smithi149.stdout:5/586: rename d0/d9/db6/c6b to d0/d6/d2d/cc2 0 2024-04-15T21:02:43.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/393: unlink d2/d7/d25/c68 0 2024-04-15T21:02:43.174 INFO:tasks.workunit.client.0.smithi072.stdout:1/385: truncate d5/db/f52 2121638 0 2024-04-15T21:02:43.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/394: chown d2/d7/d25/f42 705979 1 2024-04-15T21:02:43.175 INFO:tasks.workunit.client.1.smithi149.stdout:3/647: rmdir d1/db 39 2024-04-15T21:02:43.180 INFO:tasks.workunit.client.0.smithi072.stdout:7/395: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f2a [8388608,4194304] 0 2024-04-15T21:02:43.182 INFO:tasks.workunit.client.0.smithi072.stdout:9/346: sync 2024-04-15T21:02:43.183 INFO:tasks.workunit.client.0.smithi072.stdout:6/398: mknod d2/d42/c78 0 2024-04-15T21:02:43.186 INFO:tasks.workunit.client.0.smithi072.stdout:5/378: creat d0/d3/f83 x:0 0 0 2024-04-15T21:02:43.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/396: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f [0,4194304] 0 2024-04-15T21:02:43.188 INFO:tasks.workunit.client.0.smithi072.stdout:1/386: symlink d5/db/l7c 0 2024-04-15T21:02:43.191 INFO:tasks.workunit.client.0.smithi072.stdout:7/397: chown d2/d7/d25/c5b 56599 1 2024-04-15T21:02:43.194 INFO:tasks.workunit.client.1.smithi149.stdout:6/539: write da/d2e/f64 [682050,39299] 0 2024-04-15T21:02:43.195 INFO:tasks.workunit.client.0.smithi072.stdout:8/433: dwrite d3/f3c [0,4194304] 0 2024-04-15T21:02:43.196 INFO:tasks.workunit.client.0.smithi072.stdout:7/398: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f [1095834,35234] 0 2024-04-15T21:02:43.196 INFO:tasks.workunit.client.1.smithi149.stdout:0/773: dread d1/d29/d2c/d4f/f5f [0,4194304] 0 2024-04-15T21:02:43.196 INFO:tasks.workunit.client.0.smithi072.stdout:5/379: dwrite d0/d3/d7/d1f/d4c/f5d [0,4194304] 0 2024-04-15T21:02:43.198 INFO:tasks.workunit.client.1.smithi149.stdout:1/536: truncate d1/db/dc/d11/d3f/d45/f57 1419284 0 2024-04-15T21:02:43.202 INFO:tasks.workunit.client.0.smithi072.stdout:0/399: truncate d0/d6/d55/f5f 764602 0 2024-04-15T21:02:43.203 INFO:tasks.workunit.client.1.smithi149.stdout:5/587: symlink d0/d6/d9f/lc3 0 2024-04-15T21:02:43.209 INFO:tasks.workunit.client.0.smithi072.stdout:7/399: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f39 [0,4194304] 0 2024-04-15T21:02:43.215 INFO:tasks.workunit.client.1.smithi149.stdout:9/549: mkdir d23/d71/dbf 0 2024-04-15T21:02:43.218 INFO:tasks.workunit.client.1.smithi149.stdout:6/540: unlink da/d18/d10/f99 0 2024-04-15T21:02:43.219 INFO:tasks.workunit.client.0.smithi072.stdout:9/347: mknod d4/d1f/d2c/d62/c68 0 2024-04-15T21:02:43.223 INFO:tasks.workunit.client.0.smithi072.stdout:8/434: dwrite d3/d4/d4d/f73 [0,4194304] 0 2024-04-15T21:02:43.223 INFO:tasks.workunit.client.0.smithi072.stdout:6/399: symlink d2/d10/d11/l79 0 2024-04-15T21:02:43.224 INFO:tasks.workunit.client.0.smithi072.stdout:8/435: write d3/f30 [2277149,10796] 0 2024-04-15T21:02:43.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/583: creat d3/d17/d1f/fd7 x:0 0 0 2024-04-15T21:02:43.227 INFO:tasks.workunit.client.0.smithi072.stdout:0/400: rename d0/d45/d35/d3a/f75 to d0/d45/d7a/d70/d59/f88 0 2024-04-15T21:02:43.228 INFO:tasks.workunit.client.0.smithi072.stdout:5/380: dread d0/d3/d6/ff [0,4194304] 0 2024-04-15T21:02:43.229 INFO:tasks.workunit.client.0.smithi072.stdout:4/371: getdents d7/d24/d3e 0 2024-04-15T21:02:43.233 INFO:tasks.workunit.client.0.smithi072.stdout:5/381: dread d0/d3/d7/d12/f54 [0,4194304] 0 2024-04-15T21:02:43.236 INFO:tasks.workunit.client.1.smithi149.stdout:2/663: rename d4/d7/d10/d6b to d4/d7/d46/de4 0 2024-04-15T21:02:43.244 INFO:tasks.workunit.client.0.smithi072.stdout:8/436: rename d3/de/d1b/d3f/f75 to d3/de/d1b/d3f/f83 0 2024-04-15T21:02:43.244 INFO:tasks.workunit.client.0.smithi072.stdout:8/437: chown c2 24 1 2024-04-15T21:02:43.252 INFO:tasks.workunit.client.1.smithi149.stdout:5/588: dread d0/d9/db6/f62 [0,4194304] 0 2024-04-15T21:02:43.256 INFO:tasks.workunit.client.0.smithi072.stdout:5/382: dread d0/d3/d7/d12/d31/f3d [0,4194304] 0 2024-04-15T21:02:43.260 INFO:tasks.workunit.client.1.smithi149.stdout:4/660: rename dc/d2c/d3e/d35/d4b/f57 to dc/d2c/d3e/d15/fde 0 2024-04-15T21:02:43.261 INFO:tasks.workunit.client.1.smithi149.stdout:1/537: truncate d1/db/f20 2133311 0 2024-04-15T21:02:43.264 INFO:tasks.workunit.client.0.smithi072.stdout:8/438: symlink d3/l84 0 2024-04-15T21:02:43.264 INFO:tasks.workunit.client.1.smithi149.stdout:6/541: truncate da/d18/d10/f1c 3310162 0 2024-04-15T21:02:43.265 INFO:tasks.workunit.client.0.smithi072.stdout:8/439: truncate d3/d4/d3b/f55 5854806 0 2024-04-15T21:02:43.265 INFO:tasks.workunit.client.0.smithi072.stdout:4/372: mkdir d7/d23/d74 0 2024-04-15T21:02:43.268 INFO:tasks.workunit.client.0.smithi072.stdout:7/400: truncate d2/d7/d25/d2d/d46/d5a/d5f/f11 1625787 0 2024-04-15T21:02:43.270 INFO:tasks.workunit.client.1.smithi149.stdout:8/677: rename d2/df/d10/d25/d57/dc7 to d2/df/d10/d25/d57/dd1/df3 0 2024-04-15T21:02:43.273 INFO:tasks.workunit.client.1.smithi149.stdout:1/538: creat d1/db/dc/d11/f9b x:0 0 0 2024-04-15T21:02:43.274 INFO:tasks.workunit.client.1.smithi149.stdout:7/584: dwrite d3/d16/d20/d36/fbd [0,4194304] 0 2024-04-15T21:02:43.280 INFO:tasks.workunit.client.0.smithi072.stdout:5/383: creat d0/d3/d7/d12/d31/d49/f84 x:0 0 0 2024-04-15T21:02:43.283 INFO:tasks.workunit.client.1.smithi149.stdout:5/589: creat d0/fc4 x:0 0 0 2024-04-15T21:02:43.291 INFO:tasks.workunit.client.0.smithi072.stdout:4/373: unlink d7/d28/f4d 0 2024-04-15T21:02:43.292 INFO:tasks.workunit.client.0.smithi072.stdout:4/374: fdatasync d7/d10/d41/d44/f48 0 2024-04-15T21:02:43.293 INFO:tasks.workunit.client.0.smithi072.stdout:4/375: chown d7/d10/d41/d44/f73 414487 1 2024-04-15T21:02:43.297 INFO:tasks.workunit.client.0.smithi072.stdout:9/348: getdents d4/d1f/d31 0 2024-04-15T21:02:43.297 INFO:tasks.workunit.client.1.smithi149.stdout:2/664: link d4/d7/d46/de4/d21/d6d/db4/cd7 d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/ce5 0 2024-04-15T21:02:43.298 INFO:tasks.workunit.client.0.smithi072.stdout:5/384: mkdir d0/d3/d33/d85 0 2024-04-15T21:02:43.299 INFO:tasks.workunit.client.0.smithi072.stdout:7/401: dwrite d2/fa [0,4194304] 0 2024-04-15T21:02:43.301 INFO:tasks.workunit.client.0.smithi072.stdout:7/402: chown d2/d7/d25/c5b 8634190 1 2024-04-15T21:02:43.301 INFO:tasks.workunit.client.0.smithi072.stdout:5/385: write d0/d3/d7/d12/d31/d62/f64 [670837,20453] 0 2024-04-15T21:02:43.304 INFO:tasks.workunit.client.0.smithi072.stdout:5/386: truncate d0/d3/d6/d14/d61/f82 147612 0 2024-04-15T21:02:43.304 INFO:tasks.workunit.client.0.smithi072.stdout:2/370: sync 2024-04-15T21:02:43.305 INFO:tasks.workunit.client.1.smithi149.stdout:0/774: rename d1/ca5 to d1/d5/d24/d30/d92/c113 0 2024-04-15T21:02:43.309 INFO:tasks.workunit.client.0.smithi072.stdout:4/376: creat d7/d28/d42/f75 x:0 0 0 2024-04-15T21:02:43.309 INFO:tasks.workunit.client.1.smithi149.stdout:7/585: write d3/d16/d20/d60/f77 [1351678,101960] 0 2024-04-15T21:02:43.312 INFO:tasks.workunit.client.0.smithi072.stdout:6/400: getdents d2/d10/d18/d47 0 2024-04-15T21:02:43.313 INFO:tasks.workunit.client.0.smithi072.stdout:6/401: chown d2/d40/d56/d6a/d70 217287 1 2024-04-15T21:02:43.315 INFO:tasks.workunit.client.0.smithi072.stdout:1/387: truncate d5/db/d2d/d3a/f39 3251799 0 2024-04-15T21:02:43.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/648: rename d1/db/d24/d4d/d63/fa6 to d1/db/d24/d4d/d63/d65/fc5 0 2024-04-15T21:02:43.319 INFO:tasks.workunit.client.0.smithi072.stdout:5/387: mkdir d0/d3/d23/d86 0 2024-04-15T21:02:43.320 INFO:tasks.workunit.client.1.smithi149.stdout:4/661: getdents dc/d2c/d3e/d15/d3f 0 2024-04-15T21:02:43.321 INFO:tasks.workunit.client.0.smithi072.stdout:2/371: creat d2/d37/f75 x:0 0 0 2024-04-15T21:02:43.322 INFO:tasks.workunit.client.0.smithi072.stdout:7/403: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f13 [0,4194304] 0 2024-04-15T21:02:43.322 INFO:tasks.workunit.client.0.smithi072.stdout:8/440: rmdir d3/d4/d82 0 2024-04-15T21:02:43.325 INFO:tasks.workunit.client.1.smithi149.stdout:7/586: mknod d3/d39/d92/cd8 0 2024-04-15T21:02:43.325 INFO:tasks.workunit.client.1.smithi149.stdout:7/587: fsync d3/d16/fac 0 2024-04-15T21:02:43.327 INFO:tasks.workunit.client.1.smithi149.stdout:1/539: link d1/db/dc/d11/c22 d1/db/d16/d86/c9c 0 2024-04-15T21:02:43.328 INFO:tasks.workunit.client.1.smithi149.stdout:1/540: chown d1/db/dc/d38/d39/l53 121605149 1 2024-04-15T21:02:43.332 INFO:tasks.workunit.client.1.smithi149.stdout:5/590: creat d0/d6/d82/da1/d12/d16/da9/fc5 x:0 0 0 2024-04-15T21:02:43.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/591: chown d0/d9/d71 0 1 2024-04-15T21:02:43.334 INFO:tasks.workunit.client.0.smithi072.stdout:6/402: mknod d2/d10/d11/d1f/c7a 0 2024-04-15T21:02:43.334 INFO:tasks.workunit.client.1.smithi149.stdout:5/592: readlink d0/d6/d79/l87 0 2024-04-15T21:02:43.334 INFO:tasks.workunit.client.0.smithi072.stdout:6/403: dread d2/d40/d6e/f36 [0,4194304] 0 2024-04-15T21:02:43.335 INFO:tasks.workunit.client.0.smithi072.stdout:1/388: chown d5/db/d27/f34 417698 1 2024-04-15T21:02:43.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/678: getdents d2/df/d10/d25 0 2024-04-15T21:02:43.339 INFO:tasks.workunit.client.1.smithi149.stdout:8/679: fsync d2/df/d10/d4e/d9f/fde 0 2024-04-15T21:02:43.340 INFO:tasks.workunit.client.1.smithi149.stdout:7/588: creat d3/d16/d20/fd9 x:0 0 0 2024-04-15T21:02:43.342 INFO:tasks.workunit.client.1.smithi149.stdout:7/589: chown d3/d16/d32/d90/dad/dc4/dd6 1073385610 1 2024-04-15T21:02:43.343 INFO:tasks.workunit.client.1.smithi149.stdout:1/541: unlink d1/db/dc/d11/d3f/f76 0 2024-04-15T21:02:43.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/649: dread d1/db/d28/f32 [0,4194304] 0 2024-04-15T21:02:43.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/590: truncate d3/d16/d20/d6c/f9f 538259 0 2024-04-15T21:02:43.347 INFO:tasks.workunit.client.1.smithi149.stdout:5/593: mkdir d0/d6/d82/dc6 0 2024-04-15T21:02:43.349 INFO:tasks.workunit.client.1.smithi149.stdout:8/680: mkdir d2/d5b/df4 0 2024-04-15T21:02:43.349 INFO:tasks.workunit.client.1.smithi149.stdout:7/591: dwrite d3/d16/d32/fa1 [0,4194304] 0 2024-04-15T21:02:43.351 INFO:tasks.workunit.client.1.smithi149.stdout:7/592: read d3/da9/fb9 [4006584,68290] 0 2024-04-15T21:02:43.354 INFO:tasks.workunit.client.1.smithi149.stdout:9/550: rename d23/d3c/d87/d9a/la1 to d23/d3c/d7a/d7c/lc0 0 2024-04-15T21:02:43.361 INFO:tasks.workunit.client.1.smithi149.stdout:3/650: symlink d1/db/d24/d39/dc0/lc6 0 2024-04-15T21:02:43.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/651: chown d1/db/d24/d4d/d63/d65/fad 126 1 2024-04-15T21:02:43.364 INFO:tasks.workunit.client.0.smithi072.stdout:4/377: mkdir d7/d23/d74/d76 0 2024-04-15T21:02:43.364 INFO:tasks.workunit.client.0.smithi072.stdout:9/349: rename d4/d1f/l3c to d4/d1f/d2c/l69 0 2024-04-15T21:02:43.364 INFO:tasks.workunit.client.0.smithi072.stdout:6/404: mknod d2/d40/d56/d6a/d70/c7b 0 2024-04-15T21:02:43.365 INFO:tasks.workunit.client.1.smithi149.stdout:3/652: read d1/db/d24/d4d/d63/d65/f91 [388283,61438] 0 2024-04-15T21:02:43.367 INFO:tasks.workunit.client.0.smithi072.stdout:1/389: unlink d5/d31/d51/l6c 0 2024-04-15T21:02:43.367 INFO:tasks.workunit.client.1.smithi149.stdout:0/775: truncate d1/d5/d24/d50/d13/d38/fd1 2641700 0 2024-04-15T21:02:43.368 INFO:tasks.workunit.client.0.smithi072.stdout:1/390: readlink d5/db/d2d/d3a/l2c 0 2024-04-15T21:02:43.370 INFO:tasks.workunit.client.1.smithi149.stdout:3/653: dread d1/db/d28/fbf [0,4194304] 0 2024-04-15T21:02:43.371 INFO:tasks.workunit.client.1.smithi149.stdout:7/593: dread d3/f47 [0,4194304] 0 2024-04-15T21:02:43.372 INFO:tasks.workunit.client.1.smithi149.stdout:3/654: write d1/db/d24/d4d/d63/d65/f91 [1036910,40693] 0 2024-04-15T21:02:43.373 INFO:tasks.workunit.client.1.smithi149.stdout:7/594: dread - d3/d16/d32/d90/fc1 zero size 2024-04-15T21:02:43.375 INFO:tasks.workunit.client.0.smithi072.stdout:8/441: mkdir d3/de/d1b/d85 0 2024-04-15T21:02:43.377 INFO:tasks.workunit.client.0.smithi072.stdout:6/405: symlink d2/d40/l7c 0 2024-04-15T21:02:43.379 INFO:tasks.workunit.client.1.smithi149.stdout:6/542: rename da/d32/f9d to da/d49/fa5 0 2024-04-15T21:02:43.381 INFO:tasks.workunit.client.1.smithi149.stdout:5/594: write d0/d6/f6f [1348474,99687] 0 2024-04-15T21:02:43.382 INFO:tasks.workunit.client.0.smithi072.stdout:9/350: rmdir d4/d1f/d31 39 2024-04-15T21:02:43.384 INFO:tasks.workunit.client.0.smithi072.stdout:4/378: dwrite d7/d10/f11 [4194304,4194304] 0 2024-04-15T21:02:43.385 INFO:tasks.workunit.client.0.smithi072.stdout:4/379: truncate d7/f4f 704171 0 2024-04-15T21:02:43.386 INFO:tasks.workunit.client.1.smithi149.stdout:0/776: creat d1/d5/dda/f114 x:0 0 0 2024-04-15T21:02:43.386 INFO:tasks.workunit.client.0.smithi072.stdout:4/380: stat d7/d24/d3e/d5e/d6b 0 2024-04-15T21:02:43.387 INFO:tasks.workunit.client.0.smithi072.stdout:4/381: chown d7/d10/d41/d4c 61 1 2024-04-15T21:02:43.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/777: chown d1/d5/d24/d30/d43/ceb 38994 1 2024-04-15T21:02:43.388 INFO:tasks.workunit.client.1.smithi149.stdout:1/542: getdents d1/db/dc/d11 0 2024-04-15T21:02:43.390 INFO:tasks.workunit.client.1.smithi149.stdout:3/655: creat d1/db/d24/d39/d79/d97/fc7 x:0 0 0 2024-04-15T21:02:43.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/595: mknod d3/d16/d32/d90/dad/dc4/cda 0 2024-04-15T21:02:43.397 INFO:tasks.workunit.client.1.smithi149.stdout:8/681: truncate d2/df/d10/f23 3024986 0 2024-04-15T21:02:43.401 INFO:tasks.workunit.client.1.smithi149.stdout:2/665: rename d4/d7/d46/d74/f87 to d4/d7/d46/de4/db6/fe6 0 2024-04-15T21:02:43.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/551: write d23/f47 [1965253,86121] 0 2024-04-15T21:02:43.406 INFO:tasks.workunit.client.0.smithi072.stdout:2/372: getdents d2/d64 0 2024-04-15T21:02:43.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/370: sync 2024-04-15T21:02:43.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/371: chown d1/c4c 474 1 2024-04-15T21:02:43.407 INFO:tasks.workunit.client.0.smithi072.stdout:4/382: fdatasync d7/d24/f59 0 2024-04-15T21:02:43.407 INFO:tasks.workunit.client.1.smithi149.stdout:5/595: mkdir d0/d9/d3f/dc7 0 2024-04-15T21:02:43.408 INFO:tasks.workunit.client.1.smithi149.stdout:1/543: dread d1/f5 [0,4194304] 0 2024-04-15T21:02:43.409 INFO:tasks.workunit.client.0.smithi072.stdout:7/404: getdents d2/d7 0 2024-04-15T21:02:43.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/405: readlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/l23 0 2024-04-15T21:02:43.412 INFO:tasks.workunit.client.0.smithi072.stdout:7/406: write d2/d7/d25/d2d/d46/d5a/d5f/d43/f53 [1013523,55321] 0 2024-04-15T21:02:43.412 INFO:tasks.workunit.client.0.smithi072.stdout:8/442: creat d3/de/d81/f86 x:0 0 0 2024-04-15T21:02:43.417 INFO:tasks.workunit.client.1.smithi149.stdout:6/543: write da/d11/f22 [2903671,26530] 0 2024-04-15T21:02:43.417 INFO:tasks.workunit.client.0.smithi072.stdout:6/406: dwrite d2/d10/d11/d15/f20 [8388608,4194304] 0 2024-04-15T21:02:43.418 INFO:tasks.workunit.client.0.smithi072.stdout:6/407: read d2/fc [633919,127459] 0 2024-04-15T21:02:43.419 INFO:tasks.workunit.client.1.smithi149.stdout:3/656: write d1/db/d40/d56/d84/d85/f93 [722780,126600] 0 2024-04-15T21:02:43.419 INFO:tasks.workunit.client.0.smithi072.stdout:1/391: creat d5/f7d x:0 0 0 2024-04-15T21:02:43.421 INFO:tasks.workunit.client.0.smithi072.stdout:2/373: write d2/d38/f48 [4425363,82177] 0 2024-04-15T21:02:43.422 INFO:tasks.workunit.client.1.smithi149.stdout:8/682: creat d2/df/d10/d25/d57/ff5 x:0 0 0 2024-04-15T21:02:43.423 INFO:tasks.workunit.client.0.smithi072.stdout:4/383: creat d7/d15/d58/f77 x:0 0 0 2024-04-15T21:02:43.424 INFO:tasks.workunit.client.0.smithi072.stdout:4/384: readlink d7/l17 0 2024-04-15T21:02:43.425 INFO:tasks.workunit.client.1.smithi149.stdout:6/544: dwrite da/d18/d10/f68 [0,4194304] 0 2024-04-15T21:02:43.426 INFO:tasks.workunit.client.0.smithi072.stdout:2/374: dread d2/d38/f2a [4194304,4194304] 0 2024-04-15T21:02:43.426 INFO:tasks.workunit.client.1.smithi149.stdout:4/662: rename dc/d2c/d3e/d35/d4b/d75/db3/dcc to dc/ddf 0 2024-04-15T21:02:43.427 INFO:tasks.workunit.client.0.smithi072.stdout:3/372: symlink d1/d15/d32/d2f/l79 0 2024-04-15T21:02:43.428 INFO:tasks.workunit.client.0.smithi072.stdout:7/407: mkdir d2/d7/d25/d81 0 2024-04-15T21:02:43.432 INFO:tasks.workunit.client.1.smithi149.stdout:5/596: mkdir d0/d6/dc8 0 2024-04-15T21:02:43.434 INFO:tasks.workunit.client.0.smithi072.stdout:9/351: creat d4/f6a x:0 0 0 2024-04-15T21:02:43.436 INFO:tasks.workunit.client.0.smithi072.stdout:1/392: mknod d5/db/d2d/d3a/d1f/c7e 0 2024-04-15T21:02:43.440 INFO:tasks.workunit.client.0.smithi072.stdout:4/385: mknod d7/d10/d41/c78 0 2024-04-15T21:02:43.441 INFO:tasks.workunit.client.1.smithi149.stdout:5/597: dwrite d0/d9/fa2 [0,4194304] 0 2024-04-15T21:02:43.443 INFO:tasks.workunit.client.1.smithi149.stdout:5/598: write d0/d6/d82/da1/fb2 [4569705,83635] 0 2024-04-15T21:02:43.444 INFO:tasks.workunit.client.0.smithi072.stdout:3/373: fdatasync d1/f64 0 2024-04-15T21:02:43.447 INFO:tasks.workunit.client.0.smithi072.stdout:7/408: creat d2/d7/d25/d2d/d46/d5a/d5f/f82 x:0 0 0 2024-04-15T21:02:43.448 INFO:tasks.workunit.client.1.smithi149.stdout:7/596: mknod d3/d16/d32/d90/dad/dc4/dd6/cdb 0 2024-04-15T21:02:43.449 INFO:tasks.workunit.client.1.smithi149.stdout:3/657: dread d1/db/d24/d39/f70 [0,4194304] 0 2024-04-15T21:02:43.455 INFO:tasks.workunit.client.1.smithi149.stdout:0/778: write d1/d9/f6f [1429180,82228] 0 2024-04-15T21:02:43.458 INFO:tasks.workunit.client.1.smithi149.stdout:3/658: dwrite d1/db/d24/d4d/d63/d65/fad [0,4194304] 0 2024-04-15T21:02:43.464 INFO:tasks.workunit.client.0.smithi072.stdout:2/375: dwrite d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:43.466 INFO:tasks.workunit.client.0.smithi072.stdout:3/374: symlink d1/d3f/d4f/l7a 0 2024-04-15T21:02:43.467 INFO:tasks.workunit.client.1.smithi149.stdout:4/663: dwrite dc/d2c/d3e/d35/d4b/d6c/fa9 [4194304,4194304] 0 2024-04-15T21:02:43.467 INFO:tasks.workunit.client.0.smithi072.stdout:8/443: truncate d3/de/f20 3659375 0 2024-04-15T21:02:43.469 INFO:tasks.workunit.client.1.smithi149.stdout:6/545: write da/d32/f43 [4574373,116994] 0 2024-04-15T21:02:43.471 INFO:tasks.workunit.client.0.smithi072.stdout:9/352: mknod d4/d1f/d31/d42/c6b 0 2024-04-15T21:02:43.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/599: fdatasync d0/d6/d82/da1/f2e 0 2024-04-15T21:02:43.473 INFO:tasks.workunit.client.0.smithi072.stdout:9/353: fsync d4/d1f/d2c/d47/f5f 0 2024-04-15T21:02:43.476 INFO:tasks.workunit.client.0.smithi072.stdout:8/444: dwrite d3/de/d1b/f57 [0,4194304] 0 2024-04-15T21:02:43.479 INFO:tasks.workunit.client.1.smithi149.stdout:7/597: symlink d3/d16/d20/dab/ldc 0 2024-04-15T21:02:43.480 INFO:tasks.workunit.client.1.smithi149.stdout:8/683: getdents d2/d5b/dcd 0 2024-04-15T21:02:43.484 INFO:tasks.workunit.client.1.smithi149.stdout:2/666: rename d4/d7/d10/f81 to d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/fe7 0 2024-04-15T21:02:43.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/664: symlink dc/d2c/d3e/d35/d4b/d75/d80/le0 0 2024-04-15T21:02:43.490 INFO:tasks.workunit.client.1.smithi149.stdout:7/598: creat d3/d16/d20/fdd x:0 0 0 2024-04-15T21:02:43.493 INFO:tasks.workunit.client.1.smithi149.stdout:8/684: symlink d2/df/d10/d25/d57/dd1/d50/d5d/dc6/lf6 0 2024-04-15T21:02:43.493 INFO:tasks.workunit.client.1.smithi149.stdout:7/599: read d3/d16/d20/f41 [3334276,115978] 0 2024-04-15T21:02:43.493 INFO:tasks.workunit.client.1.smithi149.stdout:2/667: symlink d4/d7/d46/de4/db6/le8 0 2024-04-15T21:02:43.495 INFO:tasks.workunit.client.1.smithi149.stdout:3/659: mkdir d1/db/d24/d4d/d63/db6/dc8 0 2024-04-15T21:02:43.497 INFO:tasks.workunit.client.1.smithi149.stdout:3/660: write d1/db/d24/d4d/f9d [459136,119562] 0 2024-04-15T21:02:43.499 INFO:tasks.workunit.client.1.smithi149.stdout:4/665: mkdir dc/d2c/de1 0 2024-04-15T21:02:43.505 INFO:tasks.workunit.client.1.smithi149.stdout:8/685: creat d2/df/d10/d25/d37/d53/daf/ff7 x:0 0 0 2024-04-15T21:02:43.506 INFO:tasks.workunit.client.1.smithi149.stdout:1/544: link d1/db/f20 d1/db/d14/f9d 0 2024-04-15T21:02:43.510 INFO:tasks.workunit.client.1.smithi149.stdout:5/600: dread d0/d6/d82/da1/f5e [0,4194304] 0 2024-04-15T21:02:43.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/601: chown d0/d6/d82/da1/cae 10411615 1 2024-04-15T21:02:43.512 INFO:tasks.workunit.client.1.smithi149.stdout:5/602: chown d0/d9/c6d 74315 1 2024-04-15T21:02:43.512 INFO:tasks.workunit.client.1.smithi149.stdout:4/666: fsync dc/d2c/d3e/d15/d3f/f87 0 2024-04-15T21:02:43.514 INFO:tasks.workunit.client.1.smithi149.stdout:0/779: getdents d1/d9 0 2024-04-15T21:02:43.515 INFO:tasks.workunit.client.1.smithi149.stdout:8/686: creat d2/df/d10/d25/d37/d53/daf/ff8 x:0 0 0 2024-04-15T21:02:43.516 INFO:tasks.workunit.client.1.smithi149.stdout:0/780: chown d1/d5/d24/d50/d13 1977 1 2024-04-15T21:02:43.518 INFO:tasks.workunit.client.1.smithi149.stdout:6/546: getdents da/d49/d55/da0 0 2024-04-15T21:02:43.520 INFO:tasks.workunit.client.1.smithi149.stdout:9/552: dwrite d23/d46/f73 [0,4194304] 0 2024-04-15T21:02:43.523 INFO:tasks.workunit.client.1.smithi149.stdout:5/603: mknod d0/d9/d3f/cc9 0 2024-04-15T21:02:43.529 INFO:tasks.workunit.client.1.smithi149.stdout:1/545: dread d1/db/f33 [4194304,4194304] 0 2024-04-15T21:02:43.529 INFO:tasks.workunit.client.1.smithi149.stdout:1/546: fdatasync d1/f62 0 2024-04-15T21:02:43.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/661: creat d1/db/d24/fc9 x:0 0 0 2024-04-15T21:02:43.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/667: write dc/d2c/d3e/d15/d3f/f87 [4487882,11868] 0 2024-04-15T21:02:43.539 INFO:tasks.workunit.client.1.smithi149.stdout:9/553: dread - d23/d3c/d7a/d7c/d7f/d86/fb7 zero size 2024-04-15T21:02:43.540 INFO:tasks.workunit.client.1.smithi149.stdout:3/662: truncate d1/db/d24/fc9 949343 0 2024-04-15T21:02:43.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/600: dwrite d3/d17/d1f/f22 [0,4194304] 0 2024-04-15T21:02:43.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/547: creat da/d11/d90/fa6 x:0 0 0 2024-04-15T21:02:43.547 INFO:tasks.workunit.client.0.smithi072.stdout:0/401: sync 2024-04-15T21:02:43.547 INFO:tasks.workunit.client.1.smithi149.stdout:8/687: write d2/f8d [372339,83102] 0 2024-04-15T21:02:43.547 INFO:tasks.workunit.client.0.smithi072.stdout:7/409: mknod d2/d7/d25/d81/c83 0 2024-04-15T21:02:43.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/668: dwrite d4/d7/d46/de4/d21/d2c/d32/d4a/fb2 [0,4194304] 0 2024-04-15T21:02:43.548 INFO:tasks.workunit.client.1.smithi149.stdout:9/554: stat d23/d2b/d37/d50/d79/d8d 0 2024-04-15T21:02:43.549 INFO:tasks.workunit.client.0.smithi072.stdout:4/386: truncate d7/d28/f40 339552 0 2024-04-15T21:02:43.549 INFO:tasks.workunit.client.0.smithi072.stdout:0/402: stat d0/d45/d35/l6b 0 2024-04-15T21:02:43.551 INFO:tasks.workunit.client.1.smithi149.stdout:5/604: rmdir d0/d6/d82/da1/d12/d16/da9/d9b/db7/dbf 0 2024-04-15T21:02:43.551 INFO:tasks.workunit.client.0.smithi072.stdout:0/403: write d0/d45/d52/f65 [66440,62019] 0 2024-04-15T21:02:43.552 INFO:tasks.workunit.client.0.smithi072.stdout:0/404: write d0/d3/fe [383991,125536] 0 2024-04-15T21:02:43.553 INFO:tasks.workunit.client.1.smithi149.stdout:0/781: write d1/d9/d64/df0/f10f [771560,36575] 0 2024-04-15T21:02:43.553 INFO:tasks.workunit.client.0.smithi072.stdout:3/375: symlink d1/d3f/d4f/d73/l7b 0 2024-04-15T21:02:43.554 INFO:tasks.workunit.client.1.smithi149.stdout:6/548: truncate da/d11/f1a 1578359 0 2024-04-15T21:02:43.556 INFO:tasks.workunit.client.0.smithi072.stdout:1/393: link d5/db/d2d/f3e d5/db/d2d/d56/f7f 0 2024-04-15T21:02:43.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/547: truncate d1/db/f37 1036213 0 2024-04-15T21:02:43.559 INFO:tasks.workunit.client.0.smithi072.stdout:1/394: read - d5/db/d2d/d3a/d1f/d63/f68 zero size 2024-04-15T21:02:43.563 INFO:tasks.workunit.client.1.smithi149.stdout:0/782: unlink d1/d5/d24/f9e 0 2024-04-15T21:02:43.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/548: write d1/db/f8d [89620,9470] 0 2024-04-15T21:02:43.564 INFO:tasks.workunit.client.0.smithi072.stdout:8/445: rename d3/de/l5b to d3/d4/d76/l87 0 2024-04-15T21:02:43.567 INFO:tasks.workunit.client.0.smithi072.stdout:4/387: chown d7/d10/d41/d4c/c64 4 1 2024-04-15T21:02:43.567 INFO:tasks.workunit.client.1.smithi149.stdout:4/668: getdents dc/d2c/d3e/d15/d3f 0 2024-04-15T21:02:43.567 INFO:tasks.workunit.client.1.smithi149.stdout:7/601: dwrite d3/d16/d20/d36/d3d/d56/f5f [4194304,4194304] 0 2024-04-15T21:02:43.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/555: mknod d23/d3c/d87/d9a/cc1 0 2024-04-15T21:02:43.569 INFO:tasks.workunit.client.1.smithi149.stdout:4/669: readlink dc/d18/d21/l88 0 2024-04-15T21:02:43.571 INFO:tasks.workunit.client.0.smithi072.stdout:0/405: creat d0/d45/d35/f89 x:0 0 0 2024-04-15T21:02:43.571 INFO:tasks.workunit.client.1.smithi149.stdout:5/605: mknod d0/d6/d82/da1/d12/d16/da9/d9b/db7/cca 0 2024-04-15T21:02:43.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/669: truncate d4/d7/d46/d74/fb1 619042 0 2024-04-15T21:02:43.576 INFO:tasks.workunit.client.1.smithi149.stdout:8/688: truncate d2/d16/f65 1189318 0 2024-04-15T21:02:43.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/446: creat d3/d4/d3b/f88 x:0 0 0 2024-04-15T21:02:43.578 INFO:tasks.workunit.client.0.smithi072.stdout:8/447: chown d3/de/d1b/d3f/l3a 120055 1 2024-04-15T21:02:43.578 INFO:tasks.workunit.client.0.smithi072.stdout:9/354: dread d4/f5 [4194304,4194304] 0 2024-04-15T21:02:43.580 INFO:tasks.workunit.client.1.smithi149.stdout:5/606: dwrite d0/d6/d79/f9d [0,4194304] 0 2024-04-15T21:02:43.584 INFO:tasks.workunit.client.0.smithi072.stdout:0/406: chown d0/d45/c30 11092833 1 2024-04-15T21:02:43.585 INFO:tasks.workunit.client.0.smithi072.stdout:0/407: fdatasync d0/d45/d35/d3a/f47 0 2024-04-15T21:02:43.585 INFO:tasks.workunit.client.0.smithi072.stdout:0/408: chown d0/d45/c30 0 1 2024-04-15T21:02:43.587 INFO:tasks.workunit.client.1.smithi149.stdout:5/607: dread d0/f8 [0,4194304] 0 2024-04-15T21:02:43.592 INFO:tasks.workunit.client.1.smithi149.stdout:5/608: chown d0/d6/d82/da1/d12/d16/da9/d1b/d9c/fa0 236567 1 2024-04-15T21:02:43.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/609: read d0/d6/d82/da1/d12/d2b/f9e [394450,103956] 0 2024-04-15T21:02:43.597 INFO:tasks.workunit.client.1.smithi149.stdout:5/610: dread d0/d6/d82/da1/d12/d2b/f9e [0,4194304] 0 2024-04-15T21:02:43.598 INFO:tasks.workunit.client.0.smithi072.stdout:3/376: rename d1/d3f/c48 to d1/d5b/c7c 0 2024-04-15T21:02:43.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/556: rename d23/d3c/f67 to d23/d3c/d7a/fc2 0 2024-04-15T21:02:43.602 INFO:tasks.workunit.client.0.smithi072.stdout:3/377: dread d1/d26/f30 [0,4194304] 0 2024-04-15T21:02:43.602 INFO:tasks.workunit.client.0.smithi072.stdout:1/395: dwrite d5/f3c [0,4194304] 0 2024-04-15T21:02:43.603 INFO:tasks.workunit.client.1.smithi149.stdout:2/670: rmdir d4 39 2024-04-15T21:02:43.606 INFO:tasks.workunit.client.1.smithi149.stdout:5/611: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d83/f97 [0,4194304] 0 2024-04-15T21:02:43.607 INFO:tasks.workunit.client.0.smithi072.stdout:7/410: truncate d2/d7/d25/f34 4151970 0 2024-04-15T21:02:43.611 INFO:tasks.workunit.client.0.smithi072.stdout:0/409: rename d0/d45/d52 to d0/d45/d7a/d70/d59/d8a 0 2024-04-15T21:02:43.613 INFO:tasks.workunit.client.1.smithi149.stdout:5/612: dread d0/d6/d82/da1/d12/d16/da9/f81 [0,4194304] 0 2024-04-15T21:02:43.614 INFO:tasks.workunit.client.1.smithi149.stdout:8/689: creat d2/df/d10/d25/d57/dd1/d46/dce/ff9 x:0 0 0 2024-04-15T21:02:43.619 INFO:tasks.workunit.client.0.smithi072.stdout:0/410: dwrite d0/d45/d35/f56 [0,4194304] 0 2024-04-15T21:02:43.622 INFO:tasks.workunit.client.1.smithi149.stdout:8/690: dwrite d2/df/d10/f19 [0,4194304] 0 2024-04-15T21:02:43.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/549: symlink d1/db/d16/d86/l9e 0 2024-04-15T21:02:43.631 INFO:tasks.workunit.client.0.smithi072.stdout:3/378: dread d1/d5b/f6a [0,4194304] 0 2024-04-15T21:02:43.633 INFO:tasks.workunit.client.0.smithi072.stdout:7/411: dread d2/d7/d25/d2d/d46/d5a/d5f/d26/f29 [0,4194304] 0 2024-04-15T21:02:43.641 INFO:tasks.workunit.client.1.smithi149.stdout:3/663: link d1/db/d23/c8e d1/db/d24/d39/cca 0 2024-04-15T21:02:43.642 INFO:tasks.workunit.client.1.smithi149.stdout:1/550: dwrite d1/db/d16/d35/f96 [0,4194304] 0 2024-04-15T21:02:43.642 INFO:tasks.workunit.client.1.smithi149.stdout:1/551: chown d1/f62 0 1 2024-04-15T21:02:43.647 INFO:tasks.workunit.client.1.smithi149.stdout:9/557: mknod d23/d2b/d37/d50/d79/cc3 0 2024-04-15T21:02:43.647 INFO:tasks.workunit.client.1.smithi149.stdout:1/552: truncate d1/db/d16/d35/f95 360142 0 2024-04-15T21:02:43.654 INFO:tasks.workunit.client.0.smithi072.stdout:1/396: mknod d5/db/d27/d5c/c80 0 2024-04-15T21:02:43.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/664: dwrite d1/db/d24/d8a/f8c [0,4194304] 0 2024-04-15T21:02:43.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/553: dread d1/db/d16/d35/f96 [0,4194304] 0 2024-04-15T21:02:43.665 INFO:tasks.workunit.client.1.smithi149.stdout:8/691: symlink d2/df/d10/d20/d6b/lfa 0 2024-04-15T21:02:43.666 INFO:tasks.workunit.client.0.smithi072.stdout:5/388: sync 2024-04-15T21:02:43.666 INFO:tasks.workunit.client.0.smithi072.stdout:6/408: sync 2024-04-15T21:02:43.666 INFO:tasks.workunit.client.0.smithi072.stdout:0/411: unlink d0/d6/f20 0 2024-04-15T21:02:43.667 INFO:tasks.workunit.client.0.smithi072.stdout:0/412: chown d0/d3/f34 124806 1 2024-04-15T21:02:43.668 INFO:tasks.workunit.client.0.smithi072.stdout:6/409: chown d2/d40/d6e/f4e 4 1 2024-04-15T21:02:43.668 INFO:tasks.workunit.client.0.smithi072.stdout:8/448: getdents d3/de/d21 0 2024-04-15T21:02:43.670 INFO:tasks.workunit.client.0.smithi072.stdout:9/355: getdents d4/d29/d4c 0 2024-04-15T21:02:43.674 INFO:tasks.workunit.client.0.smithi072.stdout:5/389: write d0/d3/d6/f2b [2366114,27049] 0 2024-04-15T21:02:43.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/449: symlink d3/l89 0 2024-04-15T21:02:43.683 INFO:tasks.workunit.client.1.smithi149.stdout:9/558: write d23/d2b/d37/d50/f57 [3543010,77978] 0 2024-04-15T21:02:43.686 INFO:tasks.workunit.client.0.smithi072.stdout:3/379: rename d1/d15/d32/d2f/c42 to d1/d15/d40/c7d 0 2024-04-15T21:02:43.687 INFO:tasks.workunit.client.0.smithi072.stdout:8/450: dwrite d3/de/d81/f86 [0,4194304] 0 2024-04-15T21:02:43.689 INFO:tasks.workunit.client.1.smithi149.stdout:0/783: link d1/d5/d24/d30/df7/cb9 d1/d5/d24/d30/d43/de9/c115 0 2024-04-15T21:02:43.690 INFO:tasks.workunit.client.1.smithi149.stdout:2/671: dwrite d4/d7/d46/de4/d21/d55/f59 [0,4194304] 0 2024-04-15T21:02:43.695 INFO:tasks.workunit.client.0.smithi072.stdout:5/390: dwrite d0/d3/d7/d12/d31/f3d [0,4194304] 0 2024-04-15T21:02:43.695 INFO:tasks.workunit.client.1.smithi149.stdout:1/554: mknod d1/d17/d5e/d64/c9f 0 2024-04-15T21:02:43.695 INFO:tasks.workunit.client.1.smithi149.stdout:8/692: mkdir d2/df/d10/d20/d6b/dfb 0 2024-04-15T21:02:43.697 INFO:tasks.workunit.client.0.smithi072.stdout:9/356: dread d4/d1f/d2c/f2d [0,4194304] 0 2024-04-15T21:02:43.697 INFO:tasks.workunit.client.1.smithi149.stdout:0/784: chown d1/d5/d24/d50/d15/f89 11146 1 2024-04-15T21:02:43.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/357: readlink d4/d1f/l26 0 2024-04-15T21:02:43.699 INFO:tasks.workunit.client.0.smithi072.stdout:9/358: dread - d4/d1f/d2c/d47/f5f zero size 2024-04-15T21:02:43.704 INFO:tasks.workunit.client.0.smithi072.stdout:0/413: dread d0/d3/f34 [0,4194304] 0 2024-04-15T21:02:43.705 INFO:tasks.workunit.client.0.smithi072.stdout:6/410: rename d2/d10/d18/c69 to d2/d10/d11/d1f/c7d 0 2024-04-15T21:02:43.705 INFO:tasks.workunit.client.0.smithi072.stdout:7/412: write d2/d7/d25/f34 [4626084,52979] 0 2024-04-15T21:02:43.707 INFO:tasks.workunit.client.0.smithi072.stdout:6/411: dread - d2/d1a/f41 zero size 2024-04-15T21:02:43.713 INFO:tasks.workunit.client.0.smithi072.stdout:3/380: rmdir d1/d26 39 2024-04-15T21:02:43.714 INFO:tasks.workunit.client.0.smithi072.stdout:9/359: fdatasync d4/d1f/d2c/f2d 0 2024-04-15T21:02:43.714 INFO:tasks.workunit.client.0.smithi072.stdout:3/381: chown d1/d3f/d4f/d73 5231 1 2024-04-15T21:02:43.715 INFO:tasks.workunit.client.0.smithi072.stdout:0/414: mkdir d0/d45/d7a/d70/d59/d8a/d8b 0 2024-04-15T21:02:43.716 INFO:tasks.workunit.client.1.smithi149.stdout:9/559: rename ld to d23/d2b/d37/d6d/db8/lc4 0 2024-04-15T21:02:43.716 INFO:tasks.workunit.client.1.smithi149.stdout:8/693: rmdir d2/df/d10/d25/d57/dd1/d46 39 2024-04-15T21:02:43.716 INFO:tasks.workunit.client.1.smithi149.stdout:3/665: dread d1/db/d28/d87/dbd/f86 [0,4194304] 0 2024-04-15T21:02:43.716 INFO:tasks.workunit.client.0.smithi072.stdout:9/360: read d4/d1f/d31/d4d/f5c [2551979,5419] 0 2024-04-15T21:02:43.717 INFO:tasks.workunit.client.1.smithi149.stdout:0/785: fsync d1/d9/d64/d65/f79 0 2024-04-15T21:02:43.717 INFO:tasks.workunit.client.0.smithi072.stdout:8/451: rename d3/de/d21/c36 to d3/d4/d4d/c8a 0 2024-04-15T21:02:43.718 INFO:tasks.workunit.client.0.smithi072.stdout:8/452: dread - d3/de/d1b/d44/f78 zero size 2024-04-15T21:02:43.719 INFO:tasks.workunit.client.0.smithi072.stdout:8/453: write d3/de/f22 [3907271,27170] 0 2024-04-15T21:02:43.720 INFO:tasks.workunit.client.0.smithi072.stdout:7/413: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f84 x:0 0 0 2024-04-15T21:02:43.721 INFO:tasks.workunit.client.0.smithi072.stdout:5/391: fsync d0/d3/d6/f8 0 2024-04-15T21:02:43.723 INFO:tasks.workunit.client.0.smithi072.stdout:8/454: dread d3/de/d81/f86 [0,4194304] 0 2024-04-15T21:02:43.724 INFO:tasks.workunit.client.0.smithi072.stdout:0/415: symlink d0/d6/d6d/l8c 0 2024-04-15T21:02:43.725 INFO:tasks.workunit.client.0.smithi072.stdout:8/455: chown d3/de/f25 3509912 1 2024-04-15T21:02:43.725 INFO:tasks.workunit.client.0.smithi072.stdout:8/456: write d3/f3c [913126,31512] 0 2024-04-15T21:02:43.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/666: dwrite d1/db/d24/f89 [0,4194304] 0 2024-04-15T21:02:43.728 INFO:tasks.workunit.client.0.smithi072.stdout:9/361: stat d4/c4a 0 2024-04-15T21:02:43.728 INFO:tasks.workunit.client.0.smithi072.stdout:9/362: chown d4/fc 357754211 1 2024-04-15T21:02:43.729 INFO:tasks.workunit.client.1.smithi149.stdout:8/694: dwrite d2/df/d10/d4e/d9f/fcc [4194304,4194304] 0 2024-04-15T21:02:43.730 INFO:tasks.workunit.client.0.smithi072.stdout:5/392: dread d0/d3/d7/d12/d31/d62/f64 [0,4194304] 0 2024-04-15T21:02:43.730 INFO:tasks.workunit.client.0.smithi072.stdout:0/416: dwrite d0/d45/f26 [0,4194304] 0 2024-04-15T21:02:43.732 INFO:tasks.workunit.client.0.smithi072.stdout:2/376: sync 2024-04-15T21:02:43.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/388: sync 2024-04-15T21:02:43.734 INFO:tasks.workunit.client.1.smithi149.stdout:3/667: write d1/db/d24/d4d/d63/faa [184282,61392] 0 2024-04-15T21:02:43.735 INFO:tasks.workunit.client.1.smithi149.stdout:3/668: stat d1/db/d24/d4d 0 2024-04-15T21:02:43.736 INFO:tasks.workunit.client.0.smithi072.stdout:3/382: rename d1/f2e to d1/d3f/d4f/f7e 0 2024-04-15T21:02:43.738 INFO:tasks.workunit.client.0.smithi072.stdout:4/389: write d7/d10/d41/d44/f73 [921475,1156] 0 2024-04-15T21:02:43.739 INFO:tasks.workunit.client.0.smithi072.stdout:3/383: fsync d1/d5b/f62 0 2024-04-15T21:02:43.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/363: read d4/f1e [3942699,9897] 0 2024-04-15T21:02:43.740 INFO:tasks.workunit.client.0.smithi072.stdout:6/412: symlink d2/d10/d18/l7e 0 2024-04-15T21:02:43.744 INFO:tasks.workunit.client.0.smithi072.stdout:5/393: dwrite d0/d3/d7/d12/d31/d49/f84 [0,4194304] 0 2024-04-15T21:02:43.748 INFO:tasks.workunit.client.0.smithi072.stdout:2/377: dwrite d2/d37/f75 [0,4194304] 0 2024-04-15T21:02:43.751 INFO:tasks.workunit.client.0.smithi072.stdout:2/378: dread d2/d38/f54 [0,4194304] 0 2024-04-15T21:02:43.755 INFO:tasks.workunit.client.0.smithi072.stdout:2/379: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:43.764 INFO:tasks.workunit.client.0.smithi072.stdout:0/417: mknod d0/d19/d58/c8d 0 2024-04-15T21:02:43.764 INFO:tasks.workunit.client.0.smithi072.stdout:9/364: dread d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:02:43.764 INFO:tasks.workunit.client.0.smithi072.stdout:9/365: stat d4/f5 0 2024-04-15T21:02:43.765 INFO:tasks.workunit.client.0.smithi072.stdout:9/366: readlink d4/d1f/d2c/d47/l65 0 2024-04-15T21:02:43.766 INFO:tasks.workunit.client.0.smithi072.stdout:1/397: sync 2024-04-15T21:02:43.771 INFO:tasks.workunit.client.0.smithi072.stdout:0/418: dwrite d0/d6/ff [0,4194304] 0 2024-04-15T21:02:43.773 INFO:tasks.workunit.client.0.smithi072.stdout:0/419: write d0/d19/f4a [4078936,33632] 0 2024-04-15T21:02:43.775 INFO:tasks.workunit.client.0.smithi072.stdout:0/420: dread - d0/d6/d55/f68 zero size 2024-04-15T21:02:43.775 INFO:tasks.workunit.client.0.smithi072.stdout:1/398: dwrite d5/d31/f49 [0,4194304] 0 2024-04-15T21:02:43.781 INFO:tasks.workunit.client.0.smithi072.stdout:6/413: dwrite d2/d40/d56/d6a/d70/f5c [0,4194304] 0 2024-04-15T21:02:43.782 INFO:tasks.workunit.client.0.smithi072.stdout:5/394: read d0/d3/d7/d1f/f26 [1590890,71365] 0 2024-04-15T21:02:43.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/555: rename d1/d17/d52/d92/c98 to d1/db/dc/d38/d39/d88/ca0 0 2024-04-15T21:02:43.799 INFO:tasks.workunit.client.0.smithi072.stdout:2/380: mknod d2/d64/c76 0 2024-04-15T21:02:43.802 INFO:tasks.workunit.client.1.smithi149.stdout:1/556: dwrite d1/db/d16/d35/f95 [0,4194304] 0 2024-04-15T21:02:43.803 INFO:tasks.workunit.client.1.smithi149.stdout:1/557: chown d1/d17/l5f 1046078 1 2024-04-15T21:02:43.806 INFO:tasks.workunit.client.0.smithi072.stdout:8/457: dread d3/de/d21/d2e/f5c [0,4194304] 0 2024-04-15T21:02:43.810 INFO:tasks.workunit.client.0.smithi072.stdout:3/384: write d1/d5b/f60 [562500,17983] 0 2024-04-15T21:02:43.812 INFO:tasks.workunit.client.0.smithi072.stdout:9/367: creat d4/d1f/d2c/d62/f6c x:0 0 0 2024-04-15T21:02:43.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/669: creat d1/d81/fcb x:0 0 0 2024-04-15T21:02:43.816 INFO:tasks.workunit.client.1.smithi149.stdout:3/670: fdatasync d1/db/d24/d4d/f9d 0 2024-04-15T21:02:43.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/671: dread d1/db/d24/d8a/f8c [0,4194304] 0 2024-04-15T21:02:43.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/786: dread - d1/d29/fe1 zero size 2024-04-15T21:02:43.828 INFO:tasks.workunit.client.0.smithi072.stdout:6/414: mkdir d2/d40/d66/d7f 0 2024-04-15T21:02:43.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/560: write d23/d2b/d44/f64 [3331884,5563] 0 2024-04-15T21:02:43.830 INFO:tasks.workunit.client.0.smithi072.stdout:7/414: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d43/d7b 0 2024-04-15T21:02:43.831 INFO:tasks.workunit.client.0.smithi072.stdout:7/415: write d2/d7/d25/d2d/f44 [1962767,10430] 0 2024-04-15T21:02:43.833 INFO:tasks.workunit.client.0.smithi072.stdout:5/395: rename d0/d3/d23/f4b to d0/d3/d7/d12/d31/d49/f87 0 2024-04-15T21:02:43.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/672: truncate d1/db/d24/d4d/d63/d65/f91 959437 0 2024-04-15T21:02:43.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/787: readlink d1/d5/d24/d50/d13/d38/d44/l83 0 2024-04-15T21:02:43.840 INFO:tasks.workunit.client.0.smithi072.stdout:3/385: mkdir d1/d3f/d7f 0 2024-04-15T21:02:43.841 INFO:tasks.workunit.client.1.smithi149.stdout:9/561: truncate f22 2602642 0 2024-04-15T21:02:43.845 INFO:tasks.workunit.client.0.smithi072.stdout:4/390: link d7/d24/f59 d7/d23/d6c/f79 0 2024-04-15T21:02:43.847 INFO:tasks.workunit.client.1.smithi149.stdout:8/695: rename d2/df/d10/d25/d37/d53/daf/d92/fc4 to d2/df/d10/d20/ffc 0 2024-04-15T21:02:43.849 INFO:tasks.workunit.client.1.smithi149.stdout:0/788: truncate d1/d5/f4a 3995293 0 2024-04-15T21:02:43.851 INFO:tasks.workunit.client.1.smithi149.stdout:1/558: link d1/db/dc/d11/d3f/l94 d1/db/dc/d11/d3e/la1 0 2024-04-15T21:02:43.854 INFO:tasks.workunit.client.0.smithi072.stdout:6/415: unlink d2/d40/d56/d6a/d70/f48 0 2024-04-15T21:02:43.856 INFO:tasks.workunit.client.1.smithi149.stdout:9/562: mkdir d23/d3c/d7a/d7c/d7f/d86/dc5 0 2024-04-15T21:02:43.865 INFO:tasks.workunit.client.1.smithi149.stdout:1/559: mknod d1/db/dc/d11/d3e/ca2 0 2024-04-15T21:02:43.867 INFO:tasks.workunit.client.1.smithi149.stdout:9/563: mknod d23/d3c/d7a/d7c/d7f/cc6 0 2024-04-15T21:02:43.871 INFO:tasks.workunit.client.1.smithi149.stdout:3/673: rename d1/db/d24/d2b/da9/fac to d1/db/d24/d4d/d63/d65/dc3/fcc 0 2024-04-15T21:02:43.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/674: write d1/db/d24/d4d/f82 [628940,115522] 0 2024-04-15T21:02:43.872 INFO:tasks.workunit.client.0.smithi072.stdout:4/391: fsync d7/d23/f29 0 2024-04-15T21:02:43.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/560: mkdir d1/d17/d36/d6f/da3 0 2024-04-15T21:02:43.880 INFO:tasks.workunit.client.0.smithi072.stdout:6/416: rmdir d2/d40/d66 39 2024-04-15T21:02:43.883 INFO:tasks.workunit.client.0.smithi072.stdout:2/381: creat d2/f77 x:0 0 0 2024-04-15T21:02:43.883 INFO:tasks.workunit.client.1.smithi149.stdout:0/789: write d1/d5/dda/fc0 [565774,30409] 0 2024-04-15T21:02:43.883 INFO:tasks.workunit.client.1.smithi149.stdout:9/564: dread f4 [0,4194304] 0 2024-04-15T21:02:43.884 INFO:tasks.workunit.client.1.smithi149.stdout:9/565: stat d23/d2b/c34 0 2024-04-15T21:02:43.886 INFO:tasks.workunit.client.0.smithi072.stdout:8/458: creat d3/de/d21/f8b x:0 0 0 2024-04-15T21:02:43.889 INFO:tasks.workunit.client.0.smithi072.stdout:9/368: link d4/d1f/d2c/d47/l65 d4/d29/d45/l6d 0 2024-04-15T21:02:43.892 INFO:tasks.workunit.client.0.smithi072.stdout:8/459: dwrite d3/de/d1b/d44/f78 [0,4194304] 0 2024-04-15T21:02:43.893 INFO:tasks.workunit.client.0.smithi072.stdout:1/399: getdents d5/d3d 0 2024-04-15T21:02:43.894 INFO:tasks.workunit.client.1.smithi149.stdout:0/790: mknod d1/d5/dc/c116 0 2024-04-15T21:02:43.896 INFO:tasks.workunit.client.1.smithi149.stdout:9/566: mknod d23/d2b/d70/cc7 0 2024-04-15T21:02:43.896 INFO:tasks.workunit.client.1.smithi149.stdout:8/696: dwrite d2/d16/f65 [0,4194304] 0 2024-04-15T21:02:43.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/697: chown d2/df/d10/d25/d37/d53/daf/d92/fb0 27 1 2024-04-15T21:02:43.901 INFO:tasks.workunit.client.0.smithi072.stdout:8/460: dwrite d3/d4/d4c/f6c [0,4194304] 0 2024-04-15T21:02:43.902 INFO:tasks.workunit.client.0.smithi072.stdout:8/461: write d3/f1d [2331801,123452] 0 2024-04-15T21:02:43.905 INFO:tasks.workunit.client.0.smithi072.stdout:4/392: dread f6 [0,4194304] 0 2024-04-15T21:02:43.906 INFO:tasks.workunit.client.0.smithi072.stdout:0/421: getdents d0/d19/d71 0 2024-04-15T21:02:43.906 INFO:tasks.workunit.client.0.smithi072.stdout:0/422: chown d0/d19 265 1 2024-04-15T21:02:43.907 INFO:tasks.workunit.client.1.smithi149.stdout:9/567: mknod d23/d71/cc8 0 2024-04-15T21:02:43.907 INFO:tasks.workunit.client.1.smithi149.stdout:0/791: creat d1/d5/d24/d50/d13/f117 x:0 0 0 2024-04-15T21:02:43.911 INFO:tasks.workunit.client.0.smithi072.stdout:2/382: mknod d2/d8/d41/c78 0 2024-04-15T21:02:43.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:43 smithi072 ceph-mon[29079]: pgmap v6: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 75 MiB/s wr, 186 op/s 2024-04-15T21:02:43.913 INFO:tasks.workunit.client.1.smithi149.stdout:1/561: creat d1/db/dc/fa4 x:0 0 0 2024-04-15T21:02:43.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/675: getdents d1/db/d40/d56/d84 0 2024-04-15T21:02:43.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/676: truncate d1/db/fa4 1144602 0 2024-04-15T21:02:43.917 INFO:tasks.workunit.client.1.smithi149.stdout:0/792: creat d1/d5/d24/d50/d13/d38/d44/f118 x:0 0 0 2024-04-15T21:02:43.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/568: dwrite d23/d3c/d7a/d7c/fb1 [0,4194304] 0 2024-04-15T21:02:43.920 INFO:tasks.workunit.client.0.smithi072.stdout:1/400: creat d5/db/d2d/f81 x:0 0 0 2024-04-15T21:02:43.921 INFO:tasks.workunit.client.0.smithi072.stdout:8/462: mknod d3/d4/d4c/c8c 0 2024-04-15T21:02:43.921 INFO:tasks.workunit.client.0.smithi072.stdout:1/401: write d5/db/d2d/d3a/f50 [5756660,41186] 0 2024-04-15T21:02:43.922 INFO:tasks.workunit.client.0.smithi072.stdout:1/402: chown d5/ld 6779751 1 2024-04-15T21:02:43.923 INFO:tasks.workunit.client.0.smithi072.stdout:1/403: fsync d5/f3c 0 2024-04-15T21:02:43.924 INFO:tasks.workunit.client.1.smithi149.stdout:9/569: fdatasync d23/d3c/d52/f6f 0 2024-04-15T21:02:43.929 INFO:tasks.workunit.client.1.smithi149.stdout:0/793: rename d1/d5/d24/d30 to d1/d9/d64/d65/d104/d119 0 2024-04-15T21:02:43.933 INFO:tasks.workunit.client.0.smithi072.stdout:5/396: getdents d0 0 2024-04-15T21:02:43.935 INFO:tasks.workunit.client.0.smithi072.stdout:5/397: write d0/d3/d7/d12/d1d/f3e [264681,85350] 0 2024-04-15T21:02:43.935 INFO:tasks.workunit.client.1.smithi149.stdout:9/570: chown d23/l25 4037790 1 2024-04-15T21:02:43.936 INFO:tasks.workunit.client.0.smithi072.stdout:3/386: link d1/d15/d32/d2f/d1a/c5d d1/d26/c80 0 2024-04-15T21:02:43.937 INFO:tasks.workunit.client.0.smithi072.stdout:3/387: readlink d1/d15/d32/l57 0 2024-04-15T21:02:43.940 INFO:tasks.workunit.client.1.smithi149.stdout:1/562: creat d1/db/dc/fa5 x:0 0 0 2024-04-15T21:02:43.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:43 smithi149 ceph-mon[36029]: pgmap v6: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 75 MiB/s wr, 186 op/s 2024-04-15T21:02:43.941 INFO:tasks.workunit.client.1.smithi149.stdout:1/563: truncate d1/d17/d4d/f6a 880572 0 2024-04-15T21:02:43.943 INFO:tasks.workunit.client.1.smithi149.stdout:9/571: unlink d23/d2b/d37/d50/d79/d8d/f98 0 2024-04-15T21:02:43.944 INFO:tasks.workunit.client.0.smithi072.stdout:4/393: dread d7/d24/f1e [0,4194304] 0 2024-04-15T21:02:43.944 INFO:tasks.workunit.client.0.smithi072.stdout:1/404: mkdir d5/d31/d51/d82 0 2024-04-15T21:02:43.945 INFO:tasks.workunit.client.1.smithi149.stdout:0/794: truncate d1/d5/d24/d50/d13/d59/f8d 557862 0 2024-04-15T21:02:43.947 INFO:tasks.workunit.client.0.smithi072.stdout:0/423: mkdir d0/d45/d7a/d5d/d8e 0 2024-04-15T21:02:43.947 INFO:tasks.workunit.client.0.smithi072.stdout:6/417: write d2/d10/d11/f4b [3234301,123155] 0 2024-04-15T21:02:43.947 INFO:tasks.workunit.client.0.smithi072.stdout:0/424: stat d0/d6/f41 0 2024-04-15T21:02:43.951 INFO:tasks.workunit.client.1.smithi149.stdout:1/564: symlink d1/db/dc/d11/la6 0 2024-04-15T21:02:43.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/398: dread d0/d3/d6/f2b [4194304,4194304] 0 2024-04-15T21:02:43.953 INFO:tasks.workunit.client.0.smithi072.stdout:2/383: symlink d2/l79 0 2024-04-15T21:02:43.953 INFO:tasks.workunit.client.1.smithi149.stdout:8/698: dwrite d2/df/d10/d25/f33 [0,4194304] 0 2024-04-15T21:02:43.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/399: write d0/d3/d6/f2b [2434193,21860] 0 2024-04-15T21:02:43.958 INFO:tasks.workunit.client.1.smithi149.stdout:0/795: write d1/d9/d64/d65/d104/d119/d54/fa9 [1452430,100156] 0 2024-04-15T21:02:43.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/405: dread d5/db/d2d/d3a/f50 [0,4194304] 0 2024-04-15T21:02:43.961 INFO:tasks.workunit.client.1.smithi149.stdout:1/565: symlink d1/db/dc/d38/la7 0 2024-04-15T21:02:43.963 INFO:tasks.workunit.client.0.smithi072.stdout:8/463: creat d3/d7e/f8d x:0 0 0 2024-04-15T21:02:43.963 INFO:tasks.workunit.client.0.smithi072.stdout:8/464: fsync d3/de/d1b/d3f/f67 0 2024-04-15T21:02:43.966 INFO:tasks.workunit.client.0.smithi072.stdout:4/394: mkdir d7/d10/d41/d44/d7a 0 2024-04-15T21:02:43.967 INFO:tasks.workunit.client.0.smithi072.stdout:4/395: write d7/f1b [1395831,87099] 0 2024-04-15T21:02:43.973 INFO:tasks.workunit.client.0.smithi072.stdout:0/425: creat d0/d6/d55/f8f x:0 0 0 2024-04-15T21:02:43.975 INFO:tasks.workunit.client.1.smithi149.stdout:1/566: creat d1/d17/d36/d69/fa8 x:0 0 0 2024-04-15T21:02:43.977 INFO:tasks.workunit.client.0.smithi072.stdout:0/426: dread d0/d45/d35/d3a/f6c [0,4194304] 0 2024-04-15T21:02:43.981 INFO:tasks.workunit.client.0.smithi072.stdout:7/416: sync 2024-04-15T21:02:43.982 INFO:tasks.workunit.client.0.smithi072.stdout:7/417: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 [5184777,96596] 0 2024-04-15T21:02:43.983 INFO:tasks.workunit.client.0.smithi072.stdout:1/406: creat d5/d31/d51/f83 x:0 0 0 2024-04-15T21:02:43.987 INFO:tasks.workunit.client.1.smithi149.stdout:9/572: dwrite d23/d3c/d52/f6f [0,4194304] 0 2024-04-15T21:02:43.988 INFO:tasks.workunit.client.0.smithi072.stdout:4/396: creat d7/d15/d58/f7b x:0 0 0 2024-04-15T21:02:43.988 INFO:tasks.workunit.client.0.smithi072.stdout:4/397: truncate d7/f2e 1771645 0 2024-04-15T21:02:43.989 INFO:tasks.workunit.client.0.smithi072.stdout:4/398: fdatasync d7/d10/d41/f60 0 2024-04-15T21:02:43.989 INFO:tasks.workunit.client.1.smithi149.stdout:1/567: dread d1/db/dc/d38/d39/d43/f1f [0,4194304] 0 2024-04-15T21:02:43.990 INFO:tasks.workunit.client.1.smithi149.stdout:1/568: fdatasync d1/f6 0 2024-04-15T21:02:43.992 INFO:tasks.workunit.client.1.smithi149.stdout:8/699: write d2/df/d10/d25/d57/dd1/f41 [5101497,26600] 0 2024-04-15T21:02:43.992 INFO:tasks.workunit.client.0.smithi072.stdout:0/427: unlink d0/d45/c30 0 2024-04-15T21:02:43.993 INFO:tasks.workunit.client.1.smithi149.stdout:8/700: chown d2/d16/cc9 12 1 2024-04-15T21:02:43.994 INFO:tasks.workunit.client.0.smithi072.stdout:2/384: creat d2/d38/d73/f7a x:0 0 0 2024-04-15T21:02:43.995 INFO:tasks.workunit.client.0.smithi072.stdout:2/385: chown d2/l79 1038284332 1 2024-04-15T21:02:43.995 INFO:tasks.workunit.client.1.smithi149.stdout:1/569: unlink d1/db/d16/d35/c5d 0 2024-04-15T21:02:43.996 INFO:tasks.workunit.client.0.smithi072.stdout:2/386: fdatasync d2/d37/f75 0 2024-04-15T21:02:43.998 INFO:tasks.workunit.client.0.smithi072.stdout:3/388: creat d1/d15/d32/f81 x:0 0 0 2024-04-15T21:02:43.999 INFO:tasks.workunit.client.1.smithi149.stdout:9/573: creat d23/d3c/d7a/d7c/d7f/d86/dc5/fc9 x:0 0 0 2024-04-15T21:02:44.003 INFO:tasks.workunit.client.0.smithi072.stdout:2/387: dread d2/d3/f46 [0,4194304] 0 2024-04-15T21:02:44.004 INFO:tasks.workunit.client.1.smithi149.stdout:0/796: dwrite d1/d5/d24/fe3 [0,4194304] 0 2024-04-15T21:02:44.004 INFO:tasks.workunit.client.0.smithi072.stdout:7/418: unlink d2/d78/f7f 0 2024-04-15T21:02:44.007 INFO:tasks.workunit.client.1.smithi149.stdout:1/570: rename d1/db/dc/d11/c2f to d1/d17/d36/d6f/da3/ca9 0 2024-04-15T21:02:44.020 INFO:tasks.workunit.client.1.smithi149.stdout:0/797: stat d1/d5/le 0 2024-04-15T21:02:44.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/574: symlink d23/d3c/d7a/d7c/lca 0 2024-04-15T21:02:44.027 INFO:tasks.workunit.client.1.smithi149.stdout:8/701: dwrite d2/df/d10/d34/f9c [0,4194304] 0 2024-04-15T21:02:44.027 INFO:tasks.workunit.client.1.smithi149.stdout:1/571: truncate d1/db/f20 713235 0 2024-04-15T21:02:44.029 INFO:tasks.workunit.client.1.smithi149.stdout:0/798: dwrite d1/d9/d64/d65/faf [0,4194304] 0 2024-04-15T21:02:44.032 INFO:tasks.workunit.client.0.smithi072.stdout:1/407: creat d5/db/d27/d5c/f84 x:0 0 0 2024-04-15T21:02:44.033 INFO:tasks.workunit.client.0.smithi072.stdout:8/465: write d3/de/d21/f4a [2728043,15273] 0 2024-04-15T21:02:44.034 INFO:tasks.workunit.client.0.smithi072.stdout:6/418: rename d2/d10/d11/l1c to d2/d40/l80 0 2024-04-15T21:02:44.036 INFO:tasks.workunit.client.0.smithi072.stdout:6/419: stat d2/d10/d18/l19 0 2024-04-15T21:02:44.037 INFO:tasks.workunit.client.0.smithi072.stdout:8/466: chown d3/de/d1b/d44/c6a 11908699 1 2024-04-15T21:02:44.038 INFO:tasks.workunit.client.0.smithi072.stdout:7/419: dwrite d2/d7/d25/d2d/d46/f79 [0,4194304] 0 2024-04-15T21:02:44.042 INFO:tasks.workunit.client.0.smithi072.stdout:1/408: mkdir d5/db/d2d/d85 0 2024-04-15T21:02:44.044 INFO:tasks.workunit.client.1.smithi149.stdout:8/702: dread d2/f8d [0,4194304] 0 2024-04-15T21:02:44.044 INFO:tasks.workunit.client.1.smithi149.stdout:8/703: dread - d2/d16/fd3 zero size 2024-04-15T21:02:44.046 INFO:tasks.workunit.client.0.smithi072.stdout:4/399: dwrite f6 [0,4194304] 0 2024-04-15T21:02:44.046 INFO:tasks.workunit.client.0.smithi072.stdout:2/388: link d2/d8/f3a d2/d8/d6c/f7b 0 2024-04-15T21:02:44.047 INFO:tasks.workunit.client.1.smithi149.stdout:8/704: mknod d2/d5b/cfd 0 2024-04-15T21:02:44.049 INFO:tasks.workunit.client.0.smithi072.stdout:4/400: chown d7/f4f 712577732 1 2024-04-15T21:02:44.049 INFO:tasks.workunit.client.0.smithi072.stdout:1/409: fsync d5/db/fc 0 2024-04-15T21:02:44.049 INFO:tasks.workunit.client.0.smithi072.stdout:2/389: stat d2/d3/f5 0 2024-04-15T21:02:44.051 INFO:tasks.workunit.client.0.smithi072.stdout:2/390: chown d2/l62 6364 1 2024-04-15T21:02:44.051 INFO:tasks.workunit.client.0.smithi072.stdout:7/420: dwrite d2/d7/d25/d2d/d46/f79 [0,4194304] 0 2024-04-15T21:02:44.051 INFO:tasks.workunit.client.0.smithi072.stdout:1/410: write d5/f7d [963895,106629] 0 2024-04-15T21:02:44.053 INFO:tasks.workunit.client.0.smithi072.stdout:6/420: rename d2/d40/d56/f76 to d2/d40/f81 0 2024-04-15T21:02:44.054 INFO:tasks.workunit.client.0.smithi072.stdout:7/421: write d2/d7/d25/d2d/d47/f4a [533716,27076] 0 2024-04-15T21:02:44.056 INFO:tasks.workunit.client.0.smithi072.stdout:2/391: rmdir d2/d38/d73 39 2024-04-15T21:02:44.058 INFO:tasks.workunit.client.0.smithi072.stdout:1/411: symlink d5/d31/d51/l86 0 2024-04-15T21:02:44.058 INFO:tasks.workunit.client.0.smithi072.stdout:6/421: dread d2/d10/f3c [0,4194304] 0 2024-04-15T21:02:44.059 INFO:tasks.workunit.client.0.smithi072.stdout:1/412: chown d5/db/d2d/d3a/c69 284661 1 2024-04-15T21:02:44.059 INFO:tasks.workunit.client.0.smithi072.stdout:1/413: chown d5/l25 9872143 1 2024-04-15T21:02:44.062 INFO:tasks.workunit.client.0.smithi072.stdout:2/392: rmdir d2/d8/d6c 39 2024-04-15T21:02:44.065 INFO:tasks.workunit.client.0.smithi072.stdout:7/422: creat d2/d7/d25/d72/f85 x:0 0 0 2024-04-15T21:02:44.069 INFO:tasks.workunit.client.0.smithi072.stdout:6/422: symlink d2/d10/d11/d1f/d60/l82 0 2024-04-15T21:02:44.072 INFO:tasks.workunit.client.0.smithi072.stdout:1/414: write d5/db/f55 [1269711,6038] 0 2024-04-15T21:02:44.073 INFO:tasks.workunit.client.1.smithi149.stdout:9/575: write d23/f33 [1481625,45127] 0 2024-04-15T21:02:44.074 INFO:tasks.workunit.client.0.smithi072.stdout:2/393: creat d2/d3/d5f/f7c x:0 0 0 2024-04-15T21:02:44.074 INFO:tasks.workunit.client.0.smithi072.stdout:7/423: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f76 [0,4194304] 0 2024-04-15T21:02:44.074 INFO:tasks.workunit.client.0.smithi072.stdout:1/415: stat d5/d3d/d5e/c65 0 2024-04-15T21:02:44.075 INFO:tasks.workunit.client.0.smithi072.stdout:9/369: sync 2024-04-15T21:02:44.076 INFO:tasks.workunit.client.0.smithi072.stdout:7/424: dread - d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d zero size 2024-04-15T21:02:44.077 INFO:tasks.workunit.client.0.smithi072.stdout:1/416: chown d5/db/d2d/d3a/d1f/f78 12222 1 2024-04-15T21:02:44.078 INFO:tasks.workunit.client.0.smithi072.stdout:1/417: chown d5/c16 151282761 1 2024-04-15T21:02:44.079 INFO:tasks.workunit.client.1.smithi149.stdout:0/799: dwrite d1/d9/f1b [0,4194304] 0 2024-04-15T21:02:44.079 INFO:tasks.workunit.client.1.smithi149.stdout:9/576: read f1b [1401397,13310] 0 2024-04-15T21:02:44.079 INFO:tasks.workunit.client.0.smithi072.stdout:7/425: write d2/d7/d25/d2d/f44 [4690011,6145] 0 2024-04-15T21:02:44.079 INFO:tasks.workunit.client.0.smithi072.stdout:3/389: truncate d1/d15/d40/f9 4171295 0 2024-04-15T21:02:44.080 INFO:tasks.workunit.client.1.smithi149.stdout:0/800: read - d1/d9/d64/d65/fcc zero size 2024-04-15T21:02:44.082 INFO:tasks.workunit.client.0.smithi072.stdout:9/370: readlink d4/d1f/d31/d42/l60 0 2024-04-15T21:02:44.082 INFO:tasks.workunit.client.0.smithi072.stdout:2/394: dread d2/d37/f75 [0,4194304] 0 2024-04-15T21:02:44.087 INFO:tasks.workunit.client.0.smithi072.stdout:1/418: dwrite d5/d31/f49 [0,4194304] 0 2024-04-15T21:02:44.089 INFO:tasks.workunit.client.0.smithi072.stdout:3/390: dwrite d1/f43 [0,4194304] 0 2024-04-15T21:02:44.094 INFO:tasks.workunit.client.0.smithi072.stdout:4/401: dread d7/d23/f2a [0,4194304] 0 2024-04-15T21:02:44.096 INFO:tasks.workunit.client.0.smithi072.stdout:8/467: truncate d3/de/d81/f86 181442 0 2024-04-15T21:02:44.096 INFO:tasks.workunit.client.1.smithi149.stdout:9/577: symlink d23/d3c/lcb 0 2024-04-15T21:02:44.098 INFO:tasks.workunit.client.0.smithi072.stdout:7/426: write d2/f1c [639367,48530] 0 2024-04-15T21:02:44.100 INFO:tasks.workunit.client.0.smithi072.stdout:2/395: unlink d2/d8/f30 0 2024-04-15T21:02:44.102 INFO:tasks.workunit.client.0.smithi072.stdout:3/391: dwrite d1/f64 [0,4194304] 0 2024-04-15T21:02:44.104 INFO:tasks.workunit.client.1.smithi149.stdout:9/578: unlink d23/d2b/d37/d50/la3 0 2024-04-15T21:02:44.107 INFO:tasks.workunit.client.0.smithi072.stdout:4/402: dwrite d7/f2e [0,4194304] 0 2024-04-15T21:02:44.113 INFO:tasks.workunit.client.0.smithi072.stdout:9/371: mkdir d4/d1f/d2c/d6e 0 2024-04-15T21:02:44.113 INFO:tasks.workunit.client.0.smithi072.stdout:3/392: dwrite d1/f14 [0,4194304] 0 2024-04-15T21:02:44.123 INFO:tasks.workunit.client.0.smithi072.stdout:4/403: unlink d7/f1b 0 2024-04-15T21:02:44.124 INFO:tasks.workunit.client.0.smithi072.stdout:4/404: write d7/d28/d42/f65 [952838,104358] 0 2024-04-15T21:02:44.125 INFO:tasks.workunit.client.0.smithi072.stdout:4/405: write d7/f54 [535327,82995] 0 2024-04-15T21:02:44.129 INFO:tasks.workunit.client.0.smithi072.stdout:3/393: truncate d1/d15/d32/f24 1376173 0 2024-04-15T21:02:44.129 INFO:tasks.workunit.client.0.smithi072.stdout:3/394: chown d1/d15/d40/f22 68370861 1 2024-04-15T21:02:44.132 INFO:tasks.workunit.client.0.smithi072.stdout:1/419: dread d5/db/d27/f33 [0,4194304] 0 2024-04-15T21:02:44.133 INFO:tasks.workunit.client.0.smithi072.stdout:2/396: creat d2/d38/d73/f7d x:0 0 0 2024-04-15T21:02:44.137 INFO:tasks.workunit.client.0.smithi072.stdout:9/372: mknod d4/d29/d45/c6f 0 2024-04-15T21:02:44.138 INFO:tasks.workunit.client.0.smithi072.stdout:4/406: mkdir d7/d10/d41/d45/d7c 0 2024-04-15T21:02:44.139 INFO:tasks.workunit.client.0.smithi072.stdout:2/397: dwrite d2/d3/f43 [0,4194304] 0 2024-04-15T21:02:44.139 INFO:tasks.workunit.client.0.smithi072.stdout:3/395: truncate d1/d15/f31 1540948 0 2024-04-15T21:02:44.140 INFO:tasks.workunit.client.0.smithi072.stdout:4/407: chown d7/d24 65 1 2024-04-15T21:02:44.142 INFO:tasks.workunit.client.0.smithi072.stdout:2/398: write d2/d37/f49 [3490012,9492] 0 2024-04-15T21:02:44.142 INFO:tasks.workunit.client.0.smithi072.stdout:8/468: rename d3/de/f22 to d3/de/d21/f8e 0 2024-04-15T21:02:44.142 INFO:tasks.workunit.client.0.smithi072.stdout:1/420: creat d5/d31/f87 x:0 0 0 2024-04-15T21:02:44.143 INFO:tasks.workunit.client.0.smithi072.stdout:5/400: sync 2024-04-15T21:02:44.147 INFO:tasks.workunit.client.1.smithi149.stdout:9/579: write f22 [2769340,31246] 0 2024-04-15T21:02:44.150 INFO:tasks.workunit.client.0.smithi072.stdout:8/469: dwrite d3/d4/d3b/f55 [4194304,4194304] 0 2024-04-15T21:02:44.152 INFO:tasks.workunit.client.0.smithi072.stdout:1/421: chown d5/db/f28 1 1 2024-04-15T21:02:44.154 INFO:tasks.workunit.client.0.smithi072.stdout:2/399: mknod d2/d66/d69/c7e 0 2024-04-15T21:02:44.156 INFO:tasks.workunit.client.0.smithi072.stdout:8/470: dwrite d3/d7e/f8d [0,4194304] 0 2024-04-15T21:02:44.159 INFO:tasks.workunit.client.1.smithi149.stdout:9/580: dwrite f1a [0,4194304] 0 2024-04-15T21:02:44.162 INFO:tasks.workunit.client.0.smithi072.stdout:7/427: dread d2/d7/d25/d2d/d46/d5a/d5f/f2e [0,4194304] 0 2024-04-15T21:02:44.164 INFO:tasks.workunit.client.0.smithi072.stdout:8/471: dwrite d3/d4/d3b/f6e [0,4194304] 0 2024-04-15T21:02:44.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/428: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 [401167,75582] 0 2024-04-15T21:02:44.166 INFO:tasks.workunit.client.0.smithi072.stdout:7/429: fsync d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 0 2024-04-15T21:02:44.167 INFO:tasks.workunit.client.0.smithi072.stdout:1/422: creat d5/db/d2d/d3a/f88 x:0 0 0 2024-04-15T21:02:44.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/581: truncate d23/d2b/d37/d50/fa2 5155044 0 2024-04-15T21:02:44.171 INFO:tasks.workunit.client.0.smithi072.stdout:7/430: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f39 4404027 0 2024-04-15T21:02:44.185 INFO:tasks.workunit.client.1.smithi149.stdout:9/582: dwrite d23/f5a [0,4194304] 0 2024-04-15T21:02:44.185 INFO:tasks.workunit.client.0.smithi072.stdout:5/401: link d0/f59 d0/d3/d33/d76/f88 0 2024-04-15T21:02:44.185 INFO:tasks.workunit.client.0.smithi072.stdout:6/423: sync 2024-04-15T21:02:44.185 INFO:tasks.workunit.client.0.smithi072.stdout:0/428: sync 2024-04-15T21:02:44.186 INFO:tasks.workunit.client.0.smithi072.stdout:0/429: fdatasync d0/d45/d35/f89 0 2024-04-15T21:02:44.186 INFO:tasks.workunit.client.0.smithi072.stdout:6/424: stat d2/d10/d11/d15/c25 0 2024-04-15T21:02:44.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/396: creat d1/f82 x:0 0 0 2024-04-15T21:02:44.191 INFO:tasks.workunit.client.1.smithi149.stdout:9/583: creat d23/d2b/d44/d7e/fcc x:0 0 0 2024-04-15T21:02:44.193 INFO:tasks.workunit.client.0.smithi072.stdout:8/472: mkdir d3/d4/d76/d8f 0 2024-04-15T21:02:44.193 INFO:tasks.workunit.client.0.smithi072.stdout:1/423: mknod d5/d31/c89 0 2024-04-15T21:02:44.195 INFO:tasks.workunit.client.0.smithi072.stdout:7/431: fsync d2/d7/d25/d2d/d46/d5a/d5f/f2e 0 2024-04-15T21:02:44.195 INFO:tasks.workunit.client.0.smithi072.stdout:9/373: link d4/d1f/d31/d42/c6b d4/d1f/d2c/c70 0 2024-04-15T21:02:44.196 INFO:tasks.workunit.client.0.smithi072.stdout:5/402: fsync d0/d3/d6/d14/f18 0 2024-04-15T21:02:44.198 INFO:tasks.workunit.client.0.smithi072.stdout:4/408: dwrite d7/d24/f1e [4194304,4194304] 0 2024-04-15T21:02:44.200 INFO:tasks.workunit.client.0.smithi072.stdout:6/425: mknod d2/c83 0 2024-04-15T21:02:44.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/584: getdents d23/d3c/d52 0 2024-04-15T21:02:44.202 INFO:tasks.workunit.client.0.smithi072.stdout:6/426: dread - d2/d42/f73 zero size 2024-04-15T21:02:44.205 INFO:tasks.workunit.client.0.smithi072.stdout:1/424: mkdir d5/db/d27/d8a 0 2024-04-15T21:02:44.206 INFO:tasks.workunit.client.0.smithi072.stdout:0/430: dwrite d0/d6/f4c [0,4194304] 0 2024-04-15T21:02:44.208 INFO:tasks.workunit.client.0.smithi072.stdout:0/431: write d0/d45/d7a/d70/d59/d8a/d7b/f7e [4253320,120041] 0 2024-04-15T21:02:44.209 INFO:tasks.workunit.client.1.smithi149.stdout:9/585: mknod d23/d3c/d7a/d7c/d7f/d86/dc5/ccd 0 2024-04-15T21:02:44.209 INFO:tasks.workunit.client.0.smithi072.stdout:0/432: stat d0/d19/d58/f5a 0 2024-04-15T21:02:44.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/374: creat d4/d29/f71 x:0 0 0 2024-04-15T21:02:44.218 INFO:tasks.workunit.client.0.smithi072.stdout:2/400: truncate d2/d3/f17 4060591 0 2024-04-15T21:02:44.221 INFO:tasks.workunit.client.0.smithi072.stdout:1/425: creat d5/db/d2d/f8b x:0 0 0 2024-04-15T21:02:44.222 INFO:tasks.workunit.client.0.smithi072.stdout:0/433: chown d0/d6/f25 17392050 1 2024-04-15T21:02:44.224 INFO:tasks.workunit.client.0.smithi072.stdout:9/375: chown d4/d1f/d31/d42/c6b 17 1 2024-04-15T21:02:44.225 INFO:tasks.workunit.client.0.smithi072.stdout:9/376: chown d4/d1f/d2c/d47/l65 0 1 2024-04-15T21:02:44.226 INFO:tasks.workunit.client.0.smithi072.stdout:9/377: fdatasync d4/d29/f59 0 2024-04-15T21:02:44.227 INFO:tasks.workunit.client.0.smithi072.stdout:3/397: rename d1/d15/d32/d2f/c5f to d1/c83 0 2024-04-15T21:02:44.228 INFO:tasks.workunit.client.0.smithi072.stdout:8/473: dwrite d3/de/d21/d2e/f5c [4194304,4194304] 0 2024-04-15T21:02:44.228 INFO:tasks.workunit.client.0.smithi072.stdout:9/378: read - d4/d29/d4c/f52 zero size 2024-04-15T21:02:44.229 INFO:tasks.workunit.client.0.smithi072.stdout:3/398: readlink d1/d3f/d4f/l61 0 2024-04-15T21:02:44.233 INFO:tasks.workunit.client.1.smithi149.stdout:9/586: dwrite f1d [4194304,4194304] 0 2024-04-15T21:02:44.234 INFO:tasks.workunit.client.0.smithi072.stdout:6/427: symlink d2/d40/d66/d7f/l84 0 2024-04-15T21:02:44.234 INFO:tasks.workunit.client.0.smithi072.stdout:5/403: truncate d0/d3/d7/d12/d31/f3d 532944 0 2024-04-15T21:02:44.235 INFO:tasks.workunit.client.1.smithi149.stdout:9/587: chown d23/d46/l62 0 1 2024-04-15T21:02:44.235 INFO:tasks.workunit.client.0.smithi072.stdout:4/409: dwrite d7/d15/d58/d62/f72 [0,4194304] 0 2024-04-15T21:02:44.239 INFO:tasks.workunit.client.0.smithi072.stdout:7/432: rename d2/d7/d25/d2d/d46/f79 to d2/d7/d25/d81/f86 0 2024-04-15T21:02:44.242 INFO:tasks.workunit.client.0.smithi072.stdout:7/433: read d2/d7/d25/d2d/d46/d5a/d5f/d26/f41 [2461900,100462] 0 2024-04-15T21:02:44.247 INFO:tasks.workunit.client.0.smithi072.stdout:3/399: creat d1/d5b/f84 x:0 0 0 2024-04-15T21:02:44.250 INFO:tasks.workunit.client.0.smithi072.stdout:2/401: creat d2/d3/f7f x:0 0 0 2024-04-15T21:02:44.252 INFO:tasks.workunit.client.0.smithi072.stdout:4/410: mknod d7/d28/d42/c7d 0 2024-04-15T21:02:44.253 INFO:tasks.workunit.client.0.smithi072.stdout:9/379: rename d4/f1e to d4/d29/d45/f72 0 2024-04-15T21:02:44.254 INFO:tasks.workunit.client.0.smithi072.stdout:3/400: dwrite d1/d5b/f60 [0,4194304] 0 2024-04-15T21:02:44.255 INFO:tasks.workunit.client.0.smithi072.stdout:1/426: truncate d5/db/fc 2105134 0 2024-04-15T21:02:44.256 INFO:tasks.workunit.client.0.smithi072.stdout:7/434: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 x:0 0 0 2024-04-15T21:02:44.257 INFO:tasks.workunit.client.0.smithi072.stdout:8/474: truncate d3/d4/d3b/f3e 1684986 0 2024-04-15T21:02:44.259 INFO:tasks.workunit.client.0.smithi072.stdout:3/401: chown d1/d15/d32/d2f/l3c 1 1 2024-04-15T21:02:44.259 INFO:tasks.workunit.client.0.smithi072.stdout:2/402: mkdir d2/d38/d73/d80 0 2024-04-15T21:02:44.261 INFO:tasks.workunit.client.0.smithi072.stdout:7/435: read - d2/d7/d25/d72/f85 zero size 2024-04-15T21:02:44.261 INFO:tasks.workunit.client.0.smithi072.stdout:1/427: mknod d5/d3d/d5e/c8c 0 2024-04-15T21:02:44.263 INFO:tasks.workunit.client.0.smithi072.stdout:4/411: dwrite f6 [4194304,4194304] 0 2024-04-15T21:02:44.265 INFO:tasks.workunit.client.0.smithi072.stdout:4/412: read - d7/d15/d58/f77 zero size 2024-04-15T21:02:44.268 INFO:tasks.workunit.client.0.smithi072.stdout:2/403: unlink d2/d8/l4a 0 2024-04-15T21:02:44.273 INFO:tasks.workunit.client.1.smithi149.stdout:9/588: write d23/f48 [122185,89039] 0 2024-04-15T21:02:44.276 INFO:tasks.workunit.client.0.smithi072.stdout:4/413: mknod d7/d10/d41/d45/c7e 0 2024-04-15T21:02:44.278 INFO:tasks.workunit.client.0.smithi072.stdout:2/404: mknod d2/d66/d69/c81 0 2024-04-15T21:02:44.279 INFO:tasks.workunit.client.1.smithi149.stdout:9/589: rename d23/d2b/d37/d6d/f7d to d23/d3c/d87/d9a/dad/fce 0 2024-04-15T21:02:44.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/434: dwrite d0/f13 [0,4194304] 0 2024-04-15T21:02:44.283 INFO:tasks.workunit.client.0.smithi072.stdout:1/428: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:44.284 INFO:tasks.workunit.client.1.smithi149.stdout:9/590: dread d23/d46/f73 [0,4194304] 0 2024-04-15T21:02:44.285 INFO:tasks.workunit.client.1.smithi149.stdout:9/591: chown d23/d2b/d37/d50/d79/cc3 17203919 1 2024-04-15T21:02:44.286 INFO:tasks.workunit.client.0.smithi072.stdout:5/404: dwrite d0/d3/d7/d12/f51 [4194304,4194304] 0 2024-04-15T21:02:44.288 INFO:tasks.workunit.client.0.smithi072.stdout:5/405: stat d0/d3/d7/d1f/f26 0 2024-04-15T21:02:44.289 INFO:tasks.workunit.client.0.smithi072.stdout:5/406: stat d0/d3/d7 0 2024-04-15T21:02:44.293 INFO:tasks.workunit.client.0.smithi072.stdout:0/435: rename d0/d45/d35/f36 to d0/d6/d48/d61/f90 0 2024-04-15T21:02:44.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/592: mkdir d23/d46/dcf 0 2024-04-15T21:02:44.300 INFO:tasks.workunit.client.0.smithi072.stdout:4/414: link d7/d28/d42/c61 d7/d15/d58/d62/d6f/c7f 0 2024-04-15T21:02:44.301 INFO:tasks.workunit.client.1.smithi149.stdout:9/593: dwrite d23/f5a [0,4194304] 0 2024-04-15T21:02:44.304 INFO:tasks.workunit.client.0.smithi072.stdout:0/436: creat d0/d45/d7a/d70/d59/d8a/d7b/f91 x:0 0 0 2024-04-15T21:02:44.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/380: truncate d4/d1f/d2c/f35 1131973 0 2024-04-15T21:02:44.308 INFO:tasks.workunit.client.0.smithi072.stdout:4/415: dwrite d7/d10/d41/d44/f48 [0,4194304] 0 2024-04-15T21:02:44.314 INFO:tasks.workunit.client.0.smithi072.stdout:9/381: read d4/d1f/d2c/f46 [4114537,61860] 0 2024-04-15T21:02:44.317 INFO:tasks.workunit.client.0.smithi072.stdout:9/382: stat d4/d1f/d2c/f57 0 2024-04-15T21:02:44.317 INFO:tasks.workunit.client.0.smithi072.stdout:2/405: getdents d2/d3 0 2024-04-15T21:02:44.318 INFO:tasks.workunit.client.0.smithi072.stdout:3/402: dwrite d1/d3f/d4f/f7e [0,4194304] 0 2024-04-15T21:02:44.321 INFO:tasks.workunit.client.0.smithi072.stdout:4/416: symlink d7/d15/d58/l80 0 2024-04-15T21:02:44.322 INFO:tasks.workunit.client.0.smithi072.stdout:4/417: chown d7/d24/f1e 170214237 1 2024-04-15T21:02:44.323 INFO:tasks.workunit.client.0.smithi072.stdout:4/418: write d7/f54 [1270573,49626] 0 2024-04-15T21:02:44.328 INFO:tasks.workunit.client.0.smithi072.stdout:3/403: creat d1/d3f/d4f/d73/f85 x:0 0 0 2024-04-15T21:02:44.331 INFO:tasks.workunit.client.0.smithi072.stdout:3/404: write d1/f64 [3985486,68755] 0 2024-04-15T21:02:44.333 INFO:tasks.workunit.client.0.smithi072.stdout:1/429: dwrite d5/db/f4f [0,4194304] 0 2024-04-15T21:02:44.336 INFO:tasks.workunit.client.0.smithi072.stdout:1/430: fsync d5/f8 0 2024-04-15T21:02:44.337 INFO:tasks.workunit.client.0.smithi072.stdout:9/383: dwrite d4/f1c [0,4194304] 0 2024-04-15T21:02:44.338 INFO:tasks.workunit.client.0.smithi072.stdout:1/431: fdatasync d5/db/f55 0 2024-04-15T21:02:44.340 INFO:tasks.workunit.client.0.smithi072.stdout:2/406: creat d2/d38/d73/d80/f82 x:0 0 0 2024-04-15T21:02:44.345 INFO:tasks.workunit.client.0.smithi072.stdout:0/437: dwrite d0/d6/f42 [0,4194304] 0 2024-04-15T21:02:44.346 INFO:tasks.workunit.client.0.smithi072.stdout:9/384: mkdir d4/d1f/d2c/d62/d73 0 2024-04-15T21:02:44.351 INFO:tasks.workunit.client.0.smithi072.stdout:0/438: creat d0/d19/d71/f92 x:0 0 0 2024-04-15T21:02:44.353 INFO:tasks.workunit.client.0.smithi072.stdout:1/432: rename d5/d3d/d77 to d5/db/d2d/d3a/d8d 0 2024-04-15T21:02:44.354 INFO:tasks.workunit.client.0.smithi072.stdout:4/419: dwrite d7/f2e [4194304,4194304] 0 2024-04-15T21:02:44.357 INFO:tasks.workunit.client.0.smithi072.stdout:2/407: dwrite d2/d66/f68 [0,4194304] 0 2024-04-15T21:02:44.359 INFO:tasks.workunit.client.0.smithi072.stdout:0/439: mkdir d0/d45/d7a/d70/d59/d8a/d93 0 2024-04-15T21:02:44.361 INFO:tasks.workunit.client.0.smithi072.stdout:0/440: stat d0/d6/f6a 0 2024-04-15T21:02:44.363 INFO:tasks.workunit.client.0.smithi072.stdout:9/385: dwrite d4/d1f/d2c/d62/f6c [0,4194304] 0 2024-04-15T21:02:44.364 INFO:tasks.workunit.client.0.smithi072.stdout:4/420: symlink d7/d28/l81 0 2024-04-15T21:02:44.371 INFO:tasks.workunit.client.0.smithi072.stdout:4/421: dwrite f6 [0,4194304] 0 2024-04-15T21:02:44.379 INFO:tasks.workunit.client.0.smithi072.stdout:9/386: truncate d4/d1f/d2c/f35 908683 0 2024-04-15T21:02:44.381 INFO:tasks.workunit.client.0.smithi072.stdout:3/405: dread d1/f10 [0,4194304] 0 2024-04-15T21:02:44.382 INFO:tasks.workunit.client.0.smithi072.stdout:4/422: creat d7/d10/d41/d4c/f82 x:0 0 0 2024-04-15T21:02:44.384 INFO:tasks.workunit.client.0.smithi072.stdout:9/387: mkdir d4/d29/d4c/d74 0 2024-04-15T21:02:44.384 INFO:tasks.workunit.client.0.smithi072.stdout:4/423: read d7/d10/d41/d44/f73 [372520,126158] 0 2024-04-15T21:02:44.386 INFO:tasks.workunit.client.0.smithi072.stdout:4/424: chown d7/d28/d6d 12 1 2024-04-15T21:02:44.386 INFO:tasks.workunit.client.0.smithi072.stdout:3/406: symlink d1/d3f/d4f/l86 0 2024-04-15T21:02:44.389 INFO:tasks.workunit.client.0.smithi072.stdout:4/425: symlink d7/d23/d74/l83 0 2024-04-15T21:02:44.390 INFO:tasks.workunit.client.0.smithi072.stdout:4/426: chown d7/d23/f29 201 1 2024-04-15T21:02:44.392 INFO:tasks.workunit.client.0.smithi072.stdout:2/408: truncate d2/d66/f68 4191080 0 2024-04-15T21:02:44.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/407: read d1/d15/d32/f50 [2349408,52406] 0 2024-04-15T21:02:44.394 INFO:tasks.workunit.client.0.smithi072.stdout:4/427: mknod d7/d23/c84 0 2024-04-15T21:02:44.396 INFO:tasks.workunit.client.0.smithi072.stdout:2/409: symlink d2/d64/l83 0 2024-04-15T21:02:44.397 INFO:tasks.workunit.client.0.smithi072.stdout:4/428: creat d7/d10/f85 x:0 0 0 2024-04-15T21:02:44.398 INFO:tasks.workunit.client.0.smithi072.stdout:3/408: creat d1/d3f/d4f/d73/f87 x:0 0 0 2024-04-15T21:02:44.398 INFO:tasks.workunit.client.0.smithi072.stdout:9/388: dread d4/f5 [8388608,4194304] 0 2024-04-15T21:02:44.402 INFO:tasks.workunit.client.0.smithi072.stdout:9/389: creat d4/d1f/d2c/d62/f75 x:0 0 0 2024-04-15T21:02:44.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/409: dwrite d1/d15/f5e [0,4194304] 0 2024-04-15T21:02:44.407 INFO:tasks.workunit.client.0.smithi072.stdout:0/441: dwrite d0/d6/d55/f5f [0,4194304] 0 2024-04-15T21:02:44.408 INFO:tasks.workunit.client.0.smithi072.stdout:9/390: mkdir d4/d76 0 2024-04-15T21:02:44.408 INFO:tasks.workunit.client.0.smithi072.stdout:3/410: chown d1/f43 2764 1 2024-04-15T21:02:44.409 INFO:tasks.workunit.client.0.smithi072.stdout:4/429: rename d7/d23/d74 to d7/d10/d41/d44/d7a/d86 0 2024-04-15T21:02:44.412 INFO:tasks.workunit.client.0.smithi072.stdout:0/442: unlink d0/d45/d35/l79 0 2024-04-15T21:02:44.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/391: symlink d4/l77 0 2024-04-15T21:02:44.415 INFO:tasks.workunit.client.0.smithi072.stdout:9/392: fsync d4/d29/d4c/f52 0 2024-04-15T21:02:44.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/549: sync 2024-04-15T21:02:44.416 INFO:tasks.workunit.client.0.smithi072.stdout:4/430: mknod d7/d15/d58/d62/d6f/c87 0 2024-04-15T21:02:44.418 INFO:tasks.workunit.client.0.smithi072.stdout:4/431: chown d7/d10/f11 289 1 2024-04-15T21:02:44.420 INFO:tasks.workunit.client.0.smithi072.stdout:2/410: dwrite d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:44.420 INFO:tasks.workunit.client.0.smithi072.stdout:9/393: dread d4/d1f/d31/d4d/f5e [0,4194304] 0 2024-04-15T21:02:44.425 INFO:tasks.workunit.client.0.smithi072.stdout:0/443: rmdir d0/d45/d7a/d70/d59/d8a/d93 0 2024-04-15T21:02:44.425 INFO:tasks.workunit.client.0.smithi072.stdout:0/444: chown d0/d45/f62 885453 1 2024-04-15T21:02:44.426 INFO:tasks.workunit.client.1.smithi149.stdout:6/550: dwrite da/d18/d10/d66/f69 [8388608,4194304] 0 2024-04-15T21:02:44.428 INFO:tasks.workunit.client.0.smithi072.stdout:3/411: getdents d1/d15 0 2024-04-15T21:02:44.430 INFO:tasks.workunit.client.0.smithi072.stdout:6/428: sync 2024-04-15T21:02:44.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/432: dread d7/d15/f20 [0,4194304] 0 2024-04-15T21:02:44.436 INFO:tasks.workunit.client.0.smithi072.stdout:3/412: dwrite d1/d15/d32/f5a [0,4194304] 0 2024-04-15T21:02:44.436 INFO:tasks.workunit.client.0.smithi072.stdout:4/433: dread - d7/d28/d42/f75 zero size 2024-04-15T21:02:44.438 INFO:tasks.workunit.client.1.smithi149.stdout:6/551: creat da/d49/d55/fa7 x:0 0 0 2024-04-15T21:02:44.439 INFO:tasks.workunit.client.0.smithi072.stdout:6/429: dwrite d2/f4a [0,4194304] 0 2024-04-15T21:02:44.443 INFO:tasks.workunit.client.0.smithi072.stdout:0/445: write d0/d45/d7a/f15 [909799,1634] 0 2024-04-15T21:02:44.452 INFO:tasks.workunit.client.0.smithi072.stdout:2/411: rename d2/d8/d6c/f7b to d2/d8/d6c/f84 0 2024-04-15T21:02:44.453 INFO:tasks.workunit.client.0.smithi072.stdout:2/412: fdatasync d2/d8/f13 0 2024-04-15T21:02:44.453 INFO:tasks.workunit.client.1.smithi149.stdout:6/552: unlink da/d18/d10/c20 0 2024-04-15T21:02:44.456 INFO:tasks.workunit.client.0.smithi072.stdout:4/434: symlink d7/d15/d58/d62/d6f/l88 0 2024-04-15T21:02:44.456 INFO:tasks.workunit.client.0.smithi072.stdout:4/435: stat d7/fc 0 2024-04-15T21:02:44.457 INFO:tasks.workunit.client.0.smithi072.stdout:0/446: read d0/d19/d58/f5a [3440988,106374] 0 2024-04-15T21:02:44.461 INFO:tasks.workunit.client.0.smithi072.stdout:3/413: symlink d1/d15/d32/l88 0 2024-04-15T21:02:44.463 INFO:tasks.workunit.client.0.smithi072.stdout:4/436: mknod d7/d10/d41/d45/c89 0 2024-04-15T21:02:44.464 INFO:tasks.workunit.client.0.smithi072.stdout:9/394: getdents d4/d1f/d31 0 2024-04-15T21:02:44.464 INFO:tasks.workunit.client.0.smithi072.stdout:2/413: mknod d2/c85 0 2024-04-15T21:02:44.467 INFO:tasks.workunit.client.0.smithi072.stdout:4/437: creat d7/d10/d41/d45/f8a x:0 0 0 2024-04-15T21:02:44.468 INFO:tasks.workunit.client.0.smithi072.stdout:3/414: dwrite d1/f74 [0,4194304] 0 2024-04-15T21:02:44.469 INFO:tasks.workunit.client.0.smithi072.stdout:2/414: symlink d2/d64/l86 0 2024-04-15T21:02:44.472 INFO:tasks.workunit.client.0.smithi072.stdout:2/415: dread - d2/d38/d73/f7d zero size 2024-04-15T21:02:44.473 INFO:tasks.workunit.client.0.smithi072.stdout:9/395: rmdir d4/d1f/d2c/d62/d73 0 2024-04-15T21:02:44.475 INFO:tasks.workunit.client.0.smithi072.stdout:4/438: dread d7/d23/f25 [0,4194304] 0 2024-04-15T21:02:44.476 INFO:tasks.workunit.client.0.smithi072.stdout:2/416: creat d2/d64/f87 x:0 0 0 2024-04-15T21:02:44.478 INFO:tasks.workunit.client.0.smithi072.stdout:9/396: creat d4/d1f/d2c/d62/f78 x:0 0 0 2024-04-15T21:02:44.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/397: chown d4/d1f/d31/d42/c6b 1490 1 2024-04-15T21:02:44.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/398: write d4/d1f/d2c/f57 [509218,36549] 0 2024-04-15T21:02:44.482 INFO:tasks.workunit.client.0.smithi072.stdout:3/415: rename d1/d3f/d4f/l6e to d1/d15/d32/l89 0 2024-04-15T21:02:44.482 INFO:tasks.workunit.client.0.smithi072.stdout:3/416: chown d1/d15/d32/d2f/l3c 3633746 1 2024-04-15T21:02:44.486 INFO:tasks.workunit.client.0.smithi072.stdout:3/417: write d1/d5b/f6a [5011355,128706] 0 2024-04-15T21:02:44.488 INFO:tasks.workunit.client.0.smithi072.stdout:9/399: getdents d4/d29/d4c 0 2024-04-15T21:02:44.489 INFO:tasks.workunit.client.0.smithi072.stdout:9/400: stat d4/d1f/c1d 0 2024-04-15T21:02:44.491 INFO:tasks.workunit.client.0.smithi072.stdout:3/418: rename d1/d15/f44 to d1/d3f/f8a 0 2024-04-15T21:02:44.491 INFO:tasks.workunit.client.1.smithi149.stdout:6/553: dwrite da/d2e/f50 [0,4194304] 0 2024-04-15T21:02:44.495 INFO:tasks.workunit.client.1.smithi149.stdout:6/554: creat da/d18/d33/fa8 x:0 0 0 2024-04-15T21:02:44.502 INFO:tasks.workunit.client.0.smithi072.stdout:3/419: dwrite d1/f49 [0,4194304] 0 2024-04-15T21:02:44.502 INFO:tasks.workunit.client.0.smithi072.stdout:2/417: dread d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:44.502 INFO:tasks.workunit.client.0.smithi072.stdout:9/401: rmdir d4/d1f/d58 0 2024-04-15T21:02:44.502 INFO:tasks.workunit.client.0.smithi072.stdout:4/439: truncate d7/d24/f1e 6816192 0 2024-04-15T21:02:44.505 INFO:tasks.workunit.client.0.smithi072.stdout:2/418: mknod d2/d66/c88 0 2024-04-15T21:02:44.506 INFO:tasks.workunit.client.0.smithi072.stdout:9/402: creat d4/d1f/d2c/d47/f79 x:0 0 0 2024-04-15T21:02:44.506 INFO:tasks.workunit.client.0.smithi072.stdout:3/420: dwrite d1/f64 [0,4194304] 0 2024-04-15T21:02:44.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/419: symlink d2/d3/l89 0 2024-04-15T21:02:44.512 INFO:tasks.workunit.client.0.smithi072.stdout:4/440: mkdir d7/d10/d41/d44/d7a/d86/d76/d8b 0 2024-04-15T21:02:44.516 INFO:tasks.workunit.client.1.smithi149.stdout:6/555: dread da/d18/d10/d16/f6d [0,4194304] 0 2024-04-15T21:02:44.517 INFO:tasks.workunit.client.0.smithi072.stdout:9/403: creat d4/d76/f7a x:0 0 0 2024-04-15T21:02:44.517 INFO:tasks.workunit.client.1.smithi149.stdout:6/556: dread - da/d49/d55/fa7 zero size 2024-04-15T21:02:44.519 INFO:tasks.workunit.client.1.smithi149.stdout:6/557: chown da/d18/d10/d66/l5a 558639 1 2024-04-15T21:02:44.520 INFO:tasks.workunit.client.0.smithi072.stdout:3/421: rename d1/d15/c2c to d1/d3f/d4f/d73/c8b 0 2024-04-15T21:02:44.521 INFO:tasks.workunit.client.0.smithi072.stdout:4/441: truncate d7/fc 5625701 0 2024-04-15T21:02:44.522 INFO:tasks.workunit.client.1.smithi149.stdout:6/558: truncate da/d18/d33/f6f 337640 0 2024-04-15T21:02:44.523 INFO:tasks.workunit.client.0.smithi072.stdout:9/404: dwrite d4/d1f/d2c/f57 [0,4194304] 0 2024-04-15T21:02:44.523 INFO:tasks.workunit.client.0.smithi072.stdout:4/442: truncate d7/f5c 195595 0 2024-04-15T21:02:44.524 INFO:tasks.workunit.client.0.smithi072.stdout:9/405: chown d4/d1f/d2c/f57 173258734 1 2024-04-15T21:02:44.524 INFO:tasks.workunit.client.0.smithi072.stdout:2/420: rename d2/l57 to d2/d8/d6c/l8a 0 2024-04-15T21:02:44.526 INFO:tasks.workunit.client.0.smithi072.stdout:4/443: mkdir d7/d28/d42/d8c 0 2024-04-15T21:02:44.527 INFO:tasks.workunit.client.0.smithi072.stdout:9/406: rmdir d4/d1f 39 2024-04-15T21:02:44.527 INFO:tasks.workunit.client.0.smithi072.stdout:4/444: write d7/d28/d42/f75 [771845,83358] 0 2024-04-15T21:02:44.528 INFO:tasks.workunit.client.0.smithi072.stdout:3/422: mkdir d1/d3f/d7f/d8c 0 2024-04-15T21:02:44.528 INFO:tasks.workunit.client.0.smithi072.stdout:3/423: chown d1/d5b/f62 27 1 2024-04-15T21:02:44.528 INFO:tasks.workunit.client.0.smithi072.stdout:2/421: fdatasync d2/d38/f54 0 2024-04-15T21:02:44.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/407: unlink d4/l77 0 2024-04-15T21:02:44.535 INFO:tasks.workunit.client.0.smithi072.stdout:4/445: mknod d7/d24/d3e/d5e/d6b/c8d 0 2024-04-15T21:02:44.536 INFO:tasks.workunit.client.0.smithi072.stdout:9/408: dread - d4/d1f/d31/f63 zero size 2024-04-15T21:02:44.554 INFO:tasks.workunit.client.1.smithi149.stdout:6/559: dread da/f75 [0,4194304] 0 2024-04-15T21:02:44.559 INFO:tasks.workunit.client.0.smithi072.stdout:3/424: write d1/d15/f3b [735925,93424] 0 2024-04-15T21:02:44.561 INFO:tasks.workunit.client.1.smithi149.stdout:6/560: dwrite da/d18/d10/fa3 [0,4194304] 0 2024-04-15T21:02:44.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/425: creat d1/d15/d32/d2f/d1a/f8d x:0 0 0 2024-04-15T21:02:44.565 INFO:tasks.workunit.client.0.smithi072.stdout:9/409: dwrite f3 [0,4194304] 0 2024-04-15T21:02:44.565 INFO:tasks.workunit.client.0.smithi072.stdout:9/410: readlink d4/l2f 0 2024-04-15T21:02:44.566 INFO:tasks.workunit.client.0.smithi072.stdout:9/411: fsync d4/d1f/d2c/f4f 0 2024-04-15T21:02:44.567 INFO:tasks.workunit.client.0.smithi072.stdout:3/426: unlink d1/d26/f30 0 2024-04-15T21:02:44.567 INFO:tasks.workunit.client.0.smithi072.stdout:3/427: dread - d1/d15/f6f zero size 2024-04-15T21:02:44.571 INFO:tasks.workunit.client.0.smithi072.stdout:4/446: truncate d7/d10/f11 4101622 0 2024-04-15T21:02:44.572 INFO:tasks.workunit.client.0.smithi072.stdout:4/447: write d7/d15/f66 [712120,12811] 0 2024-04-15T21:02:44.575 INFO:tasks.workunit.client.0.smithi072.stdout:9/412: rename d4/d1f/d31/d42/f53 to d4/d1f/d31/d4d/f7b 0 2024-04-15T21:02:44.576 INFO:tasks.workunit.client.0.smithi072.stdout:8/475: sync 2024-04-15T21:02:44.576 INFO:tasks.workunit.client.0.smithi072.stdout:7/436: sync 2024-04-15T21:02:44.577 INFO:tasks.workunit.client.0.smithi072.stdout:3/428: creat d1/f8e x:0 0 0 2024-04-15T21:02:44.578 INFO:tasks.workunit.client.1.smithi149.stdout:7/602: sync 2024-04-15T21:02:44.578 INFO:tasks.workunit.client.1.smithi149.stdout:4/670: sync 2024-04-15T21:02:44.578 INFO:tasks.workunit.client.0.smithi072.stdout:4/448: getdents d7/d28/d42/d8c 0 2024-04-15T21:02:44.579 INFO:tasks.workunit.client.0.smithi072.stdout:8/476: read d3/de/d1b/d3f/f83 [759853,130953] 0 2024-04-15T21:02:44.581 INFO:tasks.workunit.client.0.smithi072.stdout:9/413: link d4/d29/d4c/f52 d4/d29/d4c/d74/f7c 0 2024-04-15T21:02:44.581 INFO:tasks.workunit.client.0.smithi072.stdout:7/437: dread d2/d7/d25/d2d/d47/f64 [0,4194304] 0 2024-04-15T21:02:44.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/561: chown da/d18/d10/f42 50 1 2024-04-15T21:02:44.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/562: stat da/d49/fa5 0 2024-04-15T21:02:44.584 INFO:tasks.workunit.client.1.smithi149.stdout:4/671: creat dc/d18/dce/fe2 x:0 0 0 2024-04-15T21:02:44.586 INFO:tasks.workunit.client.1.smithi149.stdout:7/603: mkdir d3/d16/d32/d90/dad/dc4/dde 0 2024-04-15T21:02:44.586 INFO:tasks.workunit.client.0.smithi072.stdout:8/477: dwrite d3/de/d21/d2e/f42 [4194304,4194304] 0 2024-04-15T21:02:44.587 INFO:tasks.workunit.client.0.smithi072.stdout:4/449: creat d7/d10/d41/d44/f8e x:0 0 0 2024-04-15T21:02:44.587 INFO:tasks.workunit.client.0.smithi072.stdout:8/478: chown d3/de/d1b/d3f/c34 9309859 1 2024-04-15T21:02:44.588 INFO:tasks.workunit.client.0.smithi072.stdout:8/479: readlink d3/l84 0 2024-04-15T21:02:44.588 INFO:tasks.workunit.client.1.smithi149.stdout:7/604: read d3/d16/d20/f24 [2237671,34674] 0 2024-04-15T21:02:44.589 INFO:tasks.workunit.client.0.smithi072.stdout:4/450: read d7/d15/f33 [2490879,100365] 0 2024-04-15T21:02:44.589 INFO:tasks.workunit.client.1.smithi149.stdout:4/672: creat dc/fe3 x:0 0 0 2024-04-15T21:02:44.590 INFO:tasks.workunit.client.0.smithi072.stdout:8/480: truncate d3/d4/d3b/f65 890897 0 2024-04-15T21:02:44.590 INFO:tasks.workunit.client.1.smithi149.stdout:7/605: fdatasync d3/d16/d20/d36/d3d/d56/f5f 0 2024-04-15T21:02:44.595 INFO:tasks.workunit.client.1.smithi149.stdout:4/673: fsync fa 0 2024-04-15T21:02:44.599 INFO:tasks.workunit.client.0.smithi072.stdout:3/429: creat d1/f8f x:0 0 0 2024-04-15T21:02:44.600 INFO:tasks.workunit.client.0.smithi072.stdout:3/430: read - d1/f8e zero size 2024-04-15T21:02:44.600 INFO:tasks.workunit.client.0.smithi072.stdout:7/438: link d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 d2/d7/d25/d2d/d46/d5a/f88 0 2024-04-15T21:02:44.601 INFO:tasks.workunit.client.1.smithi149.stdout:4/674: write dc/d2c/d3e/d7c/fb2 [2409489,106344] 0 2024-04-15T21:02:44.602 INFO:tasks.workunit.client.0.smithi072.stdout:7/439: write d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 [627802,85352] 0 2024-04-15T21:02:44.603 INFO:tasks.workunit.client.1.smithi149.stdout:7/606: creat d3/d17/d1f/d93/fdf x:0 0 0 2024-04-15T21:02:44.603 INFO:tasks.workunit.client.1.smithi149.stdout:4/675: chown dc/d2c/d3e/d15/d3f/c9b 103880 1 2024-04-15T21:02:44.603 INFO:tasks.workunit.client.0.smithi072.stdout:7/440: chown d2/d7/d25/d2d/d47/f5c 0 1 2024-04-15T21:02:44.604 INFO:tasks.workunit.client.1.smithi149.stdout:6/563: getdents da/d2e 0 2024-04-15T21:02:44.604 INFO:tasks.workunit.client.0.smithi072.stdout:7/441: dread - d2/d7/d25/d2d/d46/d5a/f7c zero size 2024-04-15T21:02:44.605 INFO:tasks.workunit.client.1.smithi149.stdout:7/607: chown d3/d16/d32/d90/fc1 46 1 2024-04-15T21:02:44.605 INFO:tasks.workunit.client.0.smithi072.stdout:9/414: rmdir d4/d1f/d2c/d6e 0 2024-04-15T21:02:44.605 INFO:tasks.workunit.client.0.smithi072.stdout:7/442: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f76 [3203799,124400] 0 2024-04-15T21:02:44.606 INFO:tasks.workunit.client.0.smithi072.stdout:3/431: mknod d1/d3f/d4f/c90 0 2024-04-15T21:02:44.607 INFO:tasks.workunit.client.0.smithi072.stdout:9/415: write d4/f11 [4117669,30492] 0 2024-04-15T21:02:44.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/676: chown dc/d18/cda 0 1 2024-04-15T21:02:44.608 INFO:tasks.workunit.client.0.smithi072.stdout:3/432: fsync d1/d15/d32/d2f/f3a 0 2024-04-15T21:02:44.609 INFO:tasks.workunit.client.0.smithi072.stdout:9/416: dread - d4/d1f/d31/d4d/f7b zero size 2024-04-15T21:02:44.610 INFO:tasks.workunit.client.0.smithi072.stdout:9/417: fsync d4/d1f/d2c/f2d 0 2024-04-15T21:02:44.610 INFO:tasks.workunit.client.0.smithi072.stdout:4/451: creat d7/d28/f8f x:0 0 0 2024-04-15T21:02:44.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/564: symlink da/d11/la9 0 2024-04-15T21:02:44.611 INFO:tasks.workunit.client.0.smithi072.stdout:4/452: readlink d7/d28/l81 0 2024-04-15T21:02:44.612 INFO:tasks.workunit.client.1.smithi149.stdout:6/565: chown da/d60/f9c 17504697 1 2024-04-15T21:02:44.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/608: mknod d3/d16/d20/ce0 0 2024-04-15T21:02:44.616 INFO:tasks.workunit.client.0.smithi072.stdout:3/433: dwrite d1/d15/d32/f65 [0,4194304] 0 2024-04-15T21:02:44.616 INFO:tasks.workunit.client.1.smithi149.stdout:6/566: dread da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:44.623 INFO:tasks.workunit.client.0.smithi072.stdout:4/453: rmdir d7/d15 39 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:1/572: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:2/672: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:3/677: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:5/613: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:9/594: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:8/705: sync 2024-04-15T21:02:44.624 INFO:tasks.workunit.client.1.smithi149.stdout:0/801: sync 2024-04-15T21:02:44.626 INFO:tasks.workunit.client.0.smithi072.stdout:9/418: dread d4/d1f/d31/d4d/f5c [0,4194304] 0 2024-04-15T21:02:44.627 INFO:tasks.workunit.client.0.smithi072.stdout:9/419: truncate d4/d29/f71 445215 0 2024-04-15T21:02:44.629 INFO:tasks.workunit.client.1.smithi149.stdout:1/573: dread d1/d17/d52/d42/f74 [0,4194304] 0 2024-04-15T21:02:44.632 INFO:tasks.workunit.client.0.smithi072.stdout:9/420: dwrite d4/d1f/f54 [0,4194304] 0 2024-04-15T21:02:44.633 INFO:tasks.workunit.client.0.smithi072.stdout:7/443: unlink d2/d7/d25/d2d/d52/c65 0 2024-04-15T21:02:44.633 INFO:tasks.workunit.client.0.smithi072.stdout:9/421: readlink d4/d29/l38 0 2024-04-15T21:02:44.633 INFO:tasks.workunit.client.1.smithi149.stdout:8/706: dwrite d2/d16/f65 [0,4194304] 0 2024-04-15T21:02:44.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/678: creat d1/db/d28/d87/fcd x:0 0 0 2024-04-15T21:02:44.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/614: dwrite d0/f4f [0,4194304] 0 2024-04-15T21:02:44.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/609: link d3/d39/d92/cd8 d3/d16/d20/d36/d3d/da4/ce1 0 2024-04-15T21:02:44.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/679: chown d1/db/d24/d2b/c75 5906296 1 2024-04-15T21:02:44.642 INFO:tasks.workunit.client.1.smithi149.stdout:7/610: truncate d3/d16/d32/d90/fc1 627521 0 2024-04-15T21:02:44.643 INFO:tasks.workunit.client.0.smithi072.stdout:3/434: mkdir d1/d91 0 2024-04-15T21:02:44.644 INFO:tasks.workunit.client.0.smithi072.stdout:3/435: write d1/d15/f6f [499925,20632] 0 2024-04-15T21:02:44.648 INFO:tasks.workunit.client.1.smithi149.stdout:5/615: fsync d0/d6/d82/da1/f7f 0 2024-04-15T21:02:44.651 INFO:tasks.workunit.client.1.smithi149.stdout:0/802: creat d1/d5/d24/d50/d13/d38/d44/f11a x:0 0 0 2024-04-15T21:02:44.653 INFO:tasks.workunit.client.1.smithi149.stdout:0/803: write d1/d9/d64/d65/d104/d119/df7/f10e [127133,103345] 0 2024-04-15T21:02:44.654 INFO:tasks.workunit.client.1.smithi149.stdout:0/804: chown d1/d9/d64/df0/f10f 858860 1 2024-04-15T21:02:44.655 INFO:tasks.workunit.client.1.smithi149.stdout:2/673: creat d4/dc7/fe9 x:0 0 0 2024-04-15T21:02:44.657 INFO:tasks.workunit.client.0.smithi072.stdout:4/454: creat d7/d15/d58/d62/f90 x:0 0 0 2024-04-15T21:02:44.658 INFO:tasks.workunit.client.1.smithi149.stdout:8/707: rmdir d2/df/d10/d20/d6b 39 2024-04-15T21:02:44.660 INFO:tasks.workunit.client.1.smithi149.stdout:8/708: write d2/df/d10/d25/d37/d53/daf/d85/fcb [920780,90143] 0 2024-04-15T21:02:44.660 INFO:tasks.workunit.client.1.smithi149.stdout:4/677: write dc/d2c/d3e/d15/d5b/f71 [4563407,27204] 0 2024-04-15T21:02:44.661 INFO:tasks.workunit.client.0.smithi072.stdout:7/444: dread d2/d7/d25/d2d/d46/d5a/d5f/f3c [0,4194304] 0 2024-04-15T21:02:44.661 INFO:tasks.workunit.client.1.smithi149.stdout:3/680: creat d1/db/d40/fce x:0 0 0 2024-04-15T21:02:44.662 INFO:tasks.workunit.client.1.smithi149.stdout:8/709: readlink d2/df/d10/d25/d37/d53/lac 0 2024-04-15T21:02:44.666 INFO:tasks.workunit.client.0.smithi072.stdout:7/445: dwrite d2/f1c [8388608,4194304] 0 2024-04-15T21:02:44.669 INFO:tasks.workunit.client.0.smithi072.stdout:4/455: mknod d7/d23/d6c/c91 0 2024-04-15T21:02:44.673 INFO:tasks.workunit.client.0.smithi072.stdout:7/446: dread d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 [0,4194304] 0 2024-04-15T21:02:44.673 INFO:tasks.workunit.client.0.smithi072.stdout:7/447: rename d2/d7/d25/d81 to d2/d7/d25/d81/d89 22 2024-04-15T21:02:44.674 INFO:tasks.workunit.client.1.smithi149.stdout:0/805: mkdir d1/d5/d24/d50/d13/d38/d44/d61/d11b 0 2024-04-15T21:02:44.678 INFO:tasks.workunit.client.0.smithi072.stdout:9/422: creat d4/d1f/d2c/f7d x:0 0 0 2024-04-15T21:02:44.679 INFO:tasks.workunit.client.0.smithi072.stdout:9/423: truncate d4/f6a 483615 0 2024-04-15T21:02:44.679 INFO:tasks.workunit.client.0.smithi072.stdout:9/424: fsync d4/f6a 0 2024-04-15T21:02:44.680 INFO:tasks.workunit.client.1.smithi149.stdout:3/681: chown d1/l18 29660619 1 2024-04-15T21:02:44.685 INFO:tasks.workunit.client.1.smithi149.stdout:8/710: rename d2/df/d10/d25/d32/d45/l54 to d2/df/d10/d25/d57/dd1/d50/d5d/lfe 0 2024-04-15T21:02:44.687 INFO:tasks.workunit.client.1.smithi149.stdout:7/611: dwrite d3/d16/d20/d36/d3d/f4f [0,4194304] 0 2024-04-15T21:02:44.688 INFO:tasks.workunit.client.1.smithi149.stdout:1/574: write d1/db/d14/f9d [352305,114853] 0 2024-04-15T21:02:44.689 INFO:tasks.workunit.client.1.smithi149.stdout:1/575: fdatasync d1/db/dc/d38/f63 0 2024-04-15T21:02:44.691 INFO:tasks.workunit.client.0.smithi072.stdout:7/448: rmdir d2/d7/d25/d2d 39 2024-04-15T21:02:44.693 INFO:tasks.workunit.client.1.smithi149.stdout:5/616: symlink d0/lcb 0 2024-04-15T21:02:44.696 INFO:tasks.workunit.client.0.smithi072.stdout:5/407: sync 2024-04-15T21:02:44.696 INFO:tasks.workunit.client.0.smithi072.stdout:1/433: sync 2024-04-15T21:02:44.698 INFO:tasks.workunit.client.1.smithi149.stdout:0/806: unlink d1/d5/d24/d50/c23 0 2024-04-15T21:02:44.702 INFO:tasks.workunit.client.0.smithi072.stdout:9/425: rename d4/fc to d4/d1f/d31/f7e 0 2024-04-15T21:02:44.702 INFO:tasks.workunit.client.1.smithi149.stdout:4/678: dwrite dc/d18/d21/d81/fa7 [0,4194304] 0 2024-04-15T21:02:44.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/426: readlink d4/d1f/d2c/d47/l65 0 2024-04-15T21:02:44.703 INFO:tasks.workunit.client.1.smithi149.stdout:2/674: getdents d4/d7/da 0 2024-04-15T21:02:44.703 INFO:tasks.workunit.client.0.smithi072.stdout:4/456: creat d7/d28/d6d/f92 x:0 0 0 2024-04-15T21:02:44.704 INFO:tasks.workunit.client.0.smithi072.stdout:3/436: getdents d1/d3f/d4f/d73 0 2024-04-15T21:02:44.705 INFO:tasks.workunit.client.1.smithi149.stdout:4/679: chown dc/d8f/d91/f97 16396774 1 2024-04-15T21:02:44.705 INFO:tasks.workunit.client.0.smithi072.stdout:4/457: dread - d7/d10/d41/d45/f8a zero size 2024-04-15T21:02:44.706 INFO:tasks.workunit.client.0.smithi072.stdout:7/449: rmdir d2/d7/d25/d81 39 2024-04-15T21:02:44.709 INFO:tasks.workunit.client.1.smithi149.stdout:7/612: write d3/d96/f9a [7210812,2899] 0 2024-04-15T21:02:44.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/408: rmdir d0/d3/d7/d12/d31/d55 39 2024-04-15T21:02:44.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/409: chown d0/f80 1369045 1 2024-04-15T21:02:44.711 INFO:tasks.workunit.client.1.smithi149.stdout:8/711: mkdir d2/df/d10/d25/d57/dd1/d50/dff 0 2024-04-15T21:02:44.711 INFO:tasks.workunit.client.0.smithi072.stdout:5/410: write d0/d3/d7/d1f/d4c/f5d [491572,4189] 0 2024-04-15T21:02:44.713 INFO:tasks.workunit.client.0.smithi072.stdout:3/437: rename d1/d3f/d4f/l7a to d1/d15/l92 0 2024-04-15T21:02:44.715 INFO:tasks.workunit.client.0.smithi072.stdout:9/427: dread d4/d1f/d2c/f2d [0,4194304] 0 2024-04-15T21:02:44.715 INFO:tasks.workunit.client.0.smithi072.stdout:4/458: mkdir d7/d10/d41/d45/d93 0 2024-04-15T21:02:44.717 INFO:tasks.workunit.client.0.smithi072.stdout:9/428: dread d4/d1f/d2c/f39 [0,4194304] 0 2024-04-15T21:02:44.719 INFO:tasks.workunit.client.1.smithi149.stdout:1/576: rename d1/d17/d5e/d64 to d1/db/dc/d38/d39/d43/daa 0 2024-04-15T21:02:44.722 INFO:tasks.workunit.client.0.smithi072.stdout:3/438: dread d1/d15/d32/d2f/d1a/f1d [0,4194304] 0 2024-04-15T21:02:44.724 INFO:tasks.workunit.client.0.smithi072.stdout:5/411: write d0/d3/d7/d12/d31/d55/d58/f65 [32545,100133] 0 2024-04-15T21:02:44.726 INFO:tasks.workunit.client.0.smithi072.stdout:4/459: rmdir d7/d10/d41/d4c 39 2024-04-15T21:02:44.728 INFO:tasks.workunit.client.1.smithi149.stdout:7/613: truncate d3/d39/f79 4416110 0 2024-04-15T21:02:44.729 INFO:tasks.workunit.client.1.smithi149.stdout:7/614: readlink d3/d16/d20/dab/ldc 0 2024-04-15T21:02:44.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/429: read d4/d1f/f2b [1788246,13409] 0 2024-04-15T21:02:44.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/450: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c8a 0 2024-04-15T21:02:44.733 INFO:tasks.workunit.client.0.smithi072.stdout:1/434: rmdir d5/db/d2d/d3a/d8d 0 2024-04-15T21:02:44.734 INFO:tasks.workunit.client.0.smithi072.stdout:1/435: chown d5/db/d2d/d3a/l1d 2920 1 2024-04-15T21:02:44.735 INFO:tasks.workunit.client.0.smithi072.stdout:3/439: creat d1/d15/f93 x:0 0 0 2024-04-15T21:02:44.737 INFO:tasks.workunit.client.0.smithi072.stdout:9/430: truncate d4/f1c 1477637 0 2024-04-15T21:02:44.740 INFO:tasks.workunit.client.0.smithi072.stdout:5/412: creat d0/d3/d33/d85/f89 x:0 0 0 2024-04-15T21:02:44.742 INFO:tasks.workunit.client.0.smithi072.stdout:3/440: rename d1/d15/c66 to d1/d15/c94 0 2024-04-15T21:02:44.746 INFO:tasks.workunit.client.0.smithi072.stdout:0/447: sync 2024-04-15T21:02:44.746 INFO:tasks.workunit.client.0.smithi072.stdout:6/430: sync 2024-04-15T21:02:44.747 INFO:tasks.workunit.client.0.smithi072.stdout:1/436: mknod d5/db/d2d/d85/c8e 0 2024-04-15T21:02:44.747 INFO:tasks.workunit.client.0.smithi072.stdout:0/448: fdatasync d0/d6/d6d/f83 0 2024-04-15T21:02:44.749 INFO:tasks.workunit.client.0.smithi072.stdout:0/449: write d0/d45/d7a/d70/d59/d8a/f65 [362112,95632] 0 2024-04-15T21:02:44.749 INFO:tasks.workunit.client.0.smithi072.stdout:3/441: write d1/d15/d32/f77 [1219384,92640] 0 2024-04-15T21:02:44.750 INFO:tasks.workunit.client.0.smithi072.stdout:4/460: link d7/d28/l4b d7/d24/d3e/d5e/l94 0 2024-04-15T21:02:44.754 INFO:tasks.workunit.client.0.smithi072.stdout:7/451: creat d2/d7/d25/f8b x:0 0 0 2024-04-15T21:02:44.762 INFO:tasks.workunit.client.0.smithi072.stdout:0/450: mkdir d0/d74/d94 0 2024-04-15T21:02:44.768 INFO:tasks.workunit.client.0.smithi072.stdout:7/452: mknod d2/d7/d25/d2d/d46/c8c 0 2024-04-15T21:02:44.773 INFO:tasks.workunit.client.0.smithi072.stdout:5/413: rmdir d0/d3/d7/d12/d75 0 2024-04-15T21:02:44.776 INFO:tasks.workunit.client.1.smithi149.stdout:6/567: sync 2024-04-15T21:02:44.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/431: write d4/d1f/f24 [639452,3508] 0 2024-04-15T21:02:44.779 INFO:tasks.workunit.client.0.smithi072.stdout:7/453: rmdir d2/d7/d25/d2d/d47 39 2024-04-15T21:02:44.785 INFO:tasks.workunit.client.0.smithi072.stdout:0/451: symlink d0/d3/l95 0 2024-04-15T21:02:44.790 INFO:tasks.workunit.client.0.smithi072.stdout:7/454: chown d2/d7/d25/d2d/d46/d5a/d5f/f11 204957308 1 2024-04-15T21:02:44.790 INFO:tasks.workunit.client.0.smithi072.stdout:5/414: dread d0/d3/d7/d12/d31/d49/f52 [0,4194304] 0 2024-04-15T21:02:44.792 INFO:tasks.workunit.client.0.smithi072.stdout:0/452: mkdir d0/d19/d96 0 2024-04-15T21:02:44.793 INFO:tasks.workunit.client.0.smithi072.stdout:0/453: dread - d0/d6/d6d/f83 zero size 2024-04-15T21:02:44.796 INFO:tasks.workunit.client.1.smithi149.stdout:5/617: rename d0/d6/d2d/c4c to d0/d6/d82/da1/d12/d16/da9/d1b/ccc 0 2024-04-15T21:02:44.796 INFO:tasks.workunit.client.0.smithi072.stdout:3/442: dwrite d1/d15/d32/d2f/d1a/f37 [0,4194304] 0 2024-04-15T21:02:44.796 INFO:tasks.workunit.client.0.smithi072.stdout:1/437: write d5/db/f52 [2379467,33220] 0 2024-04-15T21:02:44.798 INFO:tasks.workunit.client.0.smithi072.stdout:7/455: fsync d2/d7/d25/d2d/d46/d5a/f88 0 2024-04-15T21:02:44.798 INFO:tasks.workunit.client.1.smithi149.stdout:1/577: symlink d1/db/d16/d86/lab 0 2024-04-15T21:02:44.800 INFO:tasks.workunit.client.1.smithi149.stdout:1/578: truncate d1/db/dc/fa5 164591 0 2024-04-15T21:02:44.801 INFO:tasks.workunit.client.0.smithi072.stdout:9/432: dread d4/d1f/d31/f7e [0,4194304] 0 2024-04-15T21:02:44.802 INFO:tasks.workunit.client.1.smithi149.stdout:1/579: truncate d1/d17/d36/d69/fa8 149084 0 2024-04-15T21:02:44.805 INFO:tasks.workunit.client.0.smithi072.stdout:1/438: dwrite d5/db/d2d/d3a/d1f/d63/f68 [0,4194304] 0 2024-04-15T21:02:44.805 INFO:tasks.workunit.client.1.smithi149.stdout:3/682: link d1/db/d40/da0/fbb d1/fcf 0 2024-04-15T21:02:44.811 INFO:tasks.workunit.client.0.smithi072.stdout:0/454: mkdir d0/d97 0 2024-04-15T21:02:44.818 INFO:tasks.workunit.client.0.smithi072.stdout:3/443: unlink d1/d15/d32/d2f/d1a/f37 0 2024-04-15T21:02:44.822 INFO:tasks.workunit.client.0.smithi072.stdout:7/456: read - d2/d7/d25/d2d/d47/f5c zero size 2024-04-15T21:02:44.824 INFO:tasks.workunit.client.0.smithi072.stdout:7/457: chown d2/d7/d25/d2d/d46/d5a/d5f 0 1 2024-04-15T21:02:44.824 INFO:tasks.workunit.client.1.smithi149.stdout:6/568: truncate da/d11/f7b 215002 0 2024-04-15T21:02:44.825 INFO:tasks.workunit.client.0.smithi072.stdout:7/458: fsync d2/f1c 0 2024-04-15T21:02:44.825 INFO:tasks.workunit.client.1.smithi149.stdout:9/595: sync 2024-04-15T21:02:44.827 INFO:tasks.workunit.client.1.smithi149.stdout:2/675: rename d4/d7/d46/de4/l75 to d4/d7/d46/de4/d21/d5e/dbe/lea 0 2024-04-15T21:02:44.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/439: unlink d5/db/d2d/d3a/d1f/f53 0 2024-04-15T21:02:44.830 INFO:tasks.workunit.client.1.smithi149.stdout:5/618: symlink d0/d9/d71/lcd 0 2024-04-15T21:02:44.832 INFO:tasks.workunit.client.1.smithi149.stdout:5/619: write d0/d6/d82/da1/d12/d16/da9/d9b/fa7 [876580,109866] 0 2024-04-15T21:02:44.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/433: dread d4/f13 [0,4194304] 0 2024-04-15T21:02:44.835 INFO:tasks.workunit.client.1.smithi149.stdout:1/580: mkdir d1/d17/d52/d42/dac 0 2024-04-15T21:02:44.836 INFO:tasks.workunit.client.0.smithi072.stdout:1/440: dwrite d5/db/d27/f47 [4194304,4194304] 0 2024-04-15T21:02:44.837 INFO:tasks.workunit.client.1.smithi149.stdout:3/683: creat d1/d81/fd0 x:0 0 0 2024-04-15T21:02:44.839 INFO:tasks.workunit.client.0.smithi072.stdout:5/415: rename d0/d3/d7/d12/d31/d49/f52 to d0/d3/d7/f8a 0 2024-04-15T21:02:44.840 INFO:tasks.workunit.client.0.smithi072.stdout:5/416: readlink d0/l3f 0 2024-04-15T21:02:44.841 INFO:tasks.workunit.client.0.smithi072.stdout:5/417: stat d0/f80 0 2024-04-15T21:02:44.842 INFO:tasks.workunit.client.0.smithi072.stdout:7/459: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d 0 2024-04-15T21:02:44.843 INFO:tasks.workunit.client.0.smithi072.stdout:3/444: dwrite d1/d15/d32/f50 [0,4194304] 0 2024-04-15T21:02:44.845 INFO:tasks.workunit.client.0.smithi072.stdout:7/460: chown d2/d7/d25/d2d/d52/d6d/c7a 14 1 2024-04-15T21:02:44.845 INFO:tasks.workunit.client.0.smithi072.stdout:1/441: dwrite d5/db/d27/d5c/f84 [0,4194304] 0 2024-04-15T21:02:44.846 INFO:tasks.workunit.client.1.smithi149.stdout:2/676: chown d4/d7/d46/de4/d21/d5e/fb9 6 1 2024-04-15T21:02:44.848 INFO:tasks.workunit.client.1.smithi149.stdout:5/620: fdatasync d0/d6/d82/da1/d12/f6e 0 2024-04-15T21:02:44.850 INFO:tasks.workunit.client.1.smithi149.stdout:0/807: dwrite d1/d5/dc/f5e [0,4194304] 0 2024-04-15T21:02:44.852 INFO:tasks.workunit.client.0.smithi072.stdout:3/445: dwrite d1/d15/d32/d2f/f5c [0,4194304] 0 2024-04-15T21:02:44.853 INFO:tasks.workunit.client.0.smithi072.stdout:7/461: dread d2/d7/d25/d2d/d46/d5a/d5f/f3c [0,4194304] 0 2024-04-15T21:02:44.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/621: dread - d0/d6/d82/fa6 zero size 2024-04-15T21:02:44.855 INFO:tasks.workunit.client.1.smithi149.stdout:9/596: dread d23/f24 [0,4194304] 0 2024-04-15T21:02:44.858 INFO:tasks.workunit.client.1.smithi149.stdout:4/680: write dc/d18/d21/f4d [471292,126670] 0 2024-04-15T21:02:44.860 INFO:tasks.workunit.client.0.smithi072.stdout:2/422: sync 2024-04-15T21:02:44.860 INFO:tasks.workunit.client.0.smithi072.stdout:8/481: sync 2024-04-15T21:02:44.860 INFO:tasks.workunit.client.0.smithi072.stdout:5/418: creat d0/d3/d33/d60/f8b x:0 0 0 2024-04-15T21:02:44.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/581: creat d1/db/dc/d11/fad x:0 0 0 2024-04-15T21:02:44.862 INFO:tasks.workunit.client.1.smithi149.stdout:2/677: write d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/f8f [3923399,82695] 0 2024-04-15T21:02:44.862 INFO:tasks.workunit.client.1.smithi149.stdout:6/569: getdents da/d49/d55/da0 0 2024-04-15T21:02:44.863 INFO:tasks.workunit.client.1.smithi149.stdout:7/615: write d3/f2c [4593675,85074] 0 2024-04-15T21:02:44.864 INFO:tasks.workunit.client.1.smithi149.stdout:3/684: mkdir d1/db/d40/da0/dd1 0 2024-04-15T21:02:44.865 INFO:tasks.workunit.client.1.smithi149.stdout:8/712: write d2/f86 [865273,18885] 0 2024-04-15T21:02:44.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/622: readlink d0/d6/d82/da1/d12/d16/da9/d1b/d9c/lab 0 2024-04-15T21:02:44.867 INFO:tasks.workunit.client.0.smithi072.stdout:8/482: dwrite d3/d4/d3b/f3d [0,4194304] 0 2024-04-15T21:02:44.869 INFO:tasks.workunit.client.0.smithi072.stdout:8/483: truncate d3/de/f25 8480417 0 2024-04-15T21:02:44.870 INFO:tasks.workunit.client.1.smithi149.stdout:4/681: chown dc/d18/d21/d81/c82 13023 1 2024-04-15T21:02:44.871 INFO:tasks.workunit.client.1.smithi149.stdout:3/685: read - d1/db/d40/fce zero size 2024-04-15T21:02:44.879 INFO:tasks.workunit.client.1.smithi149.stdout:9/597: symlink d23/d3c/d52/ld0 0 2024-04-15T21:02:44.882 INFO:tasks.workunit.client.1.smithi149.stdout:7/616: symlink d3/d16/d20/db5/le2 0 2024-04-15T21:02:44.886 INFO:tasks.workunit.client.0.smithi072.stdout:7/462: symlink d2/d7/d25/d2d/d46/d5a/d5f/d43/l8e 0 2024-04-15T21:02:44.888 INFO:tasks.workunit.client.0.smithi072.stdout:0/455: dwrite d0/d45/d7a/f2a [0,4194304] 0 2024-04-15T21:02:44.890 INFO:tasks.workunit.client.1.smithi149.stdout:6/570: creat da/d18/d10/d3f/faa x:0 0 0 2024-04-15T21:02:44.891 INFO:tasks.workunit.client.1.smithi149.stdout:7/617: write d3/d16/d20/d6c/f9f [858404,53824] 0 2024-04-15T21:02:44.901 INFO:tasks.workunit.client.0.smithi072.stdout:9/434: write d4/f7 [4329733,28571] 0 2024-04-15T21:02:44.901 INFO:tasks.workunit.client.0.smithi072.stdout:9/435: chown f3 4654 1 2024-04-15T21:02:44.902 INFO:tasks.workunit.client.0.smithi072.stdout:5/419: dwrite d0/d3/d7/d12/f54 [0,4194304] 0 2024-04-15T21:02:44.903 INFO:tasks.workunit.client.1.smithi149.stdout:4/682: read dc/d1a/f4e [1318892,87740] 0 2024-04-15T21:02:44.906 INFO:tasks.workunit.client.1.smithi149.stdout:4/683: read dc/d2c/d3e/d15/d5b/fc5 [934442,86152] 0 2024-04-15T21:02:44.906 INFO:tasks.workunit.client.1.smithi149.stdout:8/713: rename d2/df/d10/d25/d37/d53/lac to d2/df/d10/d25/d57/dd1/d50/d8e/l100 0 2024-04-15T21:02:44.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/431: sync 2024-04-15T21:02:44.909 INFO:tasks.workunit.client.1.smithi149.stdout:8/714: write d2/df/d10/d25/d37/d53/daf/d85/d35/feb [37437,53226] 0 2024-04-15T21:02:44.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/686: unlink d1/db/d40/da0/fb2 0 2024-04-15T21:02:44.913 INFO:tasks.workunit.client.1.smithi149.stdout:9/598: creat d23/d46/fd1 x:0 0 0 2024-04-15T21:02:44.917 INFO:tasks.workunit.client.1.smithi149.stdout:7/618: fdatasync d3/f94 0 2024-04-15T21:02:44.923 INFO:tasks.workunit.client.1.smithi149.stdout:4/684: readlink dc/d2c/d3e/d35/d4b/l90 0 2024-04-15T21:02:44.925 INFO:tasks.workunit.client.1.smithi149.stdout:8/715: symlink d2/df/d10/d25/d37/d53/daf/d92/l101 0 2024-04-15T21:02:44.929 INFO:tasks.workunit.client.0.smithi072.stdout:7/463: creat d2/d7/d25/d2d/d46/d5a/f8f x:0 0 0 2024-04-15T21:02:44.931 INFO:tasks.workunit.client.0.smithi072.stdout:7/464: truncate d2/d7/d25/d2d/d46/d5a/d5f/f82 260204 0 2024-04-15T21:02:44.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/599: unlink d23/f48 0 2024-04-15T21:02:44.933 INFO:tasks.workunit.client.0.smithi072.stdout:2/423: symlink d2/d8/l8b 0 2024-04-15T21:02:44.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/456: creat d0/d19/f98 x:0 0 0 2024-04-15T21:02:44.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/457: write d0/d6/f4c [4911845,91360] 0 2024-04-15T21:02:44.942 INFO:tasks.workunit.client.0.smithi072.stdout:1/442: creat d5/f8f x:0 0 0 2024-04-15T21:02:44.943 INFO:tasks.workunit.client.1.smithi149.stdout:2/678: write d4/d7/da/fa2 [471995,125712] 0 2024-04-15T21:02:44.944 INFO:tasks.workunit.client.1.smithi149.stdout:0/808: dwrite d1/d9/d64/d65/fb4 [0,4194304] 0 2024-04-15T21:02:44.956 INFO:tasks.workunit.client.0.smithi072.stdout:5/420: rename d0/d3/d33/d76 to d0/d3/d7/d12/d1d/d8c 0 2024-04-15T21:02:44.962 INFO:tasks.workunit.client.0.smithi072.stdout:7/465: creat d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 x:0 0 0 2024-04-15T21:02:44.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/571: link da/d18/d7d/l8c da/d32/lab 0 2024-04-15T21:02:44.965 INFO:tasks.workunit.client.0.smithi072.stdout:4/461: sync 2024-04-15T21:02:44.966 INFO:tasks.workunit.client.1.smithi149.stdout:1/582: getdents d1/db/dc/d38 0 2024-04-15T21:02:44.967 INFO:tasks.workunit.client.0.smithi072.stdout:0/458: creat d0/d45/d35/d3a/f99 x:0 0 0 2024-04-15T21:02:44.968 INFO:tasks.workunit.client.0.smithi072.stdout:0/459: chown d0/d45/f1d 3122638 1 2024-04-15T21:02:44.969 INFO:tasks.workunit.client.0.smithi072.stdout:1/443: write d5/db/f28 [2066098,86250] 0 2024-04-15T21:02:44.969 INFO:tasks.workunit.client.0.smithi072.stdout:0/460: dread - d0/d45/d35/d3a/f99 zero size 2024-04-15T21:02:44.969 INFO:tasks.workunit.client.1.smithi149.stdout:3/687: write d1/db/d28/d87/dbd/f6d [1209249,41871] 0 2024-04-15T21:02:44.970 INFO:tasks.workunit.client.0.smithi072.stdout:8/484: creat d3/de/d21/f90 x:0 0 0 2024-04-15T21:02:44.972 INFO:tasks.workunit.client.0.smithi072.stdout:9/436: creat d4/d29/d4c/d74/f7f x:0 0 0 2024-04-15T21:02:44.973 INFO:tasks.workunit.client.0.smithi072.stdout:9/437: fsync d4/d1f/d2c/d47/f79 0 2024-04-15T21:02:44.977 INFO:tasks.workunit.client.1.smithi149.stdout:9/600: rmdir d23/d3c/d87/d9a/dad 39 2024-04-15T21:02:44.979 INFO:tasks.workunit.client.0.smithi072.stdout:3/446: getdents d1 0 2024-04-15T21:02:44.979 INFO:tasks.workunit.client.1.smithi149.stdout:6/572: symlink da/d18/d10/d3f/lac 0 2024-04-15T21:02:44.980 INFO:tasks.workunit.client.1.smithi149.stdout:4/685: write dc/d18/d21/f73 [3109570,102543] 0 2024-04-15T21:02:44.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/583: rename d1/d17/d36/d69 to d1/db/dc/d11/d3f/d45/dae 0 2024-04-15T21:02:44.984 INFO:tasks.workunit.client.1.smithi149.stdout:7/619: dwrite d3/d16/d20/d36/d3d/f9d [0,4194304] 0 2024-04-15T21:02:44.984 INFO:tasks.workunit.client.0.smithi072.stdout:7/466: rmdir d2/d7 39 2024-04-15T21:02:44.986 INFO:tasks.workunit.client.0.smithi072.stdout:6/432: write d2/d10/f3c [289499,37633] 0 2024-04-15T21:02:44.990 INFO:tasks.workunit.client.1.smithi149.stdout:0/809: symlink d1/d9/d64/d65/d104/d119/l11c 0 2024-04-15T21:02:44.994 INFO:tasks.workunit.client.1.smithi149.stdout:3/688: creat d1/db/d24/d4d/d63/db6/fd2 x:0 0 0 2024-04-15T21:02:44.997 INFO:tasks.workunit.client.1.smithi149.stdout:9/601: write d23/d2b/d44/f64 [769863,77955] 0 2024-04-15T21:02:44.998 INFO:tasks.workunit.client.1.smithi149.stdout:8/716: truncate d2/df/d10/d25/d57/dd1/f41 2370644 0 2024-04-15T21:02:45.000 INFO:tasks.workunit.client.0.smithi072.stdout:1/444: unlink d5/db/d27/c58 0 2024-04-15T21:02:45.001 INFO:tasks.workunit.client.0.smithi072.stdout:1/445: read d5/d31/f37 [513239,23326] 0 2024-04-15T21:02:45.001 INFO:tasks.workunit.client.1.smithi149.stdout:8/717: dread d2/df/d10/d25/d57/dd1/d50/d8e/f9e [0,4194304] 0 2024-04-15T21:02:45.002 INFO:tasks.workunit.client.1.smithi149.stdout:6/573: rmdir da/d32 39 2024-04-15T21:02:45.004 INFO:tasks.workunit.client.0.smithi072.stdout:5/421: dwrite d0/d3/d7/d12/d31/d49/f87 [0,4194304] 0 2024-04-15T21:02:45.006 INFO:tasks.workunit.client.0.smithi072.stdout:9/438: mkdir d4/d1f/d31/d80 0 2024-04-15T21:02:45.006 INFO:tasks.workunit.client.0.smithi072.stdout:9/439: chown d4/d1f/d31/d80 1 1 2024-04-15T21:02:45.007 INFO:tasks.workunit.client.1.smithi149.stdout:4/686: symlink dc/d2c/d3e/d35/d4b/d6c/d70/le4 0 2024-04-15T21:02:45.010 INFO:tasks.workunit.client.1.smithi149.stdout:1/584: symlink d1/db/dc/d38/laf 0 2024-04-15T21:02:45.010 INFO:tasks.workunit.client.1.smithi149.stdout:1/585: readlink d1/db/dc/d11/d3e/l4f 0 2024-04-15T21:02:45.011 INFO:tasks.workunit.client.1.smithi149.stdout:5/623: sync 2024-04-15T21:02:45.013 INFO:tasks.workunit.client.0.smithi072.stdout:0/461: dwrite d0/d19/d71/f76 [0,4194304] 0 2024-04-15T21:02:45.013 INFO:tasks.workunit.client.0.smithi072.stdout:3/447: creat d1/d3f/f95 x:0 0 0 2024-04-15T21:02:45.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/679: creat d4/d7/d46/de4/d21/d2c/feb x:0 0 0 2024-04-15T21:02:45.020 INFO:tasks.workunit.client.0.smithi072.stdout:6/433: rmdir d2/d10/d18/d47 39 2024-04-15T21:02:45.021 INFO:tasks.workunit.client.0.smithi072.stdout:6/434: chown d2/d40/d66/l74 17277197 1 2024-04-15T21:02:45.022 INFO:tasks.workunit.client.1.smithi149.stdout:0/810: rename d1/d5/d24/d50/l27 to d1/d5/d24/d50/d13/d38/d44/d61/d11b/l11d 0 2024-04-15T21:02:45.023 INFO:tasks.workunit.client.0.smithi072.stdout:2/424: truncate d2/d3/f15 2220251 0 2024-04-15T21:02:45.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/620: dwrite d3/d16/d20/f24 [0,4194304] 0 2024-04-15T21:02:45.035 INFO:tasks.workunit.client.1.smithi149.stdout:7/621: chown d3/d17/d1f/c7a 3 1 2024-04-15T21:02:45.037 INFO:tasks.workunit.client.1.smithi149.stdout:6/574: write da/d49/f8d [1108750,54879] 0 2024-04-15T21:02:45.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/575: fsync da/d18/d10/d3f/faa 0 2024-04-15T21:02:45.041 INFO:tasks.workunit.client.0.smithi072.stdout:5/422: read d0/d3/d7/d12/d31/d55/f56 [252288,56165] 0 2024-04-15T21:02:45.041 INFO:tasks.workunit.client.0.smithi072.stdout:9/440: fsync d4/d1f/d31/d4d/f5c 0 2024-04-15T21:02:45.041 INFO:tasks.workunit.client.1.smithi149.stdout:4/687: mknod dc/d8f/d91/ce5 0 2024-04-15T21:02:45.043 INFO:tasks.workunit.client.1.smithi149.stdout:4/688: fdatasync dc/fe 0 2024-04-15T21:02:45.043 INFO:tasks.workunit.client.1.smithi149.stdout:2/680: dread d4/d7/d46/de4/d21/d2c/fbc [0,4194304] 0 2024-04-15T21:02:45.045 INFO:tasks.workunit.client.0.smithi072.stdout:0/462: creat d0/d45/d7a/d70/d59/d8a/d7b/f9a x:0 0 0 2024-04-15T21:02:45.047 INFO:tasks.workunit.client.1.smithi149.stdout:0/811: mkdir d1/d5/d24/d50/de2/d11e 0 2024-04-15T21:02:45.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/689: dwrite d1/db/d28/d87/dbd/f8f [4194304,4194304] 0 2024-04-15T21:02:45.052 INFO:tasks.workunit.client.1.smithi149.stdout:8/718: creat d2/df/d10/d20/d6b/f102 x:0 0 0 2024-04-15T21:02:45.054 INFO:tasks.workunit.client.0.smithi072.stdout:2/425: dwrite d2/d3/d5f/f7c [0,4194304] 0 2024-04-15T21:02:45.056 INFO:tasks.workunit.client.0.smithi072.stdout:2/426: readlink d2/d8/l25 0 2024-04-15T21:02:45.057 INFO:tasks.workunit.client.0.smithi072.stdout:1/446: unlink d5/db/c3b 0 2024-04-15T21:02:45.060 INFO:tasks.workunit.client.0.smithi072.stdout:8/485: creat d3/d4/f91 x:0 0 0 2024-04-15T21:02:45.066 INFO:tasks.workunit.client.0.smithi072.stdout:5/423: creat d0/d3/d7/d12/d31/d55/d58/f8d x:0 0 0 2024-04-15T21:02:45.066 INFO:tasks.workunit.client.0.smithi072.stdout:5/424: chown d0/f59 28 1 2024-04-15T21:02:45.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/425: readlink d0/l20 0 2024-04-15T21:02:45.072 INFO:tasks.workunit.client.0.smithi072.stdout:5/426: dwrite d0/d3/d7/d12/d1d/d8c/f88 [0,4194304] 0 2024-04-15T21:02:45.073 INFO:tasks.workunit.client.0.smithi072.stdout:5/427: readlink d0/d3/d7/d1f/l22 0 2024-04-15T21:02:45.074 INFO:tasks.workunit.client.0.smithi072.stdout:7/467: creat d2/d7/d25/d2d/d47/d7e/f91 x:0 0 0 2024-04-15T21:02:45.076 INFO:tasks.workunit.client.1.smithi149.stdout:3/690: creat d1/db/d24/d4d/d63/fd3 x:0 0 0 2024-04-15T21:02:45.076 INFO:tasks.workunit.client.0.smithi072.stdout:7/468: truncate d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 553841 0 2024-04-15T21:02:45.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/602: link d23/d2b/d37/d50/db3/lbc d23/d3c/d7a/da5/ld2 0 2024-04-15T21:02:45.081 INFO:tasks.workunit.client.1.smithi149.stdout:7/622: dwrite d3/d39/f5d [0,4194304] 0 2024-04-15T21:02:45.083 INFO:tasks.workunit.client.0.smithi072.stdout:4/462: link d7/d28/f40 d7/d10/d41/d44/d7a/d86/f95 0 2024-04-15T21:02:45.087 INFO:tasks.workunit.client.0.smithi072.stdout:3/448: truncate d1/d15/f5e 851693 0 2024-04-15T21:02:45.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/427: symlink d2/d37/l8c 0 2024-04-15T21:02:45.088 INFO:tasks.workunit.client.1.smithi149.stdout:5/624: link d0/d6/d2d/lad d0/d9/lce 0 2024-04-15T21:02:45.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/812: write d1/d9/d64/d65/d104/d119/f5a [4843520,16768] 0 2024-04-15T21:02:45.095 INFO:tasks.workunit.client.0.smithi072.stdout:8/486: symlink d3/d7e/l92 0 2024-04-15T21:02:45.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/813: read d1/d9/d64/d65/d104/d119/faa [313258,80626] 0 2024-04-15T21:02:45.098 INFO:tasks.workunit.client.0.smithi072.stdout:9/441: link d4/d1f/d2c/d62/f6c d4/d1f/d2c/d62/f81 0 2024-04-15T21:02:45.099 INFO:tasks.workunit.client.0.smithi072.stdout:5/428: mkdir d0/d3/d7/d12/d31/d62/d8e 0 2024-04-15T21:02:45.100 INFO:tasks.workunit.client.0.smithi072.stdout:0/463: creat d0/d45/d7a/d5d/d8e/f9b x:0 0 0 2024-04-15T21:02:45.101 INFO:tasks.workunit.client.1.smithi149.stdout:9/603: mkdir d23/d2b/dd3 0 2024-04-15T21:02:45.102 INFO:tasks.workunit.client.0.smithi072.stdout:7/469: creat d2/d7/d25/d72/f92 x:0 0 0 2024-04-15T21:02:45.103 INFO:tasks.workunit.client.1.smithi149.stdout:7/623: mkdir d3/d39/de3 0 2024-04-15T21:02:45.104 INFO:tasks.workunit.client.0.smithi072.stdout:7/470: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f [660881,60639] 0 2024-04-15T21:02:45.105 INFO:tasks.workunit.client.0.smithi072.stdout:5/429: dwrite d0/d3/d7/d12/d31/d55/d58/f72 [0,4194304] 0 2024-04-15T21:02:45.106 INFO:tasks.workunit.client.0.smithi072.stdout:7/471: write d2/d7/d25/d72/f85 [578255,92671] 0 2024-04-15T21:02:45.107 INFO:tasks.workunit.client.1.smithi149.stdout:5/625: creat d0/d6/d82/da1/d12/d16/da9/d1b/fcf x:0 0 0 2024-04-15T21:02:45.107 INFO:tasks.workunit.client.1.smithi149.stdout:6/576: truncate da/d49/f8d 384005 0 2024-04-15T21:02:45.107 INFO:tasks.workunit.client.0.smithi072.stdout:7/472: write d2/d7/d25/d2d/f44 [1548448,391] 0 2024-04-15T21:02:45.108 INFO:tasks.workunit.client.0.smithi072.stdout:7/473: chown d2/d7 31353 1 2024-04-15T21:02:45.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/577: readlink da/d18/d10/d3f/l5f 0 2024-04-15T21:02:45.109 INFO:tasks.workunit.client.0.smithi072.stdout:4/463: creat d7/d10/d41/d44/d7a/d86/d76/f96 x:0 0 0 2024-04-15T21:02:45.109 INFO:tasks.workunit.client.1.smithi149.stdout:8/719: dread d2/df/d10/d25/d57/f80 [0,4194304] 0 2024-04-15T21:02:45.110 INFO:tasks.workunit.client.0.smithi072.stdout:4/464: chown d7/d15/d58/f7b 188988483 1 2024-04-15T21:02:45.110 INFO:tasks.workunit.client.1.smithi149.stdout:6/578: fsync da/d18/d10/f8b 0 2024-04-15T21:02:45.111 INFO:tasks.workunit.client.1.smithi149.stdout:4/689: creat dc/d2c/d3e/d15/fe6 x:0 0 0 2024-04-15T21:02:45.113 INFO:tasks.workunit.client.1.smithi149.stdout:2/681: creat d4/d7/d46/de4/d21/d2c/fec x:0 0 0 2024-04-15T21:02:45.114 INFO:tasks.workunit.client.0.smithi072.stdout:3/449: symlink d1/d15/d32/d2f/d1a/l96 0 2024-04-15T21:02:45.115 INFO:tasks.workunit.client.0.smithi072.stdout:3/450: dread - d1/d15/f93 zero size 2024-04-15T21:02:45.116 INFO:tasks.workunit.client.0.smithi072.stdout:2/428: dwrite d2/d66/f68 [0,4194304] 0 2024-04-15T21:02:45.117 INFO:tasks.workunit.client.1.smithi149.stdout:2/682: read d4/f12 [1021808,43769] 0 2024-04-15T21:02:45.118 INFO:tasks.workunit.client.0.smithi072.stdout:1/447: mknod d5/db/d27/d5c/c90 0 2024-04-15T21:02:45.119 INFO:tasks.workunit.client.0.smithi072.stdout:1/448: stat d5/d3d/d5e/c8c 0 2024-04-15T21:02:45.128 INFO:tasks.workunit.client.0.smithi072.stdout:0/464: creat d0/d6/d48/f9c x:0 0 0 2024-04-15T21:02:45.131 INFO:tasks.workunit.client.0.smithi072.stdout:6/435: getdents d2/d40 0 2024-04-15T21:02:45.133 INFO:tasks.workunit.client.1.smithi149.stdout:6/579: creat da/d18/d33/fad x:0 0 0 2024-04-15T21:02:45.133 INFO:tasks.workunit.client.1.smithi149.stdout:7/624: dread d3/d16/d20/d36/d3d/f80 [0,4194304] 0 2024-04-15T21:02:45.134 INFO:tasks.workunit.client.1.smithi149.stdout:7/625: write d3/d34/f6d [7718927,36511] 0 2024-04-15T21:02:45.135 INFO:tasks.workunit.client.1.smithi149.stdout:7/626: chown d3/d16/d32 344090992 1 2024-04-15T21:02:45.135 INFO:tasks.workunit.client.1.smithi149.stdout:8/720: unlink d2/df/d10/d25/d57/dd1/d50/d5d/dc6/fdc 0 2024-04-15T21:02:45.136 INFO:tasks.workunit.client.0.smithi072.stdout:5/430: creat d0/d3/d33/d60/f8f x:0 0 0 2024-04-15T21:02:45.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/690: symlink dc/d18/daa/le7 0 2024-04-15T21:02:45.141 INFO:tasks.workunit.client.0.smithi072.stdout:4/465: mkdir d7/d10/d41/d44/d7a/d97 0 2024-04-15T21:02:45.146 INFO:tasks.workunit.client.1.smithi149.stdout:2/683: dread d4/d7/d46/de4/d21/d2c/d32/fd4 [0,4194304] 0 2024-04-15T21:02:45.147 INFO:tasks.workunit.client.0.smithi072.stdout:2/429: chown d2/d3/f5e 22 1 2024-04-15T21:02:45.148 INFO:tasks.workunit.client.0.smithi072.stdout:1/449: rmdir d5/d3d 39 2024-04-15T21:02:45.150 INFO:tasks.workunit.client.1.smithi149.stdout:5/626: write d0/d6/d82/da1/d12/d16/da9/d1b/f20 [9171762,420] 0 2024-04-15T21:02:45.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/431: mknod d0/d3/d7/d12/d31/d55/d58/c90 0 2024-04-15T21:02:45.154 INFO:tasks.workunit.client.0.smithi072.stdout:1/450: dwrite d5/d31/d51/f6f [0,4194304] 0 2024-04-15T21:02:45.154 INFO:tasks.workunit.client.1.smithi149.stdout:6/580: mknod da/d49/d55/da0/cae 0 2024-04-15T21:02:45.159 INFO:tasks.workunit.client.0.smithi072.stdout:5/432: dwrite d0/d3/d33/d60/f8f [0,4194304] 0 2024-04-15T21:02:45.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/586: sync 2024-04-15T21:02:45.167 INFO:tasks.workunit.client.1.smithi149.stdout:2/684: dread d4/d7/d46/de4/d21/d3b/f43 [4194304,4194304] 0 2024-04-15T21:02:45.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/581: dwrite da/d18/f86 [8388608,4194304] 0 2024-04-15T21:02:45.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/691: truncate dc/d2c/d3e/d35/d3a/f65 513754 0 2024-04-15T21:02:45.179 INFO:tasks.workunit.client.0.smithi072.stdout:8/487: rename d3/de/d21/d2e/f42 to d3/de/d1b/f93 0 2024-04-15T21:02:45.181 INFO:tasks.workunit.client.1.smithi149.stdout:8/721: dwrite d2/df/d10/d25/d57/dd1/d50/d8e/f9e [0,4194304] 0 2024-04-15T21:02:45.182 INFO:tasks.workunit.client.1.smithi149.stdout:3/691: link d1/db/d24/d2b/f66 d1/db/fd4 0 2024-04-15T21:02:45.184 INFO:tasks.workunit.client.0.smithi072.stdout:3/451: dwrite d1/d15/f34 [0,4194304] 0 2024-04-15T21:02:45.185 INFO:tasks.workunit.client.0.smithi072.stdout:3/452: chown d1/d15/d40/f22 42257903 1 2024-04-15T21:02:45.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/604: truncate d23/d2b/d44/d7e/f9b 1818713 0 2024-04-15T21:02:45.188 INFO:tasks.workunit.client.1.smithi149.stdout:8/722: write d2/df/d10/d4e/d9f/fcc [6192622,117606] 0 2024-04-15T21:02:45.189 INFO:tasks.workunit.client.0.smithi072.stdout:7/474: truncate d2/d7/d25/d2d/d47/f64 349393 0 2024-04-15T21:02:45.192 INFO:tasks.workunit.client.0.smithi072.stdout:1/451: dread - d5/d3d/f75 zero size 2024-04-15T21:02:45.193 INFO:tasks.workunit.client.0.smithi072.stdout:7/475: stat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c8a 0 2024-04-15T21:02:45.194 INFO:tasks.workunit.client.1.smithi149.stdout:0/814: rename d1/d29/d2c/d4f/f5f to d1/d5/d24/d50/d13/d59/f11f 0 2024-04-15T21:02:45.197 INFO:tasks.workunit.client.1.smithi149.stdout:7/627: dread d3/d17/f19 [0,4194304] 0 2024-04-15T21:02:45.197 INFO:tasks.workunit.client.0.smithi072.stdout:4/466: dwrite d7/d28/f40 [0,4194304] 0 2024-04-15T21:02:45.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/433: mknod d0/d3/d6/d2d/c91 0 2024-04-15T21:02:45.203 INFO:tasks.workunit.client.0.smithi072.stdout:5/434: write d0/f80 [1539195,37620] 0 2024-04-15T21:02:45.205 INFO:tasks.workunit.client.0.smithi072.stdout:5/435: chown d0/d3/d7/d12/d31/d55/f56 0 1 2024-04-15T21:02:45.211 INFO:tasks.workunit.client.1.smithi149.stdout:1/587: unlink d1/db/f20 0 2024-04-15T21:02:45.213 INFO:tasks.workunit.client.1.smithi149.stdout:6/582: mknod da/d18/d10/d16/caf 0 2024-04-15T21:02:45.214 INFO:tasks.workunit.client.0.smithi072.stdout:8/488: fdatasync d3/de/d1b/d3f/f83 0 2024-04-15T21:02:45.214 INFO:tasks.workunit.client.0.smithi072.stdout:8/489: chown d3/de/l19 15553492 1 2024-04-15T21:02:45.215 INFO:tasks.workunit.client.1.smithi149.stdout:2/685: fdatasync d4/d7/d46/de4/d21/d55/f76 0 2024-04-15T21:02:45.220 INFO:tasks.workunit.client.1.smithi149.stdout:6/583: dwrite da/d18/d10/fa3 [0,4194304] 0 2024-04-15T21:02:45.220 INFO:tasks.workunit.client.0.smithi072.stdout:8/490: dwrite d3/de/d1b/f57 [0,4194304] 0 2024-04-15T21:02:45.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/491: fsync d3/d4/f91 0 2024-04-15T21:02:45.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/492: fdatasync d3/ff 0 2024-04-15T21:02:45.222 INFO:tasks.workunit.client.0.smithi072.stdout:8/493: stat d3/d4/d4c/l18 0 2024-04-15T21:02:45.224 INFO:tasks.workunit.client.1.smithi149.stdout:3/692: creat d1/db/d24/d2b/fd5 x:0 0 0 2024-04-15T21:02:45.225 INFO:tasks.workunit.client.0.smithi072.stdout:2/430: dread d2/d38/f56 [0,4194304] 0 2024-04-15T21:02:45.230 INFO:tasks.workunit.client.0.smithi072.stdout:1/452: truncate d5/db/d2d/d3a/f13 4371253 0 2024-04-15T21:02:45.231 INFO:tasks.workunit.client.1.smithi149.stdout:0/815: write d1/d9/d64/d73/da3/f107 [263651,105887] 0 2024-04-15T21:02:45.235 INFO:tasks.workunit.client.0.smithi072.stdout:9/442: rename d4/d1f/d31/d4d/f5e to d4/d29/d4c/f82 0 2024-04-15T21:02:45.238 INFO:tasks.workunit.client.0.smithi072.stdout:9/443: truncate d4/d1f/d2c/d62/f81 4942660 0 2024-04-15T21:02:45.239 INFO:tasks.workunit.client.0.smithi072.stdout:5/436: dread d0/d3/d6/f2b [0,4194304] 0 2024-04-15T21:02:45.243 INFO:tasks.workunit.client.0.smithi072.stdout:0/465: getdents d0/d45/d7a/d5d 0 2024-04-15T21:02:45.245 INFO:tasks.workunit.client.1.smithi149.stdout:1/588: chown d1/db/dc/d11/d3e/la1 0 1 2024-04-15T21:02:45.245 INFO:tasks.workunit.client.1.smithi149.stdout:1/589: chown d1/d17/d52/d92 3370 1 2024-04-15T21:02:45.246 INFO:tasks.workunit.client.0.smithi072.stdout:3/453: readlink d1/d3f/d4f/l86 0 2024-04-15T21:02:45.248 INFO:tasks.workunit.client.0.smithi072.stdout:0/466: dwrite d0/d45/d7a/d70/d59/d8a/f65 [0,4194304] 0 2024-04-15T21:02:45.251 INFO:tasks.workunit.client.0.smithi072.stdout:2/431: creat d2/d8/d41/f8d x:0 0 0 2024-04-15T21:02:45.255 INFO:tasks.workunit.client.0.smithi072.stdout:1/453: mknod d5/db/d2d/d3a/d1f/d63/c91 0 2024-04-15T21:02:45.256 INFO:tasks.workunit.client.1.smithi149.stdout:2/686: fdatasync d4/d7/d93/fad 0 2024-04-15T21:02:45.257 INFO:tasks.workunit.client.0.smithi072.stdout:8/494: dread d3/de/d1b/f93 [0,4194304] 0 2024-04-15T21:02:45.258 INFO:tasks.workunit.client.1.smithi149.stdout:9/605: write d23/d2b/d37/d6d/f6e [50906,19879] 0 2024-04-15T21:02:45.258 INFO:tasks.workunit.client.1.smithi149.stdout:2/687: read - d4/d7/d46/de4/d21/d2c/feb zero size 2024-04-15T21:02:45.261 INFO:tasks.workunit.client.0.smithi072.stdout:6/436: rename d2/d1a/f4f to d2/d40/d56/f85 0 2024-04-15T21:02:45.263 INFO:tasks.workunit.client.1.smithi149.stdout:6/584: mknod da/d11/cb0 0 2024-04-15T21:02:45.265 INFO:tasks.workunit.client.1.smithi149.stdout:3/693: fdatasync d1/d81/f94 0 2024-04-15T21:02:45.268 INFO:tasks.workunit.client.0.smithi072.stdout:5/437: mkdir d0/d3/d23/d92 0 2024-04-15T21:02:45.269 INFO:tasks.workunit.client.1.smithi149.stdout:5/627: write d0/d6/d82/da1/f38 [10017467,118982] 0 2024-04-15T21:02:45.270 INFO:tasks.workunit.client.0.smithi072.stdout:8/495: dread d3/f30 [0,4194304] 0 2024-04-15T21:02:45.271 INFO:tasks.workunit.client.1.smithi149.stdout:1/590: dread d1/db/dc/d38/d39/d43/f54 [0,4194304] 0 2024-04-15T21:02:45.271 INFO:tasks.workunit.client.1.smithi149.stdout:8/723: mknod d2/df/d10/d25/d57/dd1/d46/c103 0 2024-04-15T21:02:45.272 INFO:tasks.workunit.client.0.smithi072.stdout:8/496: read d3/d4/d3b/f65 [840205,67489] 0 2024-04-15T21:02:45.273 INFO:tasks.workunit.client.0.smithi072.stdout:3/454: creat d1/d5b/f97 x:0 0 0 2024-04-15T21:02:45.274 INFO:tasks.workunit.client.0.smithi072.stdout:3/455: chown d1/d15/d32/l57 3530 1 2024-04-15T21:02:45.275 INFO:tasks.workunit.client.1.smithi149.stdout:0/816: creat d1/d9/d64/df0/f120 x:0 0 0 2024-04-15T21:02:45.276 INFO:tasks.workunit.client.1.smithi149.stdout:0/817: dread - d1/d5/d24/d50/d13/d38/d44/f11a zero size 2024-04-15T21:02:45.276 INFO:tasks.workunit.client.0.smithi072.stdout:7/476: truncate d2/f1c 1863690 0 2024-04-15T21:02:45.282 INFO:tasks.workunit.client.0.smithi072.stdout:9/444: dread d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:45.283 INFO:tasks.workunit.client.0.smithi072.stdout:2/432: dread d2/f44 [0,4194304] 0 2024-04-15T21:02:45.284 INFO:tasks.workunit.client.0.smithi072.stdout:8/497: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:45.287 INFO:tasks.workunit.client.0.smithi072.stdout:6/437: creat d2/d40/f86 x:0 0 0 2024-04-15T21:02:45.295 INFO:tasks.workunit.client.0.smithi072.stdout:5/438: mkdir d0/d3/d7/d12/d31/d55/d93 0 2024-04-15T21:02:45.298 INFO:tasks.workunit.client.1.smithi149.stdout:3/694: rmdir d1/db/d24 39 2024-04-15T21:02:45.301 INFO:tasks.workunit.client.1.smithi149.stdout:9/606: write f1f [3657474,105485] 0 2024-04-15T21:02:45.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/585: write da/f1b [5127198,17197] 0 2024-04-15T21:02:45.305 INFO:tasks.workunit.client.0.smithi072.stdout:7/477: mknod d2/d7/d25/d2d/d47/d7e/c93 0 2024-04-15T21:02:45.306 INFO:tasks.workunit.client.0.smithi072.stdout:7/478: chown d2/d7/d25/d2d/d47/d7e/c93 36803677 1 2024-04-15T21:02:45.306 INFO:tasks.workunit.client.1.smithi149.stdout:8/724: truncate d2/fe 2195543 0 2024-04-15T21:02:45.307 INFO:tasks.workunit.client.0.smithi072.stdout:1/454: creat d5/d31/d51/d82/f92 x:0 0 0 2024-04-15T21:02:45.307 INFO:tasks.workunit.client.0.smithi072.stdout:7/479: dread d2/d7/d25/d2d/d46/d5a/d5f/f82 [0,4194304] 0 2024-04-15T21:02:45.307 INFO:tasks.workunit.client.0.smithi072.stdout:1/455: chown d5/d31/d51/d82 99614 1 2024-04-15T21:02:45.308 INFO:tasks.workunit.client.0.smithi072.stdout:9/445: stat d4/d1f/d2c/l33 0 2024-04-15T21:02:45.308 INFO:tasks.workunit.client.0.smithi072.stdout:7/480: stat d2/d7/d25/d2d/d46/d5a/f88 0 2024-04-15T21:02:45.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/692: getdents dc/d2c/d3e/d7c/dd0 0 2024-04-15T21:02:45.309 INFO:tasks.workunit.client.0.smithi072.stdout:9/446: dread - d4/d1f/d31/d4d/f7b zero size 2024-04-15T21:02:45.310 INFO:tasks.workunit.client.1.smithi149.stdout:2/688: mkdir d4/d7/d46/de4/d21/d2c/d32/ded 0 2024-04-15T21:02:45.311 INFO:tasks.workunit.client.0.smithi072.stdout:9/447: chown d4/d1f/d2c/f2d 59 1 2024-04-15T21:02:45.311 INFO:tasks.workunit.client.1.smithi149.stdout:2/689: dread d4/f7a [0,4194304] 0 2024-04-15T21:02:45.311 INFO:tasks.workunit.client.1.smithi149.stdout:3/695: rmdir d1/db/d40/d56/d84 39 2024-04-15T21:02:45.315 INFO:tasks.workunit.client.1.smithi149.stdout:5/628: rename d0/d6/d82/da1/d12/d16/da9/d1b/l91 to d0/d9/db6/ld0 0 2024-04-15T21:02:45.316 INFO:tasks.workunit.client.1.smithi149.stdout:5/629: read d0/f3 [2002094,8271] 0 2024-04-15T21:02:45.317 INFO:tasks.workunit.client.1.smithi149.stdout:5/630: chown d0/d6/d82/da1/d12/d16/da9/d9b/fa7 750 1 2024-04-15T21:02:45.319 INFO:tasks.workunit.client.1.smithi149.stdout:5/631: readlink d0/d6/d82/da1/d12/d16/da9/d1b/d83/l86 0 2024-04-15T21:02:45.322 INFO:tasks.workunit.client.0.smithi072.stdout:1/456: mkdir d5/db/d2d/d56/d93 0 2024-04-15T21:02:45.322 INFO:tasks.workunit.client.0.smithi072.stdout:1/457: write d5/f70 [161671,43841] 0 2024-04-15T21:02:45.322 INFO:tasks.workunit.client.1.smithi149.stdout:8/725: readlink d2/df/d10/d34/l81 0 2024-04-15T21:02:45.324 INFO:tasks.workunit.client.1.smithi149.stdout:0/818: creat d1/d5/dfb/f121 x:0 0 0 2024-04-15T21:02:45.325 INFO:tasks.workunit.client.1.smithi149.stdout:9/607: dread d23/d2b/d44/d7e/f9b [0,4194304] 0 2024-04-15T21:02:45.326 INFO:tasks.workunit.client.0.smithi072.stdout:8/498: mkdir d3/de/d94 0 2024-04-15T21:02:45.329 INFO:tasks.workunit.client.0.smithi072.stdout:7/481: dread d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 [0,4194304] 0 2024-04-15T21:02:45.330 INFO:tasks.workunit.client.1.smithi149.stdout:3/696: write d1/db/d24/d2b/f73 [2634928,87653] 0 2024-04-15T21:02:45.330 INFO:tasks.workunit.client.0.smithi072.stdout:8/499: dread d3/de/d1b/d3f/f83 [0,4194304] 0 2024-04-15T21:02:45.331 INFO:tasks.workunit.client.1.smithi149.stdout:3/697: chown d1/db/d24/d39 17399 1 2024-04-15T21:02:45.331 INFO:tasks.workunit.client.0.smithi072.stdout:7/482: read d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e [341301,98473] 0 2024-04-15T21:02:45.332 INFO:tasks.workunit.client.0.smithi072.stdout:4/467: rename d7/d23/d6c/c57 to d7/d10/d41/c98 0 2024-04-15T21:02:45.334 INFO:tasks.workunit.client.1.smithi149.stdout:2/690: rename d4/d7/d46/d74 to d4/d7/d46/de4/d21/d2c/d32/d4a/dee 0 2024-04-15T21:02:45.335 INFO:tasks.workunit.client.0.smithi072.stdout:9/448: symlink d4/d29/d45/l83 0 2024-04-15T21:02:45.335 INFO:tasks.workunit.client.1.smithi149.stdout:2/691: write d4/d7/d46/de4/f56 [2736394,16101] 0 2024-04-15T21:02:45.336 INFO:tasks.workunit.client.0.smithi072.stdout:9/449: write d4/f4e [713990,111615] 0 2024-04-15T21:02:45.337 INFO:tasks.workunit.client.1.smithi149.stdout:1/591: truncate d1/db/d14/f9d 744596 0 2024-04-15T21:02:45.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/692: write d4/d7/d93/fde [388342,2197] 0 2024-04-15T21:02:45.340 INFO:tasks.workunit.client.1.smithi149.stdout:5/632: truncate d0/d6/d82/da1/d12/d2b/f72 2584975 0 2024-04-15T21:02:45.342 INFO:tasks.workunit.client.1.smithi149.stdout:6/586: dwrite da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:45.344 INFO:tasks.workunit.client.1.smithi149.stdout:8/726: unlink d2/df/d10/d25/d37/d53/daf/d92/c99 0 2024-04-15T21:02:45.344 INFO:tasks.workunit.client.1.smithi149.stdout:9/608: mknod d23/d2b/d44/cd4 0 2024-04-15T21:02:45.345 INFO:tasks.workunit.client.0.smithi072.stdout:1/458: fsync d5/db/f12 0 2024-04-15T21:02:45.346 INFO:tasks.workunit.client.1.smithi149.stdout:4/693: mkdir dc/d2c/d3e/d35/d4b/de8 0 2024-04-15T21:02:45.351 INFO:tasks.workunit.client.1.smithi149.stdout:1/592: unlink d1/db/dc/d38/d39/d43/l2e 0 2024-04-15T21:02:45.353 INFO:tasks.workunit.client.1.smithi149.stdout:7/628: sync 2024-04-15T21:02:45.355 INFO:tasks.workunit.client.0.smithi072.stdout:7/483: creat d2/d7/d25/d2d/d47/d7e/f94 x:0 0 0 2024-04-15T21:02:45.359 INFO:tasks.workunit.client.1.smithi149.stdout:1/593: dwrite d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:45.361 INFO:tasks.workunit.client.0.smithi072.stdout:0/467: rename d0/d3/f67 to d0/d19/d2b/f9d 0 2024-04-15T21:02:45.366 INFO:tasks.workunit.client.0.smithi072.stdout:6/438: creat d2/d10/d18/d47/d6d/f87 x:0 0 0 2024-04-15T21:02:45.369 INFO:tasks.workunit.client.0.smithi072.stdout:9/450: mkdir d4/d29/d4c/d74/d84 0 2024-04-15T21:02:45.369 INFO:tasks.workunit.client.0.smithi072.stdout:9/451: readlink d4/d29/d45/l6d 0 2024-04-15T21:02:45.374 INFO:tasks.workunit.client.1.smithi149.stdout:9/609: mknod d23/d3c/d7a/d7c/d7f/cd5 0 2024-04-15T21:02:45.374 INFO:tasks.workunit.client.0.smithi072.stdout:2/433: getdents d2/d38/d73 0 2024-04-15T21:02:45.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/694: dread - dc/d8f/fa6 zero size 2024-04-15T21:02:45.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/459: truncate d5/d3d/f75 712045 0 2024-04-15T21:02:45.377 INFO:tasks.workunit.client.1.smithi149.stdout:4/695: write dc/d2c/fa1 [4014028,118274] 0 2024-04-15T21:02:45.378 INFO:tasks.workunit.client.1.smithi149.stdout:5/633: write d0/d6/d82/da1/d12/f64 [1486484,16469] 0 2024-04-15T21:02:45.381 INFO:tasks.workunit.client.0.smithi072.stdout:8/500: link d3/d4/d3b/f6e d3/de/d1b/d41/f95 0 2024-04-15T21:02:45.381 INFO:tasks.workunit.client.0.smithi072.stdout:7/484: creat d2/d78/f95 x:0 0 0 2024-04-15T21:02:45.383 INFO:tasks.workunit.client.1.smithi149.stdout:7/629: unlink d3/d34/f4e 0 2024-04-15T21:02:45.384 INFO:tasks.workunit.client.0.smithi072.stdout:0/468: unlink d0/d6/f6a 0 2024-04-15T21:02:45.384 INFO:tasks.workunit.client.1.smithi149.stdout:6/587: rmdir da/d32 39 2024-04-15T21:02:45.387 INFO:tasks.workunit.client.0.smithi072.stdout:7/485: dwrite d2/d7/d25/d72/f85 [0,4194304] 0 2024-04-15T21:02:45.388 INFO:tasks.workunit.client.1.smithi149.stdout:9/610: fdatasync f21 0 2024-04-15T21:02:45.393 INFO:tasks.workunit.client.0.smithi072.stdout:1/460: creat d5/d3d/f94 x:0 0 0 2024-04-15T21:02:45.394 INFO:tasks.workunit.client.0.smithi072.stdout:1/461: write d5/db/f12 [2032120,39001] 0 2024-04-15T21:02:45.395 INFO:tasks.workunit.client.1.smithi149.stdout:0/819: rename d1/d9/d64/d65/d104/d119/d43/c4b to d1/c122 0 2024-04-15T21:02:45.400 INFO:tasks.workunit.client.1.smithi149.stdout:2/693: creat d4/d7/d46/de4/d21/d2c/d32/fef x:0 0 0 2024-04-15T21:02:45.403 INFO:tasks.workunit.client.0.smithi072.stdout:0/469: mkdir d0/d19/d71/d9e 0 2024-04-15T21:02:45.404 INFO:tasks.workunit.client.0.smithi072.stdout:7/486: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f76 [0,4194304] 0 2024-04-15T21:02:45.406 INFO:tasks.workunit.client.0.smithi072.stdout:9/452: creat d4/d29/d4c/d74/d84/f85 x:0 0 0 2024-04-15T21:02:45.409 INFO:tasks.workunit.client.0.smithi072.stdout:2/434: mkdir d2/d8/d8e 0 2024-04-15T21:02:45.410 INFO:tasks.workunit.client.1.smithi149.stdout:5/634: mkdir d0/d9/d6c/db4/dd1 0 2024-04-15T21:02:45.411 INFO:tasks.workunit.client.1.smithi149.stdout:8/727: link d2/c58 d2/df/d10/d4e/d51/c104 0 2024-04-15T21:02:45.414 INFO:tasks.workunit.client.0.smithi072.stdout:5/439: rename d0/d3/d23 to d0/d3/d7/d94 0 2024-04-15T21:02:45.415 INFO:tasks.workunit.client.0.smithi072.stdout:0/470: fsync d0/d19/d2b/f2e 0 2024-04-15T21:02:45.416 INFO:tasks.workunit.client.0.smithi072.stdout:0/471: readlink d0/lb 0 2024-04-15T21:02:45.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/611: symlink d23/d3c/ld6 0 2024-04-15T21:02:45.418 INFO:tasks.workunit.client.0.smithi072.stdout:6/439: creat d2/d40/d56/d6a/f88 x:0 0 0 2024-04-15T21:02:45.418 INFO:tasks.workunit.client.0.smithi072.stdout:6/440: dread - d2/d40/d56/f85 zero size 2024-04-15T21:02:45.419 INFO:tasks.workunit.client.1.smithi149.stdout:8/728: dwrite d2/df/d10/d25/f28 [0,4194304] 0 2024-04-15T21:02:45.419 INFO:tasks.workunit.client.0.smithi072.stdout:6/441: write d2/d10/d11/f4b [3689814,92963] 0 2024-04-15T21:02:45.420 INFO:tasks.workunit.client.0.smithi072.stdout:6/442: chown d2/d1a/f55 2099310541 1 2024-04-15T21:02:45.420 INFO:tasks.workunit.client.0.smithi072.stdout:6/443: stat d2/d40/d56/d6a/d70/d49 0 2024-04-15T21:02:45.421 INFO:tasks.workunit.client.0.smithi072.stdout:6/444: stat d2/fc 0 2024-04-15T21:02:45.422 INFO:tasks.workunit.client.1.smithi149.stdout:7/630: dread d3/fb [4194304,4194304] 0 2024-04-15T21:02:45.422 INFO:tasks.workunit.client.0.smithi072.stdout:3/456: getdents d1 0 2024-04-15T21:02:45.428 INFO:tasks.workunit.client.0.smithi072.stdout:9/453: rmdir d4/d1f/d31/d42 39 2024-04-15T21:02:45.430 INFO:tasks.workunit.client.1.smithi149.stdout:5/635: unlink d0/d6/d9f/laa 0 2024-04-15T21:02:45.432 INFO:tasks.workunit.client.1.smithi149.stdout:5/636: truncate d0/d6/d82/da1/d12/d16/da9/d1b/fcf 544216 0 2024-04-15T21:02:45.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/820: creat d1/d5/d24/d50/de2/d11e/f123 x:0 0 0 2024-04-15T21:02:45.437 INFO:tasks.workunit.client.0.smithi072.stdout:8/501: creat d3/d4/f96 x:0 0 0 2024-04-15T21:02:45.438 INFO:tasks.workunit.client.1.smithi149.stdout:9/612: readlink d23/d3c/d7a/d7c/lc0 0 2024-04-15T21:02:45.441 INFO:tasks.workunit.client.1.smithi149.stdout:8/729: write d2/df/d10/fee [1883458,87742] 0 2024-04-15T21:02:45.443 INFO:tasks.workunit.client.0.smithi072.stdout:8/502: dwrite d3/de/d1b/d44/f78 [4194304,4194304] 0 2024-04-15T21:02:45.444 INFO:tasks.workunit.client.1.smithi149.stdout:3/698: rename d1/db/d24/d4d/d63/db6/fd2 to d1/db/d24/fd6 0 2024-04-15T21:02:45.445 INFO:tasks.workunit.client.1.smithi149.stdout:3/699: dread - d1/d81/fcb zero size 2024-04-15T21:02:45.447 INFO:tasks.workunit.client.1.smithi149.stdout:7/631: creat d3/d39/d92/fe4 x:0 0 0 2024-04-15T21:02:45.449 INFO:tasks.workunit.client.0.smithi072.stdout:0/472: symlink d0/d45/d7a/l9f 0 2024-04-15T21:02:45.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/473: stat d0/d19/d58/c8d 0 2024-04-15T21:02:45.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/694: link d4/d7/d46/de4/d21/d2c/d63/f91 d4/d7/d93/ff0 0 2024-04-15T21:02:45.451 INFO:tasks.workunit.client.0.smithi072.stdout:0/474: write d0/d45/d7a/d70/d59/d8a/f65 [1400957,54851] 0 2024-04-15T21:02:45.453 INFO:tasks.workunit.client.0.smithi072.stdout:2/435: write d2/d8/f36 [2703485,45728] 0 2024-04-15T21:02:45.454 INFO:tasks.workunit.client.1.smithi149.stdout:7/632: dwrite d3/d16/d32/fa1 [0,4194304] 0 2024-04-15T21:02:45.454 INFO:tasks.workunit.client.0.smithi072.stdout:2/436: chown d2/d8/f3a 19699960 1 2024-04-15T21:02:45.458 INFO:tasks.workunit.client.0.smithi072.stdout:0/475: dwrite d0/d6/d55/f5f [4194304,4194304] 0 2024-04-15T21:02:45.460 INFO:tasks.workunit.client.0.smithi072.stdout:9/454: unlink d4/d1f/d31/c3d 0 2024-04-15T21:02:45.461 INFO:tasks.workunit.client.1.smithi149.stdout:8/730: mknod d2/df/d10/d25/d37/d53/daf/d92/c105 0 2024-04-15T21:02:45.462 INFO:tasks.workunit.client.1.smithi149.stdout:4/696: rename dc/d18/l3d to dc/d2c/le9 0 2024-04-15T21:02:45.465 INFO:tasks.workunit.client.0.smithi072.stdout:5/440: dwrite d0/d3/d7/f3c [4194304,4194304] 0 2024-04-15T21:02:45.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/455: read - d4/d29/d4c/d74/f7f zero size 2024-04-15T21:02:45.466 INFO:tasks.workunit.client.1.smithi149.stdout:2/695: mknod d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/cf1 0 2024-04-15T21:02:45.470 INFO:tasks.workunit.client.0.smithi072.stdout:7/487: link d2/d7/d25/d2d/d47/c69 d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/c96 0 2024-04-15T21:02:45.472 INFO:tasks.workunit.client.0.smithi072.stdout:7/488: write d2/d7/d25/d2d/d47/f4a [1243877,8955] 0 2024-04-15T21:02:45.473 INFO:tasks.workunit.client.0.smithi072.stdout:2/437: readlink d2/d37/l3d 0 2024-04-15T21:02:45.475 INFO:tasks.workunit.client.1.smithi149.stdout:0/821: unlink d1/d9/d64/d65/d104/d119/d43/de9/ffd 0 2024-04-15T21:02:45.479 INFO:tasks.workunit.client.1.smithi149.stdout:6/588: rename da/d11/l34 to da/d18/d10/d66/lb1 0 2024-04-15T21:02:45.480 INFO:tasks.workunit.client.0.smithi072.stdout:7/489: dwrite d2/d7/d25/d72/f92 [0,4194304] 0 2024-04-15T21:02:45.482 INFO:tasks.workunit.client.0.smithi072.stdout:8/503: symlink d3/d4/l97 0 2024-04-15T21:02:45.490 INFO:tasks.workunit.client.1.smithi149.stdout:0/822: rmdir d1/d5/d24/d50/d13 39 2024-04-15T21:02:45.493 INFO:tasks.workunit.client.0.smithi072.stdout:6/445: link d2/d10/d11/l62 d2/d40/d56/d6a/d70/d49/l89 0 2024-04-15T21:02:45.496 INFO:tasks.workunit.client.1.smithi149.stdout:3/700: dread d1/db/d24/f36 [0,4194304] 0 2024-04-15T21:02:45.497 INFO:tasks.workunit.client.1.smithi149.stdout:2/696: rename d4/d7/d46/de4/d21/f9b to d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/ff2 0 2024-04-15T21:02:45.503 INFO:tasks.workunit.client.0.smithi072.stdout:3/457: link d1/d3f/d4f/d73/f87 d1/d15/f98 0 2024-04-15T21:02:45.504 INFO:tasks.workunit.client.0.smithi072.stdout:3/458: chown d1/f2b 56 1 2024-04-15T21:02:45.504 INFO:tasks.workunit.client.1.smithi149.stdout:5/637: getdents d0/d6/d82/da1/d12/d16/da9/d9b 0 2024-04-15T21:02:45.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/638: write d0/d6/d82/da1/f38 [1963764,28823] 0 2024-04-15T21:02:45.507 INFO:tasks.workunit.client.1.smithi149.stdout:9/613: getdents d23/d3c 0 2024-04-15T21:02:45.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/614: write d23/d2b/d44/f64 [3424386,88388] 0 2024-04-15T21:02:45.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/615: write f16 [1274391,6959] 0 2024-04-15T21:02:45.511 INFO:tasks.workunit.client.0.smithi072.stdout:3/459: dwrite d1/d15/f6f [0,4194304] 0 2024-04-15T21:02:45.511 INFO:tasks.workunit.client.1.smithi149.stdout:0/823: mkdir d1/d9/d64/d124 0 2024-04-15T21:02:45.512 INFO:tasks.workunit.client.1.smithi149.stdout:0/824: readlink d1/d5/d24/d50/l28 0 2024-04-15T21:02:45.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/697: write dc/d2c/d3e/d35/f86 [3509387,69960] 0 2024-04-15T21:02:45.520 INFO:tasks.workunit.client.1.smithi149.stdout:4/698: chown dc/d2c/l5c 10804230 1 2024-04-15T21:02:45.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/633: dwrite d3/f10 [0,4194304] 0 2024-04-15T21:02:45.521 INFO:tasks.workunit.client.1.smithi149.stdout:4/699: chown dc/d8f/d91/ce5 101839697 1 2024-04-15T21:02:45.522 INFO:tasks.workunit.client.0.smithi072.stdout:5/441: write d0/f4a [423500,118819] 0 2024-04-15T21:02:45.527 INFO:tasks.workunit.client.0.smithi072.stdout:6/446: chown d2/d40/d6e/f4e 233 1 2024-04-15T21:02:45.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/447: dread - d2/d1a/f41 zero size 2024-04-15T21:02:45.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/448: chown d2/d40/d56/d6a/d70/f44 60674 1 2024-04-15T21:02:45.529 INFO:tasks.workunit.client.1.smithi149.stdout:6/589: write da/d11/f35 [1167812,99107] 0 2024-04-15T21:02:45.530 INFO:tasks.workunit.client.1.smithi149.stdout:3/701: dread d1/f2f [0,4194304] 0 2024-04-15T21:02:45.536 INFO:tasks.workunit.client.0.smithi072.stdout:8/504: dwrite d3/d4/d3b/f65 [0,4194304] 0 2024-04-15T21:02:45.540 INFO:tasks.workunit.client.0.smithi072.stdout:2/438: truncate d2/d3/d5f/f7c 694308 0 2024-04-15T21:02:45.546 INFO:tasks.workunit.client.1.smithi149.stdout:6/590: dread da/d2e/f52 [0,4194304] 0 2024-04-15T21:02:45.546 INFO:tasks.workunit.client.1.smithi149.stdout:9/616: unlink f1a 0 2024-04-15T21:02:45.547 INFO:tasks.workunit.client.1.smithi149.stdout:9/617: readlink d23/d2b/d37/d50/l51 0 2024-04-15T21:02:45.548 INFO:tasks.workunit.client.0.smithi072.stdout:3/460: rename d1/d91 to d1/d15/d32/d78/d99 0 2024-04-15T21:02:45.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/731: link d2/la d2/df/d10/d25/d37/d53/l106 0 2024-04-15T21:02:45.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/456: creat d4/f86 x:0 0 0 2024-04-15T21:02:45.551 INFO:tasks.workunit.client.1.smithi149.stdout:4/700: fsync dc/d18/f1f 0 2024-04-15T21:02:45.552 INFO:tasks.workunit.client.0.smithi072.stdout:9/457: read d4/d1f/d31/f7e [2469855,18213] 0 2024-04-15T21:02:45.553 INFO:tasks.workunit.client.0.smithi072.stdout:0/476: getdents d0/d45/d7a/d70 0 2024-04-15T21:02:45.555 INFO:tasks.workunit.client.1.smithi149.stdout:4/701: readlink dc/d2c/d3e/d15/l1e 0 2024-04-15T21:02:45.555 INFO:tasks.workunit.client.0.smithi072.stdout:3/461: dwrite d1/f8f [0,4194304] 0 2024-04-15T21:02:45.556 INFO:tasks.workunit.client.1.smithi149.stdout:9/618: dwrite d23/d2b/d37/d6d/f74 [0,4194304] 0 2024-04-15T21:02:45.566 INFO:tasks.workunit.client.0.smithi072.stdout:7/490: link d2/d7/d25/l4f d2/d7/d25/d2d/d46/l97 0 2024-04-15T21:02:45.576 INFO:tasks.workunit.client.0.smithi072.stdout:8/505: write d3/de/d1b/f62 [1400348,39071] 0 2024-04-15T21:02:45.578 INFO:tasks.workunit.client.0.smithi072.stdout:5/442: symlink d0/d3/d7/l95 0 2024-04-15T21:02:45.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/697: rename d4/d7/d10/d36/l8c to d4/d7/d46/lf3 0 2024-04-15T21:02:45.584 INFO:tasks.workunit.client.0.smithi072.stdout:6/449: link d2/d10/f3c d2/d40/d56/f8a 0 2024-04-15T21:02:45.585 INFO:tasks.workunit.client.1.smithi149.stdout:3/702: dwrite d1/db/d40/d56/f95 [0,4194304] 0 2024-04-15T21:02:45.586 INFO:tasks.workunit.client.0.smithi072.stdout:6/450: fdatasync d2/d40/d56/d6a/f72 0 2024-04-15T21:02:45.590 INFO:tasks.workunit.client.0.smithi072.stdout:0/477: mknod d0/d19/d71/ca0 0 2024-04-15T21:02:45.591 INFO:tasks.workunit.client.1.smithi149.stdout:3/703: truncate d1/db/d24/d2b/f25 4692387 0 2024-04-15T21:02:45.591 INFO:tasks.workunit.client.1.smithi149.stdout:6/591: dwrite da/d18/f87 [0,4194304] 0 2024-04-15T21:02:45.591 INFO:tasks.workunit.client.0.smithi072.stdout:3/462: fsync d1/d3f/f8a 0 2024-04-15T21:02:45.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/619: rmdir d23/d3c/d7a/d7c/d7f/d86 39 2024-04-15T21:02:45.601 INFO:tasks.workunit.client.0.smithi072.stdout:2/439: symlink d2/d38/l8f 0 2024-04-15T21:02:45.601 INFO:tasks.workunit.client.1.smithi149.stdout:8/732: dread d2/df/d10/f90 [4194304,4194304] 0 2024-04-15T21:02:45.603 INFO:tasks.workunit.client.0.smithi072.stdout:7/491: truncate d2/d7/d25/d2d/d46/d5a/d5f/d26/f41 3459341 0 2024-04-15T21:02:45.605 INFO:tasks.workunit.client.0.smithi072.stdout:8/506: chown d3/d4/d3b/f3e 1789042 1 2024-04-15T21:02:45.605 INFO:tasks.workunit.client.1.smithi149.stdout:9/620: dwrite d23/d2b/d37/d50/faf [0,4194304] 0 2024-04-15T21:02:45.605 INFO:tasks.workunit.client.1.smithi149.stdout:8/733: dread - d2/df/d10/d25/d37/d53/daf/ff7 zero size 2024-04-15T21:02:45.605 INFO:tasks.workunit.client.0.smithi072.stdout:8/507: fsync d3/de/d1b/d44/f78 0 2024-04-15T21:02:45.607 INFO:tasks.workunit.client.0.smithi072.stdout:5/443: creat d0/d3/d6/d2d/f96 x:0 0 0 2024-04-15T21:02:45.608 INFO:tasks.workunit.client.0.smithi072.stdout:4/468: sync 2024-04-15T21:02:45.608 INFO:tasks.workunit.client.0.smithi072.stdout:6/451: creat d2/d42/f8b x:0 0 0 2024-04-15T21:02:45.609 INFO:tasks.workunit.client.0.smithi072.stdout:1/462: sync 2024-04-15T21:02:45.612 INFO:tasks.workunit.client.0.smithi072.stdout:0/478: symlink d0/d19/d71/la1 0 2024-04-15T21:02:45.614 INFO:tasks.workunit.client.0.smithi072.stdout:3/463: fdatasync d1/d26/f47 0 2024-04-15T21:02:45.618 INFO:tasks.workunit.client.0.smithi072.stdout:9/458: dread d4/d29/d45/f72 [0,4194304] 0 2024-04-15T21:02:45.621 INFO:tasks.workunit.client.0.smithi072.stdout:7/492: mkdir d2/d7/d25/d72/d98 0 2024-04-15T21:02:45.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/734: creat d2/df/d10/d25/d57/dd1/d46/f107 x:0 0 0 2024-04-15T21:02:45.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/634: getdents d3/d96 0 2024-04-15T21:02:45.634 INFO:tasks.workunit.client.1.smithi149.stdout:1/594: sync 2024-04-15T21:02:45.636 INFO:tasks.workunit.client.1.smithi149.stdout:1/595: chown d1/db 110103 1 2024-04-15T21:02:45.636 INFO:tasks.workunit.client.1.smithi149.stdout:2/698: mknod d4/d7/d93/dc3/cf4 0 2024-04-15T21:02:45.637 INFO:tasks.workunit.client.0.smithi072.stdout:0/479: creat d0/d6/d48/fa2 x:0 0 0 2024-04-15T21:02:45.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/621: dwrite d23/d3c/d7a/d7c/d7f/d86/dc5/fc9 [0,4194304] 0 2024-04-15T21:02:45.639 INFO:tasks.workunit.client.1.smithi149.stdout:2/699: write d4/d7/d46/de4/d21/fe1 [377445,110287] 0 2024-04-15T21:02:45.641 INFO:tasks.workunit.client.1.smithi149.stdout:9/622: write d23/d2b/d37/d50/faf [4655168,61317] 0 2024-04-15T21:02:45.645 INFO:tasks.workunit.client.0.smithi072.stdout:3/464: symlink d1/d15/d32/d78/l9a 0 2024-04-15T21:02:45.647 INFO:tasks.workunit.client.1.smithi149.stdout:6/592: link da/d18/d10/f8b da/d11/fb2 0 2024-04-15T21:02:45.648 INFO:tasks.workunit.client.0.smithi072.stdout:2/440: mkdir d2/d8/d8e/d90 0 2024-04-15T21:02:45.650 INFO:tasks.workunit.client.0.smithi072.stdout:6/452: dwrite d2/d40/d56/f8a [0,4194304] 0 2024-04-15T21:02:45.653 INFO:tasks.workunit.client.1.smithi149.stdout:2/700: dwrite d4/d7/d93/fde [0,4194304] 0 2024-04-15T21:02:45.655 INFO:tasks.workunit.client.0.smithi072.stdout:7/493: dread d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:02:45.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/623: dwrite d23/d2b/d37/d6d/f6e [0,4194304] 0 2024-04-15T21:02:45.665 INFO:tasks.workunit.client.0.smithi072.stdout:0/480: dread d0/d6/ff [0,4194304] 0 2024-04-15T21:02:45.668 INFO:tasks.workunit.client.1.smithi149.stdout:4/702: getdents dc/d8f/d91 0 2024-04-15T21:02:45.670 INFO:tasks.workunit.client.0.smithi072.stdout:8/508: mkdir d3/de/d1b/d41/d74/d98 0 2024-04-15T21:02:45.672 INFO:tasks.workunit.client.0.smithi072.stdout:4/469: symlink d7/d10/d41/l99 0 2024-04-15T21:02:45.673 INFO:tasks.workunit.client.0.smithi072.stdout:4/470: dread - d7/d15/d58/d62/f90 zero size 2024-04-15T21:02:45.674 INFO:tasks.workunit.client.0.smithi072.stdout:4/471: write d7/d10/d41/f51 [181580,81932] 0 2024-04-15T21:02:45.682 INFO:tasks.workunit.client.0.smithi072.stdout:1/463: creat d5/db/d27/d8a/f95 x:0 0 0 2024-04-15T21:02:45.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/704: rename d1/db/d23/f49 to d1/db/d24/d4d/fd7 0 2024-04-15T21:02:45.690 INFO:tasks.workunit.client.1.smithi149.stdout:3/705: stat d1/db/d24/d4d/f82 0 2024-04-15T21:02:45.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/465: mknod d1/d15/d32/d78/c9b 0 2024-04-15T21:02:45.692 INFO:tasks.workunit.client.0.smithi072.stdout:8/509: dread d3/de/f25 [4194304,4194304] 0 2024-04-15T21:02:45.694 INFO:tasks.workunit.client.0.smithi072.stdout:3/466: dread d1/d15/d32/f50 [0,4194304] 0 2024-04-15T21:02:45.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/703: creat dc/d2c/d3e/d35/d4b/d75/d80/fea x:0 0 0 2024-04-15T21:02:45.697 INFO:tasks.workunit.client.0.smithi072.stdout:6/453: symlink d2/d40/d6e/l8c 0 2024-04-15T21:02:45.700 INFO:tasks.workunit.client.1.smithi149.stdout:9/624: dread d23/f33 [0,4194304] 0 2024-04-15T21:02:45.701 INFO:tasks.workunit.client.1.smithi149.stdout:2/701: rename d4/d7/d46/de4/d21/d5e/dbe/da7/l95 to d4/d7/d10/lf5 0 2024-04-15T21:02:45.703 INFO:tasks.workunit.client.1.smithi149.stdout:6/593: write da/d2e/f52 [198196,115764] 0 2024-04-15T21:02:45.706 INFO:tasks.workunit.client.1.smithi149.stdout:8/735: dread d2/df/d10/d25/d32/f42 [0,4194304] 0 2024-04-15T21:02:45.706 INFO:tasks.workunit.client.0.smithi072.stdout:0/481: creat d0/d19/d2b/fa3 x:0 0 0 2024-04-15T21:02:45.707 INFO:tasks.workunit.client.1.smithi149.stdout:8/736: rename d2 to d2/df/d10/d4e/d9f/dd8/d108 22 2024-04-15T21:02:45.708 INFO:tasks.workunit.client.1.smithi149.stdout:3/706: mkdir d1/db/d40/da0/dd8 0 2024-04-15T21:02:45.710 INFO:tasks.workunit.client.1.smithi149.stdout:7/635: rmdir d3/d39/de3 0 2024-04-15T21:02:45.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/704: dread dc/d2c/d3e/d15/fde [0,4194304] 0 2024-04-15T21:02:45.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/705: readlink dc/d18/daa/le7 0 2024-04-15T21:02:45.714 INFO:tasks.workunit.client.1.smithi149.stdout:6/594: creat da/d49/fb3 x:0 0 0 2024-04-15T21:02:45.716 INFO:tasks.workunit.client.0.smithi072.stdout:1/464: unlink d5/db/d2d/f3e 0 2024-04-15T21:02:45.716 INFO:tasks.workunit.client.0.smithi072.stdout:1/465: write d5/f3c [1599210,49900] 0 2024-04-15T21:02:45.724 INFO:tasks.workunit.client.1.smithi149.stdout:8/737: mkdir d2/df/d10/d20/d6b/d109 0 2024-04-15T21:02:45.725 INFO:tasks.workunit.client.1.smithi149.stdout:8/738: chown d2/df/d10/d25/d37 10 1 2024-04-15T21:02:45.725 INFO:tasks.workunit.client.0.smithi072.stdout:8/510: dread d3/de/d81/f86 [0,4194304] 0 2024-04-15T21:02:45.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/707: rename d1/db/d40/d56/f95 to d1/db/d24/d4d/d63/d65/dc3/fd9 0 2024-04-15T21:02:45.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/708: readlink d1/db/d24/d4d/l72 0 2024-04-15T21:02:45.727 INFO:tasks.workunit.client.0.smithi072.stdout:3/467: creat d1/d3f/f9c x:0 0 0 2024-04-15T21:02:45.728 INFO:tasks.workunit.client.1.smithi149.stdout:7/636: mkdir d3/d16/d32/d90/de5 0 2024-04-15T21:02:45.729 INFO:tasks.workunit.client.0.smithi072.stdout:7/494: rmdir d2/d7/d25/d81 39 2024-04-15T21:02:45.731 INFO:tasks.workunit.client.0.smithi072.stdout:9/459: rmdir d4/d1f/d31/d80 0 2024-04-15T21:02:45.734 INFO:tasks.workunit.client.0.smithi072.stdout:0/482: fsync d0/d19/d2b/d63/f7c 0 2024-04-15T21:02:45.735 INFO:tasks.workunit.client.1.smithi149.stdout:2/702: mkdir d4/df6 0 2024-04-15T21:02:45.737 INFO:tasks.workunit.client.0.smithi072.stdout:7/495: dread d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:45.737 INFO:tasks.workunit.client.0.smithi072.stdout:2/441: dwrite d2/d38/f2a [0,4194304] 0 2024-04-15T21:02:45.738 INFO:tasks.workunit.client.1.smithi149.stdout:6/595: mkdir da/d49/d55/da0/db4 0 2024-04-15T21:02:45.739 INFO:tasks.workunit.client.0.smithi072.stdout:7/496: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d 62 1 2024-04-15T21:02:45.742 INFO:tasks.workunit.client.0.smithi072.stdout:8/511: fdatasync d3/d4/d4c/f2a 0 2024-04-15T21:02:45.746 INFO:tasks.workunit.client.0.smithi072.stdout:2/442: dwrite d2/d8/f36 [0,4194304] 0 2024-04-15T21:02:45.747 INFO:tasks.workunit.client.1.smithi149.stdout:4/706: dwrite fa [4194304,4194304] 0 2024-04-15T21:02:45.748 INFO:tasks.workunit.client.0.smithi072.stdout:9/460: symlink d4/d29/d4c/d74/d84/l87 0 2024-04-15T21:02:45.749 INFO:tasks.workunit.client.0.smithi072.stdout:6/454: getdents d2/d10/d11/d1f/d60/d63 0 2024-04-15T21:02:45.754 INFO:tasks.workunit.client.0.smithi072.stdout:2/443: dwrite d2/d38/f54 [0,4194304] 0 2024-04-15T21:02:45.754 INFO:tasks.workunit.client.0.smithi072.stdout:2/444: dread - d2/d8/f72 zero size 2024-04-15T21:02:45.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/639: sync 2024-04-15T21:02:45.761 INFO:tasks.workunit.client.0.smithi072.stdout:7/497: symlink d2/d7/d25/d72/l99 0 2024-04-15T21:02:45.763 INFO:tasks.workunit.client.0.smithi072.stdout:3/468: dwrite d1/d15/f98 [0,4194304] 0 2024-04-15T21:02:45.770 INFO:tasks.workunit.client.0.smithi072.stdout:9/461: creat d4/d29/d45/f88 x:0 0 0 2024-04-15T21:02:45.771 INFO:tasks.workunit.client.0.smithi072.stdout:9/462: write d4/d76/f7a [1009055,19851] 0 2024-04-15T21:02:45.774 INFO:tasks.workunit.client.0.smithi072.stdout:9/463: dread d4/f4e [0,4194304] 0 2024-04-15T21:02:45.776 INFO:tasks.workunit.client.0.smithi072.stdout:6/455: fdatasync d2/d10/d18/f39 0 2024-04-15T21:02:45.777 INFO:tasks.workunit.client.0.smithi072.stdout:6/456: write d2/d1a/f5f [1878984,90621] 0 2024-04-15T21:02:45.777 INFO:tasks.workunit.client.0.smithi072.stdout:0/483: creat d0/d6/d6d/d87/fa4 x:0 0 0 2024-04-15T21:02:45.778 INFO:tasks.workunit.client.0.smithi072.stdout:1/466: creat d5/f96 x:0 0 0 2024-04-15T21:02:45.779 INFO:tasks.workunit.client.0.smithi072.stdout:1/467: dread - d5/f8f zero size 2024-04-15T21:02:45.784 INFO:tasks.workunit.client.0.smithi072.stdout:7/498: creat d2/d7/f9a x:0 0 0 2024-04-15T21:02:45.785 INFO:tasks.workunit.client.0.smithi072.stdout:3/469: mkdir d1/d9d 0 2024-04-15T21:02:45.787 INFO:tasks.workunit.client.0.smithi072.stdout:3/470: dread - d1/f82 zero size 2024-04-15T21:02:45.787 INFO:tasks.workunit.client.0.smithi072.stdout:6/457: dwrite d2/f2a [4194304,4194304] 0 2024-04-15T21:02:45.788 INFO:tasks.workunit.client.0.smithi072.stdout:9/464: symlink d4/d76/l89 0 2024-04-15T21:02:45.792 INFO:tasks.workunit.client.0.smithi072.stdout:0/484: dwrite d0/d19/f98 [0,4194304] 0 2024-04-15T21:02:45.794 INFO:tasks.workunit.client.0.smithi072.stdout:2/445: dwrite d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:45.794 INFO:tasks.workunit.client.1.smithi149.stdout:8/739: rmdir d2/df/d10/d25/d32/d45/d77 39 2024-04-15T21:02:45.795 INFO:tasks.workunit.client.0.smithi072.stdout:3/471: write d1/d15/d32/d2f/f5c [3941033,60263] 0 2024-04-15T21:02:45.795 INFO:tasks.workunit.client.0.smithi072.stdout:2/446: stat d2/d8/d41/c55 0 2024-04-15T21:02:45.798 INFO:tasks.workunit.client.0.smithi072.stdout:3/472: readlink d1/d15/d40/l21 0 2024-04-15T21:02:45.799 INFO:tasks.workunit.client.0.smithi072.stdout:1/468: creat d5/d3d/d5e/f97 x:0 0 0 2024-04-15T21:02:45.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/512: creat d3/de/f99 x:0 0 0 2024-04-15T21:02:45.802 INFO:tasks.workunit.client.0.smithi072.stdout:3/473: dread - d1/d3f/f95 zero size 2024-04-15T21:02:45.805 INFO:tasks.workunit.client.1.smithi149.stdout:7/637: chown d3/l14 1405 1 2024-04-15T21:02:45.805 INFO:tasks.workunit.client.0.smithi072.stdout:6/458: dwrite d2/d42/f5d [0,4194304] 0 2024-04-15T21:02:45.806 INFO:tasks.workunit.client.0.smithi072.stdout:9/465: dwrite d4/d29/d4c/d74/f7f [0,4194304] 0 2024-04-15T21:02:45.806 INFO:tasks.workunit.client.0.smithi072.stdout:3/474: write d1/d15/d32/f65 [3135960,59156] 0 2024-04-15T21:02:45.806 INFO:tasks.workunit.client.1.smithi149.stdout:3/709: fsync d1/fcf 0 2024-04-15T21:02:45.808 INFO:tasks.workunit.client.0.smithi072.stdout:9/466: write d4/d1f/d2c/f2d [4425168,29683] 0 2024-04-15T21:02:45.809 INFO:tasks.workunit.client.0.smithi072.stdout:9/467: write d4/d1f/d2c/d47/f5f [262377,26890] 0 2024-04-15T21:02:45.810 INFO:tasks.workunit.client.1.smithi149.stdout:9/625: rmdir d23/d2b/d37/d50/dbe 0 2024-04-15T21:02:45.811 INFO:tasks.workunit.client.1.smithi149.stdout:9/626: read d23/d2b/d37/d50/faf [2101972,119595] 0 2024-04-15T21:02:45.822 INFO:tasks.workunit.client.1.smithi149.stdout:0/825: sync 2024-04-15T21:02:45.822 INFO:tasks.workunit.client.1.smithi149.stdout:1/596: sync 2024-04-15T21:02:45.833 INFO:tasks.workunit.client.0.smithi072.stdout:1/469: fsync d5/db/f4f 0 2024-04-15T21:02:45.835 INFO:tasks.workunit.client.1.smithi149.stdout:4/707: mkdir dc/deb 0 2024-04-15T21:02:45.836 INFO:tasks.workunit.client.1.smithi149.stdout:0/826: dread d1/d9/d64/d65/d104/d119/f5a [4194304,4194304] 0 2024-04-15T21:02:45.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/708: chown dc/lf 1 1 2024-04-15T21:02:45.839 INFO:tasks.workunit.client.0.smithi072.stdout:0/485: symlink d0/d45/d7a/la5 0 2024-04-15T21:02:45.844 INFO:tasks.workunit.client.1.smithi149.stdout:8/740: rename d2/df/d10 to d2/d5b/dcd/d10a 0 2024-04-15T21:02:45.861 INFO:tasks.workunit.client.0.smithi072.stdout:2/447: mkdir d2/d38/d91 0 2024-04-15T21:02:45.865 INFO:tasks.workunit.client.1.smithi149.stdout:6/596: creat da/d32/fb5 x:0 0 0 2024-04-15T21:02:45.866 INFO:tasks.workunit.client.0.smithi072.stdout:1/470: creat d5/db/d2d/d3a/d1f/f98 x:0 0 0 2024-04-15T21:02:45.868 INFO:tasks.workunit.client.0.smithi072.stdout:0/486: creat d0/d45/d7a/d70/d59/d8a/fa6 x:0 0 0 2024-04-15T21:02:45.868 INFO:tasks.workunit.client.0.smithi072.stdout:7/499: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f19 [1406987,77361] 0 2024-04-15T21:02:45.871 INFO:tasks.workunit.client.0.smithi072.stdout:3/475: mkdir d1/d15/d40/d9e 0 2024-04-15T21:02:45.872 INFO:tasks.workunit.client.0.smithi072.stdout:3/476: chown d1/d3f/d4f/d73 911 1 2024-04-15T21:02:45.873 INFO:tasks.workunit.client.0.smithi072.stdout:6/459: mknod d2/d10/d11/d1f/d60/d63/c8d 0 2024-04-15T21:02:45.873 INFO:tasks.workunit.client.0.smithi072.stdout:3/477: stat d1/d5b/f60 0 2024-04-15T21:02:45.874 INFO:tasks.workunit.client.0.smithi072.stdout:3/478: chown d1/d3f/d4f 15 1 2024-04-15T21:02:45.874 INFO:tasks.workunit.client.0.smithi072.stdout:6/460: write d2/fa [1573461,8519] 0 2024-04-15T21:02:45.874 INFO:tasks.workunit.client.0.smithi072.stdout:0/487: dwrite d0/d6/d48/f9c [0,4194304] 0 2024-04-15T21:02:45.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/638: rename d3/d16/d20/db5/cb3 to d3/d16/da0/ce6 0 2024-04-15T21:02:45.875 INFO:tasks.workunit.client.1.smithi149.stdout:2/703: dwrite d4/d7/d46/de4/d21/d55/d94/faf [4194304,4194304] 0 2024-04-15T21:02:45.876 INFO:tasks.workunit.client.0.smithi072.stdout:2/448: chown d2/d38/f48 0 1 2024-04-15T21:02:45.878 INFO:tasks.workunit.client.1.smithi149.stdout:8/741: truncate d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda/f9a 115187 0 2024-04-15T21:02:45.879 INFO:tasks.workunit.client.0.smithi072.stdout:1/471: creat d5/db/d2d/d85/f99 x:0 0 0 2024-04-15T21:02:45.881 INFO:tasks.workunit.client.0.smithi072.stdout:1/472: read d5/db/d27/d5c/f84 [561231,41451] 0 2024-04-15T21:02:45.881 INFO:tasks.workunit.client.0.smithi072.stdout:8/513: rename d3/f33 to d3/de/d21/f9a 0 2024-04-15T21:02:45.891 INFO:tasks.workunit.client.0.smithi072.stdout:6/461: chown d2/d1a/l6b 49191 1 2024-04-15T21:02:45.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/462: write d2/d1a/f75 [1038240,114421] 0 2024-04-15T21:02:45.892 INFO:tasks.workunit.client.1.smithi149.stdout:5/640: dwrite d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:45.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/463: chown d2/d10/d11/f2e 281 1 2024-04-15T21:02:45.895 INFO:tasks.workunit.client.1.smithi149.stdout:0/827: creat d1/d29/d2c/d4f/d95/f125 x:0 0 0 2024-04-15T21:02:45.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/828: chown d1/d5/d24/d50/l28 1395 1 2024-04-15T21:02:45.896 INFO:tasks.workunit.client.0.smithi072.stdout:0/488: unlink d0/d6/d48/d61/f90 0 2024-04-15T21:02:45.904 INFO:tasks.workunit.client.1.smithi149.stdout:0/829: dread d1/d5/fb8 [0,4194304] 0 2024-04-15T21:02:45.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/704: mknod d4/d7/d46/de4/d21/d2c/d3e/d9d/cf7 0 2024-04-15T21:02:45.911 INFO:tasks.workunit.client.1.smithi149.stdout:8/742: symlink d2/d16/l10b 0 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 175 MiB/s wr, 340 op/s 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: Standby manager daemon smithi072.wfjmmp started 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/crt"}]: dispatch 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/key"}]: dispatch 2024-04-15T21:02:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:45 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:02:45.913 INFO:tasks.workunit.client.0.smithi072.stdout:1/473: creat d5/db/d2d/d3a/d1f/f9a x:0 0 0 2024-04-15T21:02:45.914 INFO:tasks.workunit.client.1.smithi149.stdout:3/710: creat d1/db/d40/d56/fda x:0 0 0 2024-04-15T21:02:45.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/705: dwrite d4/d7/d93/fde [0,4194304] 0 2024-04-15T21:02:45.926 INFO:tasks.workunit.client.1.smithi149.stdout:4/709: dwrite dc/d2c/d3e/f47 [4194304,4194304] 0 2024-04-15T21:02:45.928 INFO:tasks.workunit.client.1.smithi149.stdout:4/710: stat dc/d2c/d3e/d35/d4b/d75/dca 0 2024-04-15T21:02:45.930 INFO:tasks.workunit.client.1.smithi149.stdout:0/830: dread - d1/d5/d24/d50/d13/d38/f110 zero size 2024-04-15T21:02:45.933 INFO:tasks.workunit.client.1.smithi149.stdout:0/831: chown d1/d9/d64/d73/f91 143574 1 2024-04-15T21:02:45.939 INFO:tasks.workunit.client.1.smithi149.stdout:1/597: getdents d1/d17/d52 0 2024-04-15T21:02:45.941 INFO:tasks.workunit.client.1.smithi149.stdout:3/711: truncate d1/db/f1d 1733142 0 2024-04-15T21:02:45.941 INFO:tasks.workunit.client.1.smithi149.stdout:7/639: write d3/d16/d20/d9c/f55 [406493,13772] 0 2024-04-15T21:02:45.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/641: link d0/d6/d82/da1/d12/d16/da9/d1b/d83/f90 d0/d6/fd2 0 2024-04-15T21:02:45.953 INFO:tasks.workunit.client.0.smithi072.stdout:3/479: fsync d1/d15/d32/f24 0 2024-04-15T21:02:45.954 INFO:tasks.workunit.client.1.smithi149.stdout:6/597: dwrite da/d18/d10/d16/f3c [0,4194304] 0 2024-04-15T21:02:45.956 INFO:tasks.workunit.client.0.smithi072.stdout:6/464: mknod d2/d10/d11/d1f/d60/d63/c8e 0 2024-04-15T21:02:45.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/832: symlink d1/d5/dfb/l126 0 2024-04-15T21:02:45.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/743: mknod d2/d5b/dcd/d10a/d34/c10c 0 2024-04-15T21:02:45.962 INFO:tasks.workunit.client.1.smithi149.stdout:8/744: write d2/d5b/dcd/d10a/d25/d57/ff5 [984419,124894] 0 2024-04-15T21:02:45.963 INFO:tasks.workunit.client.0.smithi072.stdout:5/444: sync 2024-04-15T21:02:45.963 INFO:tasks.workunit.client.0.smithi072.stdout:2/449: link d2/d8/f36 d2/d38/d73/d80/f92 0 2024-04-15T21:02:45.970 INFO:tasks.workunit.client.0.smithi072.stdout:7/500: rename d2/d7/d25/d2d/d46/d5a/d5f/d26/f41 to d2/d7/d25/d2d/d46/d5a/f9b 0 2024-04-15T21:02:45.970 INFO:tasks.workunit.client.0.smithi072.stdout:8/514: rename d3/d7e to d3/d7e/d9b 22 2024-04-15T21:02:45.971 INFO:tasks.workunit.client.1.smithi149.stdout:7/640: fdatasync d3/ff 0 2024-04-15T21:02:45.972 INFO:tasks.workunit.client.0.smithi072.stdout:1/474: creat d5/d31/d51/f9b x:0 0 0 2024-04-15T21:02:45.974 INFO:tasks.workunit.client.1.smithi149.stdout:2/706: rename d4/d7/d46/de4/d21/d2c/d32/d4a/dee/fb1 to d4/d7/d46/de4/d21/d5e/dbe/ff8 0 2024-04-15T21:02:45.976 INFO:tasks.workunit.client.0.smithi072.stdout:3/480: stat d1/d15/d40/f9 0 2024-04-15T21:02:45.980 INFO:tasks.workunit.client.1.smithi149.stdout:6/598: symlink da/d18/d7d/lb6 0 2024-04-15T21:02:45.981 INFO:tasks.workunit.client.1.smithi149.stdout:2/707: dwrite d4/d7/d46/fe2 [0,4194304] 0 2024-04-15T21:02:45.990 INFO:tasks.workunit.client.0.smithi072.stdout:4/472: sync 2024-04-15T21:02:45.990 INFO:tasks.workunit.client.0.smithi072.stdout:7/501: creat d2/d7/d25/d72/f9c x:0 0 0 2024-04-15T21:02:45.992 INFO:tasks.workunit.client.0.smithi072.stdout:7/502: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f [1696326,91752] 0 2024-04-15T21:02:45.994 INFO:tasks.workunit.client.1.smithi149.stdout:5/642: dread d0/d6/d82/da1/f7b [0,4194304] 0 2024-04-15T21:02:45.995 INFO:tasks.workunit.client.1.smithi149.stdout:3/712: mknod d1/db/d24/cdb 0 2024-04-15T21:02:45.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/481: symlink d1/l9f 0 2024-04-15T21:02:45.999 INFO:tasks.workunit.client.1.smithi149.stdout:7/641: unlink d3/d16/d20/d36/d3d/l45 0 2024-04-15T21:02:46.000 INFO:tasks.workunit.client.0.smithi072.stdout:6/465: dwrite d2/d10/d11/d15/f53 [0,4194304] 0 2024-04-15T21:02:46.000 INFO:tasks.workunit.client.1.smithi149.stdout:4/711: write dc/d18/d21/f63 [1582614,117880] 0 2024-04-15T21:02:46.006 INFO:tasks.workunit.client.0.smithi072.stdout:7/503: creat d2/d7/d25/d2d/d52/f9d x:0 0 0 2024-04-15T21:02:46.008 INFO:tasks.workunit.client.0.smithi072.stdout:3/482: rmdir d1/d26 39 2024-04-15T21:02:46.009 INFO:tasks.workunit.client.1.smithi149.stdout:7/642: rmdir d3/d39 39 2024-04-15T21:02:46.010 INFO:tasks.workunit.client.0.smithi072.stdout:3/483: write d1/d3f/d4f/d73/f85 [364021,120823] 0 2024-04-15T21:02:46.011 INFO:tasks.workunit.client.1.smithi149.stdout:4/712: rename dc/d2c/d3e/d15/fa0 to dc/d18/dce/fec 0 2024-04-15T21:02:46.012 INFO:tasks.workunit.client.0.smithi072.stdout:0/489: getdents d0/d45/d35 0 2024-04-15T21:02:46.015 INFO:tasks.workunit.client.0.smithi072.stdout:3/484: dwrite d1/f64 [0,4194304] 0 2024-04-15T21:02:46.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/745: rmdir d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/de8 0 2024-04-15T21:02:46.017 INFO:tasks.workunit.client.0.smithi072.stdout:5/445: link d0/d3/d6/d14/c38 d0/d3/d7/d12/d31/d55/d58/c97 0 2024-04-15T21:02:46.017 INFO:tasks.workunit.client.0.smithi072.stdout:3/485: read d1/d15/f3e [290600,12733] 0 2024-04-15T21:02:46.018 INFO:tasks.workunit.client.0.smithi072.stdout:5/446: write d0/f59 [3852901,97531] 0 2024-04-15T21:02:46.023 INFO:tasks.workunit.client.1.smithi149.stdout:7/643: rename d3/d16/d20/d6c/f83 to d3/d16/d32/d90/dad/dc4/fe7 0 2024-04-15T21:02:46.024 INFO:tasks.workunit.client.1.smithi149.stdout:8/746: chown d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f43 18145902 1 2024-04-15T21:02:46.024 INFO:tasks.workunit.client.1.smithi149.stdout:4/713: mknod dc/d2c/d3e/d7c/dd0/ced 0 2024-04-15T21:02:46.025 INFO:tasks.workunit.client.1.smithi149.stdout:1/598: write d1/db/f37 [250447,121529] 0 2024-04-15T21:02:46.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/643: dread d0/d9/db6/f7e [0,4194304] 0 2024-04-15T21:02:46.026 INFO:tasks.workunit.client.1.smithi149.stdout:0/833: dread d1/d5/d24/d50/d13/d38/d44/f60 [0,4194304] 0 2024-04-15T21:02:46.027 INFO:tasks.workunit.client.1.smithi149.stdout:3/713: creat d1/db/d40/d56/fdc x:0 0 0 2024-04-15T21:02:46.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/747: read d2/d5b/dcd/d10a/fee [1391209,56638] 0 2024-04-15T21:02:46.030 INFO:tasks.workunit.client.1.smithi149.stdout:5/644: write d0/d6/d82/da1/fb2 [4914833,69969] 0 2024-04-15T21:02:46.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/714: stat d1/db/d24/d4d/l72 0 2024-04-15T21:02:46.031 INFO:tasks.workunit.client.0.smithi072.stdout:0/490: creat d0/d45/d7a/d70/d59/d8a/fa7 x:0 0 0 2024-04-15T21:02:46.031 INFO:tasks.workunit.client.0.smithi072.stdout:6/466: dread d2/d1a/f5f [0,4194304] 0 2024-04-15T21:02:46.031 INFO:tasks.workunit.client.0.smithi072.stdout:8/515: dwrite d3/d4/d3b/f3e [0,4194304] 0 2024-04-15T21:02:46.032 INFO:tasks.workunit.client.0.smithi072.stdout:9/468: sync 2024-04-15T21:02:46.034 INFO:tasks.workunit.client.0.smithi072.stdout:2/450: truncate d2/d37/f49 3557066 0 2024-04-15T21:02:46.038 INFO:tasks.workunit.client.0.smithi072.stdout:4/473: getdents d7/d24/d3e 0 2024-04-15T21:02:46.038 INFO:tasks.workunit.client.0.smithi072.stdout:9/469: dwrite d4/d1f/d31/d4d/f5c [0,4194304] 0 2024-04-15T21:02:46.039 INFO:tasks.workunit.client.1.smithi149.stdout:1/599: rmdir d1/d17 39 2024-04-15T21:02:46.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/834: mknod d1/d9/d64/d65/d104/d119/df7/c127 0 2024-04-15T21:02:46.045 INFO:tasks.workunit.client.0.smithi072.stdout:1/475: dwrite d5/db/d2d/d3a/f39 [0,4194304] 0 2024-04-15T21:02:46.047 INFO:tasks.workunit.client.0.smithi072.stdout:1/476: write d5/db/d2d/d3a/f22 [1549764,9339] 0 2024-04-15T21:02:46.053 INFO:tasks.workunit.client.0.smithi072.stdout:1/477: dwrite d5/db/d27/d8a/f95 [0,4194304] 0 2024-04-15T21:02:46.054 INFO:tasks.workunit.client.0.smithi072.stdout:1/478: write d5/db/d27/d5c/f64 [68236,31829] 0 2024-04-15T21:02:46.056 INFO:tasks.workunit.client.0.smithi072.stdout:0/491: creat d0/d6/fa8 x:0 0 0 2024-04-15T21:02:46.059 INFO:tasks.workunit.client.1.smithi149.stdout:3/715: fsync d1/db/f1c 0 2024-04-15T21:02:46.059 INFO:tasks.workunit.client.1.smithi149.stdout:5/645: creat d0/d9/d3f/d47/fd3 x:0 0 0 2024-04-15T21:02:46.060 INFO:tasks.workunit.client.0.smithi072.stdout:2/451: dread - d2/d3/f5d zero size 2024-04-15T21:02:46.061 INFO:tasks.workunit.client.1.smithi149.stdout:3/716: read - d1/db/d24/d4d/d63/d65/f9c zero size 2024-04-15T21:02:46.061 INFO:tasks.workunit.client.1.smithi149.stdout:5/646: truncate d0/d9/db6/f62 4578849 0 2024-04-15T21:02:46.063 INFO:tasks.workunit.client.1.smithi149.stdout:4/714: rename dc/d2c/d3e/c7a to dc/d2c/d3e/d7c/cee 0 2024-04-15T21:02:46.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/486: write d1/d15/f4d [1202108,118233] 0 2024-04-15T21:02:46.065 INFO:tasks.workunit.client.1.smithi149.stdout:4/715: chown dc/d2c/l7e 130252044 1 2024-04-15T21:02:46.065 INFO:tasks.workunit.client.0.smithi072.stdout:8/516: dwrite f1 [0,4194304] 0 2024-04-15T21:02:46.067 INFO:tasks.workunit.client.0.smithi072.stdout:8/517: write d3/d4/d4d/f73 [3507415,129508] 0 2024-04-15T21:02:46.069 INFO:tasks.workunit.client.0.smithi072.stdout:8/518: chown d3/de/c71 27405 1 2024-04-15T21:02:46.071 INFO:tasks.workunit.client.0.smithi072.stdout:5/447: creat d0/d3/d7/d12/d31/d62/d8e/f98 x:0 0 0 2024-04-15T21:02:46.073 INFO:tasks.workunit.client.1.smithi149.stdout:7/644: mknod d3/d16/d32/d90/dad/dc4/dde/ce8 0 2024-04-15T21:02:46.074 INFO:tasks.workunit.client.1.smithi149.stdout:1/600: dwrite d1/db/dc/d38/d39/d43/f54 [0,4194304] 0 2024-04-15T21:02:46.074 INFO:tasks.workunit.client.0.smithi072.stdout:3/487: dwrite d1/d15/d32/d2f/d1a/f8d [0,4194304] 0 2024-04-15T21:02:46.075 INFO:tasks.workunit.client.0.smithi072.stdout:3/488: chown d1/d15/d32 6 1 2024-04-15T21:02:46.077 INFO:tasks.workunit.client.1.smithi149.stdout:1/601: dread - d1/db/dc/d11/f9b zero size 2024-04-15T21:02:46.084 INFO:tasks.workunit.client.1.smithi149.stdout:8/748: rename d2/d5b/dcd/d10a/d4e/d9f/fde to d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f10d 0 2024-04-15T21:02:46.086 INFO:tasks.workunit.client.0.smithi072.stdout:2/452: mknod d2/d8/d41/c93 0 2024-04-15T21:02:46.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/453: chown d2/d8/d6c/f84 2 1 2024-04-15T21:02:46.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/645: rmdir d3/d16/d20/dab 39 2024-04-15T21:02:46.093 INFO:tasks.workunit.client.0.smithi072.stdout:8/519: write d3/de/d21/f51 [3411345,105469] 0 2024-04-15T21:02:46.097 INFO:tasks.workunit.client.1.smithi149.stdout:9/627: sync 2024-04-15T21:02:46.098 INFO:tasks.workunit.client.1.smithi149.stdout:1/602: unlink d1/db/dc/d11/d3f/d45/c4b 0 2024-04-15T21:02:46.099 INFO:tasks.workunit.client.0.smithi072.stdout:4/474: mknod d7/d10/d41/d45/d93/c9a 0 2024-04-15T21:02:46.100 INFO:tasks.workunit.client.0.smithi072.stdout:4/475: readlink d7/d15/d58/l80 0 2024-04-15T21:02:46.103 INFO:tasks.workunit.client.0.smithi072.stdout:4/476: read d7/d28/d42/f75 [166399,124174] 0 2024-04-15T21:02:46.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/504: getdents d2/d7/d25/d2d/d46/d5a/d5f 0 2024-04-15T21:02:46.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/835: link d1/d9/d64/d65/d104/d119/d43/ceb d1/d9/d64/d65/c128 0 2024-04-15T21:02:46.106 INFO:tasks.workunit.client.1.smithi149.stdout:0/836: chown d1/d29/d2c/d4f/d95/ldd 27408 1 2024-04-15T21:02:46.107 INFO:tasks.workunit.client.0.smithi072.stdout:2/454: mkdir d2/d8/d41/d94 0 2024-04-15T21:02:46.107 INFO:tasks.workunit.client.1.smithi149.stdout:7/646: rmdir d3/d16/d32/d90/dad/dc4/dde 39 2024-04-15T21:02:46.108 INFO:tasks.workunit.client.0.smithi072.stdout:2/455: chown d2/d8/d41/l6b 245 1 2024-04-15T21:02:46.112 INFO:tasks.workunit.client.1.smithi149.stdout:4/716: link dc/d18/d21/d81/f8e dc/deb/fef 0 2024-04-15T21:02:46.114 INFO:tasks.workunit.client.0.smithi072.stdout:4/477: symlink d7/d15/d58/l9b 0 2024-04-15T21:02:46.115 INFO:tasks.workunit.client.1.smithi149.stdout:7/647: creat d3/d16/d20/d60/fe9 x:0 0 0 2024-04-15T21:02:46.116 INFO:tasks.workunit.client.0.smithi072.stdout:7/505: rmdir d2/d7/d25/d2d/d47/d7e 39 2024-04-15T21:02:46.118 INFO:tasks.workunit.client.0.smithi072.stdout:7/506: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/f5d 6 1 2024-04-15T21:02:46.118 INFO:tasks.workunit.client.1.smithi149.stdout:0/837: dread d1/d9/d64/d65/d104/d119/d43/f48 [0,4194304] 0 2024-04-15T21:02:46.119 INFO:tasks.workunit.client.0.smithi072.stdout:7/507: dread - d2/d7/d25/d2d/d46/d5a/d5f/d1f/f84 zero size 2024-04-15T21:02:46.119 INFO:tasks.workunit.client.0.smithi072.stdout:3/489: mknod d1/d15/d32/ca0 0 2024-04-15T21:02:46.120 INFO:tasks.workunit.client.0.smithi072.stdout:7/508: chown d2/d7/d25/f8b 0 1 2024-04-15T21:02:46.120 INFO:tasks.workunit.client.0.smithi072.stdout:3/490: chown d1/d3f/l54 236572554 1 2024-04-15T21:02:46.121 INFO:tasks.workunit.client.0.smithi072.stdout:3/491: truncate d1/d15/d40/f71 777281 0 2024-04-15T21:02:46.124 INFO:tasks.workunit.client.1.smithi149.stdout:5/647: write d0/d6/d82/da1/d12/d16/f1d [7148876,4599] 0 2024-04-15T21:02:46.125 INFO:tasks.workunit.client.0.smithi072.stdout:2/456: mknod d2/d38/d73/d80/c95 0 2024-04-15T21:02:46.125 INFO:tasks.workunit.client.0.smithi072.stdout:2/457: readlink d2/d37/l8c 0 2024-04-15T21:02:46.129 INFO:tasks.workunit.client.1.smithi149.stdout:3/717: dwrite d1/db/d24/f5f [4194304,4194304] 0 2024-04-15T21:02:46.133 INFO:tasks.workunit.client.0.smithi072.stdout:5/448: creat d0/d3/d7/d12/f99 x:0 0 0 2024-04-15T21:02:46.134 INFO:tasks.workunit.client.1.smithi149.stdout:4/717: dread dc/d18/d21/f6b [0,4194304] 0 2024-04-15T21:02:46.135 INFO:tasks.workunit.client.1.smithi149.stdout:4/718: readlink dc/d18/d21/l2f 0 2024-04-15T21:02:46.139 INFO:tasks.workunit.client.1.smithi149.stdout:0/838: dread d1/d5/d24/d50/d13/d59/fd4 [0,4194304] 0 2024-04-15T21:02:46.140 INFO:tasks.workunit.client.0.smithi072.stdout:9/470: truncate d4/d1f/d2c/d62/f6c 674770 0 2024-04-15T21:02:46.141 INFO:tasks.workunit.client.0.smithi072.stdout:9/471: write d4/d1f/d2c/d47/f79 [510446,124218] 0 2024-04-15T21:02:46.141 INFO:tasks.workunit.client.1.smithi149.stdout:0/839: chown d1/d9/d64/d65/d104/d119/cf6 0 1 2024-04-15T21:02:46.145 INFO:tasks.workunit.client.0.smithi072.stdout:8/520: write d3/d4/d3b/f6e [3799404,102614] 0 2024-04-15T21:02:46.148 INFO:tasks.workunit.client.0.smithi072.stdout:7/509: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c9e 0 2024-04-15T21:02:46.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/628: dread d23/d46/f49 [0,4194304] 0 2024-04-15T21:02:46.153 INFO:tasks.workunit.client.1.smithi149.stdout:3/718: creat d1/db/d24/d39/dc0/fdd x:0 0 0 2024-04-15T21:02:46.154 INFO:tasks.workunit.client.0.smithi072.stdout:7/510: dwrite d2/d7/f55 [0,4194304] 0 2024-04-15T21:02:46.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/749: dwrite d2/d5b/dcd/d10a/d25/d37/f5f [0,4194304] 0 2024-04-15T21:02:46.158 INFO:tasks.workunit.client.1.smithi149.stdout:1/603: truncate d1/d17/d52/f40 302229 0 2024-04-15T21:02:46.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/719: read d1/db/d24/d2b/f73 [724469,14114] 0 2024-04-15T21:02:46.162 INFO:tasks.workunit.client.0.smithi072.stdout:4/478: getdents d7/d10/d41/d44/d7a/d86/d76/d8b 0 2024-04-15T21:02:46.167 INFO:tasks.workunit.client.0.smithi072.stdout:1/479: getdents d5/db/d2d/d56 0 2024-04-15T21:02:46.168 INFO:tasks.workunit.client.1.smithi149.stdout:4/719: fdatasync dc/d2c/d3e/d15/d3f/f6e 0 2024-04-15T21:02:46.168 INFO:tasks.workunit.client.1.smithi149.stdout:4/720: chown dc/d1a 106775 1 2024-04-15T21:02:46.168 INFO:tasks.workunit.client.1.smithi149.stdout:5/648: unlink d0/d6/d82/da1/d12/d16/da9/d1b/d83/f85 0 2024-04-15T21:02:46.169 INFO:tasks.workunit.client.1.smithi149.stdout:7/648: write d3/d16/d20/d36/d3d/f80 [4482969,62809] 0 2024-04-15T21:02:46.171 INFO:tasks.workunit.client.0.smithi072.stdout:8/521: creat d3/de/d1b/d41/d74/f9c x:0 0 0 2024-04-15T21:02:46.172 INFO:tasks.workunit.client.0.smithi072.stdout:8/522: dread - d3/d4/f96 zero size 2024-04-15T21:02:46.172 INFO:tasks.workunit.client.1.smithi149.stdout:7/649: read d3/f10 [3596951,92426] 0 2024-04-15T21:02:46.178 INFO:tasks.workunit.client.0.smithi072.stdout:8/523: dwrite d3/de/d1b/d41/d74/f9c [0,4194304] 0 2024-04-15T21:02:46.180 INFO:tasks.workunit.client.0.smithi072.stdout:2/458: write d2/d3/f5e [3523298,125503] 0 2024-04-15T21:02:46.181 INFO:tasks.workunit.client.1.smithi149.stdout:9/629: dread d23/d3c/d7a/d7c/d7f/f96 [0,4194304] 0 2024-04-15T21:02:46.183 INFO:tasks.workunit.client.0.smithi072.stdout:5/449: dread d0/d3/d7/d12/d1d/d8c/f88 [4194304,4194304] 0 2024-04-15T21:02:46.184 INFO:tasks.workunit.client.1.smithi149.stdout:8/750: dread - d2/d5b/dcd/d10a/d25/d57/f72 zero size 2024-04-15T21:02:46.186 INFO:tasks.workunit.client.1.smithi149.stdout:3/720: creat d1/db/d24/d39/d79/fde x:0 0 0 2024-04-15T21:02:46.187 INFO:tasks.workunit.client.1.smithi149.stdout:7/650: dwrite d3/d16/d20/d60/f7e [0,4194304] 0 2024-04-15T21:02:46.191 INFO:tasks.workunit.client.1.smithi149.stdout:5/649: dwrite d0/f4f [0,4194304] 0 2024-04-15T21:02:46.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 175 MiB/s wr, 340 op/s 2024-04-15T21:02:46.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: Standby manager daemon smithi072.wfjmmp started 2024-04-15T21:02:46.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/crt"}]: dispatch 2024-04-15T21:02:46.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:02:46.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/key"}]: dispatch 2024-04-15T21:02:46.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:45 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2766832714' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:02:46.195 INFO:tasks.workunit.client.0.smithi072.stdout:1/480: mkdir d5/db/d27/d9c 0 2024-04-15T21:02:46.197 INFO:tasks.workunit.client.1.smithi149.stdout:7/651: truncate d3/d17/d1f/d93/fdf 94937 0 2024-04-15T21:02:46.202 INFO:tasks.workunit.client.0.smithi072.stdout:8/524: creat d3/de/d21/d2e/f9d x:0 0 0 2024-04-15T21:02:46.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/450: dread d0/d3/d7/d1f/f40 [0,4194304] 0 2024-04-15T21:02:46.204 INFO:tasks.workunit.client.0.smithi072.stdout:2/459: mkdir d2/d66/d96 0 2024-04-15T21:02:46.206 INFO:tasks.workunit.client.1.smithi149.stdout:7/652: dwrite d3/d34/f6d [0,4194304] 0 2024-04-15T21:02:46.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/630: chown d23/c29 15 1 2024-04-15T21:02:46.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/721: write dc/d2c/d3e/d7c/fbe [229975,105482] 0 2024-04-15T21:02:46.215 INFO:tasks.workunit.client.0.smithi072.stdout:4/479: creat d7/d10/d41/d4c/f9c x:0 0 0 2024-04-15T21:02:46.219 INFO:tasks.workunit.client.1.smithi149.stdout:5/650: dread d0/d6/d82/da1/f5e [0,4194304] 0 2024-04-15T21:02:46.220 INFO:tasks.workunit.client.0.smithi072.stdout:9/472: creat d4/d1f/f8a x:0 0 0 2024-04-15T21:02:46.222 INFO:tasks.workunit.client.1.smithi149.stdout:3/721: unlink d1/d81/fbc 0 2024-04-15T21:02:46.223 INFO:tasks.workunit.client.0.smithi072.stdout:1/481: mkdir d5/db/d2d/d3a/d1f/d9d 0 2024-04-15T21:02:46.228 INFO:tasks.workunit.client.0.smithi072.stdout:3/492: dread d1/d26/f58 [0,4194304] 0 2024-04-15T21:02:46.228 INFO:tasks.workunit.client.0.smithi072.stdout:8/525: rename d3/d4/d4c/c45 to d3/de/d1b/d41/c9e 0 2024-04-15T21:02:46.228 INFO:tasks.workunit.client.0.smithi072.stdout:3/493: fsync d1/f64 0 2024-04-15T21:02:46.229 INFO:tasks.workunit.client.0.smithi072.stdout:6/467: sync 2024-04-15T21:02:46.230 INFO:tasks.workunit.client.0.smithi072.stdout:7/511: link d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 d2/d7/d25/d72/f9f 0 2024-04-15T21:02:46.232 INFO:tasks.workunit.client.0.smithi072.stdout:0/492: sync 2024-04-15T21:02:46.233 INFO:tasks.workunit.client.0.smithi072.stdout:6/468: write d2/d40/d56/d6a/f88 [143840,98671] 0 2024-04-15T21:02:46.233 INFO:tasks.workunit.client.0.smithi072.stdout:4/480: unlink d7/d23/c84 0 2024-04-15T21:02:46.235 INFO:tasks.workunit.client.1.smithi149.stdout:1/604: link d1/db/d16/f7c d1/d17/d36/d6f/fb0 0 2024-04-15T21:02:46.235 INFO:tasks.workunit.client.0.smithi072.stdout:4/481: chown d7/d15/c30 4676259 1 2024-04-15T21:02:46.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/651: readlink d0/l66 0 2024-04-15T21:02:46.237 INFO:tasks.workunit.client.0.smithi072.stdout:5/451: mknod d0/d3/d7/d94/d86/c9a 0 2024-04-15T21:02:46.238 INFO:tasks.workunit.client.0.smithi072.stdout:8/526: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:46.238 INFO:tasks.workunit.client.0.smithi072.stdout:1/482: truncate d5/db/f28 2882551 0 2024-04-15T21:02:46.242 INFO:tasks.workunit.client.0.smithi072.stdout:3/494: rename d1/l45 to d1/d3f/d7f/la1 0 2024-04-15T21:02:46.242 INFO:tasks.workunit.client.0.smithi072.stdout:6/469: dread d2/d10/d11/d15/f20 [4194304,4194304] 0 2024-04-15T21:02:46.247 INFO:tasks.workunit.client.0.smithi072.stdout:0/493: fsync d0/d19/d58/f5a 0 2024-04-15T21:02:46.248 INFO:tasks.workunit.client.0.smithi072.stdout:5/452: dwrite d0/d3/d33/d60/f8f [0,4194304] 0 2024-04-15T21:02:46.249 INFO:tasks.workunit.client.0.smithi072.stdout:1/483: dwrite d5/f8 [0,4194304] 0 2024-04-15T21:02:46.252 INFO:tasks.workunit.client.0.smithi072.stdout:0/494: write d0/d45/d7a/d5d/d8e/f9b [228960,45703] 0 2024-04-15T21:02:46.254 INFO:tasks.workunit.client.0.smithi072.stdout:3/495: dwrite d1/d15/d40/f27 [0,4194304] 0 2024-04-15T21:02:46.254 INFO:tasks.workunit.client.0.smithi072.stdout:9/473: symlink d4/l8b 0 2024-04-15T21:02:46.255 INFO:tasks.workunit.client.0.smithi072.stdout:2/460: dread d2/d37/f49 [0,4194304] 0 2024-04-15T21:02:46.256 INFO:tasks.workunit.client.0.smithi072.stdout:2/461: read d2/d38/d73/d80/f92 [2722066,12235] 0 2024-04-15T21:02:46.257 INFO:tasks.workunit.client.0.smithi072.stdout:2/462: chown d2/l62 1337663352 1 2024-04-15T21:02:46.259 INFO:tasks.workunit.client.0.smithi072.stdout:4/482: creat d7/d24/f9d x:0 0 0 2024-04-15T21:02:46.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/605: dread d1/db/dc/d11/d3f/d45/dae/f81 [0,4194304] 0 2024-04-15T21:02:46.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/722: write d1/db/d24/d39/fa1 [437100,112722] 0 2024-04-15T21:02:46.276 INFO:tasks.workunit.client.0.smithi072.stdout:8/527: write d3/de/d21/f9a [4500103,126429] 0 2024-04-15T21:02:46.276 INFO:tasks.workunit.client.1.smithi149.stdout:6/599: sync 2024-04-15T21:02:46.281 INFO:tasks.workunit.client.1.smithi149.stdout:7/653: creat d3/d17/fea x:0 0 0 2024-04-15T21:02:46.282 INFO:tasks.workunit.client.1.smithi149.stdout:9/631: truncate d23/d3c/d52/f6f 2060209 0 2024-04-15T21:02:46.283 INFO:tasks.workunit.client.1.smithi149.stdout:5/652: getdents d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8 0 2024-04-15T21:02:46.283 INFO:tasks.workunit.client.0.smithi072.stdout:7/512: dread - d2/d7/d25/d2d/d46/d5a/f88 zero size 2024-04-15T21:02:46.285 INFO:tasks.workunit.client.1.smithi149.stdout:8/751: link d2/d5b/dcd/d10a/d4e/d51/cb1 d2/d5b/dcd/d10a/d25/d32/d45/c10e 0 2024-04-15T21:02:46.288 INFO:tasks.workunit.client.0.smithi072.stdout:5/453: read d0/d3/d7/d1f/f40 [4726290,81192] 0 2024-04-15T21:02:46.289 INFO:tasks.workunit.client.1.smithi149.stdout:9/632: dwrite d23/d2b/d44/f64 [4194304,4194304] 0 2024-04-15T21:02:46.289 INFO:tasks.workunit.client.0.smithi072.stdout:1/484: stat d5/db/d2d/d3a/d1f/c29 0 2024-04-15T21:02:46.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/513: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f2e [0,4194304] 0 2024-04-15T21:02:46.290 INFO:tasks.workunit.client.0.smithi072.stdout:5/454: write d0/d3/d6/d14/f18 [5089895,122055] 0 2024-04-15T21:02:46.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/653: rmdir d0/d6/d2d 39 2024-04-15T21:02:46.292 INFO:tasks.workunit.client.0.smithi072.stdout:0/495: symlink d0/d19/la9 0 2024-04-15T21:02:46.296 INFO:tasks.workunit.client.0.smithi072.stdout:3/496: mkdir d1/d3f/da2 0 2024-04-15T21:02:46.299 INFO:tasks.workunit.client.1.smithi149.stdout:4/722: truncate dc/d2c/d3e/d35/f86 3543345 0 2024-04-15T21:02:46.299 INFO:tasks.workunit.client.1.smithi149.stdout:1/606: rename d1/db/dc/d11/d3f/d45/dae/l9a to d1/d17/d36/d6f/lb1 0 2024-04-15T21:02:46.303 INFO:tasks.workunit.client.0.smithi072.stdout:3/497: dwrite d1/d15/d32/f77 [0,4194304] 0 2024-04-15T21:02:46.303 INFO:tasks.workunit.client.0.smithi072.stdout:3/498: chown d1/d15/d32/d2f/d1a/f1b 8433703 1 2024-04-15T21:02:46.305 INFO:tasks.workunit.client.1.smithi149.stdout:8/752: symlink d2/d5b/dcd/d10a/d20/d6b/l10f 0 2024-04-15T21:02:46.315 INFO:tasks.workunit.client.0.smithi072.stdout:2/463: dread - d2/d3/f63 zero size 2024-04-15T21:02:46.317 INFO:tasks.workunit.client.1.smithi149.stdout:7/654: write d3/d16/d32/d90/dad/dc4/fe7 [554322,55871] 0 2024-04-15T21:02:46.317 INFO:tasks.workunit.client.0.smithi072.stdout:4/483: truncate d7/d28/f49 1008380 0 2024-04-15T21:02:46.318 INFO:tasks.workunit.client.0.smithi072.stdout:4/484: dread - d7/d15/d58/d62/f90 zero size 2024-04-15T21:02:46.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/633: truncate d23/d2b/d70/d75/faa 122384 0 2024-04-15T21:02:46.326 INFO:tasks.workunit.client.0.smithi072.stdout:5/455: fsync d0/d3/d7/d1f/f26 0 2024-04-15T21:02:46.329 INFO:tasks.workunit.client.0.smithi072.stdout:0/496: rmdir d0/d6/d6d 39 2024-04-15T21:02:46.331 INFO:tasks.workunit.client.1.smithi149.stdout:7/655: creat d3/d16/d20/d6c/feb x:0 0 0 2024-04-15T21:02:46.333 INFO:tasks.workunit.client.0.smithi072.stdout:3/499: read d1/d26/f59 [3153814,3060] 0 2024-04-15T21:02:46.333 INFO:tasks.workunit.client.1.smithi149.stdout:8/753: unlink d2/d16/l7b 0 2024-04-15T21:02:46.334 INFO:tasks.workunit.client.1.smithi149.stdout:8/754: write d2/d16/fd3 [25832,100425] 0 2024-04-15T21:02:46.338 INFO:tasks.workunit.client.1.smithi149.stdout:3/723: rename d1/db/d28/d87/dbd/fb8 to d1/fdf 0 2024-04-15T21:02:46.342 INFO:tasks.workunit.client.0.smithi072.stdout:7/514: dread d2/f16 [0,4194304] 0 2024-04-15T21:02:46.343 INFO:tasks.workunit.client.1.smithi149.stdout:4/723: link dc/d2c/d3e/d15/l1e dc/ddf/lf0 0 2024-04-15T21:02:46.343 INFO:tasks.workunit.client.1.smithi149.stdout:1/607: dwrite d1/db/dc/d11/d3f/d45/f57 [0,4194304] 0 2024-04-15T21:02:46.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/724: chown d1/d81/f94 503 1 2024-04-15T21:02:46.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/725: dread - d1/db/d24/d39/d79/fde zero size 2024-04-15T21:02:46.343 INFO:tasks.workunit.client.0.smithi072.stdout:1/485: unlink d5/db/fc 0 2024-04-15T21:02:46.345 INFO:tasks.workunit.client.0.smithi072.stdout:1/486: write d5/db/d2d/d3a/d1f/f78 [377459,121204] 0 2024-04-15T21:02:46.345 INFO:tasks.workunit.client.1.smithi149.stdout:8/755: write d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f10d [946219,101578] 0 2024-04-15T21:02:46.348 INFO:tasks.workunit.client.1.smithi149.stdout:8/756: stat d2/d5b/dcd/d10a/d25/d57/dd1/d46/fbc 0 2024-04-15T21:02:46.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/600: rename da/d49/d55/da0/cae to da/d18/d33/cb7 0 2024-04-15T21:02:46.349 INFO:tasks.workunit.client.1.smithi149.stdout:7/656: symlink d3/d16/d32/d90/dad/dc4/dde/lec 0 2024-04-15T21:02:46.351 INFO:tasks.workunit.client.0.smithi072.stdout:9/474: rename d4/d29/d4c/d74/d84/f85 to d4/d1f/d2c/f8c 0 2024-04-15T21:02:46.352 INFO:tasks.workunit.client.0.smithi072.stdout:9/475: write d4/f6a [755405,104880] 0 2024-04-15T21:02:46.353 INFO:tasks.workunit.client.0.smithi072.stdout:2/464: getdents d2/d8/d8e/d90 0 2024-04-15T21:02:46.356 INFO:tasks.workunit.client.1.smithi149.stdout:9/634: creat d23/fd7 x:0 0 0 2024-04-15T21:02:46.356 INFO:tasks.workunit.client.0.smithi072.stdout:2/465: dread d2/d3/f17 [0,4194304] 0 2024-04-15T21:02:46.357 INFO:tasks.workunit.client.0.smithi072.stdout:8/528: rmdir d3/de/d1b/d6d 0 2024-04-15T21:02:46.364 INFO:tasks.workunit.client.1.smithi149.stdout:3/726: mkdir d1/db/d24/d39/d79/d97/de0 0 2024-04-15T21:02:46.367 INFO:tasks.workunit.client.0.smithi072.stdout:6/470: link d2/d10/d11/d15/l2f d2/d40/l8f 0 2024-04-15T21:02:46.370 INFO:tasks.workunit.client.0.smithi072.stdout:4/485: write d7/d23/d6c/f79 [135342,26780] 0 2024-04-15T21:02:46.370 INFO:tasks.workunit.client.1.smithi149.stdout:6/601: dread da/d49/f8d [0,4194304] 0 2024-04-15T21:02:46.373 INFO:tasks.workunit.client.1.smithi149.stdout:6/602: write da/d18/d10/d66/f69 [12428005,118839] 0 2024-04-15T21:02:46.374 INFO:tasks.workunit.client.1.smithi149.stdout:8/757: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f110 x:0 0 0 2024-04-15T21:02:46.375 INFO:tasks.workunit.client.0.smithi072.stdout:7/515: dwrite d2/d7/d25/d2d/d47/d7e/f91 [0,4194304] 0 2024-04-15T21:02:46.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/724: dwrite dc/d2c/d3e/d15/d3f/db0/fb5 [0,4194304] 0 2024-04-15T21:02:46.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/608: symlink d1/db/dc/lb2 0 2024-04-15T21:02:46.378 INFO:tasks.workunit.client.0.smithi072.stdout:5/456: mknod d0/d3/c9b 0 2024-04-15T21:02:46.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/635: chown d23/f47 253 1 2024-04-15T21:02:46.380 INFO:tasks.workunit.client.0.smithi072.stdout:3/500: mkdir d1/d3f/d4f/da3 0 2024-04-15T21:02:46.387 INFO:tasks.workunit.client.0.smithi072.stdout:0/497: rename d0/d45/d7a/d5d to d0/d45/d7a/d70/d59/d8a/d7b/daa 0 2024-04-15T21:02:46.394 INFO:tasks.workunit.client.0.smithi072.stdout:9/476: dwrite d4/d1f/d31/d42/f66 [0,4194304] 0 2024-04-15T21:02:46.394 INFO:tasks.workunit.client.1.smithi149.stdout:7/657: creat d3/d34/db6/fed x:0 0 0 2024-04-15T21:02:46.399 INFO:tasks.workunit.client.0.smithi072.stdout:6/471: mkdir d2/d10/d11/d1f/d90 0 2024-04-15T21:02:46.401 INFO:tasks.workunit.client.0.smithi072.stdout:4/486: chown d7/d24/f1e 6292185 1 2024-04-15T21:02:46.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/487: dread d5/f32 [0,4194304] 0 2024-04-15T21:02:46.402 INFO:tasks.workunit.client.0.smithi072.stdout:4/487: readlink d7/d15/d58/d62/d6f/l88 0 2024-04-15T21:02:46.410 INFO:tasks.workunit.client.1.smithi149.stdout:8/758: dwrite d2/f8d [0,4194304] 0 2024-04-15T21:02:46.415 INFO:tasks.workunit.client.1.smithi149.stdout:7/658: dwrite d3/d16/d20/d60/f7e [0,4194304] 0 2024-04-15T21:02:46.421 INFO:tasks.workunit.client.1.smithi149.stdout:1/609: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:46.421 INFO:tasks.workunit.client.1.smithi149.stdout:2/708: sync 2024-04-15T21:02:46.421 INFO:tasks.workunit.client.1.smithi149.stdout:0/840: sync 2024-04-15T21:02:46.430 INFO:tasks.workunit.client.1.smithi149.stdout:9/636: dread d23/d3c/d52/f6f [0,4194304] 0 2024-04-15T21:02:46.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/637: write d23/d2b/d44/d7e/fcc [646920,40409] 0 2024-04-15T21:02:46.435 INFO:tasks.workunit.client.0.smithi072.stdout:2/466: mkdir d2/d38/d91/d97 0 2024-04-15T21:02:46.436 INFO:tasks.workunit.client.0.smithi072.stdout:2/467: dread - d2/d64/f87 zero size 2024-04-15T21:02:46.437 INFO:tasks.workunit.client.1.smithi149.stdout:3/727: creat d1/db/d40/d56/fe1 x:0 0 0 2024-04-15T21:02:46.437 INFO:tasks.workunit.client.1.smithi149.stdout:3/728: dread - d1/fba zero size 2024-04-15T21:02:46.440 INFO:tasks.workunit.client.1.smithi149.stdout:8/759: rename d2/df/c17 to d2/d5b/dcd/c111 0 2024-04-15T21:02:46.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/659: unlink d3/l14 0 2024-04-15T21:02:46.445 INFO:tasks.workunit.client.0.smithi072.stdout:9/477: creat d4/d29/d4c/d74/d84/f8d x:0 0 0 2024-04-15T21:02:46.445 INFO:tasks.workunit.client.0.smithi072.stdout:9/478: write d4/d1f/d2c/f57 [94636,131001] 0 2024-04-15T21:02:46.447 INFO:tasks.workunit.client.1.smithi149.stdout:4/725: creat dc/d18/ff1 x:0 0 0 2024-04-15T21:02:46.447 INFO:tasks.workunit.client.0.smithi072.stdout:6/472: write d2/d40/d56/f8a [3256814,61363] 0 2024-04-15T21:02:46.450 INFO:tasks.workunit.client.1.smithi149.stdout:0/841: unlink d1/d9/d64/d65/d104/d119/d43/c69 0 2024-04-15T21:02:46.452 INFO:tasks.workunit.client.0.smithi072.stdout:8/529: truncate d3/de/d21/f9a 3536732 0 2024-04-15T21:02:46.452 INFO:tasks.workunit.client.0.smithi072.stdout:4/488: truncate d7/d15/f20 1041694 0 2024-04-15T21:02:46.453 INFO:tasks.workunit.client.0.smithi072.stdout:4/489: read - d7/d10/d41/d4c/f82 zero size 2024-04-15T21:02:46.455 INFO:tasks.workunit.client.1.smithi149.stdout:6/603: link da/d18/d10/d16/c7c da/d60/d9b/cb8 0 2024-04-15T21:02:46.457 INFO:tasks.workunit.client.0.smithi072.stdout:3/501: getdents d1/d3f/da2 0 2024-04-15T21:02:46.458 INFO:tasks.workunit.client.0.smithi072.stdout:3/502: write d1/f8e [965258,53429] 0 2024-04-15T21:02:46.459 INFO:tasks.workunit.client.0.smithi072.stdout:8/530: dread d3/de/d21/f8e [0,4194304] 0 2024-04-15T21:02:46.459 INFO:tasks.workunit.client.0.smithi072.stdout:8/531: stat d3/de/f99 0 2024-04-15T21:02:46.460 INFO:tasks.workunit.client.1.smithi149.stdout:3/729: unlink d1/db/fa4 0 2024-04-15T21:02:46.461 INFO:tasks.workunit.client.0.smithi072.stdout:0/498: symlink d0/d74/d94/lab 0 2024-04-15T21:02:46.461 INFO:tasks.workunit.client.1.smithi149.stdout:3/730: fsync d1/db/f6e 0 2024-04-15T21:02:46.463 INFO:tasks.workunit.client.0.smithi072.stdout:0/499: truncate d0/d19/d2b/f9d 217070 0 2024-04-15T21:02:46.464 INFO:tasks.workunit.client.1.smithi149.stdout:2/709: dread d4/d7/d46/de4/d21/d5e/fb9 [0,4194304] 0 2024-04-15T21:02:46.464 INFO:tasks.workunit.client.0.smithi072.stdout:8/532: dwrite d3/d4/d4d/f73 [4194304,4194304] 0 2024-04-15T21:02:46.469 INFO:tasks.workunit.client.1.smithi149.stdout:4/726: dread - dc/d2c/d3e/d15/d5b/f9e zero size 2024-04-15T21:02:46.475 INFO:tasks.workunit.client.1.smithi149.stdout:0/842: symlink d1/d9/d64/d65/dc5/l129 0 2024-04-15T21:02:46.475 INFO:tasks.workunit.client.0.smithi072.stdout:5/457: truncate d0/d3/d7/d12/d1d/f3e 369895 0 2024-04-15T21:02:46.480 INFO:tasks.workunit.client.0.smithi072.stdout:6/473: creat d2/d40/d56/d6a/d70/d49/f91 x:0 0 0 2024-04-15T21:02:46.482 INFO:tasks.workunit.client.1.smithi149.stdout:9/638: dwrite d23/d2b/d37/d6d/f7b [0,4194304] 0 2024-04-15T21:02:46.485 INFO:tasks.workunit.client.0.smithi072.stdout:2/468: dwrite d2/d8/f3a [0,4194304] 0 2024-04-15T21:02:46.486 INFO:tasks.workunit.client.0.smithi072.stdout:7/516: creat d2/d7/d25/d2d/d47/fa0 x:0 0 0 2024-04-15T21:02:46.491 INFO:tasks.workunit.client.0.smithi072.stdout:0/500: mknod d0/cac 0 2024-04-15T21:02:46.492 INFO:tasks.workunit.client.1.smithi149.stdout:2/710: symlink d4/d7/d93/lf9 0 2024-04-15T21:02:46.499 INFO:tasks.workunit.client.1.smithi149.stdout:7/660: creat d3/d16/d20/d36/d3d/d56/fee x:0 0 0 2024-04-15T21:02:46.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/727: readlink dc/d2c/d3e/d15/l1e 0 2024-04-15T21:02:46.502 INFO:tasks.workunit.client.1.smithi149.stdout:4/728: chown dc/d2c/d3e/d35/d4b/d75/d80/l93 24421 1 2024-04-15T21:02:46.503 INFO:tasks.workunit.client.1.smithi149.stdout:1/610: creat d1/fb3 x:0 0 0 2024-04-15T21:02:46.505 INFO:tasks.workunit.client.0.smithi072.stdout:8/533: dread d3/de/f24 [0,4194304] 0 2024-04-15T21:02:46.506 INFO:tasks.workunit.client.0.smithi072.stdout:6/474: fdatasync d2/d10/d18/f26 0 2024-04-15T21:02:46.508 INFO:tasks.workunit.client.1.smithi149.stdout:3/731: symlink d1/db/le2 0 2024-04-15T21:02:46.508 INFO:tasks.workunit.client.0.smithi072.stdout:6/475: truncate d2/d10/d11/d1f/f4c 1021679 0 2024-04-15T21:02:46.510 INFO:tasks.workunit.client.0.smithi072.stdout:4/490: link d7/d15/d58/d62/f72 d7/d15/d58/d62/d6f/f9e 0 2024-04-15T21:02:46.512 INFO:tasks.workunit.client.0.smithi072.stdout:1/488: dwrite d5/db/d27/f34 [0,4194304] 0 2024-04-15T21:02:46.514 INFO:tasks.workunit.client.0.smithi072.stdout:2/469: rmdir d2/d64 39 2024-04-15T21:02:46.524 INFO:tasks.workunit.client.1.smithi149.stdout:1/611: rmdir d1/d17/d52/d6c 39 2024-04-15T21:02:46.526 INFO:tasks.workunit.client.0.smithi072.stdout:9/479: rename d4/d1f/d31/d4d/l5a to d4/l8e 0 2024-04-15T21:02:46.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/612: chown d1/d17/d52/f84 12378076 1 2024-04-15T21:02:46.527 INFO:tasks.workunit.client.1.smithi149.stdout:0/843: dread d1/d5/d24/d50/d13/d38/d44/f47 [0,4194304] 0 2024-04-15T21:02:46.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/480: dread d4/d29/d45/f72 [0,4194304] 0 2024-04-15T21:02:46.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/481: readlink d4/d1f/l4b 0 2024-04-15T21:02:46.532 INFO:tasks.workunit.client.1.smithi149.stdout:3/732: mknod d1/db/d40/ce3 0 2024-04-15T21:02:46.533 INFO:tasks.workunit.client.1.smithi149.stdout:7/661: dread d3/d16/d20/d36/f3a [0,4194304] 0 2024-04-15T21:02:46.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/733: readlink d1/db/d24/d2b/l12 0 2024-04-15T21:02:46.534 INFO:tasks.workunit.client.1.smithi149.stdout:8/760: getdents d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/d9d/dc0 0 2024-04-15T21:02:46.535 INFO:tasks.workunit.client.1.smithi149.stdout:3/734: write d1/db/d24/d39/d79/fde [894196,32755] 0 2024-04-15T21:02:46.535 INFO:tasks.workunit.client.1.smithi149.stdout:4/729: write dc/d1a/f4e [3742821,25994] 0 2024-04-15T21:02:46.540 INFO:tasks.workunit.client.1.smithi149.stdout:2/711: mkdir d4/d7/d46/de4/d21/d5e/dfa 0 2024-04-15T21:02:46.541 INFO:tasks.workunit.client.0.smithi072.stdout:0/501: dread d0/d19/f22 [0,4194304] 0 2024-04-15T21:02:46.541 INFO:tasks.workunit.client.0.smithi072.stdout:4/491: mknod d7/d24/d3e/d5e/c9f 0 2024-04-15T21:02:46.543 INFO:tasks.workunit.client.1.smithi149.stdout:3/735: dread d1/db/d24/d4d/f82 [0,4194304] 0 2024-04-15T21:02:46.544 INFO:tasks.workunit.client.1.smithi149.stdout:3/736: stat d1/db/d24/d2b 0 2024-04-15T21:02:46.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/639: link d23/d2b/d37/d6d/f7b d23/d71/dbf/fd8 0 2024-04-15T21:02:46.545 INFO:tasks.workunit.client.0.smithi072.stdout:5/458: link d0/d3/d7/d1f/f26 d0/d3/d6/d2d/f9c 0 2024-04-15T21:02:46.546 INFO:tasks.workunit.client.1.smithi149.stdout:1/613: write d1/db/dc/d11/d3f/d45/dae/f81 [4004685,107370] 0 2024-04-15T21:02:46.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/470: dread d2/d38/f48 [0,4194304] 0 2024-04-15T21:02:46.547 INFO:tasks.workunit.client.0.smithi072.stdout:9/482: unlink d4/d29/d4c/f52 0 2024-04-15T21:02:46.549 INFO:tasks.workunit.client.1.smithi149.stdout:1/614: write d1/db/dc/d11/d3f/d45/dae/f81 [1073094,84030] 0 2024-04-15T21:02:46.608 INFO:tasks.workunit.client.1.smithi149.stdout:5/654: sync 2024-04-15T21:02:46.608 INFO:tasks.workunit.client.1.smithi149.stdout:5/655: fsync d0/d9/fa2 0 2024-04-15T21:02:46.609 INFO:tasks.workunit.client.1.smithi149.stdout:5/656: fdatasync d0/d6/d82/fa6 0 2024-04-15T21:02:46.629 INFO:tasks.workunit.client.0.smithi072.stdout:3/503: getdents d1/d3f/d4f 0 2024-04-15T21:02:46.630 INFO:tasks.workunit.client.0.smithi072.stdout:0/502: rmdir d0 39 2024-04-15T21:02:46.632 INFO:tasks.workunit.client.0.smithi072.stdout:3/504: dread d1/d3f/f8a [0,4194304] 0 2024-04-15T21:02:46.635 INFO:tasks.workunit.client.0.smithi072.stdout:4/492: mknod d7/d10/d41/d45/d93/ca0 0 2024-04-15T21:02:46.637 INFO:tasks.workunit.client.0.smithi072.stdout:4/493: chown d7/d10/d41/d45/d93 408703303 1 2024-04-15T21:02:46.638 INFO:tasks.workunit.client.0.smithi072.stdout:3/505: dwrite d1/f8e [0,4194304] 0 2024-04-15T21:02:46.639 INFO:tasks.workunit.client.1.smithi149.stdout:4/730: dwrite dc/d2c/d3e/d15/fde [0,4194304] 0 2024-04-15T21:02:46.644 INFO:tasks.workunit.client.0.smithi072.stdout:7/517: rename d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/c96 to d2/d7/ca1 0 2024-04-15T21:02:46.645 INFO:tasks.workunit.client.0.smithi072.stdout:7/518: dread - d2/d7/f9a zero size 2024-04-15T21:02:46.645 INFO:tasks.workunit.client.0.smithi072.stdout:7/519: fsync d2/d7/d25/f34 0 2024-04-15T21:02:46.650 INFO:tasks.workunit.client.0.smithi072.stdout:7/520: dwrite d2/d7/d25/d2d/d47/f5c [0,4194304] 0 2024-04-15T21:02:46.653 INFO:tasks.workunit.client.1.smithi149.stdout:0/844: dwrite d1/d5/d24/d50/d13/fbc [0,4194304] 0 2024-04-15T21:02:46.656 INFO:tasks.workunit.client.0.smithi072.stdout:2/471: readlink d2/d64/l86 0 2024-04-15T21:02:46.657 INFO:tasks.workunit.client.0.smithi072.stdout:9/483: mkdir d4/d76/d8f 0 2024-04-15T21:02:46.658 INFO:tasks.workunit.client.1.smithi149.stdout:2/712: write d4/d7/d46/de4/d21/d2c/d32/d4a/f79 [3225884,13016] 0 2024-04-15T21:02:46.659 INFO:tasks.workunit.client.1.smithi149.stdout:1/615: mkdir d1/db/dc/d38/d39/d88/db4 0 2024-04-15T21:02:46.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/616: fsync d1/fb3 0 2024-04-15T21:02:46.666 INFO:tasks.workunit.client.1.smithi149.stdout:5/657: unlink d0/d6/d82/da1/d12/d16/da9/f81 0 2024-04-15T21:02:46.667 INFO:tasks.workunit.client.0.smithi072.stdout:1/489: link d5/db/d27/l5b d5/db/d2d/d56/d93/l9e 0 2024-04-15T21:02:46.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/662: mknod d3/d16/d20/d36/cef 0 2024-04-15T21:02:46.669 INFO:tasks.workunit.client.0.smithi072.stdout:4/494: mkdir d7/d28/d42/da1 0 2024-04-15T21:02:46.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/640: dwrite d23/d46/f49 [0,4194304] 0 2024-04-15T21:02:46.670 INFO:tasks.workunit.client.1.smithi149.stdout:2/713: dwrite d4/d7/d29/fe3 [0,4194304] 0 2024-04-15T21:02:46.671 INFO:tasks.workunit.client.0.smithi072.stdout:4/495: dread - d7/d24/f9d zero size 2024-04-15T21:02:46.672 INFO:tasks.workunit.client.0.smithi072.stdout:1/490: dwrite d5/db/d2d/d3a/d1f/d63/f68 [0,4194304] 0 2024-04-15T21:02:46.675 INFO:tasks.workunit.client.1.smithi149.stdout:8/761: dread - d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/ff1 zero size 2024-04-15T21:02:46.681 INFO:tasks.workunit.client.1.smithi149.stdout:8/762: fdatasync d2/d5b/dcd/d10a/d4e/d9f/fa5 0 2024-04-15T21:02:46.684 INFO:tasks.workunit.client.1.smithi149.stdout:0/845: rename d1/d5/c81 to d1/d9/d64/d65/d104/d119/df7/c12a 0 2024-04-15T21:02:46.690 INFO:tasks.workunit.client.0.smithi072.stdout:5/459: mknod d0/d3/d7/d94/d92/c9d 0 2024-04-15T21:02:46.691 INFO:tasks.workunit.client.0.smithi072.stdout:5/460: chown d0/f7c 7790 1 2024-04-15T21:02:46.692 INFO:tasks.workunit.client.0.smithi072.stdout:9/484: write d4/d1f/d31/d4d/f7b [332855,121514] 0 2024-04-15T21:02:46.693 INFO:tasks.workunit.client.0.smithi072.stdout:7/521: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f82 [0,4194304] 0 2024-04-15T21:02:46.695 INFO:tasks.workunit.client.1.smithi149.stdout:7/663: symlink d3/d16/d20/d6c/d91/lf0 0 2024-04-15T21:02:46.701 INFO:tasks.workunit.client.0.smithi072.stdout:4/496: fsync d7/d10/d41/d44/f73 0 2024-04-15T21:02:46.706 INFO:tasks.workunit.client.1.smithi149.stdout:0/846: mknod d1/d9/d64/d65/dc5/c12b 0 2024-04-15T21:02:46.707 INFO:tasks.workunit.client.0.smithi072.stdout:0/503: mkdir d0/d19/d96/dad 0 2024-04-15T21:02:46.713 INFO:tasks.workunit.client.1.smithi149.stdout:9/641: fdatasync d23/d2b/d70/d75/f95 0 2024-04-15T21:02:46.715 INFO:tasks.workunit.client.1.smithi149.stdout:5/658: dread d0/f3a [0,4194304] 0 2024-04-15T21:02:46.717 INFO:tasks.workunit.client.0.smithi072.stdout:8/534: rename d3/d4/d4d/l64 to d3/de/d21/l9f 0 2024-04-15T21:02:46.718 INFO:tasks.workunit.client.0.smithi072.stdout:2/472: rename d2/d38 to d2/d38/d73/d98 22 2024-04-15T21:02:46.718 INFO:tasks.workunit.client.1.smithi149.stdout:4/731: dwrite dc/d18/f62 [0,4194304] 0 2024-04-15T21:02:46.720 INFO:tasks.workunit.client.1.smithi149.stdout:7/664: rename d3/d16/d32/d90/dad/dc4/fc9 to d3/d96/ff1 0 2024-04-15T21:02:46.723 INFO:tasks.workunit.client.0.smithi072.stdout:8/535: dwrite d3/de/d1b/f62 [0,4194304] 0 2024-04-15T21:02:46.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/617: dwrite d1/f79 [0,4194304] 0 2024-04-15T21:02:46.738 INFO:tasks.workunit.client.1.smithi149.stdout:8/763: unlink d2/d5b/dcd/d10a/d20/d6b/la1 0 2024-04-15T21:02:46.738 INFO:tasks.workunit.client.1.smithi149.stdout:1/618: chown d1/db/dc/fa5 13712 1 2024-04-15T21:02:46.739 INFO:tasks.workunit.client.1.smithi149.stdout:8/764: chown d2/f2b 108616 1 2024-04-15T21:02:46.739 INFO:tasks.workunit.client.1.smithi149.stdout:6/604: sync 2024-04-15T21:02:46.740 INFO:tasks.workunit.client.0.smithi072.stdout:1/491: symlink d5/d31/d51/d82/l9f 0 2024-04-15T21:02:46.741 INFO:tasks.workunit.client.1.smithi149.stdout:6/605: chown da/d18/d10/d66/c8e 2 1 2024-04-15T21:02:46.743 INFO:tasks.workunit.client.1.smithi149.stdout:0/847: unlink d1/d5/dc/c34 0 2024-04-15T21:02:46.745 INFO:tasks.workunit.client.1.smithi149.stdout:0/848: readlink d1/d9/d64/d65/d104/d119/d92/l9a 0 2024-04-15T21:02:46.745 INFO:tasks.workunit.client.0.smithi072.stdout:3/506: truncate d1/d15/d32/f77 1693276 0 2024-04-15T21:02:46.746 INFO:tasks.workunit.client.1.smithi149.stdout:8/765: dread d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/feb [0,4194304] 0 2024-04-15T21:02:46.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/714: write d4/d7/d46/de4/d21/d3b/f44 [744640,68222] 0 2024-04-15T21:02:46.747 INFO:tasks.workunit.client.0.smithi072.stdout:0/504: symlink d0/d45/d7a/d70/lae 0 2024-04-15T21:02:46.749 INFO:tasks.workunit.client.1.smithi149.stdout:8/766: write d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f10d [630477,126991] 0 2024-04-15T21:02:46.762 INFO:tasks.workunit.client.0.smithi072.stdout:4/497: mkdir d7/d28/d42/da1/da2 0 2024-04-15T21:02:46.763 INFO:tasks.workunit.client.1.smithi149.stdout:9/642: write d23/d2b/d44/f66 [1223702,58953] 0 2024-04-15T21:02:46.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/507: truncate d1/d3f/d4f/f7e 1049606 0 2024-04-15T21:02:46.766 INFO:tasks.workunit.client.0.smithi072.stdout:0/505: mknod d0/d45/d7a/d70/caf 0 2024-04-15T21:02:46.768 INFO:tasks.workunit.client.0.smithi072.stdout:2/473: symlink d2/d66/d96/l99 0 2024-04-15T21:02:46.770 INFO:tasks.workunit.client.0.smithi072.stdout:5/461: dwrite d0/d3/d7/d1f/f26 [0,4194304] 0 2024-04-15T21:02:46.770 INFO:tasks.workunit.client.0.smithi072.stdout:8/536: mknod d3/de/d1b/d85/ca0 0 2024-04-15T21:02:46.772 INFO:tasks.workunit.client.0.smithi072.stdout:1/492: symlink d5/db/d2d/d56/d93/la0 0 2024-04-15T21:02:46.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/485: dwrite d4/f1c [0,4194304] 0 2024-04-15T21:02:46.774 INFO:tasks.workunit.client.0.smithi072.stdout:8/537: truncate d3/d4/f91 956376 0 2024-04-15T21:02:46.778 INFO:tasks.workunit.client.0.smithi072.stdout:2/474: dread d2/d37/f49 [0,4194304] 0 2024-04-15T21:02:46.783 INFO:tasks.workunit.client.0.smithi072.stdout:4/498: symlink d7/d10/d41/d44/d7a/d86/d76/d8b/la3 0 2024-04-15T21:02:46.785 INFO:tasks.workunit.client.0.smithi072.stdout:5/462: creat d0/d3/d7/d12/d31/d62/d8e/f9e x:0 0 0 2024-04-15T21:02:46.788 INFO:tasks.workunit.client.0.smithi072.stdout:4/499: truncate d7/f5c 987126 0 2024-04-15T21:02:46.788 INFO:tasks.workunit.client.0.smithi072.stdout:8/538: dread d3/de/d21/f8e [0,4194304] 0 2024-04-15T21:02:46.788 INFO:tasks.workunit.client.0.smithi072.stdout:1/493: dwrite d5/db/d2d/d3a/d1f/f78 [0,4194304] 0 2024-04-15T21:02:46.788 INFO:tasks.workunit.client.0.smithi072.stdout:9/486: dwrite d4/d1f/d2c/f4f [0,4194304] 0 2024-04-15T21:02:46.789 INFO:tasks.workunit.client.0.smithi072.stdout:5/463: write d0/d3/d6/d14/f5b [3741248,36237] 0 2024-04-15T21:02:46.789 INFO:tasks.workunit.client.0.smithi072.stdout:4/500: fsync d7/d10/d41/d45/f8a 0 2024-04-15T21:02:46.790 INFO:tasks.workunit.client.0.smithi072.stdout:2/475: symlink d2/d38/d73/l9a 0 2024-04-15T21:02:46.790 INFO:tasks.workunit.client.0.smithi072.stdout:8/539: chown d3/l32 6064 1 2024-04-15T21:02:46.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/506: dread d0/d45/d7a/d70/d59/d8a/f65 [0,4194304] 0 2024-04-15T21:02:46.811 INFO:tasks.workunit.client.0.smithi072.stdout:5/464: creat d0/d3/d6/f9f x:0 0 0 2024-04-15T21:02:46.813 INFO:tasks.workunit.client.0.smithi072.stdout:8/540: creat d3/d4/d76/fa1 x:0 0 0 2024-04-15T21:02:46.823 INFO:tasks.workunit.client.0.smithi072.stdout:5/465: mkdir d0/d3/d7/d94/d92/da0 0 2024-04-15T21:02:46.834 INFO:tasks.workunit.client.0.smithi072.stdout:5/466: creat d0/d3/d7/d94/fa1 x:0 0 0 2024-04-15T21:02:46.836 INFO:tasks.workunit.client.0.smithi072.stdout:5/467: read d0/f4a [380077,119245] 0 2024-04-15T21:02:46.838 INFO:tasks.workunit.client.0.smithi072.stdout:8/541: dread d3/de/f38 [0,4194304] 0 2024-04-15T21:02:46.839 INFO:tasks.workunit.client.0.smithi072.stdout:0/507: creat d0/d6/fb0 x:0 0 0 2024-04-15T21:02:46.842 INFO:tasks.workunit.client.0.smithi072.stdout:5/468: fdatasync d0/d3/d7/d12/d1d/d8c/f88 0 2024-04-15T21:02:46.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/494: dwrite d5/db/f1a [0,4194304] 0 2024-04-15T21:02:46.843 INFO:tasks.workunit.client.1.smithi149.stdout:1/619: stat d1/db/dc/d11/d3e/c83 0 2024-04-15T21:02:46.845 INFO:tasks.workunit.client.0.smithi072.stdout:8/542: unlink d3/d4/d76/fa1 0 2024-04-15T21:02:46.845 INFO:tasks.workunit.client.0.smithi072.stdout:2/476: dwrite d2/f12 [0,4194304] 0 2024-04-15T21:02:46.848 INFO:tasks.workunit.client.0.smithi072.stdout:4/501: dwrite d7/d24/f1e [0,4194304] 0 2024-04-15T21:02:46.849 INFO:tasks.workunit.client.0.smithi072.stdout:0/508: mkdir d0/d19/d71/db1 0 2024-04-15T21:02:46.850 INFO:tasks.workunit.client.0.smithi072.stdout:4/502: chown d7/fc 9758 1 2024-04-15T21:02:46.852 INFO:tasks.workunit.client.0.smithi072.stdout:0/509: dread - d0/d6/f80 zero size 2024-04-15T21:02:46.853 INFO:tasks.workunit.client.1.smithi149.stdout:2/715: rmdir d4/d7/d46 39 2024-04-15T21:02:46.855 INFO:tasks.workunit.client.0.smithi072.stdout:8/543: dwrite d3/d4/d3b/f65 [0,4194304] 0 2024-04-15T21:02:46.856 INFO:tasks.workunit.client.0.smithi072.stdout:2/477: dwrite d2/f12 [0,4194304] 0 2024-04-15T21:02:46.856 INFO:tasks.workunit.client.0.smithi072.stdout:1/495: unlink d5/db/l19 0 2024-04-15T21:02:46.858 INFO:tasks.workunit.client.0.smithi072.stdout:2/478: chown d2/d3/d5f 750398640 1 2024-04-15T21:02:46.858 INFO:tasks.workunit.client.0.smithi072.stdout:2/479: stat d2/c53 0 2024-04-15T21:02:46.859 INFO:tasks.workunit.client.0.smithi072.stdout:2/480: stat d2/d64/l6a 0 2024-04-15T21:02:46.861 INFO:tasks.workunit.client.0.smithi072.stdout:5/469: read - d0/d3/d7/d12/d31/d55/f39 zero size 2024-04-15T21:02:46.863 INFO:tasks.workunit.client.0.smithi072.stdout:6/476: sync 2024-04-15T21:02:46.869 INFO:tasks.workunit.client.0.smithi072.stdout:3/508: write d1/d15/d32/f77 [1144663,127273] 0 2024-04-15T21:02:46.872 INFO:tasks.workunit.client.0.smithi072.stdout:9/487: truncate d4/d1f/d2c/f4f 3987168 0 2024-04-15T21:02:46.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/503: symlink d7/d10/d41/d45/d93/la4 0 2024-04-15T21:02:46.879 INFO:tasks.workunit.client.1.smithi149.stdout:0/849: dread d1/f22 [8388608,4194304] 0 2024-04-15T21:02:46.881 INFO:tasks.workunit.client.1.smithi149.stdout:9/643: fdatasync d23/d46/f9c 0 2024-04-15T21:02:46.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/620: unlink d1/d17/f1c 0 2024-04-15T21:02:46.886 INFO:tasks.workunit.client.0.smithi072.stdout:8/544: rename d3/d4/d3b/l7f to d3/de/d1b/d41/d74/d98/la2 0 2024-04-15T21:02:46.888 INFO:tasks.workunit.client.0.smithi072.stdout:2/481: rmdir d2/d66/d96 39 2024-04-15T21:02:46.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/716: chown d4/d7/d46/de4/d21/d6d/fd6 1 1 2024-04-15T21:02:46.889 INFO:tasks.workunit.client.0.smithi072.stdout:5/470: symlink d0/d3/d6/d14/la2 0 2024-04-15T21:02:46.891 INFO:tasks.workunit.client.1.smithi149.stdout:8/767: rename d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/l100 to d2/d5b/dcd/d10a/d25/d57/dd1/df3/l112 0 2024-04-15T21:02:46.894 INFO:tasks.workunit.client.0.smithi072.stdout:6/477: chown d2/d40/d66 708871 1 2024-04-15T21:02:46.894 INFO:tasks.workunit.client.1.smithi149.stdout:4/732: rmdir dc/d2c/de1 0 2024-04-15T21:02:46.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/850: rmdir d1/d5/d24/d50/d13/d38/d44/d61/d11b 39 2024-04-15T21:02:46.899 INFO:tasks.workunit.client.0.smithi072.stdout:1/496: mknod d5/ca1 0 2024-04-15T21:02:46.901 INFO:tasks.workunit.client.1.smithi149.stdout:9/644: creat d23/d2b/d37/d50/db3/fd9 x:0 0 0 2024-04-15T21:02:46.902 INFO:tasks.workunit.client.1.smithi149.stdout:9/645: write d23/d2b/d37/d6d/f74 [3091158,70974] 0 2024-04-15T21:02:46.907 INFO:tasks.workunit.client.0.smithi072.stdout:2/482: unlink d2/d64/c76 0 2024-04-15T21:02:46.907 INFO:tasks.workunit.client.1.smithi149.stdout:4/733: fdatasync dc/d18/f1d 0 2024-04-15T21:02:46.908 INFO:tasks.workunit.client.0.smithi072.stdout:5/471: mknod d0/d3/d7/d1f/d50/ca3 0 2024-04-15T21:02:46.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/665: getdents d3/d16 0 2024-04-15T21:02:46.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:46 smithi072 ceph-mon[29079]: mgrmap e25: smithi149.qgbaiy(active, since 9s), standbys: smithi072.wfjmmp 2024-04-15T21:02:46.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:46 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:02:46.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/737: sync 2024-04-15T21:02:46.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/738: stat d1/db/d28/f51 0 2024-04-15T21:02:46.918 INFO:tasks.workunit.client.1.smithi149.stdout:1/621: mknod d1/cb5 0 2024-04-15T21:02:46.920 INFO:tasks.workunit.client.1.smithi149.stdout:1/622: write d1/db/dc/d38/d39/d43/f7b [2550391,96489] 0 2024-04-15T21:02:46.924 INFO:tasks.workunit.client.1.smithi149.stdout:4/734: mknod dc/d2c/d3e/d7c/cf2 0 2024-04-15T21:02:46.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/666: fdatasync d3/d16/d32/f84 0 2024-04-15T21:02:46.930 INFO:tasks.workunit.client.1.smithi149.stdout:9/646: mknod d23/d3c/db5/cda 0 2024-04-15T21:02:46.939 INFO:tasks.workunit.client.1.smithi149.stdout:2/717: rmdir d4/d7/d46/de4/d21/d5e/dfa 0 2024-04-15T21:02:46.939 INFO:tasks.workunit.client.1.smithi149.stdout:2/718: fdatasync d4/d7/d29/fe3 0 2024-04-15T21:02:46.946 INFO:tasks.workunit.client.1.smithi149.stdout:4/735: truncate dc/d18/daa/fbc 485493 0 2024-04-15T21:02:46.947 INFO:tasks.workunit.client.0.smithi072.stdout:7/522: sync 2024-04-15T21:02:46.949 INFO:tasks.workunit.client.1.smithi149.stdout:7/667: creat d3/d16/d6e/ff2 x:0 0 0 2024-04-15T21:02:46.950 INFO:tasks.workunit.client.0.smithi072.stdout:6/478: readlink d2/d10/d11/l62 0 2024-04-15T21:02:46.953 INFO:tasks.workunit.client.1.smithi149.stdout:0/851: rename d1/d29/d2c/d4f/d95/lea to d1/l12c 0 2024-04-15T21:02:46.955 INFO:tasks.workunit.client.0.smithi072.stdout:9/488: symlink d4/d1f/l90 0 2024-04-15T21:02:46.957 INFO:tasks.workunit.client.0.smithi072.stdout:4/504: creat d7/d28/d42/da1/da2/fa5 x:0 0 0 2024-04-15T21:02:46.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/497: write d5/db/f59 [1539761,11763] 0 2024-04-15T21:02:46.960 INFO:tasks.workunit.client.0.smithi072.stdout:0/510: link d0/d6/c77 d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/cb2 0 2024-04-15T21:02:46.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/719: fsync d4/d7/d10/fc1 0 2024-04-15T21:02:46.962 INFO:tasks.workunit.client.0.smithi072.stdout:9/489: dwrite d4/d29/d4c/f82 [0,4194304] 0 2024-04-15T21:02:46.962 INFO:tasks.workunit.client.0.smithi072.stdout:0/511: write d0/d19/d2b/f43 [1538517,29559] 0 2024-04-15T21:02:46.963 INFO:tasks.workunit.client.0.smithi072.stdout:8/545: symlink d3/de/d94/la3 0 2024-04-15T21:02:46.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/720: write d4/d7/d10/d36/fdd [856746,84276] 0 2024-04-15T21:02:46.964 INFO:tasks.workunit.client.1.smithi149.stdout:8/768: getdents d2/d5b/dcd/d10a/d25/d37/d53/daf/d85 0 2024-04-15T21:02:46.965 INFO:tasks.workunit.client.0.smithi072.stdout:2/483: symlink d2/d8/d6c/l9b 0 2024-04-15T21:02:46.967 INFO:tasks.workunit.client.1.smithi149.stdout:4/736: mknod dc/d2c/d3e/d35/d4b/d75/d80/cf3 0 2024-04-15T21:02:46.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/659: sync 2024-04-15T21:02:46.967 INFO:tasks.workunit.client.1.smithi149.stdout:6/606: sync 2024-04-15T21:02:46.968 INFO:tasks.workunit.client.0.smithi072.stdout:5/472: creat d0/d3/d7/d94/d92/fa4 x:0 0 0 2024-04-15T21:02:46.971 INFO:tasks.workunit.client.0.smithi072.stdout:7/523: readlink d2/d7/d25/d2d/d52/d6d/l80 0 2024-04-15T21:02:46.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/668: creat d3/d16/d32/d90/ff3 x:0 0 0 2024-04-15T21:02:46.974 INFO:tasks.workunit.client.0.smithi072.stdout:6/479: unlink d2/d10/d11/d1f/l5e 0 2024-04-15T21:02:46.975 INFO:tasks.workunit.client.0.smithi072.stdout:6/480: dread d2/d10/d11/d1f/f4c [0,4194304] 0 2024-04-15T21:02:46.977 INFO:tasks.workunit.client.0.smithi072.stdout:3/509: link d1/d15/f3b d1/d15/d32/fa4 0 2024-04-15T21:02:46.978 INFO:tasks.workunit.client.0.smithi072.stdout:1/498: dread d5/db/f59 [0,4194304] 0 2024-04-15T21:02:46.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/647: mkdir d23/d2b/d70/d75/ddb 0 2024-04-15T21:02:46.979 INFO:tasks.workunit.client.0.smithi072.stdout:1/499: write d5/db/f1a [3970549,126684] 0 2024-04-15T21:02:46.980 INFO:tasks.workunit.client.1.smithi149.stdout:1/623: dwrite d1/f62 [0,4194304] 0 2024-04-15T21:02:46.982 INFO:tasks.workunit.client.0.smithi072.stdout:4/505: rename d7/d15/f2f to d7/d10/d41/d44/d7a/fa6 0 2024-04-15T21:02:46.983 INFO:tasks.workunit.client.1.smithi149.stdout:0/852: dwrite d1/d29/f90 [4194304,4194304] 0 2024-04-15T21:02:46.985 INFO:tasks.workunit.client.0.smithi072.stdout:0/512: creat d0/fb3 x:0 0 0 2024-04-15T21:02:46.986 INFO:tasks.workunit.client.0.smithi072.stdout:0/513: chown d0/d6/d55/f5f 1 1 2024-04-15T21:02:46.988 INFO:tasks.workunit.client.1.smithi149.stdout:2/721: creat d4/d7/d46/de4/d21/d55/ffb x:0 0 0 2024-04-15T21:02:46.989 INFO:tasks.workunit.client.0.smithi072.stdout:9/490: readlink d4/l40 0 2024-04-15T21:02:46.990 INFO:tasks.workunit.client.0.smithi072.stdout:9/491: chown d4/d1f 297 1 2024-04-15T21:02:46.991 INFO:tasks.workunit.client.0.smithi072.stdout:2/484: mknod d2/d8/d41/c9c 0 2024-04-15T21:02:46.992 INFO:tasks.workunit.client.0.smithi072.stdout:2/485: chown d2/d37/l4e 41 1 2024-04-15T21:02:46.994 INFO:tasks.workunit.client.0.smithi072.stdout:0/514: dwrite d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f9b [0,4194304] 0 2024-04-15T21:02:46.996 INFO:tasks.workunit.client.0.smithi072.stdout:0/515: read - d0/d45/d35/d3a/f47 zero size 2024-04-15T21:02:46.996 INFO:tasks.workunit.client.1.smithi149.stdout:6/607: symlink da/d18/d10/d3f/lb9 0 2024-04-15T21:02:46.998 INFO:tasks.workunit.client.0.smithi072.stdout:5/473: creat d0/d3/d6/d14/d61/fa5 x:0 0 0 2024-04-15T21:02:46.999 INFO:tasks.workunit.client.1.smithi149.stdout:5/660: creat d0/d6/d82/da1/d12/d16/da9/d1b/fd4 x:0 0 0 2024-04-15T21:02:47.000 INFO:tasks.workunit.client.0.smithi072.stdout:6/481: dread d2/fe [0,4194304] 0 2024-04-15T21:02:47.002 INFO:tasks.workunit.client.1.smithi149.stdout:7/669: mknod d3/d34/cf4 0 2024-04-15T21:02:47.009 INFO:tasks.workunit.client.1.smithi149.stdout:3/739: getdents d1/db/d24/d4d/d63 0 2024-04-15T21:02:47.010 INFO:tasks.workunit.client.0.smithi072.stdout:1/500: dread - d5/f96 zero size 2024-04-15T21:02:47.014 INFO:tasks.workunit.client.0.smithi072.stdout:8/546: rename d3/de/d21 to d3/de/d1b/d41/da4 0 2024-04-15T21:02:47.017 INFO:tasks.workunit.client.1.smithi149.stdout:4/737: dwrite dc/d2c/d3e/d15/f4a [0,4194304] 0 2024-04-15T21:02:47.017 INFO:tasks.workunit.client.0.smithi072.stdout:4/506: unlink d7/d15/d58/c6e 0 2024-04-15T21:02:47.022 INFO:tasks.workunit.client.1.smithi149.stdout:2/722: creat d4/d7/d46/de4/d21/d2c/d32/d4a/ffc x:0 0 0 2024-04-15T21:02:47.024 INFO:tasks.workunit.client.0.smithi072.stdout:9/492: mkdir d4/d29/d4c/d91 0 2024-04-15T21:02:47.024 INFO:tasks.workunit.client.0.smithi072.stdout:9/493: readlink d4/d1f/l28 0 2024-04-15T21:02:47.025 INFO:tasks.workunit.client.1.smithi149.stdout:8/769: symlink d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/l113 0 2024-04-15T21:02:47.027 INFO:tasks.workunit.client.0.smithi072.stdout:7/524: symlink d2/d7/d25/la2 0 2024-04-15T21:02:47.028 INFO:tasks.workunit.client.0.smithi072.stdout:5/474: rmdir d0/d3/d7/d94/d92 39 2024-04-15T21:02:47.030 INFO:tasks.workunit.client.1.smithi149.stdout:7/670: creat d3/d16/d20/d60/ff5 x:0 0 0 2024-04-15T21:02:47.031 INFO:tasks.workunit.client.0.smithi072.stdout:3/510: unlink d1/d15/l92 0 2024-04-15T21:02:47.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/486: rename d2/d64/l86 to d2/d38/d91/l9d 0 2024-04-15T21:02:47.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/487: chown d2/d8/l25 426 1 2024-04-15T21:02:47.036 INFO:tasks.workunit.client.1.smithi149.stdout:9/648: getdents d23/d2b/d70/d75/ddb 0 2024-04-15T21:02:47.037 INFO:tasks.workunit.client.0.smithi072.stdout:8/547: mkdir d3/de/d1b/d41/d74/d98/da5 0 2024-04-15T21:02:47.038 INFO:tasks.workunit.client.0.smithi072.stdout:9/494: symlink d4/d1f/d2c/d47/l92 0 2024-04-15T21:02:47.044 INFO:tasks.workunit.client.1.smithi149.stdout:0/853: write d1/d5/dda/fe8 [118193,36373] 0 2024-04-15T21:02:47.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/488: fdatasync d2/d8/f36 0 2024-04-15T21:02:47.054 INFO:tasks.workunit.client.1.smithi149.stdout:3/740: write d1/db/d24/d8a/f8c [2441795,83490] 0 2024-04-15T21:02:47.058 INFO:tasks.workunit.client.1.smithi149.stdout:1/624: rmdir d1/d17/d5e/d73 0 2024-04-15T21:02:47.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/608: truncate f8 4113800 0 2024-04-15T21:02:47.062 INFO:tasks.workunit.client.1.smithi149.stdout:2/723: mkdir d4/d7/d46/de4/d21/d2c/d32/ded/dfd 0 2024-04-15T21:02:47.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/738: dwrite dc/d8f/d91/f97 [0,4194304] 0 2024-04-15T21:02:47.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/661: rmdir d0/d6/d82/da1/d12/d16/da9/d1b/d61/dbd 0 2024-04-15T21:02:47.067 INFO:tasks.workunit.client.1.smithi149.stdout:3/741: unlink d1/c88 0 2024-04-15T21:02:47.069 INFO:tasks.workunit.client.1.smithi149.stdout:9/649: creat d23/d2b/d37/d50/d69/fdc x:0 0 0 2024-04-15T21:02:47.070 INFO:tasks.workunit.client.1.smithi149.stdout:9/650: chown d23/d2b/d44/f64 31459493 1 2024-04-15T21:02:47.072 INFO:tasks.workunit.client.1.smithi149.stdout:9/651: chown d23/d3c/d7a/d7c/c8e 38344 1 2024-04-15T21:02:47.075 INFO:tasks.workunit.client.1.smithi149.stdout:3/742: dwrite d1/db/d24/f5d [0,4194304] 0 2024-04-15T21:02:47.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/724: mkdir d4/d7/d46/de4/d21/d55/dfe 0 2024-04-15T21:02:47.079 INFO:tasks.workunit.client.1.smithi149.stdout:0/854: write d1/d9/d64/d65/d104/d119/d43/f48 [1541358,118999] 0 2024-04-15T21:02:47.086 INFO:tasks.workunit.client.1.smithi149.stdout:1/625: readlink d1/db/d16/l49 0 2024-04-15T21:02:47.086 INFO:tasks.workunit.client.1.smithi149.stdout:6/609: creat da/d60/d9b/fba x:0 0 0 2024-04-15T21:02:47.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/652: creat d23/d46/fdd x:0 0 0 2024-04-15T21:02:47.088 INFO:tasks.workunit.client.1.smithi149.stdout:9/653: stat d23/d2b/dd3 0 2024-04-15T21:02:47.090 INFO:tasks.workunit.client.1.smithi149.stdout:2/725: unlink d4/d7/d46/de4/d21/d5e/dbe/da7/cac 0 2024-04-15T21:02:47.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/726: chown d4/d7/d46/de4/d21/d2c/d58/l8b 128998 1 2024-04-15T21:02:47.091 INFO:tasks.workunit.client.1.smithi149.stdout:8/770: getdents d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda 0 2024-04-15T21:02:47.092 INFO:tasks.workunit.client.1.smithi149.stdout:8/771: readlink d2/d5b/dcd/d10a/d25/d57/dd1/lb5 0 2024-04-15T21:02:47.094 INFO:tasks.workunit.client.1.smithi149.stdout:5/662: mknod d0/d6/d82/da1/d12/d16/da9/d98/cd5 0 2024-04-15T21:02:47.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/855: rename d1/d5/d24/d50/de2/l112 to d1/d9/d64/d65/d104/d119/d43/de9/l12d 0 2024-04-15T21:02:47.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/654: creat d23/d2b/d37/d50/d69/fde x:0 0 0 2024-04-15T21:02:47.100 INFO:tasks.workunit.client.1.smithi149.stdout:2/727: mkdir d4/d7/d29/dff 0 2024-04-15T21:02:47.103 INFO:tasks.workunit.client.1.smithi149.stdout:3/743: rename d1/db/d40/la5 to d1/db/d40/d56/d84/d85/le4 0 2024-04-15T21:02:47.104 INFO:tasks.workunit.client.1.smithi149.stdout:3/744: write d1/d81/fcb [430842,96394] 0 2024-04-15T21:02:47.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/610: link da/d18/d10/f1c da/d18/d10/d16/d97/fbb 0 2024-04-15T21:02:47.106 INFO:tasks.workunit.client.1.smithi149.stdout:4/739: truncate dc/d8f/d91/fad 305677 0 2024-04-15T21:02:47.108 INFO:tasks.workunit.client.1.smithi149.stdout:9/655: readlink d23/l42 0 2024-04-15T21:02:47.113 INFO:tasks.workunit.client.1.smithi149.stdout:4/740: mkdir dc/d2c/d3e/d15/d5b/df4 0 2024-04-15T21:02:47.116 INFO:tasks.workunit.client.0.smithi072.stdout:7/525: truncate d2/d7/d25/d2d/d47/f64 136635 0 2024-04-15T21:02:47.117 INFO:tasks.workunit.client.0.smithi072.stdout:9/495: mkdir d4/d29/d4c/d91/d93 0 2024-04-15T21:02:47.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/772: creat d2/d5b/dcd/d10a/d34/f114 x:0 0 0 2024-04-15T21:02:47.120 INFO:tasks.workunit.client.1.smithi149.stdout:5/663: link d0/d6/d82/da1/d12/d16/f58 d0/d6/d82/da1/d12/d16/da9/d1b/d9c/fd6 0 2024-04-15T21:02:47.121 INFO:tasks.workunit.client.1.smithi149.stdout:5/664: chown d0/d6/d82/da1/d12/d16/da9/d98 85 1 2024-04-15T21:02:47.123 INFO:tasks.workunit.client.1.smithi149.stdout:1/626: truncate d1/db/dc/d11/d3f/d45/dae/f81 390741 0 2024-04-15T21:02:47.123 INFO:tasks.workunit.client.0.smithi072.stdout:0/516: dwrite d0/d45/f62 [4194304,4194304] 0 2024-04-15T21:02:47.123 INFO:tasks.workunit.client.0.smithi072.stdout:9/496: write d4/d1f/d31/d4d/f5c [3562866,71943] 0 2024-04-15T21:02:47.124 INFO:tasks.workunit.client.0.smithi072.stdout:2/489: write d2/d3/f5 [2861498,125006] 0 2024-04-15T21:02:47.124 INFO:tasks.workunit.client.1.smithi149.stdout:5/665: fdatasync d0/d6/d82/da1/d12/d16/da9/fc5 0 2024-04-15T21:02:47.125 INFO:tasks.workunit.client.1.smithi149.stdout:2/728: write d4/f7a [440591,3326] 0 2024-04-15T21:02:47.126 INFO:tasks.workunit.client.0.smithi072.stdout:5/475: dwrite d0/d3/d7/d12/d31/d55/f32 [0,4194304] 0 2024-04-15T21:02:47.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/511: dwrite d1/d15/d40/f9 [0,4194304] 0 2024-04-15T21:02:47.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/856: write d1/d5/d24/d50/d13/d59/dd7/f87 [900173,89992] 0 2024-04-15T21:02:47.130 INFO:tasks.workunit.client.1.smithi149.stdout:0/857: chown d1/d5/dc/f5e 3352 1 2024-04-15T21:02:47.136 INFO:tasks.workunit.client.0.smithi072.stdout:9/497: dwrite d4/d1f/d2c/d47/f5f [0,4194304] 0 2024-04-15T21:02:47.137 INFO:tasks.workunit.client.0.smithi072.stdout:9/498: readlink d4/l5d 0 2024-04-15T21:02:47.139 INFO:tasks.workunit.client.0.smithi072.stdout:0/517: creat d0/d19/fb4 x:0 0 0 2024-04-15T21:02:47.143 INFO:tasks.workunit.client.1.smithi149.stdout:8/773: mknod d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/c115 0 2024-04-15T21:02:47.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/774: chown d2/d5b/dcd/d10a/d4e/ca6 636334373 1 2024-04-15T21:02:47.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/526: dwrite d2/d7/d25/d72/f9f [0,4194304] 0 2024-04-15T21:02:47.145 INFO:tasks.workunit.client.0.smithi072.stdout:9/499: dread d4/d1f/d31/d42/f66 [0,4194304] 0 2024-04-15T21:02:47.146 INFO:tasks.workunit.client.0.smithi072.stdout:9/500: dread - d4/d29/f59 zero size 2024-04-15T21:02:47.147 INFO:tasks.workunit.client.0.smithi072.stdout:5/476: mknod d0/ca6 0 2024-04-15T21:02:47.150 INFO:tasks.workunit.client.1.smithi149.stdout:3/745: rmdir d1/db/d24/d39/d79/d97/de0 0 2024-04-15T21:02:47.152 INFO:tasks.workunit.client.1.smithi149.stdout:5/666: symlink d0/d6/d82/da1/d12/d16/da9/d9b/ld7 0 2024-04-15T21:02:47.157 INFO:tasks.workunit.client.0.smithi072.stdout:0/518: creat d0/d45/d7a/fb5 x:0 0 0 2024-04-15T21:02:47.158 INFO:tasks.workunit.client.1.smithi149.stdout:9/656: dread d23/f5a [0,4194304] 0 2024-04-15T21:02:47.159 INFO:tasks.workunit.client.1.smithi149.stdout:5/667: dread d0/d9/db6/f62 [0,4194304] 0 2024-04-15T21:02:47.167 INFO:tasks.workunit.client.0.smithi072.stdout:2/490: mknod d2/d66/c9e 0 2024-04-15T21:02:47.168 INFO:tasks.workunit.client.1.smithi149.stdout:0/858: mknod d1/d9/d64/d65/dca/c12e 0 2024-04-15T21:02:47.170 INFO:tasks.workunit.client.1.smithi149.stdout:0/859: readlink d1/d9/d64/d65/d104/d119/lfa 0 2024-04-15T21:02:47.170 INFO:tasks.workunit.client.1.smithi149.stdout:4/741: dwrite dc/d1a/f9d [0,4194304] 0 2024-04-15T21:02:47.171 INFO:tasks.workunit.client.1.smithi149.stdout:8/775: creat d2/d5b/dcd/d10a/d4e/d9f/f116 x:0 0 0 2024-04-15T21:02:47.177 INFO:tasks.workunit.client.1.smithi149.stdout:0/860: read d1/d9/d64/d65/faf [1260797,26634] 0 2024-04-15T21:02:47.178 INFO:tasks.workunit.client.0.smithi072.stdout:0/519: rmdir d0/d45/d7a/d70/d59/d8a/d7b 39 2024-04-15T21:02:47.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/746: mknod d1/db/d40/da0/ce5 0 2024-04-15T21:02:47.180 INFO:tasks.workunit.client.1.smithi149.stdout:2/729: getdents d4/d7/d46/de4/d21/d55/dfe 0 2024-04-15T21:02:47.182 INFO:tasks.workunit.client.0.smithi072.stdout:3/512: rmdir d1/d9d 0 2024-04-15T21:02:47.183 INFO:tasks.workunit.client.1.smithi149.stdout:5/668: readlink d0/d6/d2d/lad 0 2024-04-15T21:02:47.183 INFO:tasks.workunit.client.0.smithi072.stdout:3/513: readlink d1/d3f/d4f/d73/l7b 0 2024-04-15T21:02:47.184 INFO:tasks.workunit.client.0.smithi072.stdout:9/501: dread d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:47.184 INFO:tasks.workunit.client.1.smithi149.stdout:9/657: write d23/d3c/d7a/fc2 [434858,4102] 0 2024-04-15T21:02:47.185 INFO:tasks.workunit.client.0.smithi072.stdout:2/491: creat d2/d8/d8e/d90/f9f x:0 0 0 2024-04-15T21:02:47.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/658: write d23/fd7 [149667,43528] 0 2024-04-15T21:02:47.186 INFO:tasks.workunit.client.0.smithi072.stdout:2/492: dread - d2/f77 zero size 2024-04-15T21:02:47.187 INFO:tasks.workunit.client.1.smithi149.stdout:9/659: dread - d23/d46/fdd zero size 2024-04-15T21:02:47.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/611: getdents da/d49/d55 0 2024-04-15T21:02:47.188 INFO:tasks.workunit.client.1.smithi149.stdout:6/612: write da/d18/d33/f6f [1688304,94629] 0 2024-04-15T21:02:47.190 INFO:tasks.workunit.client.1.smithi149.stdout:6/613: write da/d18/d10/d16/d97/f98 [1084811,59490] 0 2024-04-15T21:02:47.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:46 smithi149 ceph-mon[36029]: mgrmap e25: smithi149.qgbaiy(active, since 9s), standbys: smithi072.wfjmmp 2024-04-15T21:02:47.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:46 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:02:47.195 INFO:tasks.workunit.client.1.smithi149.stdout:4/742: mkdir dc/d2c/d3e/d35/d4b/d6c/df5 0 2024-04-15T21:02:47.198 INFO:tasks.workunit.client.0.smithi072.stdout:2/493: mknod d2/d38/d73/d80/ca0 0 2024-04-15T21:02:47.199 INFO:tasks.workunit.client.1.smithi149.stdout:0/861: mkdir d1/d9/d12f 0 2024-04-15T21:02:47.203 INFO:tasks.workunit.client.0.smithi072.stdout:9/502: symlink d4/d76/d8f/l94 0 2024-04-15T21:02:47.204 INFO:tasks.workunit.client.1.smithi149.stdout:1/627: dwrite d1/db/d16/f7c [0,4194304] 0 2024-04-15T21:02:47.206 INFO:tasks.workunit.client.0.smithi072.stdout:3/514: dwrite d1/f6 [0,4194304] 0 2024-04-15T21:02:47.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/669: mknod d0/d9/cd8 0 2024-04-15T21:02:47.210 INFO:tasks.workunit.client.0.smithi072.stdout:0/520: dwrite d0/f29 [0,4194304] 0 2024-04-15T21:02:47.210 INFO:tasks.workunit.client.1.smithi149.stdout:5/670: stat d0/d6/d82/da1/d12/d16/da9/d1b 0 2024-04-15T21:02:47.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/660: readlink d23/l4c 0 2024-04-15T21:02:47.214 INFO:tasks.workunit.client.1.smithi149.stdout:1/628: dwrite d1/db/dc/fa4 [0,4194304] 0 2024-04-15T21:02:47.221 INFO:tasks.workunit.client.1.smithi149.stdout:3/747: write d1/db/d24/f7d [583253,57571] 0 2024-04-15T21:02:47.229 INFO:tasks.workunit.client.1.smithi149.stdout:4/743: rename dc/ddf/fd2 to dc/d8f/ff6 0 2024-04-15T21:02:47.229 INFO:tasks.workunit.client.1.smithi149.stdout:8/776: creat d2/d5b/dcd/d10a/d20/d6b/d109/f117 x:0 0 0 2024-04-15T21:02:47.232 INFO:tasks.workunit.client.1.smithi149.stdout:2/730: symlink d4/d7/d46/de4/d21/d55/dfe/l100 0 2024-04-15T21:02:47.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/661: creat d23/d71/fdf x:0 0 0 2024-04-15T21:02:47.239 INFO:tasks.workunit.client.1.smithi149.stdout:6/614: creat da/d49/d55/d82/fbc x:0 0 0 2024-04-15T21:02:47.241 INFO:tasks.workunit.client.1.smithi149.stdout:0/862: symlink d1/l130 0 2024-04-15T21:02:47.243 INFO:tasks.workunit.client.1.smithi149.stdout:8/777: rename d2/d5b/dcd/d10a/d34/l81 to d2/d5b/dd6/l118 0 2024-04-15T21:02:47.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/744: read dc/f8a [3950759,91427] 0 2024-04-15T21:02:47.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/671: dwrite d0/d6/d82/da1/d12/d2b/f9e [0,4194304] 0 2024-04-15T21:02:47.246 INFO:tasks.workunit.client.1.smithi149.stdout:9/662: symlink d23/d2b/d44/le0 0 2024-04-15T21:02:47.246 INFO:tasks.workunit.client.1.smithi149.stdout:3/748: dread d1/db/d24/f4b [0,4194304] 0 2024-04-15T21:02:47.251 INFO:tasks.workunit.client.1.smithi149.stdout:4/745: creat dc/d2c/d3e/d35/ff7 x:0 0 0 2024-04-15T21:02:47.251 INFO:tasks.workunit.client.1.smithi149.stdout:6/615: getdents da/d49/d55/da0/db4 0 2024-04-15T21:02:47.253 INFO:tasks.workunit.client.1.smithi149.stdout:4/746: write dc/d2c/d3e/d15/f4a [4015977,123851] 0 2024-04-15T21:02:47.254 INFO:tasks.workunit.client.1.smithi149.stdout:9/663: rmdir d23/d2b/d37/d6d/db8 39 2024-04-15T21:02:47.256 INFO:tasks.workunit.client.1.smithi149.stdout:2/731: rmdir d4/d7/d46/de4/d21/d2c/d32/d4a/dc5 0 2024-04-15T21:02:47.261 INFO:tasks.workunit.client.1.smithi149.stdout:6/616: symlink da/d18/d7d/lbd 0 2024-04-15T21:02:47.262 INFO:tasks.workunit.client.1.smithi149.stdout:1/629: dread d1/db/d16/f24 [4194304,4194304] 0 2024-04-15T21:02:47.263 INFO:tasks.workunit.client.1.smithi149.stdout:1/630: write d1/d17/d36/d6f/fb0 [250898,19506] 0 2024-04-15T21:02:47.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/631: chown d1/db/dc/d11/d3f/d45/f57 1008588 1 2024-04-15T21:02:47.265 INFO:tasks.workunit.client.1.smithi149.stdout:4/747: creat dc/d18/daa/ff8 x:0 0 0 2024-04-15T21:02:47.266 INFO:tasks.workunit.client.1.smithi149.stdout:9/664: fdatasync d23/d2b/f4a 0 2024-04-15T21:02:47.268 INFO:tasks.workunit.client.1.smithi149.stdout:3/749: creat d1/db/fe6 x:0 0 0 2024-04-15T21:02:47.270 INFO:tasks.workunit.client.1.smithi149.stdout:3/750: truncate d1/db/d40/d56/fdc 465833 0 2024-04-15T21:02:47.270 INFO:tasks.workunit.client.1.smithi149.stdout:5/672: truncate d0/f5 1462742 0 2024-04-15T21:02:47.271 INFO:tasks.workunit.client.1.smithi149.stdout:6/617: mkdir da/d11/dbe 0 2024-04-15T21:02:47.274 INFO:tasks.workunit.client.1.smithi149.stdout:0/863: link d1/d5/d24/c37 d1/d5/c131 0 2024-04-15T21:02:47.277 INFO:tasks.workunit.client.0.smithi072.stdout:2/494: mkdir d2/da1 0 2024-04-15T21:02:47.277 INFO:tasks.workunit.client.1.smithi149.stdout:8/778: dwrite d2/d16/f9b [4194304,4194304] 0 2024-04-15T21:02:47.279 INFO:tasks.workunit.client.1.smithi149.stdout:9/665: truncate d23/d2b/d44/f5c 533403 0 2024-04-15T21:02:47.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/521: dwrite d0/d45/d7a/d70/d59/d8a/fa7 [0,4194304] 0 2024-04-15T21:02:47.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/522: stat d0/d6/fb0 0 2024-04-15T21:02:47.282 INFO:tasks.workunit.client.0.smithi072.stdout:5/477: mkdir d0/d3/d7/d94/d92/da0/da7 0 2024-04-15T21:02:47.283 INFO:tasks.workunit.client.1.smithi149.stdout:8/779: chown d2/d5b/dcd/d10a/d25/d37/d53/daf/ff8 24 1 2024-04-15T21:02:47.283 INFO:tasks.workunit.client.1.smithi149.stdout:6/618: dwrite da/d18/d10/d16/f3c [0,4194304] 0 2024-04-15T21:02:47.284 INFO:tasks.workunit.client.0.smithi072.stdout:5/478: write d0/d3/d6/d14/d61/f82 [59662,15715] 0 2024-04-15T21:02:47.287 INFO:tasks.workunit.client.0.smithi072.stdout:9/503: read - d4/d29/d4c/d74/d84/f8d zero size 2024-04-15T21:02:47.290 INFO:tasks.workunit.client.1.smithi149.stdout:8/780: truncate d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f110 356271 0 2024-04-15T21:02:47.293 INFO:tasks.workunit.client.1.smithi149.stdout:5/673: truncate d0/d6/fe 1845490 0 2024-04-15T21:02:47.294 INFO:tasks.workunit.client.1.smithi149.stdout:4/748: truncate dc/deb/fef 180250 0 2024-04-15T21:02:47.295 INFO:tasks.workunit.client.0.smithi072.stdout:0/523: symlink d0/d74/d94/lb6 0 2024-04-15T21:02:47.295 INFO:tasks.workunit.client.1.smithi149.stdout:5/674: write d0/d6/d82/da1/f2e [4123406,72447] 0 2024-04-15T21:02:47.296 INFO:tasks.workunit.client.1.smithi149.stdout:9/666: unlink d23/d46/c78 0 2024-04-15T21:02:47.297 INFO:tasks.workunit.client.0.smithi072.stdout:0/524: write d0/d45/d7a/d70/d59/d8a/fa6 [158888,108565] 0 2024-04-15T21:02:47.300 INFO:tasks.workunit.client.1.smithi149.stdout:6/619: rename da/d49 to da/d18/d10/d16/d97/dbf 0 2024-04-15T21:02:47.301 INFO:tasks.workunit.client.0.smithi072.stdout:5/479: write d0/f7d [461610,4415] 0 2024-04-15T21:02:47.302 INFO:tasks.workunit.client.1.smithi149.stdout:8/781: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/c119 0 2024-04-15T21:02:47.304 INFO:tasks.workunit.client.0.smithi072.stdout:0/525: mknod d0/d19/d96/cb7 0 2024-04-15T21:02:47.305 INFO:tasks.workunit.client.1.smithi149.stdout:9/667: dwrite d23/d2b/d37/d50/f57 [0,4194304] 0 2024-04-15T21:02:47.305 INFO:tasks.workunit.client.0.smithi072.stdout:0/526: write d0/d6/fb0 [1023297,54120] 0 2024-04-15T21:02:47.306 INFO:tasks.workunit.client.0.smithi072.stdout:3/515: getdents d1/d15/d32/d2f 0 2024-04-15T21:02:47.308 INFO:tasks.workunit.client.0.smithi072.stdout:5/480: creat d0/d3/d33/d85/fa8 x:0 0 0 2024-04-15T21:02:47.309 INFO:tasks.workunit.client.0.smithi072.stdout:9/504: truncate d4/d1f/d2c/d62/f6c 126457 0 2024-04-15T21:02:47.310 INFO:tasks.workunit.client.1.smithi149.stdout:8/782: fdatasync d2/d5b/dcd/d10a/d25/d32/d45/f59 0 2024-04-15T21:02:47.312 INFO:tasks.workunit.client.1.smithi149.stdout:8/783: dread - d2/d5b/dcd/d10a/d25/d37/d53/daf/ff8 zero size 2024-04-15T21:02:47.314 INFO:tasks.workunit.client.1.smithi149.stdout:5/675: rename d0/d6/d82/da1/d12/d16/da9/d1b/d9c/fd6 to d0/d6/d82/db0/fd9 0 2024-04-15T21:02:47.317 INFO:tasks.workunit.client.0.smithi072.stdout:0/527: rename d0/d3 to d0/d45/d7a/d70/d59/d8a/d8b/db8 0 2024-04-15T21:02:47.319 INFO:tasks.workunit.client.0.smithi072.stdout:5/481: mknod d0/d3/d6/d14/ca9 0 2024-04-15T21:02:47.320 INFO:tasks.workunit.client.0.smithi072.stdout:5/482: chown d0/d3/d7/d12/d1d/l36 18284142 1 2024-04-15T21:02:47.320 INFO:tasks.workunit.client.0.smithi072.stdout:5/483: chown d0/d3/d7/d1f 431828 1 2024-04-15T21:02:47.324 INFO:tasks.workunit.client.1.smithi149.stdout:2/732: write d4/d7/d46/de4/d21/d3b/f3f [328971,157] 0 2024-04-15T21:02:47.325 INFO:tasks.workunit.client.0.smithi072.stdout:2/495: dread d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:47.326 INFO:tasks.workunit.client.1.smithi149.stdout:8/784: creat d2/d5b/dcd/d10a/d20/d6b/d109/f11a x:0 0 0 2024-04-15T21:02:47.327 INFO:tasks.workunit.client.0.smithi072.stdout:2/496: write d2/d8/d8e/d90/f9f [810194,52196] 0 2024-04-15T21:02:47.331 INFO:tasks.workunit.client.0.smithi072.stdout:1/501: sync 2024-04-15T21:02:47.331 INFO:tasks.workunit.client.0.smithi072.stdout:4/507: sync 2024-04-15T21:02:47.331 INFO:tasks.workunit.client.0.smithi072.stdout:6/482: sync 2024-04-15T21:02:47.332 INFO:tasks.workunit.client.0.smithi072.stdout:4/508: stat d7/d10/d41/d44 0 2024-04-15T21:02:47.336 INFO:tasks.workunit.client.1.smithi149.stdout:5/676: dread d0/d6/d82/da1/d12/d16/da9/d1b/d61/f80 [0,4194304] 0 2024-04-15T21:02:47.340 INFO:tasks.workunit.client.1.smithi149.stdout:5/677: write d0/d6/d82/da1/d12/d16/da9/fc5 [824264,1403] 0 2024-04-15T21:02:47.343 INFO:tasks.workunit.client.0.smithi072.stdout:3/516: dread d1/d3f/d4f/f68 [0,4194304] 0 2024-04-15T21:02:47.343 INFO:tasks.workunit.client.0.smithi072.stdout:3/517: chown d1/d3f/d4f/d73/l7b 253514003 1 2024-04-15T21:02:47.382 INFO:tasks.workunit.client.0.smithi072.stdout:7/527: sync 2024-04-15T21:02:47.383 INFO:tasks.workunit.client.0.smithi072.stdout:8/548: sync 2024-04-15T21:02:47.383 INFO:tasks.workunit.client.0.smithi072.stdout:7/528: chown d2/d7/d25/f8b 6224 1 2024-04-15T21:02:47.387 INFO:tasks.workunit.client.0.smithi072.stdout:7/529: dread d2/d7/d25/d2d/d47/f5c [0,4194304] 0 2024-04-15T21:02:47.402 INFO:tasks.workunit.client.0.smithi072.stdout:9/505: symlink d4/l95 0 2024-04-15T21:02:47.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/678: symlink d0/d9/db6/lda 0 2024-04-15T21:02:47.410 INFO:tasks.workunit.client.0.smithi072.stdout:6/483: fsync d2/f2a 0 2024-04-15T21:02:47.410 INFO:tasks.workunit.client.0.smithi072.stdout:6/484: stat d2/d10/f3c 0 2024-04-15T21:02:47.412 INFO:tasks.workunit.client.1.smithi149.stdout:6/620: write da/d18/d10/f1c [2097607,10484] 0 2024-04-15T21:02:47.416 INFO:tasks.workunit.client.1.smithi149.stdout:5/679: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d83/f97 [4194304,4194304] 0 2024-04-15T21:02:47.418 INFO:tasks.workunit.client.0.smithi072.stdout:3/518: rename d1/f49 to d1/d15/d32/d78/fa5 0 2024-04-15T21:02:47.419 INFO:tasks.workunit.client.0.smithi072.stdout:3/519: fdatasync d1/f14 0 2024-04-15T21:02:47.421 INFO:tasks.workunit.client.1.smithi149.stdout:6/621: dwrite da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:47.422 INFO:tasks.workunit.client.0.smithi072.stdout:8/549: symlink d3/d4/d76/la6 0 2024-04-15T21:02:47.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/509: dread d7/d23/f25 [0,4194304] 0 2024-04-15T21:02:47.423 INFO:tasks.workunit.client.0.smithi072.stdout:8/550: readlink d3/de/d1b/d41/da4/d2e/l7a 0 2024-04-15T21:02:47.423 INFO:tasks.workunit.client.1.smithi149.stdout:5/680: dread d0/d6/d82/da1/d12/d16/da9/fc5 [0,4194304] 0 2024-04-15T21:02:47.425 INFO:tasks.workunit.client.1.smithi149.stdout:6/622: truncate da/d18/d10/d16/d97/dbf/d55/d82/fbc 135149 0 2024-04-15T21:02:47.432 INFO:tasks.workunit.client.0.smithi072.stdout:7/530: creat d2/d7/d25/d2d/d47/d7e/fa3 x:0 0 0 2024-04-15T21:02:47.433 INFO:tasks.workunit.client.0.smithi072.stdout:7/531: chown d2/d7/d25/d2d/d46/d5a/d5f/f82 29901 1 2024-04-15T21:02:47.434 INFO:tasks.workunit.client.0.smithi072.stdout:5/484: mknod d0/d3/caa 0 2024-04-15T21:02:47.437 INFO:tasks.workunit.client.0.smithi072.stdout:9/506: creat d4/d1f/d2c/d62/f96 x:0 0 0 2024-04-15T21:02:47.438 INFO:tasks.workunit.client.0.smithi072.stdout:9/507: stat d4/d1f/d2c/d47 0 2024-04-15T21:02:47.439 INFO:tasks.workunit.client.0.smithi072.stdout:0/528: write d0/d45/d35/f4f [414216,111399] 0 2024-04-15T21:02:47.440 INFO:tasks.workunit.client.0.smithi072.stdout:2/497: mkdir d2/d8/da2 0 2024-04-15T21:02:47.449 INFO:tasks.workunit.client.1.smithi149.stdout:6/623: creat da/d18/d10/d16/d97/dbf/d55/da0/db4/fc0 x:0 0 0 2024-04-15T21:02:47.450 INFO:tasks.workunit.client.1.smithi149.stdout:6/624: chown da/d18/d10/d16/d97/dbf/d55/da0 271 1 2024-04-15T21:02:47.451 INFO:tasks.workunit.client.1.smithi149.stdout:6/625: write da/d18/d10/d3f/f41 [201972,12121] 0 2024-04-15T21:02:47.455 INFO:tasks.workunit.client.0.smithi072.stdout:9/508: dread d4/d1f/f54 [0,4194304] 0 2024-04-15T21:02:47.456 INFO:tasks.workunit.client.0.smithi072.stdout:9/509: readlink d4/l2f 0 2024-04-15T21:02:47.456 INFO:tasks.workunit.client.0.smithi072.stdout:3/520: chown d1/d15/d32/c2a 18 1 2024-04-15T21:02:47.460 INFO:tasks.workunit.client.0.smithi072.stdout:4/510: dread - d7/d23/d6c/f5f zero size 2024-04-15T21:02:47.460 INFO:tasks.workunit.client.0.smithi072.stdout:6/485: dread d2/d10/d11/d1f/f28 [0,4194304] 0 2024-04-15T21:02:47.460 INFO:tasks.workunit.client.0.smithi072.stdout:4/511: readlink d7/d23/d6c/l39 0 2024-04-15T21:02:47.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/626: mkdir da/d11/dbe/dc1 0 2024-04-15T21:02:47.464 INFO:tasks.workunit.client.0.smithi072.stdout:7/532: creat d2/d78/fa4 x:0 0 0 2024-04-15T21:02:47.470 INFO:tasks.workunit.client.0.smithi072.stdout:7/533: dwrite d2/d7/d25/d2d/d52/f9d [0,4194304] 0 2024-04-15T21:02:47.471 INFO:tasks.workunit.client.0.smithi072.stdout:7/534: readlink d2/d7/d25/d2d/d52/d6d/l73 0 2024-04-15T21:02:47.493 INFO:tasks.workunit.client.0.smithi072.stdout:2/498: stat d2/d3/f46 0 2024-04-15T21:02:47.494 INFO:tasks.workunit.client.0.smithi072.stdout:9/510: unlink d4/f7 0 2024-04-15T21:02:47.494 INFO:tasks.workunit.client.0.smithi072.stdout:8/551: mknod d3/de/d1b/ca7 0 2024-04-15T21:02:47.495 INFO:tasks.workunit.client.0.smithi072.stdout:7/535: readlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/l23 0 2024-04-15T21:02:47.495 INFO:tasks.workunit.client.0.smithi072.stdout:2/499: chown d2/d3/f46 1 1 2024-04-15T21:02:47.495 INFO:tasks.workunit.client.0.smithi072.stdout:9/511: read - d4/f86 zero size 2024-04-15T21:02:47.496 INFO:tasks.workunit.client.0.smithi072.stdout:2/500: chown d2/d37/l4e 369 1 2024-04-15T21:02:47.497 INFO:tasks.workunit.client.0.smithi072.stdout:3/521: creat d1/d3f/d7f/d8c/fa6 x:0 0 0 2024-04-15T21:02:47.503 INFO:tasks.workunit.client.0.smithi072.stdout:2/501: creat d2/d38/d73/d80/fa3 x:0 0 0 2024-04-15T21:02:47.504 INFO:tasks.workunit.client.0.smithi072.stdout:9/512: dwrite d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:47.506 INFO:tasks.workunit.client.0.smithi072.stdout:8/552: dwrite d3/de/f24 [0,4194304] 0 2024-04-15T21:02:47.506 INFO:tasks.workunit.client.0.smithi072.stdout:2/502: write d2/d38/d73/d80/f82 [755465,69282] 0 2024-04-15T21:02:47.506 INFO:tasks.workunit.client.0.smithi072.stdout:3/522: mkdir d1/d15/d40/d9e/da7 0 2024-04-15T21:02:47.514 INFO:tasks.workunit.client.0.smithi072.stdout:1/502: rmdir d5/db/d27/d5c 39 2024-04-15T21:02:47.519 INFO:tasks.workunit.client.0.smithi072.stdout:3/523: creat d1/d15/d32/fa8 x:0 0 0 2024-04-15T21:02:47.519 INFO:tasks.workunit.client.0.smithi072.stdout:8/553: fsync d3/de/d1b/d41/da4/d2e/f5c 0 2024-04-15T21:02:47.525 INFO:tasks.workunit.client.1.smithi149.stdout:0/864: rename d1/d9/d64/d65/d104/d119/d43/c6c to d1/d5/d24/d50/de2/c132 0 2024-04-15T21:02:47.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/865: fsync d1/d29/d2c/d4f/d95/f125 0 2024-04-15T21:02:47.529 INFO:tasks.workunit.client.1.smithi149.stdout:0/866: read d1/d9/d64/d73/da3/f107 [1884873,43502] 0 2024-04-15T21:02:47.529 INFO:tasks.workunit.client.0.smithi072.stdout:2/503: truncate d2/f44 1319583 0 2024-04-15T21:02:47.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/504: chown d2/d8 5804 1 2024-04-15T21:02:47.534 INFO:tasks.workunit.client.0.smithi072.stdout:2/505: rmdir d2/d3/d5f 39 2024-04-15T21:02:47.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/733: write d4/d7/d10/fc1 [300152,116525] 0 2024-04-15T21:02:47.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/734: readlink d4/d7/l4d 0 2024-04-15T21:02:47.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/785: write d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f43 [1966494,34569] 0 2024-04-15T21:02:47.538 INFO:tasks.workunit.client.1.smithi149.stdout:0/867: getdents d1/d9/d12f 0 2024-04-15T21:02:47.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/786: fsync d2/f86 0 2024-04-15T21:02:47.546 INFO:tasks.workunit.client.1.smithi149.stdout:2/735: symlink d4/d7/d46/de4/d21/d3b/l101 0 2024-04-15T21:02:47.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/787: dwrite d2/d5b/dcd/d10a/d34/f114 [0,4194304] 0 2024-04-15T21:02:47.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/506: rename d2/l3f to d2/la4 0 2024-04-15T21:02:47.548 INFO:tasks.workunit.client.0.smithi072.stdout:2/507: chown d2/d3/f5 44 1 2024-04-15T21:02:47.548 INFO:tasks.workunit.client.0.smithi072.stdout:2/508: stat d2/d38/d73/d80/fa3 0 2024-04-15T21:02:47.549 INFO:tasks.workunit.client.1.smithi149.stdout:0/868: mknod d1/d9/d64/d124/c133 0 2024-04-15T21:02:47.550 INFO:tasks.workunit.client.1.smithi149.stdout:2/736: rmdir d4/d7/d46/de4/d21 39 2024-04-15T21:02:47.552 INFO:tasks.workunit.client.0.smithi072.stdout:2/509: creat d2/d8/d8e/d90/fa5 x:0 0 0 2024-04-15T21:02:47.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/510: fdatasync d2/d37/f49 0 2024-04-15T21:02:47.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/511: stat d2/d8/l8b 0 2024-04-15T21:02:47.556 INFO:tasks.workunit.client.0.smithi072.stdout:8/554: dread d3/de/d1b/d41/d74/f9c [0,4194304] 0 2024-04-15T21:02:47.557 INFO:tasks.workunit.client.1.smithi149.stdout:8/788: dwrite d2/d5b/dcd/d10a/d4e/d9f/dd8/fd2 [0,4194304] 0 2024-04-15T21:02:47.558 INFO:tasks.workunit.client.1.smithi149.stdout:7/671: sync 2024-04-15T21:02:47.563 INFO:tasks.workunit.client.1.smithi149.stdout:8/789: symlink d2/d5b/dcd/d10a/d25/l11b 0 2024-04-15T21:02:47.565 INFO:tasks.workunit.client.0.smithi072.stdout:2/512: link d2/d3/f5 d2/d8/d6c/fa6 0 2024-04-15T21:02:47.569 INFO:tasks.workunit.client.1.smithi149.stdout:2/737: readlink d4/d7/d46/de4/d21/d2c/d32/d4a/dee/le0 0 2024-04-15T21:02:47.570 INFO:tasks.workunit.client.1.smithi149.stdout:5/681: write d0/d6/d82/da1/d12/d16/da9/d1b/d9c/fa0 [3401771,130608] 0 2024-04-15T21:02:47.571 INFO:tasks.workunit.client.0.smithi072.stdout:2/513: creat d2/d8/d8e/fa7 x:0 0 0 2024-04-15T21:02:47.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/738: mkdir d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d102 0 2024-04-15T21:02:47.576 INFO:tasks.workunit.client.1.smithi149.stdout:0/869: getdents d1/d9/d64 0 2024-04-15T21:02:47.578 INFO:tasks.workunit.client.1.smithi149.stdout:2/739: mknod d4/d7/d46/de4/d21/d55/dfe/c103 0 2024-04-15T21:02:47.580 INFO:tasks.workunit.client.1.smithi149.stdout:5/682: creat d0/d9/d3f/dc7/fdb x:0 0 0 2024-04-15T21:02:47.580 INFO:tasks.workunit.client.1.smithi149.stdout:5/683: readlink d0/l66 0 2024-04-15T21:02:47.591 INFO:tasks.workunit.client.1.smithi149.stdout:7/672: unlink d3/d16/d20/d36/fcb 0 2024-04-15T21:02:47.593 INFO:tasks.workunit.client.1.smithi149.stdout:7/673: write d3/d96/ff1 [435030,68966] 0 2024-04-15T21:02:47.594 INFO:tasks.workunit.client.1.smithi149.stdout:0/870: dread d1/d9/d64/d65/d104/d119/d43/f62 [4194304,4194304] 0 2024-04-15T21:02:47.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/871: chown d1/d29/d2c/d4f/d95 4 1 2024-04-15T21:02:47.596 INFO:tasks.workunit.client.1.smithi149.stdout:7/674: mkdir d3/d17/d1f/d93/df6 0 2024-04-15T21:02:47.597 INFO:tasks.workunit.client.1.smithi149.stdout:7/675: write d3/d16/d20/f24 [3467841,51327] 0 2024-04-15T21:02:47.597 INFO:tasks.workunit.client.1.smithi149.stdout:0/872: mknod d1/d5/d24/d50/d15/c134 0 2024-04-15T21:02:47.599 INFO:tasks.workunit.client.0.smithi072.stdout:4/512: sync 2024-04-15T21:02:47.603 INFO:tasks.workunit.client.1.smithi149.stdout:7/676: mkdir d3/d17/df7 0 2024-04-15T21:02:47.604 INFO:tasks.workunit.client.0.smithi072.stdout:4/513: chown d7/d15/d58/d62/d6f/c7f 33402029 1 2024-04-15T21:02:47.605 INFO:tasks.workunit.client.1.smithi149.stdout:7/677: dread - d3/d16/d20/d9c/fbc zero size 2024-04-15T21:02:47.606 INFO:tasks.workunit.client.1.smithi149.stdout:7/678: truncate d3/d16/d32/d90/dad/dc4/fe7 803756 0 2024-04-15T21:02:47.608 INFO:tasks.workunit.client.0.smithi072.stdout:4/514: symlink d7/la7 0 2024-04-15T21:02:47.609 INFO:tasks.workunit.client.0.smithi072.stdout:4/515: symlink d7/d28/d42/d8c/la8 0 2024-04-15T21:02:47.611 INFO:tasks.workunit.client.0.smithi072.stdout:4/516: rmdir d7/d28/d42/d8c 39 2024-04-15T21:02:47.613 INFO:tasks.workunit.client.0.smithi072.stdout:4/517: truncate d7/d15/d58/d62/f90 328823 0 2024-04-15T21:02:47.614 INFO:tasks.workunit.client.0.smithi072.stdout:5/485: dwrite d0/f35 [4194304,4194304] 0 2024-04-15T21:02:47.618 INFO:tasks.workunit.client.1.smithi149.stdout:6/627: creat da/d11/fc2 x:0 0 0 2024-04-15T21:02:47.619 INFO:tasks.workunit.client.1.smithi149.stdout:6/628: read - da/d18/d33/fad zero size 2024-04-15T21:02:47.619 INFO:tasks.workunit.client.0.smithi072.stdout:4/518: dwrite d7/f5c [0,4194304] 0 2024-04-15T21:02:47.619 INFO:tasks.workunit.client.0.smithi072.stdout:5/486: dread d0/d3/d7/d1f/f26 [0,4194304] 0 2024-04-15T21:02:47.621 INFO:tasks.workunit.client.0.smithi072.stdout:4/519: write d7/f38 [5786616,53779] 0 2024-04-15T21:02:47.624 INFO:tasks.workunit.client.0.smithi072.stdout:4/520: dread - d7/d28/d42/da1/da2/fa5 zero size 2024-04-15T21:02:47.625 INFO:tasks.workunit.client.0.smithi072.stdout:5/487: rmdir d0/d3/d6/d2d 39 2024-04-15T21:02:47.626 INFO:tasks.workunit.client.0.smithi072.stdout:7/536: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f5d [0,4194304] 0 2024-04-15T21:02:47.628 INFO:tasks.workunit.client.0.smithi072.stdout:9/513: write d4/d1f/d31/f7e [2824522,8575] 0 2024-04-15T21:02:47.630 INFO:tasks.workunit.client.0.smithi072.stdout:5/488: fdatasync d0/d3/f16 0 2024-04-15T21:02:47.631 INFO:tasks.workunit.client.0.smithi072.stdout:5/489: write d0/d3/d7/d12/d31/d49/f87 [8006723,37998] 0 2024-04-15T21:02:47.632 INFO:tasks.workunit.client.0.smithi072.stdout:0/529: rename d0/d19/d2b/f43 to d0/d19/d71/d9e/fb9 0 2024-04-15T21:02:47.633 INFO:tasks.workunit.client.0.smithi072.stdout:0/530: readlink d0/d19/d2b/l3f 0 2024-04-15T21:02:47.633 INFO:tasks.workunit.client.0.smithi072.stdout:0/531: readlink d0/d74/d94/lb6 0 2024-04-15T21:02:47.634 INFO:tasks.workunit.client.0.smithi072.stdout:0/532: stat d0/d45/c73 0 2024-04-15T21:02:47.638 INFO:tasks.workunit.client.0.smithi072.stdout:5/490: dwrite d0/d3/d6/d14/f18 [0,4194304] 0 2024-04-15T21:02:47.639 INFO:tasks.workunit.client.0.smithi072.stdout:5/491: fsync d0/d3/d7/d1f/f40 0 2024-04-15T21:02:47.642 INFO:tasks.workunit.client.0.smithi072.stdout:9/514: symlink d4/d29/d4c/d91/d93/l97 0 2024-04-15T21:02:47.643 INFO:tasks.workunit.client.1.smithi149.stdout:1/632: sync 2024-04-15T21:02:47.643 INFO:tasks.workunit.client.1.smithi149.stdout:3/751: sync 2024-04-15T21:02:47.644 INFO:tasks.workunit.client.1.smithi149.stdout:3/752: fdatasync d1/db/d24/f5f 0 2024-04-15T21:02:47.645 INFO:tasks.workunit.client.0.smithi072.stdout:6/486: rename d2/l2d to d2/d40/d6e/l92 0 2024-04-15T21:02:47.646 INFO:tasks.workunit.client.0.smithi072.stdout:0/533: truncate d0/d6/f39 67118 0 2024-04-15T21:02:47.646 INFO:tasks.workunit.client.0.smithi072.stdout:3/524: write d1/d15/d32/f24 [856920,82676] 0 2024-04-15T21:02:47.648 INFO:tasks.workunit.client.0.smithi072.stdout:7/537: dwrite d2/d7/d25/d81/f86 [0,4194304] 0 2024-04-15T21:02:47.648 INFO:tasks.workunit.client.0.smithi072.stdout:6/487: chown d2/d1a/f5f 642 1 2024-04-15T21:02:47.650 INFO:tasks.workunit.client.0.smithi072.stdout:5/492: mknod d0/d3/d7/d12/d31/d55/cab 0 2024-04-15T21:02:47.651 INFO:tasks.workunit.client.1.smithi149.stdout:3/753: mkdir d1/db/d28/de7 0 2024-04-15T21:02:47.651 INFO:tasks.workunit.client.0.smithi072.stdout:0/534: chown d0/d45/d7a/d70/d59/d8a/f65 1602 1 2024-04-15T21:02:47.651 INFO:tasks.workunit.client.0.smithi072.stdout:7/538: fdatasync d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f19 0 2024-04-15T21:02:47.651 INFO:tasks.workunit.client.0.smithi072.stdout:9/515: dread d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:47.652 INFO:tasks.workunit.client.1.smithi149.stdout:1/633: mknod d1/d17/d52/cb6 0 2024-04-15T21:02:47.652 INFO:tasks.workunit.client.0.smithi072.stdout:0/535: write d0/d19/d2b/fa3 [533738,39982] 0 2024-04-15T21:02:47.653 INFO:tasks.workunit.client.1.smithi149.stdout:1/634: chown d1/db/dc/d11/c59 2037211375 1 2024-04-15T21:02:47.655 INFO:tasks.workunit.client.1.smithi149.stdout:1/635: write d1/db/d16/f7c [2107149,74738] 0 2024-04-15T21:02:47.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/754: creat d1/db/d40/fe8 x:0 0 0 2024-04-15T21:02:47.657 INFO:tasks.workunit.client.0.smithi072.stdout:3/525: symlink d1/d3f/la9 0 2024-04-15T21:02:47.658 INFO:tasks.workunit.client.0.smithi072.stdout:6/488: stat d2/d40/c54 0 2024-04-15T21:02:47.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/636: unlink d1/d17/d52/d42/f74 0 2024-04-15T21:02:47.661 INFO:tasks.workunit.client.1.smithi149.stdout:1/637: stat d1/db/dc/d11/c59 0 2024-04-15T21:02:47.663 INFO:tasks.workunit.client.1.smithi149.stdout:3/755: creat d1/db/d40/da0/fe9 x:0 0 0 2024-04-15T21:02:47.670 INFO:tasks.workunit.client.1.smithi149.stdout:3/756: dwrite d1/db/d24/fc9 [0,4194304] 0 2024-04-15T21:02:47.679 INFO:tasks.workunit.client.1.smithi149.stdout:3/757: symlink d1/db/d24/d4d/d63/lea 0 2024-04-15T21:02:47.681 INFO:tasks.workunit.client.1.smithi149.stdout:9/668: rename d23/d2b/f2c to d23/d46/fe1 0 2024-04-15T21:02:47.682 INFO:tasks.workunit.client.0.smithi072.stdout:9/516: symlink d4/d76/l98 0 2024-04-15T21:02:47.682 INFO:tasks.workunit.client.0.smithi072.stdout:0/536: creat d0/d19/d2b/fba x:0 0 0 2024-04-15T21:02:47.682 INFO:tasks.workunit.client.0.smithi072.stdout:1/503: rename d5/db/d2d/d56/f7f to d5/db/d2d/d56/d93/fa2 0 2024-04-15T21:02:47.682 INFO:tasks.workunit.client.0.smithi072.stdout:3/526: mkdir d1/d15/d32/d78/daa 0 2024-04-15T21:02:47.686 INFO:tasks.workunit.client.1.smithi149.stdout:3/758: creat d1/feb x:0 0 0 2024-04-15T21:02:47.688 INFO:tasks.workunit.client.1.smithi149.stdout:9/669: symlink d23/d3c/d7a/da5/dbd/le2 0 2024-04-15T21:02:47.690 INFO:tasks.workunit.client.1.smithi149.stdout:5/684: dwrite d0/d6/d82/da1/d12/d16/f58 [0,4194304] 0 2024-04-15T21:02:47.690 INFO:tasks.workunit.client.0.smithi072.stdout:8/555: rename d3/d4/d4c/l77 to d3/d4/d3b/la8 0 2024-04-15T21:02:47.691 INFO:tasks.workunit.client.1.smithi149.stdout:8/790: creat d2/d5b/dcd/d10a/d25/d57/f11c x:0 0 0 2024-04-15T21:02:47.693 INFO:tasks.workunit.client.0.smithi072.stdout:7/539: dread d2/d7/d25/d2d/d46/d5a/d5f/d26/f29 [0,4194304] 0 2024-04-15T21:02:47.693 INFO:tasks.workunit.client.1.smithi149.stdout:8/791: chown d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce 30737456 1 2024-04-15T21:02:47.693 INFO:tasks.workunit.client.1.smithi149.stdout:2/740: rename d4/d7/d46/de4/d21/d55/fa5 to d4/d7/d46/de4/d21/d3b/f104 0 2024-04-15T21:02:47.694 INFO:tasks.workunit.client.1.smithi149.stdout:8/792: chown d2/d5b/dcd/d10a/c98 5620595 1 2024-04-15T21:02:47.696 INFO:tasks.workunit.client.0.smithi072.stdout:3/527: fdatasync d1/d3f/d4f/f68 0 2024-04-15T21:02:47.696 INFO:tasks.workunit.client.1.smithi149.stdout:5/685: mkdir d0/d6/d82/db0/ddc 0 2024-04-15T21:02:47.696 INFO:tasks.workunit.client.0.smithi072.stdout:7/540: dread d2/d7/d25/d72/f9f [0,4194304] 0 2024-04-15T21:02:47.697 INFO:tasks.workunit.client.1.smithi149.stdout:0/873: write d1/d9/d64/d65/d104/d119/d54/f8c [831033,49200] 0 2024-04-15T21:02:47.697 INFO:tasks.workunit.client.1.smithi149.stdout:5/686: chown d0/d9/d3f 2 1 2024-04-15T21:02:47.697 INFO:tasks.workunit.client.0.smithi072.stdout:9/517: truncate d4/d1f/d2c/f39 443028 0 2024-04-15T21:02:47.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/518: fdatasync d4/d1f/d2c/d47/f5f 0 2024-04-15T21:02:47.701 INFO:tasks.workunit.client.1.smithi149.stdout:7/679: rename d3/d16/d32/d90/dad/dc4/dde/ce8 to d3/d16/d32/d90/dad/cf8 0 2024-04-15T21:02:47.702 INFO:tasks.workunit.client.1.smithi149.stdout:7/680: dread d3/d16/d20/f8b [0,4194304] 0 2024-04-15T21:02:47.703 INFO:tasks.workunit.client.1.smithi149.stdout:2/741: creat d4/d7/d93/dc3/f105 x:0 0 0 2024-04-15T21:02:47.705 INFO:tasks.workunit.client.0.smithi072.stdout:6/489: rmdir d2/d10/d11/d1f/d90 0 2024-04-15T21:02:47.706 INFO:tasks.workunit.client.1.smithi149.stdout:9/670: mkdir d23/d2b/d37/d6d/de3 0 2024-04-15T21:02:47.709 INFO:tasks.workunit.client.0.smithi072.stdout:8/556: creat d3/de/d1b/d41/fa9 x:0 0 0 2024-04-15T21:02:47.710 INFO:tasks.workunit.client.1.smithi149.stdout:0/874: fdatasync d1/d9/d64/d65/d104/d119/f93 0 2024-04-15T21:02:47.713 INFO:tasks.workunit.client.1.smithi149.stdout:6/629: truncate da/d18/d10/d3f/f41 3817605 0 2024-04-15T21:02:47.714 INFO:tasks.workunit.client.0.smithi072.stdout:0/537: creat d0/d19/d71/db1/fbb x:0 0 0 2024-04-15T21:02:47.721 INFO:tasks.workunit.client.0.smithi072.stdout:9/519: mknod d4/d29/d4c/d74/d84/c99 0 2024-04-15T21:02:47.722 INFO:tasks.workunit.client.0.smithi072.stdout:9/520: chown d4/d1f/f24 49223 1 2024-04-15T21:02:47.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/687: dread d0/d6/d82/da1/d12/d16/da9/d1b/d83/f97 [0,4194304] 0 2024-04-15T21:02:47.724 INFO:tasks.workunit.client.1.smithi149.stdout:7/681: unlink d3/f94 0 2024-04-15T21:02:47.725 INFO:tasks.workunit.client.0.smithi072.stdout:1/504: creat d5/fa3 x:0 0 0 2024-04-15T21:02:47.727 INFO:tasks.workunit.client.1.smithi149.stdout:2/742: dread d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/fe7 [0,4194304] 0 2024-04-15T21:02:47.730 INFO:tasks.workunit.client.1.smithi149.stdout:4/749: sync 2024-04-15T21:02:47.730 INFO:tasks.workunit.client.0.smithi072.stdout:8/557: dread d3/d4/d3b/f3d [0,4194304] 0 2024-04-15T21:02:47.734 INFO:tasks.workunit.client.1.smithi149.stdout:8/793: creat d2/d5b/dcd/d10a/d25/d57/dd1/d50/dff/f11d x:0 0 0 2024-04-15T21:02:47.734 INFO:tasks.workunit.client.1.smithi149.stdout:4/750: chown dc/fe 396553427 1 2024-04-15T21:02:47.735 INFO:tasks.workunit.client.1.smithi149.stdout:2/743: dread - d4/d7/d46/de4/d21/d2c/d32/d4a/ffc zero size 2024-04-15T21:02:47.736 INFO:tasks.workunit.client.1.smithi149.stdout:6/630: mkdir da/d2e/dc3 0 2024-04-15T21:02:47.740 INFO:tasks.workunit.client.1.smithi149.stdout:1/638: rename d1/c2 to d1/db/dc/d38/d39/d8c/cb7 0 2024-04-15T21:02:47.743 INFO:tasks.workunit.client.1.smithi149.stdout:8/794: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/d46/f107 [0,4194304] 0 2024-04-15T21:02:47.744 INFO:tasks.workunit.client.1.smithi149.stdout:5/688: symlink d0/d9/d71/ldd 0 2024-04-15T21:02:47.745 INFO:tasks.workunit.client.0.smithi072.stdout:1/505: mknod d5/db/d2d/d3a/d1f/d63/ca4 0 2024-04-15T21:02:47.746 INFO:tasks.workunit.client.1.smithi149.stdout:8/795: write d2/d5b/dcd/d10a/d4e/d9f/fa5 [343156,64030] 0 2024-04-15T21:02:47.746 INFO:tasks.workunit.client.1.smithi149.stdout:8/796: stat d2/la 0 2024-04-15T21:02:47.750 INFO:tasks.workunit.client.0.smithi072.stdout:2/514: rename d2/d8/d41/d94 to d2/da8 0 2024-04-15T21:02:47.756 INFO:tasks.workunit.client.0.smithi072.stdout:2/515: dwrite d2/d38/d73/d80/f82 [0,4194304] 0 2024-04-15T21:02:47.758 INFO:tasks.workunit.client.0.smithi072.stdout:0/538: creat d0/d97/fbc x:0 0 0 2024-04-15T21:02:47.761 INFO:tasks.workunit.client.0.smithi072.stdout:3/528: rmdir d1/d15/d32/d78/daa 0 2024-04-15T21:02:47.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/529: write d1/d15/f6f [3102552,31142] 0 2024-04-15T21:02:47.763 INFO:tasks.workunit.client.0.smithi072.stdout:3/530: write d1/f82 [338639,31496] 0 2024-04-15T21:02:47.764 INFO:tasks.workunit.client.0.smithi072.stdout:9/521: symlink d4/l9a 0 2024-04-15T21:02:47.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/531: dread - d1/d3f/d7f/d8c/fa6 zero size 2024-04-15T21:02:47.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/744: dread d4/d7/d46/de4/d21/d2c/fbc [0,4194304] 0 2024-04-15T21:02:47.769 INFO:tasks.workunit.client.0.smithi072.stdout:1/506: dwrite d5/db/d2d/d3a/f13 [0,4194304] 0 2024-04-15T21:02:47.773 INFO:tasks.workunit.client.0.smithi072.stdout:4/521: rename d7/d24/d3e/d5e to d7/d28/d42/d8c/da9 0 2024-04-15T21:02:47.774 INFO:tasks.workunit.client.0.smithi072.stdout:4/522: stat d7/d15/f33 0 2024-04-15T21:02:47.774 INFO:tasks.workunit.client.0.smithi072.stdout:4/523: write d7/f54 [502721,107099] 0 2024-04-15T21:02:47.776 INFO:tasks.workunit.client.0.smithi072.stdout:6/490: write d2/d40/d56/d6a/d70/f44 [2362065,14255] 0 2024-04-15T21:02:47.779 INFO:tasks.workunit.client.0.smithi072.stdout:0/539: write d0/d45/d7a/d70/d59/d8a/d7b/f91 [376785,50217] 0 2024-04-15T21:02:47.780 INFO:tasks.workunit.client.0.smithi072.stdout:0/540: readlink d0/d45/d35/d3a/l44 0 2024-04-15T21:02:47.781 INFO:tasks.workunit.client.0.smithi072.stdout:9/522: fsync d4/d1f/d31/f3f 0 2024-04-15T21:02:47.782 INFO:tasks.workunit.client.0.smithi072.stdout:3/532: rmdir d1/d3f/d4f/d73 39 2024-04-15T21:02:47.787 INFO:tasks.workunit.client.0.smithi072.stdout:8/558: link d3/de/c7b d3/d4/d4d/caa 0 2024-04-15T21:02:47.789 INFO:tasks.workunit.client.0.smithi072.stdout:6/491: rename d2/d1a/f43 to d2/d42/f93 0 2024-04-15T21:02:47.790 INFO:tasks.workunit.client.0.smithi072.stdout:9/523: dread d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:02:47.790 INFO:tasks.workunit.client.0.smithi072.stdout:9/524: dread - d4/f86 zero size 2024-04-15T21:02:47.793 INFO:tasks.workunit.client.0.smithi072.stdout:0/541: creat d0/d45/d7a/fbd x:0 0 0 2024-04-15T21:02:47.794 INFO:tasks.workunit.client.0.smithi072.stdout:0/542: chown d0/d45/d7a/d70/d59/d8a/d7b/f9a 7352914 1 2024-04-15T21:02:47.796 INFO:tasks.workunit.client.0.smithi072.stdout:0/543: dread d0/d45/d35/f4f [0,4194304] 0 2024-04-15T21:02:47.797 INFO:tasks.workunit.client.0.smithi072.stdout:1/507: mknod d5/d3d/d5e/ca5 0 2024-04-15T21:02:47.798 INFO:tasks.workunit.client.0.smithi072.stdout:1/508: dread - d5/d3d/d5e/f97 zero size 2024-04-15T21:02:47.801 INFO:tasks.workunit.client.0.smithi072.stdout:4/524: link d7/d24/f59 d7/d28/d6d/faa 0 2024-04-15T21:02:47.804 INFO:tasks.workunit.client.0.smithi072.stdout:6/492: rmdir d2/d10/d18 39 2024-04-15T21:02:47.816 INFO:tasks.workunit.client.1.smithi149.stdout:4/751: mkdir dc/d2c/d3e/d35/d4b/d6c/d70/df9 0 2024-04-15T21:02:47.817 INFO:tasks.workunit.client.0.smithi072.stdout:4/525: unlink d7/d10/d41/c68 0 2024-04-15T21:02:47.818 INFO:tasks.workunit.client.0.smithi072.stdout:4/526: fdatasync d7/f38 0 2024-04-15T21:02:47.819 INFO:tasks.workunit.client.0.smithi072.stdout:4/527: write d7/d15/d58/f77 [435767,3831] 0 2024-04-15T21:02:47.819 INFO:tasks.workunit.client.0.smithi072.stdout:8/559: mknod d3/de/cab 0 2024-04-15T21:02:47.822 INFO:tasks.workunit.client.1.smithi149.stdout:4/752: dwrite dc/d18/ff1 [0,4194304] 0 2024-04-15T21:02:47.823 INFO:tasks.workunit.client.0.smithi072.stdout:9/525: mkdir d4/d1f/d31/d9b 0 2024-04-15T21:02:47.824 INFO:tasks.workunit.client.1.smithi149.stdout:4/753: dread - dc/d2c/d3e/d35/fcd zero size 2024-04-15T21:02:47.825 INFO:tasks.workunit.client.1.smithi149.stdout:3/759: rename d1/db/d28/d87/dbd/cc2 to d1/db/d40/da0/dd8/cec 0 2024-04-15T21:02:47.827 INFO:tasks.workunit.client.1.smithi149.stdout:1/639: mknod d1/db/dc/d38/cb8 0 2024-04-15T21:02:47.829 INFO:tasks.workunit.client.1.smithi149.stdout:7/682: symlink d3/d39/lf9 0 2024-04-15T21:02:47.830 INFO:tasks.workunit.client.1.smithi149.stdout:7/683: chown d3/d16/d32/f84 153 1 2024-04-15T21:02:47.831 INFO:tasks.workunit.client.1.smithi149.stdout:5/689: chown d0/d6/d82/da1/l88 2094318 1 2024-04-15T21:02:47.831 INFO:tasks.workunit.client.1.smithi149.stdout:5/690: readlink d0/d6/d9f/lc3 0 2024-04-15T21:02:47.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/797: symlink d2/d5b/dcd/d10a/d20/d6b/d109/l11e 0 2024-04-15T21:02:47.835 INFO:tasks.workunit.client.0.smithi072.stdout:4/528: symlink d7/d28/d42/da1/da2/lab 0 2024-04-15T21:02:47.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/745: mkdir d4/d7/d46/de4/d21/d55/dfe/d106 0 2024-04-15T21:02:47.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/516: write d2/d3/f15 [763220,61824] 0 2024-04-15T21:02:47.838 INFO:tasks.workunit.client.1.smithi149.stdout:9/671: link d23/d2b/l31 d23/d2b/d44/d7e/le4 0 2024-04-15T21:02:47.839 INFO:tasks.workunit.client.1.smithi149.stdout:9/672: readlink d23/d46/l62 0 2024-04-15T21:02:47.839 INFO:tasks.workunit.client.0.smithi072.stdout:2/517: write d2/d8/d8e/fa7 [220731,113270] 0 2024-04-15T21:02:47.841 INFO:tasks.workunit.client.0.smithi072.stdout:8/560: dwrite d3/de/d1b/d41/d74/f9c [0,4194304] 0 2024-04-15T21:02:47.842 INFO:tasks.workunit.client.0.smithi072.stdout:8/561: write d3/de/d1b/d44/f78 [6556761,70817] 0 2024-04-15T21:02:47.843 INFO:tasks.workunit.client.0.smithi072.stdout:3/533: write d1/d26/f58 [388903,57321] 0 2024-04-15T21:02:47.848 INFO:tasks.workunit.client.0.smithi072.stdout:4/529: read d7/d24/f35 [1715098,73830] 0 2024-04-15T21:02:47.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/760: mknod d1/d81/ced 0 2024-04-15T21:02:47.856 INFO:tasks.workunit.client.0.smithi072.stdout:6/493: creat d2/d10/d18/f94 x:0 0 0 2024-04-15T21:02:47.857 INFO:tasks.workunit.client.1.smithi149.stdout:4/754: dwrite dc/d8f/ff6 [0,4194304] 0 2024-04-15T21:02:47.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/684: mkdir d3/d16/d6e/dfa 0 2024-04-15T21:02:47.858 INFO:tasks.workunit.client.0.smithi072.stdout:9/526: creat d4/d29/d4c/d74/f9c x:0 0 0 2024-04-15T21:02:47.860 INFO:tasks.workunit.client.0.smithi072.stdout:4/530: mkdir d7/d15/dac 0 2024-04-15T21:02:47.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/527: write d4/d1f/d2c/d62/f75 [321387,124374] 0 2024-04-15T21:02:47.862 INFO:tasks.workunit.client.0.smithi072.stdout:2/518: getdents d2/d38/d91/d97 0 2024-04-15T21:02:47.862 INFO:tasks.workunit.client.1.smithi149.stdout:2/746: creat d4/d7/d10/d36/f107 x:0 0 0 2024-04-15T21:02:47.864 INFO:tasks.workunit.client.0.smithi072.stdout:2/519: write d2/d38/f54 [2529594,37892] 0 2024-04-15T21:02:47.865 INFO:tasks.workunit.client.1.smithi149.stdout:9/673: rmdir d23/d2b/d70/d75 39 2024-04-15T21:02:47.865 INFO:tasks.workunit.client.0.smithi072.stdout:6/494: dwrite d2/d40/d6e/f4e [4194304,4194304] 0 2024-04-15T21:02:47.866 INFO:tasks.workunit.client.1.smithi149.stdout:6/631: link da/l1e da/d18/d10/d16/d97/dbf/d55/lc4 0 2024-04-15T21:02:47.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/640: mknod d1/db/dc/d38/d39/d43/daa/d8a/d97/cb9 0 2024-04-15T21:02:47.870 INFO:tasks.workunit.client.1.smithi149.stdout:1/641: chown d1/db/d16/f7c 254 1 2024-04-15T21:02:47.872 INFO:tasks.workunit.client.0.smithi072.stdout:0/544: dwrite d0/d45/d7a/d70/d59/d8a/d8b/db8/fa [0,4194304] 0 2024-04-15T21:02:47.872 INFO:tasks.workunit.client.1.smithi149.stdout:1/642: write d1/db/dc/d38/d39/d43/f54 [1944332,77451] 0 2024-04-15T21:02:47.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/531: read d7/d15/f33 [2781208,31654] 0 2024-04-15T21:02:47.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/685: mkdir d3/d34/db6/dfb 0 2024-04-15T21:02:47.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/686: stat d3/d16/d20/d6c/d91/la5 0 2024-04-15T21:02:47.878 INFO:tasks.workunit.client.0.smithi072.stdout:8/562: link d3/de/d1b/c68 d3/cac 0 2024-04-15T21:02:47.879 INFO:tasks.workunit.client.1.smithi149.stdout:4/755: mkdir dc/d18/d21/dfa 0 2024-04-15T21:02:47.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/691: mknod d0/d6/cde 0 2024-04-15T21:02:47.882 INFO:tasks.workunit.client.0.smithi072.stdout:9/528: dwrite d4/d1f/d2c/f4f [0,4194304] 0 2024-04-15T21:02:47.884 INFO:tasks.workunit.client.0.smithi072.stdout:6/495: mkdir d2/d40/d56/d95 0 2024-04-15T21:02:47.884 INFO:tasks.workunit.client.0.smithi072.stdout:0/545: dread - d0/d6/d48/d61/f64 zero size 2024-04-15T21:02:47.887 INFO:tasks.workunit.client.0.smithi072.stdout:1/509: truncate d5/f3c 809605 0 2024-04-15T21:02:47.889 INFO:tasks.workunit.client.1.smithi149.stdout:9/674: creat d23/d2b/d44/fe5 x:0 0 0 2024-04-15T21:02:47.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/675: stat d23/d3c/f6b 0 2024-04-15T21:02:47.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/676: write f22 [1813285,56656] 0 2024-04-15T21:02:47.891 INFO:tasks.workunit.client.0.smithi072.stdout:0/546: dread d0/d45/d7a/d70/d59/d8a/d7b/f91 [0,4194304] 0 2024-04-15T21:02:47.891 INFO:tasks.workunit.client.1.smithi149.stdout:6/632: rmdir da/d18/d33 39 2024-04-15T21:02:47.892 INFO:tasks.workunit.client.0.smithi072.stdout:0/547: chown d0/d19/d2b 2914008 1 2024-04-15T21:02:47.893 INFO:tasks.workunit.client.0.smithi072.stdout:0/548: chown d0/d6/f2c 48681 1 2024-04-15T21:02:47.897 INFO:tasks.workunit.client.1.smithi149.stdout:3/761: creat d1/db/d28/de7/fee x:0 0 0 2024-04-15T21:02:47.898 INFO:tasks.workunit.client.0.smithi072.stdout:3/534: write d1/d15/d40/fb [633196,40415] 0 2024-04-15T21:02:47.898 INFO:tasks.workunit.client.0.smithi072.stdout:6/496: truncate d2/d10/d11/d1f/d60/f61 4035872 0 2024-04-15T21:02:47.899 INFO:tasks.workunit.client.1.smithi149.stdout:8/798: write d2/d5b/dcd/d10a/d20/f91 [949522,41530] 0 2024-04-15T21:02:47.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/497: write d2/d40/d6e/f36 [700654,79387] 0 2024-04-15T21:02:47.900 INFO:tasks.workunit.client.1.smithi149.stdout:7/687: unlink d3/f2c 0 2024-04-15T21:02:47.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/756: creat dc/d2c/d3e/d35/ffb x:0 0 0 2024-04-15T21:02:47.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/757: chown dc/d2c/d3e/d15/d5b/fc5 0 1 2024-04-15T21:02:47.905 INFO:tasks.workunit.client.1.smithi149.stdout:4/758: chown dc/l49 382 1 2024-04-15T21:02:47.908 INFO:tasks.workunit.client.0.smithi072.stdout:2/520: write d2/d8/f28 [6087176,72427] 0 2024-04-15T21:02:47.909 INFO:tasks.workunit.client.1.smithi149.stdout:1/643: fsync d1/db/d16/f5c 0 2024-04-15T21:02:47.911 INFO:tasks.workunit.client.0.smithi072.stdout:0/549: dread d0/d6/f4e [0,4194304] 0 2024-04-15T21:02:47.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/747: write d4/d7/d46/de4/db6/fc4 [348260,3020] 0 2024-04-15T21:02:47.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:47 smithi072 ceph-mon[29079]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 136 MiB/s wr, 265 op/s 2024-04-15T21:02:47.915 INFO:tasks.workunit.client.1.smithi149.stdout:8/799: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/c11f 0 2024-04-15T21:02:47.916 INFO:tasks.workunit.client.1.smithi149.stdout:8/800: stat d2/d5b/dcd/d10a/d25/d37/lc5 0 2024-04-15T21:02:47.920 INFO:tasks.workunit.client.0.smithi072.stdout:5/493: sync 2024-04-15T21:02:47.921 INFO:tasks.workunit.client.1.smithi149.stdout:4/759: truncate dc/d2c/d3e/d35/d4b/f7d 3157635 0 2024-04-15T21:02:47.921 INFO:tasks.workunit.client.0.smithi072.stdout:4/532: write d7/d15/f20 [1922741,38765] 0 2024-04-15T21:02:47.924 INFO:tasks.workunit.client.1.smithi149.stdout:1/644: creat d1/db/dc/d11/d3e/fba x:0 0 0 2024-04-15T21:02:47.928 INFO:tasks.workunit.client.1.smithi149.stdout:8/801: readlink d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/lfe 0 2024-04-15T21:02:47.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/692: dread d0/d6/d2d/f67 [0,4194304] 0 2024-04-15T21:02:47.932 INFO:tasks.workunit.client.1.smithi149.stdout:4/760: stat dc/d18/c98 0 2024-04-15T21:02:47.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/645: rename d1/d17/l19 to d1/d17/d36/lbb 0 2024-04-15T21:02:47.936 INFO:tasks.workunit.client.1.smithi149.stdout:5/693: dwrite d0/d6/d82/da1/f38 [4194304,4194304] 0 2024-04-15T21:02:47.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/748: creat d4/d7/d46/de4/d21/d55/dfe/d106/f108 x:0 0 0 2024-04-15T21:02:47.940 INFO:tasks.workunit.client.1.smithi149.stdout:8/802: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f120 x:0 0 0 2024-04-15T21:02:47.944 INFO:tasks.workunit.client.0.smithi072.stdout:9/529: mknod d4/c9d 0 2024-04-15T21:02:47.945 INFO:tasks.workunit.client.0.smithi072.stdout:9/530: dread - d4/d29/d4c/d74/f9c zero size 2024-04-15T21:02:47.946 INFO:tasks.workunit.client.0.smithi072.stdout:3/535: creat d1/d26/fab x:0 0 0 2024-04-15T21:02:47.947 INFO:tasks.workunit.client.1.smithi149.stdout:8/803: dwrite d2/d5b/dcd/d10a/d20/f91 [0,4194304] 0 2024-04-15T21:02:47.948 INFO:tasks.workunit.client.1.smithi149.stdout:3/762: getdents d1/db/d24/d2b 0 2024-04-15T21:02:47.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/749: creat d4/d7/d46/de4/db6/f109 x:0 0 0 2024-04-15T21:02:47.954 INFO:tasks.workunit.client.1.smithi149.stdout:2/750: truncate d4/d7/d46/de4/db6/f109 738092 0 2024-04-15T21:02:47.954 INFO:tasks.workunit.client.0.smithi072.stdout:2/521: mknod d2/d8/d8e/d90/ca9 0 2024-04-15T21:02:47.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/688: link d3/d16/d20/d36/d3d/c4c d3/d17/d1f/d93/df6/cfc 0 2024-04-15T21:02:47.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/761: mkdir dc/d2c/d3e/d35/d4b/de8/dfc 0 2024-04-15T21:02:47.959 INFO:tasks.workunit.client.1.smithi149.stdout:4/762: chown dc/d2c/d3e/d15/fde 111 1 2024-04-15T21:02:47.959 INFO:tasks.workunit.client.1.smithi149.stdout:3/763: creat d1/d81/fef x:0 0 0 2024-04-15T21:02:47.963 INFO:tasks.workunit.client.0.smithi072.stdout:5/494: creat d0/d3/d33/fac x:0 0 0 2024-04-15T21:02:47.964 INFO:tasks.workunit.client.0.smithi072.stdout:7/541: sync 2024-04-15T21:02:47.964 INFO:tasks.workunit.client.0.smithi072.stdout:5/495: readlink d0/d3/d7/d12/d31/l3b 0 2024-04-15T21:02:47.966 INFO:tasks.workunit.client.0.smithi072.stdout:4/533: mkdir d7/d10/d41/d44/d7a/d86/d76/d8b/dad 0 2024-04-15T21:02:47.966 INFO:tasks.workunit.client.0.smithi072.stdout:4/534: chown d7/d15/d58/d62 0 1 2024-04-15T21:02:47.967 INFO:tasks.workunit.client.1.smithi149.stdout:7/689: truncate d3/d39/faf 611554 0 2024-04-15T21:02:47.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/646: dread d1/db/d14/f9d [0,4194304] 0 2024-04-15T21:02:47.968 INFO:tasks.workunit.client.0.smithi072.stdout:4/535: write d7/d10/d41/d44/f48 [1564990,126729] 0 2024-04-15T21:02:47.974 INFO:tasks.workunit.client.0.smithi072.stdout:4/536: dwrite d7/d15/d58/f7b [0,4194304] 0 2024-04-15T21:02:47.978 INFO:tasks.workunit.client.1.smithi149.stdout:1/647: dwrite d1/db/dc/d11/f9b [0,4194304] 0 2024-04-15T21:02:47.978 INFO:tasks.workunit.client.1.smithi149.stdout:1/648: fsync d1/db/dc/d11/d3e/fba 0 2024-04-15T21:02:47.979 INFO:tasks.workunit.client.0.smithi072.stdout:9/531: dwrite d4/d29/d4c/d74/f7f [0,4194304] 0 2024-04-15T21:02:47.979 INFO:tasks.workunit.client.0.smithi072.stdout:8/563: getdents d3/de/d1b/d3f 0 2024-04-15T21:02:47.979 INFO:tasks.workunit.client.1.smithi149.stdout:1/649: dread d1/db/dc/d11/d3f/d45/dae/fa8 [0,4194304] 0 2024-04-15T21:02:47.981 INFO:tasks.workunit.client.1.smithi149.stdout:7/690: read d3/d17/f1a [2640988,92101] 0 2024-04-15T21:02:47.982 INFO:tasks.workunit.client.1.smithi149.stdout:7/691: fdatasync d3/d16/d20/fdd 0 2024-04-15T21:02:47.983 INFO:tasks.workunit.client.1.smithi149.stdout:7/692: stat d3/d16/lbb 0 2024-04-15T21:02:47.986 INFO:tasks.workunit.client.0.smithi072.stdout:7/542: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d43 39 2024-04-15T21:02:47.990 INFO:tasks.workunit.client.0.smithi072.stdout:1/510: dwrite d5/d3d/f6a [0,4194304] 0 2024-04-15T21:02:47.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/751: rename d4/d7/d46/de4/d21/d2c/d32/ded to d4/d7/d46/de4/d21/d3b/d10a 0 2024-04-15T21:02:47.996 INFO:tasks.workunit.client.0.smithi072.stdout:8/564: dread d3/d4/d4c/f6c [0,4194304] 0 2024-04-15T21:02:47.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/764: rename d1/db/d28 to d1/db/d28/de7/df0 22 2024-04-15T21:02:48.001 INFO:tasks.workunit.client.1.smithi149.stdout:8/804: write d2/d5b/dcd/d10a/d25/fbf [1090093,61422] 0 2024-04-15T21:02:48.002 INFO:tasks.workunit.client.0.smithi072.stdout:8/565: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:48.003 INFO:tasks.workunit.client.1.smithi149.stdout:5/694: write d0/d6/d82/da1/d12/d2b/f72 [654541,116328] 0 2024-04-15T21:02:48.008 INFO:tasks.workunit.client.0.smithi072.stdout:6/498: creat d2/d10/d18/f96 x:0 0 0 2024-04-15T21:02:48.008 INFO:tasks.workunit.client.0.smithi072.stdout:6/499: read d2/d40/d6e/f4e [6367501,38689] 0 2024-04-15T21:02:48.012 INFO:tasks.workunit.client.0.smithi072.stdout:4/537: unlink d7/l13 0 2024-04-15T21:02:48.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/763: dwrite dc/d2c/d3e/d15/d5b/f6d [0,4194304] 0 2024-04-15T21:02:48.015 INFO:tasks.workunit.client.1.smithi149.stdout:2/752: dread d4/d7/da/fe [0,4194304] 0 2024-04-15T21:02:48.016 INFO:tasks.workunit.client.0.smithi072.stdout:3/536: dwrite d1/d15/d40/f13 [0,4194304] 0 2024-04-15T21:02:48.017 INFO:tasks.workunit.client.1.smithi149.stdout:2/753: readlink d4/d7/d46/de4/l8a 0 2024-04-15T21:02:48.017 INFO:tasks.workunit.client.0.smithi072.stdout:3/537: write d1/f2b [6183092,100832] 0 2024-04-15T21:02:48.027 INFO:tasks.workunit.client.1.smithi149.stdout:8/805: mkdir d2/d5b/dcd/d10a/d25/d32/d45/d77/d121 0 2024-04-15T21:02:48.027 INFO:tasks.workunit.client.1.smithi149.stdout:4/764: rename dc/d18/d21/f67 to dc/deb/ffd 0 2024-04-15T21:02:48.029 INFO:tasks.workunit.client.0.smithi072.stdout:1/511: unlink d5/db/d2d/d3a/d1f/c29 0 2024-04-15T21:02:48.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/806: fdatasync d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f110 0 2024-04-15T21:02:48.031 INFO:tasks.workunit.client.1.smithi149.stdout:2/754: chown d4/d7/d46/de4/d21/d5e/f40 258157 1 2024-04-15T21:02:48.032 INFO:tasks.workunit.client.0.smithi072.stdout:1/512: dread d5/d3d/f75 [0,4194304] 0 2024-04-15T21:02:48.033 INFO:tasks.workunit.client.0.smithi072.stdout:7/543: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e 1118649 0 2024-04-15T21:02:48.037 INFO:tasks.workunit.client.0.smithi072.stdout:8/566: creat d3/de/d1b/d85/fad x:0 0 0 2024-04-15T21:02:48.039 INFO:tasks.workunit.client.1.smithi149.stdout:1/650: dwrite d1/db/d16/f5c [0,4194304] 0 2024-04-15T21:02:48.042 INFO:tasks.workunit.client.0.smithi072.stdout:6/500: fsync d2/f2a 0 2024-04-15T21:02:48.049 INFO:tasks.workunit.client.1.smithi149.stdout:3/765: truncate d1/db/d24/d2b/f25 330040 0 2024-04-15T21:02:48.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/807: dwrite d2/d5b/dcd/d10a/f90 [0,4194304] 0 2024-04-15T21:02:48.052 INFO:tasks.workunit.client.1.smithi149.stdout:8/808: write d2/f86 [1913426,13959] 0 2024-04-15T21:02:48.053 INFO:tasks.workunit.client.0.smithi072.stdout:5/496: truncate d0/d3/d7/d12/f51 4915267 0 2024-04-15T21:02:48.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/809: chown d2/d5b/dcd/d10a/d25/d57/dd1/d50/l67 1 1 2024-04-15T21:02:48.057 INFO:tasks.workunit.client.1.smithi149.stdout:1/651: fdatasync d1/db/f2b 0 2024-04-15T21:02:48.058 INFO:tasks.workunit.client.1.smithi149.stdout:1/652: read d1/f62 [1850278,21254] 0 2024-04-15T21:02:48.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/766: rmdir d1/db/d28/de7 39 2024-04-15T21:02:48.065 INFO:tasks.workunit.client.1.smithi149.stdout:3/767: truncate d1/db/d24/d4d/d63/d65/f67 1346764 0 2024-04-15T21:02:48.066 INFO:tasks.workunit.client.1.smithi149.stdout:4/765: rmdir dc/d2c/d3e/d35/d4b/d75/dca 0 2024-04-15T21:02:48.067 INFO:tasks.workunit.client.1.smithi149.stdout:4/766: write dc/d2c/d3e/d15/d5b/f74 [5100182,3391] 0 2024-04-15T21:02:48.068 INFO:tasks.workunit.client.0.smithi072.stdout:0/550: getdents d0/d6 0 2024-04-15T21:02:48.070 INFO:tasks.workunit.client.1.smithi149.stdout:8/810: dread d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/feb [0,4194304] 0 2024-04-15T21:02:48.070 INFO:tasks.workunit.client.0.smithi072.stdout:9/532: truncate d4/d1f/d31/d4d/f5c 1355917 0 2024-04-15T21:02:48.075 INFO:tasks.workunit.client.0.smithi072.stdout:1/513: unlink d5/d3d/d5e/ca5 0 2024-04-15T21:02:48.076 INFO:tasks.workunit.client.0.smithi072.stdout:1/514: read - d5/db/d2d/d85/f99 zero size 2024-04-15T21:02:48.077 INFO:tasks.workunit.client.0.smithi072.stdout:4/538: dread d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:48.080 INFO:tasks.workunit.client.1.smithi149.stdout:2/755: dwrite d4/fd9 [0,4194304] 0 2024-04-15T21:02:48.087 INFO:tasks.workunit.client.1.smithi149.stdout:8/811: fdatasync d2/d5b/dcd/d10a/d25/d57/dd1/fa7 0 2024-04-15T21:02:48.089 INFO:tasks.workunit.client.0.smithi072.stdout:5/497: creat d0/d3/d7/d12/d31/d49/fad x:0 0 0 2024-04-15T21:02:48.090 INFO:tasks.workunit.client.0.smithi072.stdout:2/522: getdents d2/d66 0 2024-04-15T21:02:48.091 INFO:tasks.workunit.client.1.smithi149.stdout:1/653: truncate d1/db/d14/f7d 1661100 0 2024-04-15T21:02:48.096 INFO:tasks.workunit.client.0.smithi072.stdout:2/523: dwrite d2/d38/f2a [0,4194304] 0 2024-04-15T21:02:48.096 INFO:tasks.workunit.client.1.smithi149.stdout:2/756: symlink d4/d7/d46/de4/d21/d5e/dbe/l10b 0 2024-04-15T21:02:48.101 INFO:tasks.workunit.client.0.smithi072.stdout:1/515: unlink d5/db/d27/l5b 0 2024-04-15T21:02:48.102 INFO:tasks.workunit.client.0.smithi072.stdout:7/544: mknod d2/d7/d25/d2d/d46/d5a/d5f/d43/ca5 0 2024-04-15T21:02:48.103 INFO:tasks.workunit.client.0.smithi072.stdout:4/539: symlink d7/d10/d41/d44/d7a/d86/d76/lae 0 2024-04-15T21:02:48.103 INFO:tasks.workunit.client.0.smithi072.stdout:4/540: stat d7/d24/c69 0 2024-04-15T21:02:48.105 INFO:tasks.workunit.client.0.smithi072.stdout:8/567: unlink d3/d4/d3b/la8 0 2024-04-15T21:02:48.106 INFO:tasks.workunit.client.0.smithi072.stdout:8/568: fdatasync d3/de/d1b/d85/fad 0 2024-04-15T21:02:48.108 INFO:tasks.workunit.client.1.smithi149.stdout:2/757: rename d4/d7/d46/de4/d21/d2c/d3e/l48 to d4/d7/d46/de4/d21/d55/dfe/d106/l10c 0 2024-04-15T21:02:48.112 INFO:tasks.workunit.client.1.smithi149.stdout:8/812: write d2/d5b/dcd/d10a/d25/d57/f80 [2484565,77391] 0 2024-04-15T21:02:48.112 INFO:tasks.workunit.client.0.smithi072.stdout:6/501: write d2/d40/f81 [349159,59854] 0 2024-04-15T21:02:48.113 INFO:tasks.workunit.client.1.smithi149.stdout:2/758: truncate d4/d7/da/fe 2648525 0 2024-04-15T21:02:48.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/551: dwrite d0/d45/f7f [0,4194304] 0 2024-04-15T21:02:48.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/552: chown d0/lb 13818819 1 2024-04-15T21:02:48.115 INFO:tasks.workunit.client.1.smithi149.stdout:3/768: dwrite d1/db/d24/d4d/d63/d65/dc3/fcc [0,4194304] 0 2024-04-15T21:02:48.122 INFO:tasks.workunit.client.0.smithi072.stdout:8/569: dread d3/de/d1b/d41/da4/f51 [0,4194304] 0 2024-04-15T21:02:48.124 INFO:tasks.workunit.client.0.smithi072.stdout:3/538: link d1/d3f/d4f/f68 d1/d15/d40/fac 0 2024-04-15T21:02:48.125 INFO:tasks.workunit.client.0.smithi072.stdout:3/539: write d1/d5b/f84 [686014,2014] 0 2024-04-15T21:02:48.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/813: dwrite d2/d16/f65 [4194304,4194304] 0 2024-04-15T21:02:48.127 INFO:tasks.workunit.client.0.smithi072.stdout:3/540: truncate d1/d15/d32/f65 4236283 0 2024-04-15T21:02:48.131 INFO:tasks.workunit.client.1.smithi149.stdout:2/759: symlink d4/d7/d46/de4/d21/d6d/l10d 0 2024-04-15T21:02:48.133 INFO:tasks.workunit.client.0.smithi072.stdout:9/533: mkdir d4/d1f/d9e 0 2024-04-15T21:02:48.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/760: dread - d4/d7/d46/de4/d21/d6d/fd6 zero size 2024-04-15T21:02:48.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/814: fdatasync d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/fa3 0 2024-04-15T21:02:48.145 INFO:tasks.workunit.client.0.smithi072.stdout:1/516: dwrite d5/f7d [0,4194304] 0 2024-04-15T21:02:48.147 INFO:tasks.workunit.client.1.smithi149.stdout:3/769: dread d1/db/d24/d4d/fd7 [0,4194304] 0 2024-04-15T21:02:48.150 INFO:tasks.workunit.client.0.smithi072.stdout:5/498: rename d0/d3/d7/d12/d1d/d8c/l7b to d0/d3/d33/d60/d81/lae 0 2024-04-15T21:02:48.156 INFO:tasks.workunit.client.1.smithi149.stdout:8/815: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/fe1 [0,4194304] 0 2024-04-15T21:02:48.158 INFO:tasks.workunit.client.0.smithi072.stdout:8/570: mkdir d3/de/d1b/d41/dae 0 2024-04-15T21:02:48.159 INFO:tasks.workunit.client.0.smithi072.stdout:8/571: write d3/ff [2224247,9121] 0 2024-04-15T21:02:48.162 INFO:tasks.workunit.client.0.smithi072.stdout:3/541: creat d1/d15/d32/d78/fad x:0 0 0 2024-04-15T21:02:48.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/654: truncate d1/db/d14/f7d 813703 0 2024-04-15T21:02:48.166 INFO:tasks.workunit.client.1.smithi149.stdout:3/770: creat d1/db/d40/da0/dd1/ff1 x:0 0 0 2024-04-15T21:02:48.167 INFO:tasks.workunit.client.0.smithi072.stdout:2/524: write d2/d3/f5d [208985,74600] 0 2024-04-15T21:02:48.167 INFO:tasks.workunit.client.1.smithi149.stdout:2/761: write d4/d7/d46/de4/d21/d55/fb7 [684216,47681] 0 2024-04-15T21:02:48.168 INFO:tasks.workunit.client.1.smithi149.stdout:1/655: symlink d1/db/dc/d11/d3f/d45/dae/lbc 0 2024-04-15T21:02:48.176 INFO:tasks.workunit.client.0.smithi072.stdout:0/553: dwrite d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:48.176 INFO:tasks.workunit.client.0.smithi072.stdout:1/517: symlink d5/d31/d51/la6 0 2024-04-15T21:02:48.178 INFO:tasks.workunit.client.0.smithi072.stdout:5/499: chown d0/f59 1165624301 1 2024-04-15T21:02:48.178 INFO:tasks.workunit.client.0.smithi072.stdout:6/502: rename d2/f4a to d2/d42/f97 0 2024-04-15T21:02:48.180 INFO:tasks.workunit.client.0.smithi072.stdout:8/572: creat d3/de/d1b/d85/faf x:0 0 0 2024-04-15T21:02:48.180 INFO:tasks.workunit.client.0.smithi072.stdout:4/541: mkdir d7/d23/d6c/daf 0 2024-04-15T21:02:48.180 INFO:tasks.workunit.client.0.smithi072.stdout:1/518: dread - d5/d31/d51/f74 zero size 2024-04-15T21:02:48.180 INFO:tasks.workunit.client.0.smithi072.stdout:6/503: chown d2/fe 15 1 2024-04-15T21:02:48.181 INFO:tasks.workunit.client.0.smithi072.stdout:5/500: read d0/d3/d7/f8a [2947050,1506] 0 2024-04-15T21:02:48.184 INFO:tasks.workunit.client.0.smithi072.stdout:9/534: rename d4/d1f/f2b to d4/d29/f9f 0 2024-04-15T21:02:48.186 INFO:tasks.workunit.client.0.smithi072.stdout:9/535: read d4/f5 [11510589,79938] 0 2024-04-15T21:02:48.190 INFO:tasks.workunit.client.0.smithi072.stdout:6/504: creat d2/d40/d56/f98 x:0 0 0 2024-04-15T21:02:48.190 INFO:tasks.workunit.client.0.smithi072.stdout:1/519: rmdir d5/db/d2d/d56 39 2024-04-15T21:02:48.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:47 smithi149 ceph-mon[36029]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 136 MiB/s wr, 265 op/s 2024-04-15T21:02:48.191 INFO:tasks.workunit.client.0.smithi072.stdout:6/505: chown d2/d10/d18/d47/d6d/f87 66 1 2024-04-15T21:02:48.192 INFO:tasks.workunit.client.0.smithi072.stdout:0/554: link d0/d45/d7a/d70/lae d0/d19/d71/d9e/lbe 0 2024-04-15T21:02:48.194 INFO:tasks.workunit.client.0.smithi072.stdout:9/536: creat d4/d29/d4c/d91/d93/fa0 x:0 0 0 2024-04-15T21:02:48.194 INFO:tasks.workunit.client.0.smithi072.stdout:0/555: write d0/d45/f26 [3557648,124787] 0 2024-04-15T21:02:48.196 INFO:tasks.workunit.client.0.smithi072.stdout:7/545: truncate d2/d7/d25/d72/f85 1020134 0 2024-04-15T21:02:48.196 INFO:tasks.workunit.client.0.smithi072.stdout:6/506: symlink d2/d10/d11/d1f/d60/l99 0 2024-04-15T21:02:48.200 INFO:tasks.workunit.client.0.smithi072.stdout:0/556: creat d0/d97/fbf x:0 0 0 2024-04-15T21:02:48.201 INFO:tasks.workunit.client.0.smithi072.stdout:6/507: fdatasync d2/fe 0 2024-04-15T21:02:48.204 INFO:tasks.workunit.client.0.smithi072.stdout:9/537: dwrite d4/d29/f71 [0,4194304] 0 2024-04-15T21:02:48.206 INFO:tasks.workunit.client.0.smithi072.stdout:3/542: truncate d1/d26/f58 525274 0 2024-04-15T21:02:48.210 INFO:tasks.workunit.client.0.smithi072.stdout:1/520: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:48.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/538: creat d4/d29/d45/fa1 x:0 0 0 2024-04-15T21:02:48.210 INFO:tasks.workunit.client.0.smithi072.stdout:3/543: mknod d1/d5b/cae 0 2024-04-15T21:02:48.212 INFO:tasks.workunit.client.0.smithi072.stdout:3/544: dread - d1/d15/d32/fa8 zero size 2024-04-15T21:02:48.212 INFO:tasks.workunit.client.0.smithi072.stdout:4/542: symlink d7/d23/d6c/lb0 0 2024-04-15T21:02:48.213 INFO:tasks.workunit.client.0.smithi072.stdout:5/501: dread d0/d3/d7/d12/f51 [0,4194304] 0 2024-04-15T21:02:48.215 INFO:tasks.workunit.client.0.smithi072.stdout:0/557: creat d0/d45/fc0 x:0 0 0 2024-04-15T21:02:48.217 INFO:tasks.workunit.client.1.smithi149.stdout:9/677: sync 2024-04-15T21:02:48.217 INFO:tasks.workunit.client.1.smithi149.stdout:0/875: sync 2024-04-15T21:02:48.243 INFO:tasks.workunit.client.1.smithi149.stdout:1/656: write d1/db/d16/f7c [184941,94357] 0 2024-04-15T21:02:48.243 INFO:tasks.workunit.client.1.smithi149.stdout:8/816: write d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/fc2 [1540842,87850] 0 2024-04-15T21:02:48.248 INFO:tasks.workunit.client.1.smithi149.stdout:0/876: write d1/d9/d64/d65/d104/d119/d43/f48 [2474845,88369] 0 2024-04-15T21:02:48.250 INFO:tasks.workunit.client.1.smithi149.stdout:1/657: truncate d1/d17/d52/f40 4467284 0 2024-04-15T21:02:48.251 INFO:tasks.workunit.client.1.smithi149.stdout:9/678: rename d23/d2b/d37/d50/l9d to d23/d2b/dd3/le6 0 2024-04-15T21:02:48.253 INFO:tasks.workunit.client.1.smithi149.stdout:2/762: dwrite d4/d7/d46/de4/d21/d55/fb7 [0,4194304] 0 2024-04-15T21:02:48.255 INFO:tasks.workunit.client.1.smithi149.stdout:3/771: dwrite d1/db/d24/d39/d79/d97/f98 [0,4194304] 0 2024-04-15T21:02:48.256 INFO:tasks.workunit.client.1.smithi149.stdout:0/877: read d1/d9/d64/d65/fb4 [3334867,101054] 0 2024-04-15T21:02:48.256 INFO:tasks.workunit.client.1.smithi149.stdout:9/679: fdatasync d23/d2b/f41 0 2024-04-15T21:02:48.258 INFO:tasks.workunit.client.1.smithi149.stdout:2/763: dread - d4/d7/da/fc8 zero size 2024-04-15T21:02:48.261 INFO:tasks.workunit.client.1.smithi149.stdout:1/658: dread d1/f62 [0,4194304] 0 2024-04-15T21:02:48.262 INFO:tasks.workunit.client.1.smithi149.stdout:8/817: truncate d2/d5b/dcd/d10a/d25/d57/dd1/f41 2825611 0 2024-04-15T21:02:48.264 INFO:tasks.workunit.client.1.smithi149.stdout:0/878: fsync d1/d29/fa7 0 2024-04-15T21:02:48.265 INFO:tasks.workunit.client.1.smithi149.stdout:2/764: mknod d4/d7/d93/dc3/c10e 0 2024-04-15T21:02:48.267 INFO:tasks.workunit.client.1.smithi149.stdout:8/818: symlink d2/d5b/dcd/d10a/d25/d37/d53/l122 0 2024-04-15T21:02:48.270 INFO:tasks.workunit.client.1.smithi149.stdout:9/680: rename d23/d2b/d37/d50/l84 to d23/d3c/d52/le7 0 2024-04-15T21:02:48.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/659: mkdir d1/db/d16/d35/dbd 0 2024-04-15T21:02:48.274 INFO:tasks.workunit.client.0.smithi072.stdout:7/546: dread d2/fa [0,4194304] 0 2024-04-15T21:02:48.275 INFO:tasks.workunit.client.0.smithi072.stdout:3/545: symlink d1/d3f/laf 0 2024-04-15T21:02:48.277 INFO:tasks.workunit.client.0.smithi072.stdout:4/543: mkdir d7/d28/db1 0 2024-04-15T21:02:48.279 INFO:tasks.workunit.client.1.smithi149.stdout:9/681: getdents d23/d3c/d7a 0 2024-04-15T21:02:48.280 INFO:tasks.workunit.client.1.smithi149.stdout:1/660: dwrite d1/db/dc/fa4 [4194304,4194304] 0 2024-04-15T21:02:48.281 INFO:tasks.workunit.client.0.smithi072.stdout:1/521: dwrite d5/d31/d51/d82/f92 [0,4194304] 0 2024-04-15T21:02:48.285 INFO:tasks.workunit.client.0.smithi072.stdout:6/508: getdents d2/d40/d56/d6a/d70/d49 0 2024-04-15T21:02:48.288 INFO:tasks.workunit.client.0.smithi072.stdout:5/502: getdents d0 0 2024-04-15T21:02:48.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/547: write d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 [1066442,88917] 0 2024-04-15T21:02:48.294 INFO:tasks.workunit.client.0.smithi072.stdout:3/546: rename d1/d5b/cae to d1/d3f/d7f/d8c/cb0 0 2024-04-15T21:02:48.296 INFO:tasks.workunit.client.0.smithi072.stdout:1/522: dwrite d5/db/d2d/d3a/f13 [0,4194304] 0 2024-04-15T21:02:48.297 INFO:tasks.workunit.client.0.smithi072.stdout:3/547: fsync d1/d5b/f62 0 2024-04-15T21:02:48.304 INFO:tasks.workunit.client.0.smithi072.stdout:6/509: truncate d2/d10/d11/d1f/f28 479536 0 2024-04-15T21:02:48.306 INFO:tasks.workunit.client.0.smithi072.stdout:5/503: dwrite d0/d3/d6/d14/f5b [0,4194304] 0 2024-04-15T21:02:48.306 INFO:tasks.workunit.client.0.smithi072.stdout:1/523: write d5/db/d27/f33 [3254177,10517] 0 2024-04-15T21:02:48.308 INFO:tasks.workunit.client.1.smithi149.stdout:3/772: write d1/db/fd4 [394816,117995] 0 2024-04-15T21:02:48.309 INFO:tasks.workunit.client.0.smithi072.stdout:4/544: dread d7/d15/f20 [0,4194304] 0 2024-04-15T21:02:48.310 INFO:tasks.workunit.client.0.smithi072.stdout:6/510: dread - d2/d10/d18/f94 zero size 2024-04-15T21:02:48.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/545: read - d7/d10/d41/d44/d7a/d86/d76/f96 zero size 2024-04-15T21:02:48.312 INFO:tasks.workunit.client.0.smithi072.stdout:6/511: chown d2/d10/d18/c22 333528408 1 2024-04-15T21:02:48.312 INFO:tasks.workunit.client.1.smithi149.stdout:9/682: dread d23/d46/fe1 [0,4194304] 0 2024-04-15T21:02:48.313 INFO:tasks.workunit.client.0.smithi072.stdout:7/548: getdents d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38 0 2024-04-15T21:02:48.315 INFO:tasks.workunit.client.0.smithi072.stdout:7/549: chown d2/d7/d25/c37 2822 1 2024-04-15T21:02:48.316 INFO:tasks.workunit.client.0.smithi072.stdout:5/504: dwrite d0/d3/d6/f9f [0,4194304] 0 2024-04-15T21:02:48.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/773: truncate d1/db/d24/d2b/f2e 4714518 0 2024-04-15T21:02:48.318 INFO:tasks.workunit.client.0.smithi072.stdout:5/505: fsync d0/d3/d6/d14/f18 0 2024-04-15T21:02:48.319 INFO:tasks.workunit.client.0.smithi072.stdout:1/524: fsync d5/f9 0 2024-04-15T21:02:48.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/774: write d1/db/d24/d39/d79/d97/fc7 [76351,69458] 0 2024-04-15T21:02:48.321 INFO:tasks.workunit.client.0.smithi072.stdout:1/525: write d5/d31/d51/f83 [215337,50284] 0 2024-04-15T21:02:48.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/683: dread f9 [0,4194304] 0 2024-04-15T21:02:48.326 INFO:tasks.workunit.client.1.smithi149.stdout:8/819: dread d2/d5b/dcd/d10a/f14 [0,4194304] 0 2024-04-15T21:02:48.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/775: chown d1/db/d28/d87/dbd/fb5 10219 1 2024-04-15T21:02:48.331 INFO:tasks.workunit.client.1.smithi149.stdout:1/661: dread d1/db/dc/d11/d3f/d45/f57 [0,4194304] 0 2024-04-15T21:02:48.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/684: dread - d23/d3c/fa6 zero size 2024-04-15T21:02:48.338 INFO:tasks.workunit.client.1.smithi149.stdout:0/879: dwrite d1/d9/d64/d65/d104/d119/d43/f6a [0,4194304] 0 2024-04-15T21:02:48.339 INFO:tasks.workunit.client.0.smithi072.stdout:5/506: rmdir d0/d3/d7 39 2024-04-15T21:02:48.339 INFO:tasks.workunit.client.0.smithi072.stdout:0/558: dwrite d0/d19/d2b/f4d [0,4194304] 0 2024-04-15T21:02:48.340 INFO:tasks.workunit.client.0.smithi072.stdout:0/559: fdatasync d0/d19/d71/db1/fbb 0 2024-04-15T21:02:48.341 INFO:tasks.workunit.client.1.smithi149.stdout:2/765: dwrite d4/d7/d46/de4/d21/d5e/f40 [0,4194304] 0 2024-04-15T21:02:48.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/776: fdatasync d1/db/d24/d39/fb9 0 2024-04-15T21:02:48.348 INFO:tasks.workunit.client.0.smithi072.stdout:4/546: mkdir d7/d71/db2 0 2024-04-15T21:02:48.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/662: write d1/db/d16/f24 [4530695,15744] 0 2024-04-15T21:02:48.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/820: unlink d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/c97 0 2024-04-15T21:02:48.360 INFO:tasks.workunit.client.0.smithi072.stdout:7/550: mknod d2/ca6 0 2024-04-15T21:02:48.361 INFO:tasks.workunit.client.1.smithi149.stdout:3/777: dwrite d1/db/d28/d87/dbd/f8f [4194304,4194304] 0 2024-04-15T21:02:48.362 INFO:tasks.workunit.client.0.smithi072.stdout:7/551: readlink d2/d7/d25/d2d/l50 0 2024-04-15T21:02:48.362 INFO:tasks.workunit.client.0.smithi072.stdout:7/552: chown d2/d7/d25/d2d/l57 1670096 1 2024-04-15T21:02:48.363 INFO:tasks.workunit.client.1.smithi149.stdout:3/778: dread - d1/db/d40/da0/fbb zero size 2024-04-15T21:02:48.367 INFO:tasks.workunit.client.0.smithi072.stdout:0/560: unlink d0/d6/d55/f68 0 2024-04-15T21:02:48.370 INFO:tasks.workunit.client.1.smithi149.stdout:1/663: creat d1/db/dc/d38/fbe x:0 0 0 2024-04-15T21:02:48.371 INFO:tasks.workunit.client.0.smithi072.stdout:1/526: creat d5/db/d27/d9c/fa7 x:0 0 0 2024-04-15T21:02:48.374 INFO:tasks.workunit.client.0.smithi072.stdout:6/512: rename d2/d10/d11/d15/c33 to d2/d10/d18/c9a 0 2024-04-15T21:02:48.376 INFO:tasks.workunit.client.1.smithi149.stdout:8/821: creat d2/d5b/dcd/d10a/d4e/d9f/f123 x:0 0 0 2024-04-15T21:02:48.377 INFO:tasks.workunit.client.1.smithi149.stdout:2/766: write d4/f18 [4660156,50205] 0 2024-04-15T21:02:48.378 INFO:tasks.workunit.client.0.smithi072.stdout:0/561: creat d0/d6/d6d/fc1 x:0 0 0 2024-04-15T21:02:48.380 INFO:tasks.workunit.client.0.smithi072.stdout:4/547: write d7/f55 [443458,101260] 0 2024-04-15T21:02:48.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/880: mkdir d1/d5/d24/d50/d13/d38/d44/d61/d11b/d135 0 2024-04-15T21:02:48.387 INFO:tasks.workunit.client.0.smithi072.stdout:5/507: rename d0/d3/d6/d14/d61 to d0/d3/d33/d60/d81/daf 0 2024-04-15T21:02:48.387 INFO:tasks.workunit.client.0.smithi072.stdout:5/508: write d0/d3/d33/d60/f8b [274176,79122] 0 2024-04-15T21:02:48.388 INFO:tasks.workunit.client.1.smithi149.stdout:9/685: dread d23/d3c/d7a/d7c/d7f/d86/dc5/fc9 [0,4194304] 0 2024-04-15T21:02:48.390 INFO:tasks.workunit.client.0.smithi072.stdout:5/509: chown d0/d3/d6/d14/la2 1 1 2024-04-15T21:02:48.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/767: creat d4/d7/d93/f10f x:0 0 0 2024-04-15T21:02:48.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/768: stat d4/d7/d93/dc3/c10e 0 2024-04-15T21:02:48.392 INFO:tasks.workunit.client.1.smithi149.stdout:2/769: readlink d4/d7/d46/de4/d21/d3b/ld3 0 2024-04-15T21:02:48.393 INFO:tasks.workunit.client.0.smithi072.stdout:5/510: truncate d0/d3/d33/d85/fa8 356472 0 2024-04-15T21:02:48.393 INFO:tasks.workunit.client.0.smithi072.stdout:2/525: sync 2024-04-15T21:02:48.393 INFO:tasks.workunit.client.0.smithi072.stdout:7/553: dwrite d2/d7/d25/d72/f9f [0,4194304] 0 2024-04-15T21:02:48.393 INFO:tasks.workunit.client.0.smithi072.stdout:0/562: mknod d0/d19/d71/cc2 0 2024-04-15T21:02:48.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/881: write d1/d9/d64/d65/faf [256950,75812] 0 2024-04-15T21:02:48.395 INFO:tasks.workunit.client.0.smithi072.stdout:7/554: readlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/l3b 0 2024-04-15T21:02:48.397 INFO:tasks.workunit.client.1.smithi149.stdout:9/686: mkdir d23/d3c/d87/de8 0 2024-04-15T21:02:48.400 INFO:tasks.workunit.client.1.smithi149.stdout:3/779: link d1/db/d24/d4d/d63/d65/fb1 d1/d81/ff2 0 2024-04-15T21:02:48.403 INFO:tasks.workunit.client.1.smithi149.stdout:1/664: truncate d1/f62 4131590 0 2024-04-15T21:02:48.405 INFO:tasks.workunit.client.1.smithi149.stdout:2/770: dread d4/d7/f85 [0,4194304] 0 2024-04-15T21:02:48.411 INFO:tasks.workunit.client.1.smithi149.stdout:6/633: sync 2024-04-15T21:02:48.413 INFO:tasks.workunit.client.1.smithi149.stdout:0/882: creat d1/d5/d24/d100/f136 x:0 0 0 2024-04-15T21:02:48.415 INFO:tasks.workunit.client.1.smithi149.stdout:2/771: creat d4/d7/d46/de4/d21/d3b/d10a/f110 x:0 0 0 2024-04-15T21:02:48.415 INFO:tasks.workunit.client.1.smithi149.stdout:9/687: mknod d23/d3c/d7a/d7c/d7f/d83/ce9 0 2024-04-15T21:02:48.416 INFO:tasks.workunit.client.1.smithi149.stdout:8/822: link d2/l1c d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/l124 0 2024-04-15T21:02:48.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/688: chown d23/d3c/d7a 30856988 1 2024-04-15T21:02:48.418 INFO:tasks.workunit.client.1.smithi149.stdout:1/665: creat d1/db/d14/d6b/fbf x:0 0 0 2024-04-15T21:02:48.420 INFO:tasks.workunit.client.1.smithi149.stdout:6/634: dread - da/d18/d33/fad zero size 2024-04-15T21:02:48.421 INFO:tasks.workunit.client.1.smithi149.stdout:1/666: dread d1/db/d14/f9d [0,4194304] 0 2024-04-15T21:02:48.422 INFO:tasks.workunit.client.1.smithi149.stdout:6/635: chown da/d18/d10/d66/l5a 28655 1 2024-04-15T21:02:48.423 INFO:tasks.workunit.client.1.smithi149.stdout:8/823: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda/c125 0 2024-04-15T21:02:48.423 INFO:tasks.workunit.client.1.smithi149.stdout:3/780: dread d1/db/d24/d4d/d63/d65/dc3/fd9 [0,4194304] 0 2024-04-15T21:02:48.427 INFO:tasks.workunit.client.1.smithi149.stdout:1/667: creat d1/d17/fc0 x:0 0 0 2024-04-15T21:02:48.427 INFO:tasks.workunit.client.1.smithi149.stdout:6/636: chown da/d32/lab 10210545 1 2024-04-15T21:02:48.428 INFO:tasks.workunit.client.1.smithi149.stdout:1/668: chown d1/db/dc/d38/d39/d88 63 1 2024-04-15T21:02:48.429 INFO:tasks.workunit.client.1.smithi149.stdout:8/824: fsync d2/d5b/dcd/d10a/d25/d57/dd1/fad 0 2024-04-15T21:02:48.431 INFO:tasks.workunit.client.1.smithi149.stdout:2/772: link d4/d7/da/lb5 d4/d7/d46/de4/d21/d2c/d32/d4a/dee/l111 0 2024-04-15T21:02:48.432 INFO:tasks.workunit.client.1.smithi149.stdout:2/773: chown d4/d7/d10/fc1 0 1 2024-04-15T21:02:48.432 INFO:tasks.workunit.client.1.smithi149.stdout:0/883: getdents d1/d9/d64/d73/da3 0 2024-04-15T21:02:48.433 INFO:tasks.workunit.client.1.smithi149.stdout:8/825: read d2/d5b/dcd/d10a/d25/d57/dd1/d46/f107 [1526717,39851] 0 2024-04-15T21:02:48.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/637: symlink da/d18/d10/d16/d97/dbf/d55/d82/lc5 0 2024-04-15T21:02:48.433 INFO:tasks.workunit.client.1.smithi149.stdout:2/774: truncate d4/f18 5225416 0 2024-04-15T21:02:48.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/826: chown d2/d16/l10b 1 1 2024-04-15T21:02:48.436 INFO:tasks.workunit.client.1.smithi149.stdout:8/827: write d2/d5b/dcd/d10a/d20/d6b/d109/f117 [599870,13848] 0 2024-04-15T21:02:48.437 INFO:tasks.workunit.client.1.smithi149.stdout:1/669: write d1/db/dc/d11/d3f/d45/dae/f82 [601538,74323] 0 2024-04-15T21:02:48.444 INFO:tasks.workunit.client.1.smithi149.stdout:8/828: rmdir d2/d5b/dcd/d10a/d25/d37 39 2024-04-15T21:02:48.445 INFO:tasks.workunit.client.1.smithi149.stdout:3/781: truncate d1/db/d24/d4d/d63/d65/fad 1733552 0 2024-04-15T21:02:48.446 INFO:tasks.workunit.client.1.smithi149.stdout:1/670: creat d1/db/dc/d11/d3f/d45/fc1 x:0 0 0 2024-04-15T21:02:48.446 INFO:tasks.workunit.client.1.smithi149.stdout:9/689: getdents d23/d3c 0 2024-04-15T21:02:48.446 INFO:tasks.workunit.client.1.smithi149.stdout:9/690: stat c13 0 2024-04-15T21:02:48.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/671: fdatasync d1/f5 0 2024-04-15T21:02:48.448 INFO:tasks.workunit.client.1.smithi149.stdout:0/884: symlink d1/l137 0 2024-04-15T21:02:48.448 INFO:tasks.workunit.client.1.smithi149.stdout:2/775: write d4/f5d [1621518,111638] 0 2024-04-15T21:02:48.450 INFO:tasks.workunit.client.1.smithi149.stdout:1/672: dread - d1/db/dc/d11/d3e/fba zero size 2024-04-15T21:02:48.451 INFO:tasks.workunit.client.0.smithi072.stdout:0/563: creat d0/d45/d35/d3a/fc3 x:0 0 0 2024-04-15T21:02:48.452 INFO:tasks.workunit.client.0.smithi072.stdout:6/513: dwrite d2/d10/d11/d1f/d60/f64 [0,4194304] 0 2024-04-15T21:02:48.453 INFO:tasks.workunit.client.0.smithi072.stdout:4/548: dread f6 [0,4194304] 0 2024-04-15T21:02:48.454 INFO:tasks.workunit.client.0.smithi072.stdout:4/549: dread - d7/d10/d41/d44/f8e zero size 2024-04-15T21:02:48.455 INFO:tasks.workunit.client.0.smithi072.stdout:1/527: getdents d5/db/d27/d8a 0 2024-04-15T21:02:48.459 INFO:tasks.workunit.client.1.smithi149.stdout:6/638: link da/d18/d10/d16/d97/dbf/d55/d82/lc5 da/d18/d7d/lc6 0 2024-04-15T21:02:48.462 INFO:tasks.workunit.client.1.smithi149.stdout:9/691: dwrite d23/d2b/d37/d6d/f74 [4194304,4194304] 0 2024-04-15T21:02:48.463 INFO:tasks.workunit.client.0.smithi072.stdout:6/514: unlink d2/fa 0 2024-04-15T21:02:48.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/776: dwrite d4/d7/d93/fde [0,4194304] 0 2024-04-15T21:02:48.470 INFO:tasks.workunit.client.1.smithi149.stdout:1/673: dwrite d1/f5 [0,4194304] 0 2024-04-15T21:02:48.474 INFO:tasks.workunit.client.1.smithi149.stdout:0/885: rename d1/lc6 to d1/d9/d64/d73/da3/l138 0 2024-04-15T21:02:48.474 INFO:tasks.workunit.client.1.smithi149.stdout:1/674: readlink d1/db/dc/d11/d3f/d45/dae/lbc 0 2024-04-15T21:02:48.474 INFO:tasks.workunit.client.1.smithi149.stdout:2/777: chown d4/d7/d46/de4/d21/d2c/l34 0 1 2024-04-15T21:02:48.479 INFO:tasks.workunit.client.1.smithi149.stdout:5/695: sync 2024-04-15T21:02:48.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/767: sync 2024-04-15T21:02:48.479 INFO:tasks.workunit.client.1.smithi149.stdout:7/693: sync 2024-04-15T21:02:48.480 INFO:tasks.workunit.client.0.smithi072.stdout:5/511: rename d0/d3/d7/l77 to d0/d3/d7/d94/d92/da0/da7/lb0 0 2024-04-15T21:02:48.480 INFO:tasks.workunit.client.1.smithi149.stdout:4/768: truncate dc/d2c/d3e/d15/f99 1806767 0 2024-04-15T21:02:48.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/782: creat d1/db/ff3 x:0 0 0 2024-04-15T21:02:48.486 INFO:tasks.workunit.client.1.smithi149.stdout:3/783: fdatasync d1/d81/fd0 0 2024-04-15T21:02:48.489 INFO:tasks.workunit.client.1.smithi149.stdout:6/639: symlink da/d60/lc7 0 2024-04-15T21:02:48.490 INFO:tasks.workunit.client.0.smithi072.stdout:7/555: dwrite d2/d7/d25/d4c/f59 [0,4194304] 0 2024-04-15T21:02:48.491 INFO:tasks.workunit.client.1.smithi149.stdout:6/640: dread - da/d11/fc2 zero size 2024-04-15T21:02:48.496 INFO:tasks.workunit.client.1.smithi149.stdout:3/784: dread d1/db/d24/d4d/d63/faa [0,4194304] 0 2024-04-15T21:02:48.497 INFO:tasks.workunit.client.1.smithi149.stdout:3/785: chown d1/db/fe6 4985 1 2024-04-15T21:02:48.501 INFO:tasks.workunit.client.0.smithi072.stdout:0/564: rename d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f9b to d0/d19/fc4 0 2024-04-15T21:02:48.502 INFO:tasks.workunit.client.0.smithi072.stdout:8/573: sync 2024-04-15T21:02:48.503 INFO:tasks.workunit.client.0.smithi072.stdout:9/539: sync 2024-04-15T21:02:48.503 INFO:tasks.workunit.client.0.smithi072.stdout:8/574: chown d3/de/d81 6 1 2024-04-15T21:02:48.506 INFO:tasks.workunit.client.0.smithi072.stdout:4/550: symlink d7/d71/db2/lb3 0 2024-04-15T21:02:48.509 INFO:tasks.workunit.client.0.smithi072.stdout:8/575: dwrite d3/d4/f91 [0,4194304] 0 2024-04-15T21:02:48.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/692: dwrite d23/d71/dbf/fd8 [0,4194304] 0 2024-04-15T21:02:48.511 INFO:tasks.workunit.client.1.smithi149.stdout:9/693: truncate d23/d71/fdf 788666 0 2024-04-15T21:02:48.512 INFO:tasks.workunit.client.1.smithi149.stdout:8/829: getdents d2/d5b/dcd/d10a/d20/d6b/d109 0 2024-04-15T21:02:48.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/769: rename dc/d2c/d3e/d35/d4b/d75/d80/fd1 to dc/ffe 0 2024-04-15T21:02:48.520 INFO:tasks.workunit.client.1.smithi149.stdout:1/675: dwrite d1/d17/d36/f71 [0,4194304] 0 2024-04-15T21:02:48.524 INFO:tasks.workunit.client.0.smithi072.stdout:6/515: rename d2/d10/d11/d15/c25 to d2/d10/d11/d1f/d60/c9b 0 2024-04-15T21:02:48.524 INFO:tasks.workunit.client.1.smithi149.stdout:6/641: rmdir da/d18/d10/d16/d97/dbf 39 2024-04-15T21:02:48.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/694: dwrite d3/f7 [0,4194304] 0 2024-04-15T21:02:48.525 INFO:tasks.workunit.client.0.smithi072.stdout:0/565: creat d0/d19/d71/d9e/fc5 x:0 0 0 2024-04-15T21:02:48.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/676: dread d1/db/f8d [0,4194304] 0 2024-04-15T21:02:48.528 INFO:tasks.workunit.client.0.smithi072.stdout:9/540: creat d4/d76/d8f/fa2 x:0 0 0 2024-04-15T21:02:48.529 INFO:tasks.workunit.client.1.smithi149.stdout:2/778: mkdir d4/d7/d46/de4/d21/d3b/d10a/dfd/d112 0 2024-04-15T21:02:48.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/541: chown d4/d1f/d9e 268 1 2024-04-15T21:02:48.532 INFO:tasks.workunit.client.1.smithi149.stdout:5/696: mknod d0/d6/d82/da1/d12/d16/da9/cdf 0 2024-04-15T21:02:48.532 INFO:tasks.workunit.client.0.smithi072.stdout:9/542: stat d4/c4a 0 2024-04-15T21:02:48.534 INFO:tasks.workunit.client.0.smithi072.stdout:1/528: rmdir d5/db/d2d/d3a/d1f/d9d 0 2024-04-15T21:02:48.534 INFO:tasks.workunit.client.1.smithi149.stdout:1/677: dwrite d1/db/d16/f7c [0,4194304] 0 2024-04-15T21:02:48.535 INFO:tasks.workunit.client.1.smithi149.stdout:1/678: chown d1/db/dc/fa4 297413 1 2024-04-15T21:02:48.536 INFO:tasks.workunit.client.0.smithi072.stdout:6/516: dwrite d2/d1a/f75 [0,4194304] 0 2024-04-15T21:02:48.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/779: read d4/d7/d46/fe2 [353121,41712] 0 2024-04-15T21:02:48.539 INFO:tasks.workunit.client.0.smithi072.stdout:6/517: chown d2 370 1 2024-04-15T21:02:48.542 INFO:tasks.workunit.client.0.smithi072.stdout:0/566: dwrite d0/d45/d7a/f2a [0,4194304] 0 2024-04-15T21:02:48.544 INFO:tasks.workunit.client.0.smithi072.stdout:9/543: symlink d4/d1f/d2c/d47/la3 0 2024-04-15T21:02:48.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/642: rmdir da/d18/d7d 39 2024-04-15T21:02:48.545 INFO:tasks.workunit.client.0.smithi072.stdout:1/529: mknod d5/d3d/d5e/ca8 0 2024-04-15T21:02:48.547 INFO:tasks.workunit.client.0.smithi072.stdout:7/556: dwrite d2/d7/d25/f71 [0,4194304] 0 2024-04-15T21:02:48.548 INFO:tasks.workunit.client.0.smithi072.stdout:8/576: truncate d3/de/f20 125480 0 2024-04-15T21:02:48.548 INFO:tasks.workunit.client.0.smithi072.stdout:5/512: getdents d0/d3/d7/d1f/d4c 0 2024-04-15T21:02:48.549 INFO:tasks.workunit.client.0.smithi072.stdout:1/530: chown d5/db/d2d/d3a/d1f 3520 1 2024-04-15T21:02:48.550 INFO:tasks.workunit.client.0.smithi072.stdout:7/557: stat d2/fa 0 2024-04-15T21:02:48.551 INFO:tasks.workunit.client.0.smithi072.stdout:3/548: sync 2024-04-15T21:02:48.552 INFO:tasks.workunit.client.0.smithi072.stdout:3/549: chown d1/d5b/f62 164006032 1 2024-04-15T21:02:48.554 INFO:tasks.workunit.client.1.smithi149.stdout:5/697: unlink d0/c77 0 2024-04-15T21:02:48.556 INFO:tasks.workunit.client.0.smithi072.stdout:0/567: rename d0/d45/d35/f89 to d0/d19/d96/fc6 0 2024-04-15T21:02:48.557 INFO:tasks.workunit.client.0.smithi072.stdout:7/558: dwrite d2/d7/d25/d2d/d47/f4a [0,4194304] 0 2024-04-15T21:02:48.558 INFO:tasks.workunit.client.0.smithi072.stdout:9/544: mknod d4/d29/d4c/d74/d84/ca4 0 2024-04-15T21:02:48.559 INFO:tasks.workunit.client.0.smithi072.stdout:9/545: readlink d4/d29/l61 0 2024-04-15T21:02:48.559 INFO:tasks.workunit.client.1.smithi149.stdout:9/694: link f1f d23/d71/fea 0 2024-04-15T21:02:48.560 INFO:tasks.workunit.client.1.smithi149.stdout:4/770: mkdir dc/d18/d21/dfa/dff 0 2024-04-15T21:02:48.560 INFO:tasks.workunit.client.0.smithi072.stdout:1/531: truncate d5/f8f 784841 0 2024-04-15T21:02:48.561 INFO:tasks.workunit.client.0.smithi072.stdout:5/513: mknod d0/d3/d33/cb1 0 2024-04-15T21:02:48.562 INFO:tasks.workunit.client.0.smithi072.stdout:5/514: chown d0/d3/f83 2097085 1 2024-04-15T21:02:48.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/830: rename d2/d5b/dcd/d10a/d34/l6f to d2/d5b/dcd/d10a/d25/d32/d45/d77/d121/l126 0 2024-04-15T21:02:48.575 INFO:tasks.workunit.client.0.smithi072.stdout:4/551: write d7/d23/f2a [4211777,96647] 0 2024-04-15T21:02:48.576 INFO:tasks.workunit.client.1.smithi149.stdout:0/886: getdents d1 0 2024-04-15T21:02:48.578 INFO:tasks.workunit.client.0.smithi072.stdout:3/550: mknod d1/d15/d32/d2f/d1a/cb1 0 2024-04-15T21:02:48.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/786: creat d1/ff4 x:0 0 0 2024-04-15T21:02:48.582 INFO:tasks.workunit.client.0.smithi072.stdout:0/568: creat d0/d6/fc7 x:0 0 0 2024-04-15T21:02:48.584 INFO:tasks.workunit.client.0.smithi072.stdout:0/569: write d0/d45/d7a/f2a [734546,81746] 0 2024-04-15T21:02:48.585 INFO:tasks.workunit.client.1.smithi149.stdout:5/698: truncate d0/d6/f65 1440306 0 2024-04-15T21:02:48.586 INFO:tasks.workunit.client.0.smithi072.stdout:5/515: dread d0/d3/d7/d12/d31/d55/f32 [0,4194304] 0 2024-04-15T21:02:48.590 INFO:tasks.workunit.client.0.smithi072.stdout:1/532: rename d5/d3d/d5e/f97 to d5/db/d2d/d3a/d1f/d63/fa9 0 2024-04-15T21:02:48.591 INFO:tasks.workunit.client.0.smithi072.stdout:6/518: write d2/d40/d56/f6c [87781,19397] 0 2024-04-15T21:02:48.592 INFO:tasks.workunit.client.1.smithi149.stdout:9/695: rmdir d23/d3c/d87 39 2024-04-15T21:02:48.601 INFO:tasks.workunit.client.1.smithi149.stdout:4/771: rename c0 to dc/d8f/c100 0 2024-04-15T21:02:48.604 INFO:tasks.workunit.client.1.smithi149.stdout:2/780: unlink d4/d7/d46/de4/d21/d3b/f7f 0 2024-04-15T21:02:48.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/781: read d4/d7/d46/de4/d21/d5e/fb9 [1753634,40890] 0 2024-04-15T21:02:48.606 INFO:tasks.workunit.client.0.smithi072.stdout:7/559: mkdir d2/da7 0 2024-04-15T21:02:48.607 INFO:tasks.workunit.client.1.smithi149.stdout:0/887: creat d1/d29/d2c/d4f/f139 x:0 0 0 2024-04-15T21:02:48.607 INFO:tasks.workunit.client.0.smithi072.stdout:2/526: sync 2024-04-15T21:02:48.608 INFO:tasks.workunit.client.0.smithi072.stdout:2/527: dread - d2/d64/f87 zero size 2024-04-15T21:02:48.610 INFO:tasks.workunit.client.0.smithi072.stdout:7/560: rename d2/d7/d25/d2d/d46 to d2/d7/d25/d2d/d46/d5a/d5f/d43/da8 22 2024-04-15T21:02:48.610 INFO:tasks.workunit.client.0.smithi072.stdout:9/546: creat d4/d1f/d31/d9b/fa5 x:0 0 0 2024-04-15T21:02:48.611 INFO:tasks.workunit.client.0.smithi072.stdout:2/528: chown d2/d8/d41/c55 940 1 2024-04-15T21:02:48.611 INFO:tasks.workunit.client.0.smithi072.stdout:8/577: dwrite d3/de/d1b/d41/da4/d2e/f5c [4194304,4194304] 0 2024-04-15T21:02:48.612 INFO:tasks.workunit.client.0.smithi072.stdout:8/578: readlink d3/d4/d4c/l1c 0 2024-04-15T21:02:48.613 INFO:tasks.workunit.client.0.smithi072.stdout:8/579: stat d3/d4/d3b/f6e 0 2024-04-15T21:02:48.617 INFO:tasks.workunit.client.1.smithi149.stdout:1/679: creat d1/fc2 x:0 0 0 2024-04-15T21:02:48.618 INFO:tasks.workunit.client.1.smithi149.stdout:1/680: stat d1/db/d14/d6b/fbf 0 2024-04-15T21:02:48.622 INFO:tasks.workunit.client.1.smithi149.stdout:4/772: readlink dc/lb8 0 2024-04-15T21:02:48.623 INFO:tasks.workunit.client.0.smithi072.stdout:3/551: dwrite d1/d15/d40/f22 [4194304,4194304] 0 2024-04-15T21:02:48.624 INFO:tasks.workunit.client.0.smithi072.stdout:3/552: write d1/d15/d32/f81 [221106,128733] 0 2024-04-15T21:02:48.624 INFO:tasks.workunit.client.1.smithi149.stdout:8/831: dwrite d2/f1b [4194304,4194304] 0 2024-04-15T21:02:48.626 INFO:tasks.workunit.client.1.smithi149.stdout:9/696: rename d23/d3c/d7a/d7c to d23/d46/dcf/deb 0 2024-04-15T21:02:48.630 INFO:tasks.workunit.client.1.smithi149.stdout:0/888: chown d1/d5/d24/d50/d13/d38/fd1 7 1 2024-04-15T21:02:48.633 INFO:tasks.workunit.client.1.smithi149.stdout:6/643: link da/d11/c51 da/d11/dbe/cc8 0 2024-04-15T21:02:48.633 INFO:tasks.workunit.client.0.smithi072.stdout:5/516: link d0/d3/d7/d12/d31/d55/f32 d0/d3/d6/d14/fb2 0 2024-04-15T21:02:48.635 INFO:tasks.workunit.client.1.smithi149.stdout:5/699: write d0/d9/d71/fa5 [390445,129738] 0 2024-04-15T21:02:48.639 INFO:tasks.workunit.client.1.smithi149.stdout:7/695: getdents d3/d16/d32/d90/dad/dc4 0 2024-04-15T21:02:48.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/696: chown d3/f2d 9735971 1 2024-04-15T21:02:48.641 INFO:tasks.workunit.client.0.smithi072.stdout:9/547: rename d4/d1f/d31/d42/l60 to d4/d1f/d9e/la6 0 2024-04-15T21:02:48.644 INFO:tasks.workunit.client.0.smithi072.stdout:8/580: unlink d3/de/c71 0 2024-04-15T21:02:48.645 INFO:tasks.workunit.client.1.smithi149.stdout:1/681: mkdir d1/db/dc/d38/d39/d43/daa/d8a/dc3 0 2024-04-15T21:02:48.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/773: dread dc/d2c/d3e/d35/d3a/f65 [0,4194304] 0 2024-04-15T21:02:48.651 INFO:tasks.workunit.client.1.smithi149.stdout:4/774: fsync fa 0 2024-04-15T21:02:48.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/697: creat d23/d46/fec x:0 0 0 2024-04-15T21:02:48.652 INFO:tasks.workunit.client.0.smithi072.stdout:8/581: write d3/de/d1b/d41/da4/d2e/f5c [9033265,113386] 0 2024-04-15T21:02:48.653 INFO:tasks.workunit.client.0.smithi072.stdout:4/552: creat d7/d10/d41/fb4 x:0 0 0 2024-04-15T21:02:48.656 INFO:tasks.workunit.client.1.smithi149.stdout:8/832: creat d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/d9d/dc0/f127 x:0 0 0 2024-04-15T21:02:48.658 INFO:tasks.workunit.client.1.smithi149.stdout:4/775: dwrite dc/d2c/d3e/d15/d5b/f71 [0,4194304] 0 2024-04-15T21:02:48.662 INFO:tasks.workunit.client.1.smithi149.stdout:3/787: dwrite d1/db/d24/d4d/d63/d65/f91 [0,4194304] 0 2024-04-15T21:02:48.663 INFO:tasks.workunit.client.0.smithi072.stdout:3/553: unlink d1/d3f/la9 0 2024-04-15T21:02:48.663 INFO:tasks.workunit.client.0.smithi072.stdout:3/554: dread - d1/d5b/f62 zero size 2024-04-15T21:02:48.665 INFO:tasks.workunit.client.0.smithi072.stdout:5/517: creat d0/d3/d33/d60/fb3 x:0 0 0 2024-04-15T21:02:48.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/697: rename d3/d16/d32/f84 to d3/d34/db6/dfb/ffd 0 2024-04-15T21:02:48.670 INFO:tasks.workunit.client.0.smithi072.stdout:1/533: dwrite d5/f17 [0,4194304] 0 2024-04-15T21:02:48.676 INFO:tasks.workunit.client.0.smithi072.stdout:7/561: rename d2/d7/d25/d2d/l50 to d2/d7/d25/d2d/d46/la9 0 2024-04-15T21:02:48.677 INFO:tasks.workunit.client.0.smithi072.stdout:7/562: write d2/d7/d25/d2d/d46/d5a/d5f/f2a [4578353,68722] 0 2024-04-15T21:02:48.680 INFO:tasks.workunit.client.1.smithi149.stdout:8/833: mkdir d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/d128 0 2024-04-15T21:02:48.681 INFO:tasks.workunit.client.0.smithi072.stdout:6/519: link d2/l3e d2/d40/d56/d95/l9c 0 2024-04-15T21:02:48.682 INFO:tasks.workunit.client.1.smithi149.stdout:8/834: dread - d2/d5b/dcd/d10a/d4e/d9f/f123 zero size 2024-04-15T21:02:48.682 INFO:tasks.workunit.client.1.smithi149.stdout:4/776: write dc/d2c/d3e/d15/f99 [1981329,114035] 0 2024-04-15T21:02:48.683 INFO:tasks.workunit.client.1.smithi149.stdout:8/835: readlink d2/d5b/dcd/d10a/d25/d57/dd1/l61 0 2024-04-15T21:02:48.684 INFO:tasks.workunit.client.1.smithi149.stdout:8/836: fsync d2/d5b/dcd/d10a/d4e/d9f/f116 0 2024-04-15T21:02:48.686 INFO:tasks.workunit.client.1.smithi149.stdout:8/837: dread - d2/d5b/dcd/d10a/d4e/d9f/f123 zero size 2024-04-15T21:02:48.686 INFO:tasks.workunit.client.1.smithi149.stdout:6/644: creat da/d18/d10/d16/d97/dbf/fc9 x:0 0 0 2024-04-15T21:02:48.687 INFO:tasks.workunit.client.1.smithi149.stdout:3/788: symlink d1/db/d40/da0/lf5 0 2024-04-15T21:02:48.688 INFO:tasks.workunit.client.1.smithi149.stdout:3/789: readlink d1/db/l7b 0 2024-04-15T21:02:48.689 INFO:tasks.workunit.client.0.smithi072.stdout:2/529: rename d2/d8/d6c to d2/d8/daa 0 2024-04-15T21:02:48.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/530: fsync d2/d8/f72 0 2024-04-15T21:02:48.694 INFO:tasks.workunit.client.0.smithi072.stdout:0/570: rename d0/d6/d6d/d87 to d0/d19/d96/dad/dc8 0 2024-04-15T21:02:48.696 INFO:tasks.workunit.client.1.smithi149.stdout:7/698: dread d3/d17/d1f/f22 [0,4194304] 0 2024-04-15T21:02:48.698 INFO:tasks.workunit.client.0.smithi072.stdout:7/563: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/faa x:0 0 0 2024-04-15T21:02:48.698 INFO:tasks.workunit.client.0.smithi072.stdout:7/564: fsync d2/d7/d25/d2d/d47/d7e/fa3 0 2024-04-15T21:02:48.699 INFO:tasks.workunit.client.0.smithi072.stdout:6/520: readlink d2/d40/d6e/l92 0 2024-04-15T21:02:48.700 INFO:tasks.workunit.client.0.smithi072.stdout:6/521: dread - d2/d40/d56/d6a/d70/d49/f91 zero size 2024-04-15T21:02:48.701 INFO:tasks.workunit.client.0.smithi072.stdout:0/571: dread d0/d45/d7a/d70/d59/d8a/fa6 [0,4194304] 0 2024-04-15T21:02:48.704 INFO:tasks.workunit.client.1.smithi149.stdout:3/790: creat d1/db/d24/d4d/d63/db6/ff6 x:0 0 0 2024-04-15T21:02:48.705 INFO:tasks.workunit.client.0.smithi072.stdout:0/572: dread d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:48.706 INFO:tasks.workunit.client.1.smithi149.stdout:6/645: dread da/d18/d10/d66/f69 [8388608,4194304] 0 2024-04-15T21:02:48.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/646: stat da/d18/f87 0 2024-04-15T21:02:48.710 INFO:tasks.workunit.client.1.smithi149.stdout:9/698: unlink d23/d2b/d37/d6d/db8/lc4 0 2024-04-15T21:02:48.711 INFO:tasks.workunit.client.0.smithi072.stdout:1/534: mkdir d5/db/daa 0 2024-04-15T21:02:48.712 INFO:tasks.workunit.client.1.smithi149.stdout:8/838: dwrite d2/d5b/dcd/d10a/d25/d37/d53/daf/ff8 [0,4194304] 0 2024-04-15T21:02:48.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/777: mknod dc/d2c/d3e/c101 0 2024-04-15T21:02:48.713 INFO:tasks.workunit.client.1.smithi149.stdout:9/699: fsync d23/d3c/f4e 0 2024-04-15T21:02:48.714 INFO:tasks.workunit.client.0.smithi072.stdout:2/531: symlink d2/d64/lab 0 2024-04-15T21:02:48.716 INFO:tasks.workunit.client.1.smithi149.stdout:1/682: dwrite d1/db/dc/d38/d39/d43/f8f [0,4194304] 0 2024-04-15T21:02:48.718 INFO:tasks.workunit.client.1.smithi149.stdout:7/699: dread d3/d16/d20/f41 [0,4194304] 0 2024-04-15T21:02:48.722 INFO:tasks.workunit.client.0.smithi072.stdout:4/553: dwrite d7/fc [0,4194304] 0 2024-04-15T21:02:48.727 INFO:tasks.workunit.client.1.smithi149.stdout:1/683: rename d1/db/dc/d38/d39/d43/daa to d1/db/dc/d38/d39/d43/daa/dc4 22 2024-04-15T21:02:48.729 INFO:tasks.workunit.client.1.smithi149.stdout:1/684: write d1/db/dc/fa4 [4796659,56840] 0 2024-04-15T21:02:48.729 INFO:tasks.workunit.client.0.smithi072.stdout:7/565: rmdir d2/d7/d25 39 2024-04-15T21:02:48.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/582: truncate d3/de/d1b/d44/f78 2088595 0 2024-04-15T21:02:48.740 INFO:tasks.workunit.client.0.smithi072.stdout:0/573: mknod d0/d19/d58/cc9 0 2024-04-15T21:02:48.741 INFO:tasks.workunit.client.0.smithi072.stdout:0/574: fsync d0/d19/d2b/f4d 0 2024-04-15T21:02:48.742 INFO:tasks.workunit.client.0.smithi072.stdout:0/575: chown d0/fb3 114 1 2024-04-15T21:02:48.742 INFO:tasks.workunit.client.1.smithi149.stdout:8/839: mkdir d2/d5b/dcd/d10a/d4e/d9f/d129 0 2024-04-15T21:02:48.745 INFO:tasks.workunit.client.0.smithi072.stdout:5/518: creat d0/d3/d7/fb4 x:0 0 0 2024-04-15T21:02:48.746 INFO:tasks.workunit.client.1.smithi149.stdout:4/778: creat dc/d2c/d3e/d35/d4b/d75/db3/f102 x:0 0 0 2024-04-15T21:02:48.748 INFO:tasks.workunit.client.1.smithi149.stdout:6/647: dread da/d18/d10/f42 [0,4194304] 0 2024-04-15T21:02:48.749 INFO:tasks.workunit.client.0.smithi072.stdout:1/535: rename d5/db/d2d/d3a/f61 to d5/d31/fab 0 2024-04-15T21:02:48.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/791: write d1/db/d24/f8b [79253,52108] 0 2024-04-15T21:02:48.752 INFO:tasks.workunit.client.1.smithi149.stdout:9/700: mkdir d23/d46/dcf/deb/d7f/d83/ded 0 2024-04-15T21:02:48.753 INFO:tasks.workunit.client.0.smithi072.stdout:9/548: link d4/d1f/f54 d4/fa7 0 2024-04-15T21:02:48.753 INFO:tasks.workunit.client.0.smithi072.stdout:8/583: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:48.758 INFO:tasks.workunit.client.1.smithi149.stdout:1/685: dread d1/db/dc/d38/d39/d43/f54 [0,4194304] 0 2024-04-15T21:02:48.760 INFO:tasks.workunit.client.0.smithi072.stdout:8/584: dwrite d3/d4/d4d/f73 [4194304,4194304] 0 2024-04-15T21:02:48.761 INFO:tasks.workunit.client.0.smithi072.stdout:6/522: link d2/f14 d2/d40/d56/d6a/f9d 0 2024-04-15T21:02:48.766 INFO:tasks.workunit.client.0.smithi072.stdout:4/554: write d7/d15/d58/d62/d6f/f9e [4606334,126065] 0 2024-04-15T21:02:48.767 INFO:tasks.workunit.client.0.smithi072.stdout:8/585: dwrite d3/de/f24 [4194304,4194304] 0 2024-04-15T21:02:48.769 INFO:tasks.workunit.client.0.smithi072.stdout:6/523: dwrite d2/d40/d56/f98 [0,4194304] 0 2024-04-15T21:02:48.771 INFO:tasks.workunit.client.0.smithi072.stdout:6/524: write d2/d40/d56/f8a [197701,24775] 0 2024-04-15T21:02:48.773 INFO:tasks.workunit.client.0.smithi072.stdout:5/519: rename d0/d3/d7/d12/d31/d55/c48 to d0/d3/d7/d94/d92/cb5 0 2024-04-15T21:02:48.776 INFO:tasks.workunit.client.0.smithi072.stdout:5/520: read d0/d3/d7/d12/d31/d49/f84 [1237763,102271] 0 2024-04-15T21:02:48.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/525: dwrite d2/d40/d56/f98 [0,4194304] 0 2024-04-15T21:02:48.779 INFO:tasks.workunit.client.0.smithi072.stdout:6/526: readlink d2/d1a/l6b 0 2024-04-15T21:02:48.781 INFO:tasks.workunit.client.0.smithi072.stdout:9/549: mknod d4/d29/d4c/ca8 0 2024-04-15T21:02:48.790 INFO:tasks.workunit.client.0.smithi072.stdout:7/566: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab x:0 0 0 2024-04-15T21:02:48.797 INFO:tasks.workunit.client.0.smithi072.stdout:7/567: dwrite d2/d7/d25/d4c/f59 [4194304,4194304] 0 2024-04-15T21:02:48.801 INFO:tasks.workunit.client.0.smithi072.stdout:4/555: symlink d7/d15/d58/d62/d6f/lb5 0 2024-04-15T21:02:48.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/586: mknod d3/de/d1b/d41/da4/d2e/cb0 0 2024-04-15T21:02:48.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/587: stat d3/de/l2b 0 2024-04-15T21:02:48.803 INFO:tasks.workunit.client.0.smithi072.stdout:4/556: dread d7/d15/d58/d62/f90 [0,4194304] 0 2024-04-15T21:02:48.803 INFO:tasks.workunit.client.0.smithi072.stdout:8/588: chown d3/de/d1b/c28 38 1 2024-04-15T21:02:48.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/589: dwrite d3/de/d1b/f62 [0,4194304] 0 2024-04-15T21:02:48.810 INFO:tasks.workunit.client.0.smithi072.stdout:5/521: mkdir d0/d3/d7/d12/d31/d62/db6 0 2024-04-15T21:02:48.811 INFO:tasks.workunit.client.0.smithi072.stdout:8/590: write d3/de/d1b/d41/fa9 [224767,83148] 0 2024-04-15T21:02:48.812 INFO:tasks.workunit.client.0.smithi072.stdout:5/522: dread - d0/d3/d33/d60/fb3 zero size 2024-04-15T21:02:48.820 INFO:tasks.workunit.client.0.smithi072.stdout:9/550: creat d4/d76/fa9 x:0 0 0 2024-04-15T21:02:48.823 INFO:tasks.workunit.client.0.smithi072.stdout:7/568: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/lac 0 2024-04-15T21:02:48.847 INFO:tasks.workunit.client.0.smithi072.stdout:3/555: sync 2024-04-15T21:02:48.869 INFO:tasks.workunit.client.0.smithi072.stdout:4/557: truncate d7/d23/f29 2445556 0 2024-04-15T21:02:48.888 INFO:tasks.workunit.client.0.smithi072.stdout:8/591: rmdir d3/d4/d76 39 2024-04-15T21:02:48.891 INFO:tasks.workunit.client.0.smithi072.stdout:2/532: link d2/f44 d2/d64/fac 0 2024-04-15T21:02:48.893 INFO:tasks.workunit.client.0.smithi072.stdout:6/527: symlink d2/d40/d56/d95/l9e 0 2024-04-15T21:02:48.893 INFO:tasks.workunit.client.0.smithi072.stdout:6/528: chown d2/d10/d18/l7e 334 1 2024-04-15T21:02:48.895 INFO:tasks.workunit.client.0.smithi072.stdout:9/551: rename d4/d29/f59 to d4/d76/d8f/faa 0 2024-04-15T21:02:48.896 INFO:tasks.workunit.client.0.smithi072.stdout:7/569: unlink d2/c70 0 2024-04-15T21:02:48.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/779: creat dc/d18/d21/d81/f103 x:0 0 0 2024-04-15T21:02:48.900 INFO:tasks.workunit.client.0.smithi072.stdout:0/576: getdents d0/d74/d94 0 2024-04-15T21:02:48.901 INFO:tasks.workunit.client.0.smithi072.stdout:7/570: chown d2/d7/d25/d2d/d46/d5a/d5f/l4d 28 1 2024-04-15T21:02:48.901 INFO:tasks.workunit.client.1.smithi149.stdout:4/780: readlink dc/d8f/lb1 0 2024-04-15T21:02:48.901 INFO:tasks.workunit.client.0.smithi072.stdout:7/571: stat d2/d7/d25/d72/l99 0 2024-04-15T21:02:48.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/648: dread - da/d18/d10/d16/f9a zero size 2024-04-15T21:02:48.902 INFO:tasks.workunit.client.0.smithi072.stdout:8/592: rmdir d3/de/d1b/d41/d74/d98 39 2024-04-15T21:02:48.907 INFO:tasks.workunit.client.0.smithi072.stdout:2/533: mknod d2/d66/cad 0 2024-04-15T21:02:48.908 INFO:tasks.workunit.client.1.smithi149.stdout:4/781: dwrite dc/d2c/d3e/d35/ffb [0,4194304] 0 2024-04-15T21:02:48.911 INFO:tasks.workunit.client.0.smithi072.stdout:6/529: creat d2/d10/d11/d1f/d60/f9f x:0 0 0 2024-04-15T21:02:48.914 INFO:tasks.workunit.client.0.smithi072.stdout:9/552: rmdir d4/d1f/d31/d42 39 2024-04-15T21:02:48.919 INFO:tasks.workunit.client.1.smithi149.stdout:3/792: mknod d1/db/d24/cf7 0 2024-04-15T21:02:48.923 INFO:tasks.workunit.client.1.smithi149.stdout:6/649: dread da/d18/d10/f1c [0,4194304] 0 2024-04-15T21:02:48.923 INFO:tasks.workunit.client.1.smithi149.stdout:7/700: link d3/d16/l2a d3/d16/d20/d9c/lfe 0 2024-04-15T21:02:48.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/650: fsync da/f1b 0 2024-04-15T21:02:48.925 INFO:tasks.workunit.client.0.smithi072.stdout:5/523: dwrite d0/d3/d6/f8 [0,4194304] 0 2024-04-15T21:02:48.927 INFO:tasks.workunit.client.1.smithi149.stdout:4/782: creat dc/ddf/f104 x:0 0 0 2024-04-15T21:02:48.931 INFO:tasks.workunit.client.1.smithi149.stdout:8/840: creat d2/d5b/dcd/d10a/d25/d57/dd1/f12a x:0 0 0 2024-04-15T21:02:48.938 INFO:tasks.workunit.client.0.smithi072.stdout:5/524: dread d0/d3/d7/d12/f54 [0,4194304] 0 2024-04-15T21:02:48.942 INFO:tasks.workunit.client.0.smithi072.stdout:5/525: dwrite d0/d3/d7/d1f/d4c/f5d [4194304,4194304] 0 2024-04-15T21:02:48.944 INFO:tasks.workunit.client.0.smithi072.stdout:9/553: dread d4/f13 [0,4194304] 0 2024-04-15T21:02:48.945 INFO:tasks.workunit.client.0.smithi072.stdout:9/554: write d4/d1f/d2c/d62/f96 [86848,50552] 0 2024-04-15T21:02:48.947 INFO:tasks.workunit.client.1.smithi149.stdout:9/701: rename d23/d3c/ld6 to d23/d46/dcf/deb/lee 0 2024-04-15T21:02:48.948 INFO:tasks.workunit.client.1.smithi149.stdout:9/702: dread - d23/d2b/d37/d50/d69/fde zero size 2024-04-15T21:02:48.948 INFO:tasks.workunit.client.1.smithi149.stdout:9/703: chown d23/d2b/dd3 50870 1 2024-04-15T21:02:48.951 INFO:tasks.workunit.client.1.smithi149.stdout:7/701: dread d3/d16/d20/d36/d3d/f80 [0,4194304] 0 2024-04-15T21:02:48.956 INFO:tasks.workunit.client.1.smithi149.stdout:4/783: dread dc/fa8 [0,4194304] 0 2024-04-15T21:02:48.956 INFO:tasks.workunit.client.1.smithi149.stdout:3/793: mknod d1/db/cf8 0 2024-04-15T21:02:48.958 INFO:tasks.workunit.client.1.smithi149.stdout:1/686: truncate d1/db/d16/f5c 1399578 0 2024-04-15T21:02:48.961 INFO:tasks.workunit.client.1.smithi149.stdout:9/704: creat d23/d71/fef x:0 0 0 2024-04-15T21:02:48.966 INFO:tasks.workunit.client.1.smithi149.stdout:4/784: unlink dc/d18/d21/d81/fa7 0 2024-04-15T21:02:48.969 INFO:tasks.workunit.client.1.smithi149.stdout:6/651: link da/d18/d10/d66/c8e da/d18/d10/d66/cca 0 2024-04-15T21:02:48.970 INFO:tasks.workunit.client.0.smithi072.stdout:0/577: dwrite d0/d6/fa8 [0,4194304] 0 2024-04-15T21:02:48.971 INFO:tasks.workunit.client.0.smithi072.stdout:8/593: rename d3/de/d1b/d41/da4/d2e/l7a to d3/d4/d3b/lb1 0 2024-04-15T21:02:48.973 INFO:tasks.workunit.client.0.smithi072.stdout:6/530: symlink d2/d40/d56/la0 0 2024-04-15T21:02:48.978 INFO:tasks.workunit.client.0.smithi072.stdout:1/536: sync 2024-04-15T21:02:48.982 INFO:tasks.workunit.client.1.smithi149.stdout:1/687: unlink d1/db/dc/d11/d3f/d45/dae/f81 0 2024-04-15T21:02:48.983 INFO:tasks.workunit.client.0.smithi072.stdout:0/578: dread d0/d45/d7a/d70/d59/d8a/d8b/db8/fa [0,4194304] 0 2024-04-15T21:02:48.985 INFO:tasks.workunit.client.1.smithi149.stdout:6/652: creat da/d18/d10/d16/d97/dbf/fcb x:0 0 0 2024-04-15T21:02:48.987 INFO:tasks.workunit.client.1.smithi149.stdout:8/841: getdents d2/d5b/dcd/d10a/d25/d37 0 2024-04-15T21:02:48.989 INFO:tasks.workunit.client.1.smithi149.stdout:7/702: write d3/d16/d32/d90/fb0 [225675,69201] 0 2024-04-15T21:02:48.993 INFO:tasks.workunit.client.0.smithi072.stdout:7/572: mknod d2/d7/d25/d2d/d46/d5a/d5f/cad 0 2024-04-15T21:02:48.995 INFO:tasks.workunit.client.1.smithi149.stdout:7/703: dwrite d3/d34/fd1 [0,4194304] 0 2024-04-15T21:02:48.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/688: mknod d1/db/dc/d11/d3e/cc5 0 2024-04-15T21:02:48.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/653: mkdir da/d11/dcc 0 2024-04-15T21:02:48.999 INFO:tasks.workunit.client.0.smithi072.stdout:4/558: write d7/d23/f29 [540918,60428] 0 2024-04-15T21:02:49.000 INFO:tasks.workunit.client.0.smithi072.stdout:4/559: chown d7/d15/d58/l80 3 1 2024-04-15T21:02:49.002 INFO:tasks.workunit.client.1.smithi149.stdout:3/794: getdents d1/db 0 2024-04-15T21:02:49.005 INFO:tasks.workunit.client.0.smithi072.stdout:1/537: creat d5/d3d/d5e/fac x:0 0 0 2024-04-15T21:02:49.005 INFO:tasks.workunit.client.0.smithi072.stdout:1/538: chown d5/db/l7c 56 1 2024-04-15T21:02:49.008 INFO:tasks.workunit.client.1.smithi149.stdout:7/704: symlink d3/d39/lff 0 2024-04-15T21:02:49.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/654: dwrite da/d18/d10/d16/d97/dbf/fcb [0,4194304] 0 2024-04-15T21:02:49.009 INFO:tasks.workunit.client.0.smithi072.stdout:5/526: symlink d0/d3/d7/d94/d5f/lb7 0 2024-04-15T21:02:49.011 INFO:tasks.workunit.client.1.smithi149.stdout:7/705: write d3/d16/d20/d6c/feb [814198,51591] 0 2024-04-15T21:02:49.012 INFO:tasks.workunit.client.1.smithi149.stdout:1/689: creat d1/db/dc/d38/d39/fc6 x:0 0 0 2024-04-15T21:02:49.013 INFO:tasks.workunit.client.0.smithi072.stdout:9/555: creat d4/d1f/d31/d42/fab x:0 0 0 2024-04-15T21:02:49.014 INFO:tasks.workunit.client.1.smithi149.stdout:4/785: dwrite dc/d1a/f30 [0,4194304] 0 2024-04-15T21:02:49.019 INFO:tasks.workunit.client.0.smithi072.stdout:2/534: dwrite d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:49.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/531: dwrite d2/d40/d56/f77 [0,4194304] 0 2024-04-15T21:02:49.025 INFO:tasks.workunit.client.1.smithi149.stdout:7/706: creat d3/d17/d1f/d93/f100 x:0 0 0 2024-04-15T21:02:49.026 INFO:tasks.workunit.client.1.smithi149.stdout:1/690: symlink d1/db/dc/d38/d39/d88/lc7 0 2024-04-15T21:02:49.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/707: creat d3/d34/f101 x:0 0 0 2024-04-15T21:02:49.034 INFO:tasks.workunit.client.0.smithi072.stdout:9/556: creat d4/d29/d4c/d91/d93/fac x:0 0 0 2024-04-15T21:02:49.036 INFO:tasks.workunit.client.1.smithi149.stdout:4/786: dwrite dc/f41 [0,4194304] 0 2024-04-15T21:02:49.041 INFO:tasks.workunit.client.1.smithi149.stdout:1/691: truncate d1/d17/d52/f2a 6895985 0 2024-04-15T21:02:49.042 INFO:tasks.workunit.client.0.smithi072.stdout:2/535: symlink d2/da8/lae 0 2024-04-15T21:02:49.042 INFO:tasks.workunit.client.0.smithi072.stdout:2/536: dread - d2/d3/f63 zero size 2024-04-15T21:02:49.048 INFO:tasks.workunit.client.0.smithi072.stdout:8/594: creat d3/de/d1b/fb2 x:0 0 0 2024-04-15T21:02:49.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/708: dwrite d3/d39/d92/fe4 [0,4194304] 0 2024-04-15T21:02:49.050 INFO:tasks.workunit.client.0.smithi072.stdout:6/532: read d2/d10/f1d [422340,90314] 0 2024-04-15T21:02:49.051 INFO:tasks.workunit.client.1.smithi149.stdout:6/655: write da/d18/d10/d16/d97/dbf/d55/da0/fa1 [774415,13935] 0 2024-04-15T21:02:49.054 INFO:tasks.workunit.client.0.smithi072.stdout:7/573: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:49.055 INFO:tasks.workunit.client.1.smithi149.stdout:4/787: creat dc/d2c/d3e/d35/d4b/d6c/d70/dab/f105 x:0 0 0 2024-04-15T21:02:49.056 INFO:tasks.workunit.client.0.smithi072.stdout:9/557: mknod d4/d1f/d31/d4d/cad 0 2024-04-15T21:02:49.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/595: write d3/f3c [2889891,255] 0 2024-04-15T21:02:49.058 INFO:tasks.workunit.client.0.smithi072.stdout:1/539: chown d5/db/d2d/d56/d93/la0 8 1 2024-04-15T21:02:49.061 INFO:tasks.workunit.client.0.smithi072.stdout:3/556: sync 2024-04-15T21:02:49.062 INFO:tasks.workunit.client.1.smithi149.stdout:1/692: link d1/db/dc/d38/d39/c68 d1/db/dc/d11/d3f/d45/cc8 0 2024-04-15T21:02:49.068 INFO:tasks.workunit.client.0.smithi072.stdout:3/557: dwrite d1/d15/d32/d2f/d1a/f1b [4194304,4194304] 0 2024-04-15T21:02:49.069 INFO:tasks.workunit.client.0.smithi072.stdout:1/540: rmdir d5/d31/d51 39 2024-04-15T21:02:49.070 INFO:tasks.workunit.client.0.smithi072.stdout:7/574: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e [0,4194304] 0 2024-04-15T21:02:49.070 INFO:tasks.workunit.client.0.smithi072.stdout:3/558: write d1/d15/f3e [955420,113315] 0 2024-04-15T21:02:49.074 INFO:tasks.workunit.client.0.smithi072.stdout:1/541: dread d5/d3d/f6a [0,4194304] 0 2024-04-15T21:02:49.074 INFO:tasks.workunit.client.1.smithi149.stdout:6/656: rename da/d18/d10/d16/d97/dbf/d55/da0/fa1 to da/d18/d10/d16/d97/fcd 0 2024-04-15T21:02:49.075 INFO:tasks.workunit.client.0.smithi072.stdout:1/542: chown d5/db/f1a 2 1 2024-04-15T21:02:49.076 INFO:tasks.workunit.client.0.smithi072.stdout:5/527: getdents d0/d3/d7/d94 0 2024-04-15T21:02:49.081 INFO:tasks.workunit.client.0.smithi072.stdout:9/558: truncate d4/d1f/d31/d4d/f5c 2159154 0 2024-04-15T21:02:49.082 INFO:tasks.workunit.client.1.smithi149.stdout:6/657: fdatasync da/d2e/f50 0 2024-04-15T21:02:49.088 INFO:tasks.workunit.client.1.smithi149.stdout:7/709: truncate d3/d16/d20/d36/d3d/f80 4443925 0 2024-04-15T21:02:49.089 INFO:tasks.workunit.client.0.smithi072.stdout:6/533: dwrite d2/d10/d18/f39 [0,4194304] 0 2024-04-15T21:02:49.090 INFO:tasks.workunit.client.1.smithi149.stdout:1/693: write d1/db/dc/d38/d39/d43/f54 [4792804,89538] 0 2024-04-15T21:02:49.090 INFO:tasks.workunit.client.0.smithi072.stdout:9/559: write d4/d29/f36 [2765540,114080] 0 2024-04-15T21:02:49.090 INFO:tasks.workunit.client.0.smithi072.stdout:9/560: fsync d4/d1f/d31/f3f 0 2024-04-15T21:02:49.092 INFO:tasks.workunit.client.1.smithi149.stdout:4/788: dwrite dc/d2c/d3e/d15/d5b/f9e [0,4194304] 0 2024-04-15T21:02:49.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/534: dwrite d2/d1a/f75 [0,4194304] 0 2024-04-15T21:02:49.097 INFO:tasks.workunit.client.0.smithi072.stdout:9/561: dwrite d4/d76/d8f/fa2 [0,4194304] 0 2024-04-15T21:02:49.098 INFO:tasks.workunit.client.0.smithi072.stdout:6/535: stat d2/d40/f86 0 2024-04-15T21:02:49.101 INFO:tasks.workunit.client.0.smithi072.stdout:3/559: write d1/d15/d40/fac [2666135,42492] 0 2024-04-15T21:02:49.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/658: write da/d32/f43 [2683859,121499] 0 2024-04-15T21:02:49.102 INFO:tasks.workunit.client.0.smithi072.stdout:6/536: chown d2/d10/d18/d47/d6d 1182 1 2024-04-15T21:02:49.103 INFO:tasks.workunit.client.0.smithi072.stdout:5/528: symlink d0/d3/d7/d12/d31/d62/db6/lb8 0 2024-04-15T21:02:49.105 INFO:tasks.workunit.client.0.smithi072.stdout:5/529: chown d0/d3/d6/l2e 4 1 2024-04-15T21:02:49.105 INFO:tasks.workunit.client.0.smithi072.stdout:6/537: truncate d2/d10/d11/d15/f53 5114257 0 2024-04-15T21:02:49.109 INFO:tasks.workunit.client.1.smithi149.stdout:1/694: dread d1/d17/d52/f40 [0,4194304] 0 2024-04-15T21:02:49.109 INFO:tasks.workunit.client.0.smithi072.stdout:3/560: dwrite d1/d15/f3e [0,4194304] 0 2024-04-15T21:02:49.110 INFO:tasks.workunit.client.1.smithi149.stdout:1/695: fdatasync d1/db/d14/d6b/fbf 0 2024-04-15T21:02:49.110 INFO:tasks.workunit.client.0.smithi072.stdout:3/561: chown d1/f64 17703 1 2024-04-15T21:02:49.114 INFO:tasks.workunit.client.1.smithi149.stdout:6/659: symlink da/d32/lce 0 2024-04-15T21:02:49.116 INFO:tasks.workunit.client.0.smithi072.stdout:1/543: dwrite d5/f3c [0,4194304] 0 2024-04-15T21:02:49.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/789: symlink dc/d2c/d3e/d35/d4b/de8/dfc/l106 0 2024-04-15T21:02:49.122 INFO:tasks.workunit.client.1.smithi149.stdout:6/660: rename da/d60/c88 to da/d18/d10/d66/ccf 0 2024-04-15T21:02:49.122 INFO:tasks.workunit.client.1.smithi149.stdout:1/696: dread d1/db/dc/d11/d3f/d45/dae/f82 [0,4194304] 0 2024-04-15T21:02:49.124 INFO:tasks.workunit.client.1.smithi149.stdout:4/790: chown dc/d2c/d3e/l27 1275 1 2024-04-15T21:02:49.126 INFO:tasks.workunit.client.0.smithi072.stdout:6/538: mkdir d2/da1 0 2024-04-15T21:02:49.127 INFO:tasks.workunit.client.0.smithi072.stdout:5/530: truncate d0/d3/d6/ff 4577946 0 2024-04-15T21:02:49.128 INFO:tasks.workunit.client.0.smithi072.stdout:5/531: readlink d0/l1e 0 2024-04-15T21:02:49.129 INFO:tasks.workunit.client.0.smithi072.stdout:6/539: write d2/d40/d6e/f36 [1249243,63315] 0 2024-04-15T21:02:49.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/544: mknod d5/db/d27/d8a/cad 0 2024-04-15T21:02:49.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/545: chown d5/db/d2d/d3a/f39 14 1 2024-04-15T21:02:49.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/791: mknod dc/d1a/dc8/dd9/c107 0 2024-04-15T21:02:49.139 INFO:tasks.workunit.client.0.smithi072.stdout:1/546: read - d5/db/d2d/d3a/f88 zero size 2024-04-15T21:02:49.139 INFO:tasks.workunit.client.0.smithi072.stdout:1/547: dread - d5/f96 zero size 2024-04-15T21:02:49.139 INFO:tasks.workunit.client.1.smithi149.stdout:4/792: fsync dc/d2c/d3e/d15/d3f/db0/fb5 0 2024-04-15T21:02:49.141 INFO:tasks.workunit.client.1.smithi149.stdout:7/710: write d3/d16/d20/d36/d3d/f85 [116029,6912] 0 2024-04-15T21:02:49.141 INFO:tasks.workunit.client.1.smithi149.stdout:1/697: creat d1/fc9 x:0 0 0 2024-04-15T21:02:49.144 INFO:tasks.workunit.client.0.smithi072.stdout:7/575: link d2/c45 d2/d7/d25/d2d/d47/cae 0 2024-04-15T21:02:49.146 INFO:tasks.workunit.client.0.smithi072.stdout:9/562: dread d4/d1f/d2c/f57 [0,4194304] 0 2024-04-15T21:02:49.146 INFO:tasks.workunit.client.0.smithi072.stdout:3/562: dread d1/d3f/d4f/f7e [0,4194304] 0 2024-04-15T21:02:49.149 INFO:tasks.workunit.client.1.smithi149.stdout:7/711: write d3/d17/d1f/f22 [2566618,53003] 0 2024-04-15T21:02:49.151 INFO:tasks.workunit.client.0.smithi072.stdout:3/563: dwrite d1/d3f/d4f/f68 [0,4194304] 0 2024-04-15T21:02:49.152 INFO:tasks.workunit.client.0.smithi072.stdout:7/576: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/laf 0 2024-04-15T21:02:49.152 INFO:tasks.workunit.client.0.smithi072.stdout:3/564: chown d1/d5b/f97 3750 1 2024-04-15T21:02:49.153 INFO:tasks.workunit.client.1.smithi149.stdout:6/661: write da/d18/d10/d16/d97/dbf/fa4 [616377,89282] 0 2024-04-15T21:02:49.157 INFO:tasks.workunit.client.1.smithi149.stdout:7/712: dread - d3/d16/d20/fcc zero size 2024-04-15T21:02:49.158 INFO:tasks.workunit.client.0.smithi072.stdout:3/565: dwrite d1/d15/f4d [0,4194304] 0 2024-04-15T21:02:49.158 INFO:tasks.workunit.client.1.smithi149.stdout:6/662: dread da/d18/d33/f6f [0,4194304] 0 2024-04-15T21:02:49.159 INFO:tasks.workunit.client.0.smithi072.stdout:3/566: chown d1/d15/d32/f77 70 1 2024-04-15T21:02:49.163 INFO:tasks.workunit.client.1.smithi149.stdout:4/793: rmdir dc/d2c/d3e/d15/d5b/df4 0 2024-04-15T21:02:49.164 INFO:tasks.workunit.client.0.smithi072.stdout:6/540: link d2/d40/d56/f8a d2/d10/d18/fa2 0 2024-04-15T21:02:49.165 INFO:tasks.workunit.client.0.smithi072.stdout:6/541: chown d2/d40/d6e/f4e 0 1 2024-04-15T21:02:49.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/542: stat d2/d1a/f75 0 2024-04-15T21:02:49.166 INFO:tasks.workunit.client.0.smithi072.stdout:5/532: write d0/d3/f83 [844943,526] 0 2024-04-15T21:02:49.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/663: symlink da/d11/ld0 0 2024-04-15T21:02:49.168 INFO:tasks.workunit.client.1.smithi149.stdout:7/713: dread d3/d16/d20/f8b [0,4194304] 0 2024-04-15T21:02:49.171 INFO:tasks.workunit.client.0.smithi072.stdout:7/577: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0 0 2024-04-15T21:02:49.175 INFO:tasks.workunit.client.1.smithi149.stdout:7/714: dwrite d3/f7 [0,4194304] 0 2024-04-15T21:02:49.175 INFO:tasks.workunit.client.0.smithi072.stdout:1/548: link d5/f7d d5/d31/d51/d82/fae 0 2024-04-15T21:02:49.177 INFO:tasks.workunit.client.0.smithi072.stdout:9/563: dwrite d4/d1f/d31/d42/f66 [4194304,4194304] 0 2024-04-15T21:02:49.180 INFO:tasks.workunit.client.1.smithi149.stdout:1/698: dread d1/db/f33 [0,4194304] 0 2024-04-15T21:02:49.181 INFO:tasks.workunit.client.0.smithi072.stdout:3/567: fsync d1/d5b/f75 0 2024-04-15T21:02:49.183 INFO:tasks.workunit.client.1.smithi149.stdout:4/794: rename dc/deb/ffd to dc/d18/dce/dd7/f108 0 2024-04-15T21:02:49.184 INFO:tasks.workunit.client.1.smithi149.stdout:4/795: write dc/d2c/d3e/d35/ff7 [525220,42325] 0 2024-04-15T21:02:49.185 INFO:tasks.workunit.client.1.smithi149.stdout:1/699: truncate d1/db/dc/d38/d39/d43/f8f 5134423 0 2024-04-15T21:02:49.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/568: dwrite d1/d3f/f95 [0,4194304] 0 2024-04-15T21:02:49.191 INFO:tasks.workunit.client.0.smithi072.stdout:5/533: rename d0/d3/d7/d12/d31/d55/d58/f72 to d0/d3/d7/d94/d86/fb9 0 2024-04-15T21:02:49.197 INFO:tasks.workunit.client.0.smithi072.stdout:6/543: dread d2/d40/f68 [0,4194304] 0 2024-04-15T21:02:49.198 INFO:tasks.workunit.client.0.smithi072.stdout:2/537: sync 2024-04-15T21:02:49.198 INFO:tasks.workunit.client.0.smithi072.stdout:4/560: sync 2024-04-15T21:02:49.198 INFO:tasks.workunit.client.0.smithi072.stdout:0/579: sync 2024-04-15T21:02:49.201 INFO:tasks.workunit.client.1.smithi149.stdout:4/796: dwrite dc/fe3 [0,4194304] 0 2024-04-15T21:02:49.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/538: readlink d2/d38/d73/l9a 0 2024-04-15T21:02:49.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/539: chown d2/d38/d91 0 1 2024-04-15T21:02:49.203 INFO:tasks.workunit.client.0.smithi072.stdout:6/544: dwrite d2/d40/d56/d6a/d70/f44 [0,4194304] 0 2024-04-15T21:02:49.207 INFO:tasks.workunit.client.0.smithi072.stdout:9/564: mkdir d4/d1f/d31/d4d/dae 0 2024-04-15T21:02:49.211 INFO:tasks.workunit.client.1.smithi149.stdout:6/664: dread da/d18/d10/fa3 [0,4194304] 0 2024-04-15T21:02:49.212 INFO:tasks.workunit.client.1.smithi149.stdout:4/797: mkdir dc/d18/d21/dfa/d109 0 2024-04-15T21:02:49.213 INFO:tasks.workunit.client.1.smithi149.stdout:4/798: readlink dc/d1a/l95 0 2024-04-15T21:02:49.214 INFO:tasks.workunit.client.1.smithi149.stdout:6/665: fsync da/d11/f22 0 2024-04-15T21:02:49.216 INFO:tasks.workunit.client.0.smithi072.stdout:9/565: dread d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:02:49.251 INFO:tasks.workunit.client.0.smithi072.stdout:3/569: creat d1/d5b/fb2 x:0 0 0 2024-04-15T21:02:49.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/799: symlink dc/l10a 0 2024-04-15T21:02:49.255 INFO:tasks.workunit.client.0.smithi072.stdout:8/596: sync 2024-04-15T21:02:49.255 INFO:tasks.workunit.client.1.smithi149.stdout:4/800: stat dc/d2c/d3e/d15/d3f/f87 0 2024-04-15T21:02:49.256 INFO:tasks.workunit.client.0.smithi072.stdout:8/597: fsync d3/de/d1b/fb2 0 2024-04-15T21:02:49.256 INFO:tasks.workunit.client.0.smithi072.stdout:5/534: rmdir d0/d3/d7/d12/d31/d49 39 2024-04-15T21:02:49.263 INFO:tasks.workunit.client.1.smithi149.stdout:4/801: fsync dc/d2c/d3e/d35/d4b/d6c/f7b 0 2024-04-15T21:02:49.264 INFO:tasks.workunit.client.0.smithi072.stdout:1/549: dwrite d5/d31/d51/d82/fae [0,4194304] 0 2024-04-15T21:02:49.266 INFO:tasks.workunit.client.0.smithi072.stdout:1/550: write d5/d31/d51/f9b [898229,123808] 0 2024-04-15T21:02:49.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/715: dwrite d3/d16/d20/d6c/d91/fc5 [0,4194304] 0 2024-04-15T21:02:49.269 INFO:tasks.workunit.client.1.smithi149.stdout:1/700: truncate d1/f79 701891 0 2024-04-15T21:02:49.279 INFO:tasks.workunit.client.0.smithi072.stdout:2/540: unlink d2/f77 0 2024-04-15T21:02:49.280 INFO:tasks.workunit.client.1.smithi149.stdout:4/802: rename dc/d2c/d3e/c101 to dc/d2c/d3e/d35/d4b/de8/dfc/c10b 0 2024-04-15T21:02:49.286 INFO:tasks.workunit.client.0.smithi072.stdout:7/578: truncate d2/d7/d25/d2d/d46/d5a/f88 566193 0 2024-04-15T21:02:49.287 INFO:tasks.workunit.client.0.smithi072.stdout:9/566: mknod d4/d29/d4c/d91/d93/caf 0 2024-04-15T21:02:49.287 INFO:tasks.workunit.client.1.smithi149.stdout:4/803: symlink dc/d1a/dc8/l10c 0 2024-04-15T21:02:49.290 INFO:tasks.workunit.client.0.smithi072.stdout:3/570: rmdir d1/d3f/d7f/d8c 39 2024-04-15T21:02:49.290 INFO:tasks.workunit.client.1.smithi149.stdout:6/666: truncate da/d11/f35 6147519 0 2024-04-15T21:02:49.293 INFO:tasks.workunit.client.0.smithi072.stdout:8/598: mkdir d3/de/d1b/d41/da4/d2e/db3 0 2024-04-15T21:02:49.293 INFO:tasks.workunit.client.0.smithi072.stdout:6/545: dread d2/d10/d11/f2e [0,4194304] 0 2024-04-15T21:02:49.295 INFO:tasks.workunit.client.1.smithi149.stdout:6/667: symlink da/d32/ld1 0 2024-04-15T21:02:49.296 INFO:tasks.workunit.client.0.smithi072.stdout:1/551: unlink d5/d31/c3f 0 2024-04-15T21:02:49.298 INFO:tasks.workunit.client.0.smithi072.stdout:0/580: mknod d0/d6/cca 0 2024-04-15T21:02:49.298 INFO:tasks.workunit.client.0.smithi072.stdout:1/552: write d5/db/d27/f34 [1056311,129572] 0 2024-04-15T21:02:49.299 INFO:tasks.workunit.client.1.smithi149.stdout:6/668: creat da/d18/d10/d16/d97/dbf/d55/fd2 x:0 0 0 2024-04-15T21:02:49.300 INFO:tasks.workunit.client.0.smithi072.stdout:6/546: dwrite d2/d1a/f41 [0,4194304] 0 2024-04-15T21:02:49.300 INFO:tasks.workunit.client.0.smithi072.stdout:4/561: mkdir d7/d10/d41/d44/d7a/d97/db6 0 2024-04-15T21:02:49.300 INFO:tasks.workunit.client.0.smithi072.stdout:6/547: stat d2/fe 0 2024-04-15T21:02:49.301 INFO:tasks.workunit.client.0.smithi072.stdout:4/562: dread - d7/d10/d41/f60 zero size 2024-04-15T21:02:49.301 INFO:tasks.workunit.client.0.smithi072.stdout:7/579: symlink d2/d7/d25/d2d/d52/lb1 0 2024-04-15T21:02:49.303 INFO:tasks.workunit.client.0.smithi072.stdout:9/567: creat d4/d76/d8f/fb0 x:0 0 0 2024-04-15T21:02:49.305 INFO:tasks.workunit.client.0.smithi072.stdout:7/580: chown d2/d7/d25/d2d/d47/d7e/fa3 32704 1 2024-04-15T21:02:49.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/669: read da/d18/d10/d16/d97/dbf/f8d [29117,53867] 0 2024-04-15T21:02:49.307 INFO:tasks.workunit.client.0.smithi072.stdout:5/535: rename d0/d3/d33/d60/d81/lae to d0/d3/d7/d12/d31/d55/d93/lba 0 2024-04-15T21:02:49.309 INFO:tasks.workunit.client.1.smithi149.stdout:7/716: dread d3/d17/f33 [0,4194304] 0 2024-04-15T21:02:49.309 INFO:tasks.workunit.client.1.smithi149.stdout:1/701: write d1/db/d14/f9d [435522,96931] 0 2024-04-15T21:02:49.314 INFO:tasks.workunit.client.1.smithi149.stdout:6/670: read f8 [233511,12041] 0 2024-04-15T21:02:49.318 INFO:tasks.workunit.client.1.smithi149.stdout:7/717: dwrite d3/d34/fd1 [4194304,4194304] 0 2024-04-15T21:02:49.319 INFO:tasks.workunit.client.1.smithi149.stdout:7/718: fsync d3/d16/d20/d36/d3d/d56/f5f 0 2024-04-15T21:02:49.321 INFO:tasks.workunit.client.1.smithi149.stdout:6/671: unlink da/d18/d10/fa3 0 2024-04-15T21:02:49.324 INFO:tasks.workunit.client.0.smithi072.stdout:8/599: symlink d3/de/d1b/d41/d74/d98/lb4 0 2024-04-15T21:02:49.325 INFO:tasks.workunit.client.1.smithi149.stdout:7/719: mknod d3/d16/d32/d90/dad/dc4/dd6/c102 0 2024-04-15T21:02:49.326 INFO:tasks.workunit.client.0.smithi072.stdout:3/571: write d1/d15/f3b [414570,38494] 0 2024-04-15T21:02:49.326 INFO:tasks.workunit.client.0.smithi072.stdout:1/553: dread d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:49.331 INFO:tasks.workunit.client.1.smithi149.stdout:1/702: rename d1/db/d16/d35/f95 to d1/db/dc/fca 0 2024-04-15T21:02:49.331 INFO:tasks.workunit.client.1.smithi149.stdout:1/703: chown d1/d17/f41 12363227 1 2024-04-15T21:02:49.333 INFO:tasks.workunit.client.0.smithi072.stdout:2/541: rename d2/c3c to d2/d8/d8e/d90/caf 0 2024-04-15T21:02:49.333 INFO:tasks.workunit.client.1.smithi149.stdout:1/704: write d1/db/d14/d6b/fbf [231459,19276] 0 2024-04-15T21:02:49.333 INFO:tasks.workunit.client.1.smithi149.stdout:1/705: stat d1/db/dc/lb2 0 2024-04-15T21:02:49.336 INFO:tasks.workunit.client.0.smithi072.stdout:5/536: creat d0/d3/d7/d94/d92/fbb x:0 0 0 2024-04-15T21:02:49.339 INFO:tasks.workunit.client.0.smithi072.stdout:0/581: symlink d0/d6/lcb 0 2024-04-15T21:02:49.340 INFO:tasks.workunit.client.1.smithi149.stdout:6/672: write da/d2e/f64 [249926,29254] 0 2024-04-15T21:02:49.341 INFO:tasks.workunit.client.1.smithi149.stdout:6/673: readlink da/l2a 0 2024-04-15T21:02:49.341 INFO:tasks.workunit.client.1.smithi149.stdout:1/706: symlink d1/db/dc/d38/d39/d43/daa/d8a/lcb 0 2024-04-15T21:02:49.346 INFO:tasks.workunit.client.1.smithi149.stdout:6/674: rename da/d18/d10/c4d to da/d11/dcc/cd3 0 2024-04-15T21:02:49.347 INFO:tasks.workunit.client.1.smithi149.stdout:7/720: write d3/fb [633681,70987] 0 2024-04-15T21:02:49.348 INFO:tasks.workunit.client.1.smithi149.stdout:7/721: write d3/fb [7818222,6218] 0 2024-04-15T21:02:49.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/707: write d1/db/dc/d11/d3f/d45/dae/f82 [2628156,94744] 0 2024-04-15T21:02:49.350 INFO:tasks.workunit.client.0.smithi072.stdout:3/572: readlink d1/d15/d32/l89 0 2024-04-15T21:02:49.351 INFO:tasks.workunit.client.1.smithi149.stdout:1/708: write d1/db/dc/d38/f63 [3102648,64696] 0 2024-04-15T21:02:49.351 INFO:tasks.workunit.client.0.smithi072.stdout:3/573: write d1/d15/d40/f13 [614565,81855] 0 2024-04-15T21:02:49.354 INFO:tasks.workunit.client.1.smithi149.stdout:7/722: dread d3/d16/d20/d6c/d91/fc5 [0,4194304] 0 2024-04-15T21:02:49.354 INFO:tasks.workunit.client.0.smithi072.stdout:4/563: truncate d7/fc 3939090 0 2024-04-15T21:02:49.355 INFO:tasks.workunit.client.0.smithi072.stdout:9/568: write d4/d1f/d2c/d62/f6c [161699,107113] 0 2024-04-15T21:02:49.358 INFO:tasks.workunit.client.0.smithi072.stdout:5/537: symlink d0/d3/d33/d60/d81/daf/lbc 0 2024-04-15T21:02:49.358 INFO:tasks.workunit.client.0.smithi072.stdout:8/600: dread d3/f1d [0,4194304] 0 2024-04-15T21:02:49.358 INFO:tasks.workunit.client.0.smithi072.stdout:5/538: dread - d0/d3/d33/d60/fb3 zero size 2024-04-15T21:02:49.359 INFO:tasks.workunit.client.1.smithi149.stdout:7/723: mknod d3/d16/d32/d90/dad/dc4/c103 0 2024-04-15T21:02:49.360 INFO:tasks.workunit.client.1.smithi149.stdout:0/889: sync 2024-04-15T21:02:49.360 INFO:tasks.workunit.client.1.smithi149.stdout:5/700: sync 2024-04-15T21:02:49.360 INFO:tasks.workunit.client.1.smithi149.stdout:2/782: sync 2024-04-15T21:02:49.361 INFO:tasks.workunit.client.1.smithi149.stdout:0/890: readlink d1/d5/dc/l67 0 2024-04-15T21:02:49.362 INFO:tasks.workunit.client.0.smithi072.stdout:6/548: creat d2/d40/fa3 x:0 0 0 2024-04-15T21:02:49.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/701: chown d0/d6/d82/da1/d12/d16/da9/d1b/d83 1714 1 2024-04-15T21:02:49.363 INFO:tasks.workunit.client.1.smithi149.stdout:5/702: readlink d0/d9/d71/ldd 0 2024-04-15T21:02:49.364 INFO:tasks.workunit.client.1.smithi149.stdout:6/675: dread f8 [0,4194304] 0 2024-04-15T21:02:49.366 INFO:tasks.workunit.client.1.smithi149.stdout:7/724: dread - d3/d17/fc6 zero size 2024-04-15T21:02:49.368 INFO:tasks.workunit.client.0.smithi072.stdout:7/581: creat d2/d7/d25/d2d/d46/d5a/d5f/fb2 x:0 0 0 2024-04-15T21:02:49.369 INFO:tasks.workunit.client.1.smithi149.stdout:0/891: creat d1/d5/d24/d50/d15/f13a x:0 0 0 2024-04-15T21:02:49.370 INFO:tasks.workunit.client.1.smithi149.stdout:1/709: write d1/db/d16/f5c [1561993,29766] 0 2024-04-15T21:02:49.372 INFO:tasks.workunit.client.0.smithi072.stdout:4/564: mknod d7/d15/d58/d62/d6f/cb7 0 2024-04-15T21:02:49.372 INFO:tasks.workunit.client.1.smithi149.stdout:1/710: dread d1/d17/d4d/f6a [0,4194304] 0 2024-04-15T21:02:49.373 INFO:tasks.workunit.client.1.smithi149.stdout:6/676: creat da/d18/d10/d3f/fd4 x:0 0 0 2024-04-15T21:02:49.373 INFO:tasks.workunit.client.1.smithi149.stdout:1/711: chown d1/d17/c18 82259 1 2024-04-15T21:02:49.374 INFO:tasks.workunit.client.0.smithi072.stdout:1/554: creat d5/db/d27/d5c/faf x:0 0 0 2024-04-15T21:02:49.375 INFO:tasks.workunit.client.1.smithi149.stdout:5/703: mkdir d0/d6/d82/da1/d12/d2b/de0 0 2024-04-15T21:02:49.375 INFO:tasks.workunit.client.1.smithi149.stdout:5/704: dread - d0/d9/d3f/d47/fd3 zero size 2024-04-15T21:02:49.378 INFO:tasks.workunit.client.0.smithi072.stdout:5/539: rename d0/d3/d7/d1f/f26 to d0/d3/d7/d94/d92/da0/da7/fbd 0 2024-04-15T21:02:49.379 INFO:tasks.workunit.client.0.smithi072.stdout:0/582: mkdir d0/d6/d6d/dcc 0 2024-04-15T21:02:49.382 INFO:tasks.workunit.client.0.smithi072.stdout:7/582: symlink d2/d7/d25/d2d/d46/lb3 0 2024-04-15T21:02:49.384 INFO:tasks.workunit.client.1.smithi149.stdout:2/783: rename d4/d7/da/fc8 to d4/d7/d46/de4/d21/d3b/f113 0 2024-04-15T21:02:49.385 INFO:tasks.workunit.client.1.smithi149.stdout:7/725: dread d3/d16/d32/d90/dad/dc4/fe7 [0,4194304] 0 2024-04-15T21:02:49.385 INFO:tasks.workunit.client.0.smithi072.stdout:3/574: mkdir d1/d3f/d4f/d73/db3 0 2024-04-15T21:02:49.386 INFO:tasks.workunit.client.0.smithi072.stdout:3/575: write d1/f64 [1407550,83996] 0 2024-04-15T21:02:49.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/892: mkdir d1/d5/d24/d50/d13/d59/d13b 0 2024-04-15T21:02:49.389 INFO:tasks.workunit.client.0.smithi072.stdout:4/565: creat d7/d10/d41/d45/d93/fb8 x:0 0 0 2024-04-15T21:02:49.391 INFO:tasks.workunit.client.0.smithi072.stdout:3/576: dwrite d1/d5b/f97 [0,4194304] 0 2024-04-15T21:02:49.393 INFO:tasks.workunit.client.0.smithi072.stdout:8/601: symlink d3/de/d1b/d41/da4/lb5 0 2024-04-15T21:02:49.396 INFO:tasks.workunit.client.1.smithi149.stdout:6/677: rename c0 to da/d11/d90/cd5 0 2024-04-15T21:02:49.397 INFO:tasks.workunit.client.1.smithi149.stdout:1/712: write d1/f6 [31477,62589] 0 2024-04-15T21:02:49.397 INFO:tasks.workunit.client.1.smithi149.stdout:5/705: rename d0/d6/d82/da1 to d0/d6/d82/da1/d12/d16/de1 22 2024-04-15T21:02:49.399 INFO:tasks.workunit.client.0.smithi072.stdout:5/540: truncate d0/d3/d7/d1f/f29 106847 0 2024-04-15T21:02:49.400 INFO:tasks.workunit.client.1.smithi149.stdout:6/678: write da/d18/d33/fa8 [36595,115705] 0 2024-04-15T21:02:49.406 INFO:tasks.workunit.client.0.smithi072.stdout:0/583: dread d0/d6/f4e [0,4194304] 0 2024-04-15T21:02:49.406 INFO:tasks.workunit.client.0.smithi072.stdout:7/583: rename d2/d7/d25/la2 to d2/d78/lb4 0 2024-04-15T21:02:49.406 INFO:tasks.workunit.client.0.smithi072.stdout:7/584: readlink d2/d7/d25/d2d/l57 0 2024-04-15T21:02:49.407 INFO:tasks.workunit.client.1.smithi149.stdout:5/706: dwrite d0/d6/d82/da1/f2e [0,4194304] 0 2024-04-15T21:02:49.408 INFO:tasks.workunit.client.0.smithi072.stdout:4/566: symlink d7/d24/lb9 0 2024-04-15T21:02:49.409 INFO:tasks.workunit.client.0.smithi072.stdout:1/555: mknod d5/db/daa/cb0 0 2024-04-15T21:02:49.410 INFO:tasks.workunit.client.0.smithi072.stdout:1/556: stat d5/d3d/d5e/ca8 0 2024-04-15T21:02:49.410 INFO:tasks.workunit.client.1.smithi149.stdout:7/726: symlink d3/d16/d20/l104 0 2024-04-15T21:02:49.412 INFO:tasks.workunit.client.1.smithi149.stdout:7/727: write d3/d16/d6e/ff2 [6354,33592] 0 2024-04-15T21:02:49.412 INFO:tasks.workunit.client.0.smithi072.stdout:2/542: creat d2/d66/fb0 x:0 0 0 2024-04-15T21:02:49.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/679: symlink da/d11/d90/ld6 0 2024-04-15T21:02:49.414 INFO:tasks.workunit.client.0.smithi072.stdout:4/567: dwrite d7/d24/f1e [4194304,4194304] 0 2024-04-15T21:02:49.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/893: mkdir d1/d9/d64/d65/d104/d119/d13c 0 2024-04-15T21:02:49.418 INFO:tasks.workunit.client.0.smithi072.stdout:1/557: dwrite d5/d31/d51/f83 [0,4194304] 0 2024-04-15T21:02:49.428 INFO:tasks.workunit.client.0.smithi072.stdout:0/584: rename d0/d19/d71/db1 to d0/d19/dcd 0 2024-04-15T21:02:49.429 INFO:tasks.workunit.client.0.smithi072.stdout:0/585: write d0/d45/f62 [3555145,82847] 0 2024-04-15T21:02:49.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/680: readlink da/d18/d7d/l8c 0 2024-04-15T21:02:49.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/894: fdatasync d1/d5/d24/d50/d13/d59/dd7/f80 0 2024-04-15T21:02:49.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/713: rmdir d1/db/d16/d35/dbd 0 2024-04-15T21:02:49.441 INFO:tasks.workunit.client.1.smithi149.stdout:5/707: mknod d0/d6/d82/da1/ce2 0 2024-04-15T21:02:49.442 INFO:tasks.workunit.client.1.smithi149.stdout:5/708: chown d0/d9/d3f/d47 1705445 1 2024-04-15T21:02:49.443 INFO:tasks.workunit.client.0.smithi072.stdout:4/568: dread d7/fc [0,4194304] 0 2024-04-15T21:02:49.443 INFO:tasks.workunit.client.1.smithi149.stdout:2/784: link d4/d7/d46/de4/d21/d2c/d32/cce d4/d7/d46/de4/d21/d5e/c114 0 2024-04-15T21:02:49.450 INFO:tasks.workunit.client.0.smithi072.stdout:3/577: dwrite d1/d15/d40/f1c [0,4194304] 0 2024-04-15T21:02:49.450 INFO:tasks.workunit.client.0.smithi072.stdout:6/549: getdents d2/d40/d56 0 2024-04-15T21:02:49.450 INFO:tasks.workunit.client.0.smithi072.stdout:1/558: dwrite d5/f8 [4194304,4194304] 0 2024-04-15T21:02:49.451 INFO:tasks.workunit.client.0.smithi072.stdout:3/578: chown d1/d15/d32/ca0 40020 1 2024-04-15T21:02:49.453 INFO:tasks.workunit.client.0.smithi072.stdout:6/550: dread d2/d40/f68 [0,4194304] 0 2024-04-15T21:02:49.454 INFO:tasks.workunit.client.1.smithi149.stdout:7/728: creat d3/d16/d20/d36/f105 x:0 0 0 2024-04-15T21:02:49.455 INFO:tasks.workunit.client.0.smithi072.stdout:6/551: write d2/d40/fa3 [1008179,24838] 0 2024-04-15T21:02:49.455 INFO:tasks.workunit.client.0.smithi072.stdout:0/586: mkdir d0/d45/d7a/d70/dce 0 2024-04-15T21:02:49.461 INFO:tasks.workunit.client.0.smithi072.stdout:3/579: dwrite d1/d15/d32/f5a [0,4194304] 0 2024-04-15T21:02:49.461 INFO:tasks.workunit.client.0.smithi072.stdout:1/559: dwrite d5/db/d27/f33 [4194304,4194304] 0 2024-04-15T21:02:49.464 INFO:tasks.workunit.client.0.smithi072.stdout:8/602: creat d3/de/fb6 x:0 0 0 2024-04-15T21:02:49.468 INFO:tasks.workunit.client.1.smithi149.stdout:6/681: rename da/d18/d10/d16/d97/dbf/d55/d82/lc5 to da/d18/d10/d16/d97/dbf/ld7 0 2024-04-15T21:02:49.472 INFO:tasks.workunit.client.0.smithi072.stdout:8/603: dwrite d3/f3c [4194304,4194304] 0 2024-04-15T21:02:49.472 INFO:tasks.workunit.client.1.smithi149.stdout:6/682: write da/d18/d33/fad [744114,105317] 0 2024-04-15T21:02:49.472 INFO:tasks.workunit.client.0.smithi072.stdout:4/569: rename f6 to d7/d10/d41/d45/fba 0 2024-04-15T21:02:49.475 INFO:tasks.workunit.client.1.smithi149.stdout:6/683: readlink da/d18/d10/d16/d97/dbf/l7f 0 2024-04-15T21:02:49.477 INFO:tasks.workunit.client.1.smithi149.stdout:7/729: unlink d3/d39/lf9 0 2024-04-15T21:02:49.478 INFO:tasks.workunit.client.1.smithi149.stdout:0/895: dwrite d1/d9/d64/d65/d104/d119/d43/f97 [0,4194304] 0 2024-04-15T21:02:49.488 INFO:tasks.workunit.client.1.smithi149.stdout:2/785: mkdir d4/d7/d46/de4/d21/d2c/d115 0 2024-04-15T21:02:49.494 INFO:tasks.workunit.client.1.smithi149.stdout:0/896: dwrite d1/d29/d2c/d4f/f139 [0,4194304] 0 2024-04-15T21:02:49.499 INFO:tasks.workunit.client.0.smithi072.stdout:2/543: creat d2/d8/fb1 x:0 0 0 2024-04-15T21:02:49.500 INFO:tasks.workunit.client.1.smithi149.stdout:6/684: mkdir da/d11/d90/dd8 0 2024-04-15T21:02:49.501 INFO:tasks.workunit.client.1.smithi149.stdout:5/709: dwrite d0/d6/d82/da1/f1c [0,4194304] 0 2024-04-15T21:02:49.503 INFO:tasks.workunit.client.0.smithi072.stdout:8/604: symlink d3/de/d1b/d44/lb7 0 2024-04-15T21:02:49.505 INFO:tasks.workunit.client.1.smithi149.stdout:0/897: chown d1/d9/d64/d65/d104/d119/d43/c4e 54 1 2024-04-15T21:02:49.505 INFO:tasks.workunit.client.1.smithi149.stdout:7/730: creat d3/d16/d20/dab/f106 x:0 0 0 2024-04-15T21:02:49.506 INFO:tasks.workunit.client.0.smithi072.stdout:5/541: getdents d0/d3/d7/d12/d31/d62 0 2024-04-15T21:02:49.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/786: creat d4/d7/d46/de4/d21/d2c/f116 x:0 0 0 2024-04-15T21:02:49.510 INFO:tasks.workunit.client.0.smithi072.stdout:6/552: symlink d2/d10/d18/la4 0 2024-04-15T21:02:49.510 INFO:tasks.workunit.client.0.smithi072.stdout:0/587: mknod d0/d6/d6d/dcc/ccf 0 2024-04-15T21:02:49.511 INFO:tasks.workunit.client.1.smithi149.stdout:7/731: fsync d3/d16/d20/fd9 0 2024-04-15T21:02:49.517 INFO:tasks.workunit.client.1.smithi149.stdout:6/685: dwrite da/d18/d10/d16/d97/dbf/d55/da0/db4/fc0 [0,4194304] 0 2024-04-15T21:02:49.519 INFO:tasks.workunit.client.0.smithi072.stdout:4/570: mknod d7/d28/d42/cbb 0 2024-04-15T21:02:49.519 INFO:tasks.workunit.client.0.smithi072.stdout:4/571: chown d7/d15/d58 207005471 1 2024-04-15T21:02:49.520 INFO:tasks.workunit.client.0.smithi072.stdout:4/572: dread - d7/d10/d41/d44/d7a/d86/d76/f96 zero size 2024-04-15T21:02:49.522 INFO:tasks.workunit.client.1.smithi149.stdout:7/732: unlink d3/d16/d20/f8b 0 2024-04-15T21:02:49.527 INFO:tasks.workunit.client.0.smithi072.stdout:5/542: symlink d0/d3/d7/d94/d86/lbe 0 2024-04-15T21:02:49.527 INFO:tasks.workunit.client.1.smithi149.stdout:2/787: dread d4/d7/d46/de4/d21/d55/f9e [0,4194304] 0 2024-04-15T21:02:49.536 INFO:tasks.workunit.client.0.smithi072.stdout:1/560: creat d5/db/fb1 x:0 0 0 2024-04-15T21:02:49.536 INFO:tasks.workunit.client.1.smithi149.stdout:2/788: dwrite d4/d7/d46/de4/d21/d55/fb7 [0,4194304] 0 2024-04-15T21:02:49.541 INFO:tasks.workunit.client.0.smithi072.stdout:8/605: rename d3/d4/d4c/f2a to d3/d4/d76/fb8 0 2024-04-15T21:02:49.544 INFO:tasks.workunit.client.0.smithi072.stdout:5/543: creat d0/d3/d7/d1f/d4c/fbf x:0 0 0 2024-04-15T21:02:49.546 INFO:tasks.workunit.client.1.smithi149.stdout:0/898: dread d1/f22 [0,4194304] 0 2024-04-15T21:02:49.551 INFO:tasks.workunit.client.0.smithi072.stdout:1/561: mknod d5/d3d/d5e/cb2 0 2024-04-15T21:02:49.552 INFO:tasks.workunit.client.0.smithi072.stdout:1/562: chown d5/db/d2d/d56/d93/la0 267119 1 2024-04-15T21:02:49.552 INFO:tasks.workunit.client.1.smithi149.stdout:6/686: rmdir da/d11/d90/dd8 0 2024-04-15T21:02:49.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/687: dread - da/d18/d10/d16/d97/dbf/fb3 zero size 2024-04-15T21:02:49.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/544: creat d2/d3/fb2 x:0 0 0 2024-04-15T21:02:49.554 INFO:tasks.workunit.client.1.smithi149.stdout:7/733: link d3/d16/da0/fa8 d3/d39/d92/f107 0 2024-04-15T21:02:49.556 INFO:tasks.workunit.client.0.smithi072.stdout:3/580: dwrite d1/d26/f58 [0,4194304] 0 2024-04-15T21:02:49.557 INFO:tasks.workunit.client.0.smithi072.stdout:8/606: creat d3/d4/d3b/fb9 x:0 0 0 2024-04-15T21:02:49.558 INFO:tasks.workunit.client.0.smithi072.stdout:5/544: stat d0/d3/d7/d12/d31/d49/f87 0 2024-04-15T21:02:49.559 INFO:tasks.workunit.client.0.smithi072.stdout:0/588: link d0/d19/d2b/l4b d0/d19/dcd/ld0 0 2024-04-15T21:02:49.560 INFO:tasks.workunit.client.1.smithi149.stdout:5/710: dwrite d0/f5 [0,4194304] 0 2024-04-15T21:02:49.560 INFO:tasks.workunit.client.1.smithi149.stdout:6/688: dread da/d2e/f64 [0,4194304] 0 2024-04-15T21:02:49.560 INFO:tasks.workunit.client.0.smithi072.stdout:5/545: truncate d0/d3/d7/d12/d31/d55/d58/f65 1077188 0 2024-04-15T21:02:49.561 INFO:tasks.workunit.client.1.smithi149.stdout:9/705: sync 2024-04-15T21:02:49.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/842: sync 2024-04-15T21:02:49.563 INFO:tasks.workunit.client.0.smithi072.stdout:1/563: rename d5/db/d2d/d85/f99 to d5/d3d/fb3 0 2024-04-15T21:02:49.567 INFO:tasks.workunit.client.1.smithi149.stdout:0/899: symlink d1/d9/d64/d65/d104/d119/l13d 0 2024-04-15T21:02:49.569 INFO:tasks.workunit.client.1.smithi149.stdout:0/900: chown d1/d9/d64/d65/d104/d119/d92 12 1 2024-04-15T21:02:49.571 INFO:tasks.workunit.client.0.smithi072.stdout:4/573: creat d7/fbc x:0 0 0 2024-04-15T21:02:49.573 INFO:tasks.workunit.client.0.smithi072.stdout:0/589: symlink d0/d19/ld1 0 2024-04-15T21:02:49.573 INFO:tasks.workunit.client.1.smithi149.stdout:7/734: getdents d3/d17/df7 0 2024-04-15T21:02:49.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/735: write d3/d16/d20/dab/f106 [598409,39813] 0 2024-04-15T21:02:49.576 INFO:tasks.workunit.client.1.smithi149.stdout:5/711: truncate d0/d6/f6f 1661743 0 2024-04-15T21:02:49.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/607: rename d3/de/d1b/d85/ca0 to d3/de/d1b/d41/da4/d2e/cba 0 2024-04-15T21:02:49.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/736: dread d3/d17/f33 [0,4194304] 0 2024-04-15T21:02:49.579 INFO:tasks.workunit.client.1.smithi149.stdout:9/706: mkdir d23/d2b/d37/d50/d79/d8d/df0 0 2024-04-15T21:02:49.579 INFO:tasks.workunit.client.0.smithi072.stdout:0/590: dwrite d0/d19/fb4 [0,4194304] 0 2024-04-15T21:02:49.580 INFO:tasks.workunit.client.0.smithi072.stdout:1/564: creat d5/db/d27/d9c/fb4 x:0 0 0 2024-04-15T21:02:49.581 INFO:tasks.workunit.client.0.smithi072.stdout:1/565: write d5/f3c [3382860,49343] 0 2024-04-15T21:02:49.581 INFO:tasks.workunit.client.1.smithi149.stdout:6/689: dread da/d18/d33/f7e [0,4194304] 0 2024-04-15T21:02:49.582 INFO:tasks.workunit.client.1.smithi149.stdout:6/690: read - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:49.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/691: stat da/d18/c56 0 2024-04-15T21:02:49.584 INFO:tasks.workunit.client.1.smithi149.stdout:2/789: rename d4/d7/d46/de4/d21/d5e/dbe/lea to d4/d7/d46/l117 0 2024-04-15T21:02:49.585 INFO:tasks.workunit.client.0.smithi072.stdout:4/574: symlink d7/d71/lbd 0 2024-04-15T21:02:49.586 INFO:tasks.workunit.client.0.smithi072.stdout:4/575: write d7/f5c [1471529,79996] 0 2024-04-15T21:02:49.587 INFO:tasks.workunit.client.0.smithi072.stdout:5/546: truncate d0/d3/d7/d1f/f29 807984 0 2024-04-15T21:02:49.590 INFO:tasks.workunit.client.1.smithi149.stdout:6/692: dread da/d18/f86 [8388608,4194304] 0 2024-04-15T21:02:49.592 INFO:tasks.workunit.client.0.smithi072.stdout:8/608: unlink d3/d4/d4c/f6c 0 2024-04-15T21:02:49.594 INFO:tasks.workunit.client.1.smithi149.stdout:9/707: unlink d23/d46/fdd 0 2024-04-15T21:02:49.597 INFO:tasks.workunit.client.0.smithi072.stdout:1/566: symlink d5/db/d2d/d3a/d1f/lb5 0 2024-04-15T21:02:49.599 INFO:tasks.workunit.client.0.smithi072.stdout:4/576: unlink d7/f5c 0 2024-04-15T21:02:49.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/708: mkdir d23/d2b/d37/d50/df1 0 2024-04-15T21:02:49.602 INFO:tasks.workunit.client.0.smithi072.stdout:8/609: rmdir d3/de/d1b/d3f 39 2024-04-15T21:02:49.606 INFO:tasks.workunit.client.1.smithi149.stdout:6/693: unlink da/d18/d10/d66/lb1 0 2024-04-15T21:02:49.608 INFO:tasks.workunit.client.0.smithi072.stdout:1/567: creat d5/db/d2d/d3a/d1f/fb6 x:0 0 0 2024-04-15T21:02:49.610 INFO:tasks.workunit.client.0.smithi072.stdout:1/568: truncate d5/db/d2d/d3a/d1f/d63/f68 4857159 0 2024-04-15T21:02:49.610 INFO:tasks.workunit.client.1.smithi149.stdout:9/709: mknod d23/d3c/d52/cf2 0 2024-04-15T21:02:49.610 INFO:tasks.workunit.client.1.smithi149.stdout:8/843: getdents d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35 0 2024-04-15T21:02:49.612 INFO:tasks.workunit.client.0.smithi072.stdout:5/547: truncate d0/d3/d7/d12/d31/f3d 1424356 0 2024-04-15T21:02:49.613 INFO:tasks.workunit.client.0.smithi072.stdout:5/548: stat d0/d3/d7/d12/d1d/d8c 0 2024-04-15T21:02:49.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/737: dread d3/d39/f89 [0,4194304] 0 2024-04-15T21:02:49.615 INFO:tasks.workunit.client.1.smithi149.stdout:8/844: rmdir d2/d5b/dcd/d10a/d4e/d9f 39 2024-04-15T21:02:49.617 INFO:tasks.workunit.client.0.smithi072.stdout:1/569: creat d5/d3d/fb7 x:0 0 0 2024-04-15T21:02:49.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/570: write d5/db/d2d/f8b [1015326,38423] 0 2024-04-15T21:02:49.619 INFO:tasks.workunit.client.1.smithi149.stdout:9/710: mknod d23/d2b/d37/d6d/de3/cf3 0 2024-04-15T21:02:49.621 INFO:tasks.workunit.client.1.smithi149.stdout:7/738: dread - d3/d39/fa3 zero size 2024-04-15T21:02:49.622 INFO:tasks.workunit.client.0.smithi072.stdout:8/610: creat d3/de/d1b/d3f/fbb x:0 0 0 2024-04-15T21:02:49.623 INFO:tasks.workunit.client.1.smithi149.stdout:8/845: fsync d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f8b 0 2024-04-15T21:02:49.624 INFO:tasks.workunit.client.1.smithi149.stdout:6/694: link da/d18/d10/d16/f9a da/d18/d10/d3f/fd9 0 2024-04-15T21:02:49.625 INFO:tasks.workunit.client.1.smithi149.stdout:9/711: dwrite d23/d2b/d44/fe5 [0,4194304] 0 2024-04-15T21:02:49.626 INFO:tasks.workunit.client.1.smithi149.stdout:6/695: chown da/d11/f22 32 1 2024-04-15T21:02:49.628 INFO:tasks.workunit.client.0.smithi072.stdout:5/549: rename d0/d3/d6/d2d/c91 to d0/d3/d33/d60/d81/cc0 0 2024-04-15T21:02:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:1/571: creat d5/fb8 x:0 0 0 2024-04-15T21:02:49.637 INFO:tasks.workunit.client.1.smithi149.stdout:9/712: symlink d23/d2b/d70/d75/ddb/lf4 0 2024-04-15T21:02:49.638 INFO:tasks.workunit.client.0.smithi072.stdout:5/550: getdents d0/d3/d7/d12/d1d/d8c 0 2024-04-15T21:02:49.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/713: fsync d23/d2b/d44/d7e/f91 0 2024-04-15T21:02:49.640 INFO:tasks.workunit.client.0.smithi072.stdout:1/572: dwrite d5/f8 [0,4194304] 0 2024-04-15T21:02:49.642 INFO:tasks.workunit.client.1.smithi149.stdout:9/714: mkdir d23/d3c/d87/de8/df5 0 2024-04-15T21:02:49.643 INFO:tasks.workunit.client.0.smithi072.stdout:1/573: write d5/f17 [3152768,78048] 0 2024-04-15T21:02:49.648 INFO:tasks.workunit.client.0.smithi072.stdout:8/611: dread d3/de/d1b/d41/d74/f9c [0,4194304] 0 2024-04-15T21:02:49.650 INFO:tasks.workunit.client.1.smithi149.stdout:9/715: dwrite f1d [4194304,4194304] 0 2024-04-15T21:02:49.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/612: rename d3/d4/l14 to d3/de/d1b/d3f/lbc 0 2024-04-15T21:02:49.654 INFO:tasks.workunit.client.0.smithi072.stdout:8/613: write d3/de/d1b/f57 [1381354,73854] 0 2024-04-15T21:02:49.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/551: dread d0/d3/d6/d14/f18 [0,4194304] 0 2024-04-15T21:02:49.661 INFO:tasks.workunit.client.0.smithi072.stdout:5/552: mknod d0/d3/d33/d85/cc1 0 2024-04-15T21:02:49.667 INFO:tasks.workunit.client.0.smithi072.stdout:5/553: dread d0/d3/f83 [0,4194304] 0 2024-04-15T21:02:49.672 INFO:tasks.workunit.client.0.smithi072.stdout:5/554: unlink d0/d3/d7/d12/d31/d62/d8e/f98 0 2024-04-15T21:02:49.673 INFO:tasks.workunit.client.1.smithi149.stdout:8/846: dread d2/d16/f2a [0,4194304] 0 2024-04-15T21:02:49.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/901: dread d1/d5/fc4 [0,4194304] 0 2024-04-15T21:02:49.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/555: dwrite d0/d3/d7/d1f/d4c/fbf [0,4194304] 0 2024-04-15T21:02:49.679 INFO:tasks.workunit.client.1.smithi149.stdout:8/847: rename d2/d5b/dcd/d10a/d25/d57/f8c to d2/d5b/dd6/f12b 0 2024-04-15T21:02:49.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/902: symlink d1/d5/d24/d50/d13/d38/l13e 0 2024-04-15T21:02:49.683 INFO:tasks.workunit.client.1.smithi149.stdout:8/848: symlink d2/d5b/dcd/d10a/d25/d37/d53/daf/l12c 0 2024-04-15T21:02:49.684 INFO:tasks.workunit.client.0.smithi072.stdout:5/556: symlink d0/d3/lc2 0 2024-04-15T21:02:49.685 INFO:tasks.workunit.client.1.smithi149.stdout:0/903: dread - d1/d9/d64/d73/ff4 zero size 2024-04-15T21:02:49.688 INFO:tasks.workunit.client.0.smithi072.stdout:5/557: truncate d0/f7c 268964 0 2024-04-15T21:02:49.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/545: truncate d2/d3/f15 219837 0 2024-04-15T21:02:49.690 INFO:tasks.workunit.client.1.smithi149.stdout:0/904: chown d1/d5/d24/d50/d13/d59/la2 50616 1 2024-04-15T21:02:49.692 INFO:tasks.workunit.client.1.smithi149.stdout:8/849: mkdir d2/d5b/dcd/d10a/d4e/d9f/d12d 0 2024-04-15T21:02:49.695 INFO:tasks.workunit.client.1.smithi149.stdout:5/712: write d0/d6/d82/da1/d12/d2b/f53 [1985663,5528] 0 2024-04-15T21:02:49.701 INFO:tasks.workunit.client.0.smithi072.stdout:2/546: mkdir d2/db3 0 2024-04-15T21:02:49.702 INFO:tasks.workunit.client.1.smithi149.stdout:5/713: getdents d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8 0 2024-04-15T21:02:49.704 INFO:tasks.workunit.client.0.smithi072.stdout:0/591: truncate d0/d45/d35/d3a/f6c 2230972 0 2024-04-15T21:02:49.707 INFO:tasks.workunit.client.0.smithi072.stdout:0/592: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2 0 2024-04-15T21:02:49.709 INFO:tasks.workunit.client.1.smithi149.stdout:5/714: creat d0/d6/d82/da1/fe3 x:0 0 0 2024-04-15T21:02:49.709 INFO:tasks.workunit.client.1.smithi149.stdout:0/905: dread d1/d5/dc/f46 [0,4194304] 0 2024-04-15T21:02:49.710 INFO:tasks.workunit.client.0.smithi072.stdout:2/547: getdents d2/da8 0 2024-04-15T21:02:49.711 INFO:tasks.workunit.client.0.smithi072.stdout:0/593: symlink d0/d19/d2b/ld3 0 2024-04-15T21:02:49.713 INFO:tasks.workunit.client.1.smithi149.stdout:0/906: symlink d1/d9/d64/d65/d104/l13f 0 2024-04-15T21:02:49.713 INFO:tasks.workunit.client.0.smithi072.stdout:4/577: dwrite d7/f43 [0,4194304] 0 2024-04-15T21:02:49.713 INFO:tasks.workunit.client.0.smithi072.stdout:4/578: readlink d7/d10/l67 0 2024-04-15T21:02:49.715 INFO:tasks.workunit.client.1.smithi149.stdout:5/715: write d0/d6/d82/da1/d12/d16/da9/d1b/d61/f80 [4013459,53369] 0 2024-04-15T21:02:49.724 INFO:tasks.workunit.client.0.smithi072.stdout:4/579: dwrite d7/d10/d41/d45/fba [4194304,4194304] 0 2024-04-15T21:02:49.725 INFO:tasks.workunit.client.1.smithi149.stdout:5/716: creat d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8/fe4 x:0 0 0 2024-04-15T21:02:49.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/739: dwrite d3/d16/fac [0,4194304] 0 2024-04-15T21:02:49.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/580: mknod d7/d24/cbe 0 2024-04-15T21:02:49.738 INFO:tasks.workunit.client.0.smithi072.stdout:1/574: write d5/db/d2d/d3a/f2e [1098100,93440] 0 2024-04-15T21:02:49.740 INFO:tasks.workunit.client.1.smithi149.stdout:5/717: write d0/d9/db6/f62 [2129255,97139] 0 2024-04-15T21:02:49.742 INFO:tasks.workunit.client.0.smithi072.stdout:1/575: dwrite d5/d31/f49 [0,4194304] 0 2024-04-15T21:02:49.750 INFO:tasks.workunit.client.1.smithi149.stdout:6/696: dwrite da/d18/d10/f8b [4194304,4194304] 0 2024-04-15T21:02:49.751 INFO:tasks.workunit.client.1.smithi149.stdout:0/907: dread d1/d9/d64/d73/f111 [0,4194304] 0 2024-04-15T21:02:49.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/718: dread - d0/d6/d82/da1/d12/d16/da9/d1b/d83/f90 zero size 2024-04-15T21:02:49.754 INFO:tasks.workunit.client.0.smithi072.stdout:1/576: creat d5/d31/d51/d82/fb9 x:0 0 0 2024-04-15T21:02:49.758 INFO:tasks.workunit.client.0.smithi072.stdout:4/581: rename d7/d10/d41/l99 to d7/d28/d42/lbf 0 2024-04-15T21:02:49.762 INFO:tasks.workunit.client.0.smithi072.stdout:2/548: write d2/d3/f15 [687021,124231] 0 2024-04-15T21:02:49.770 INFO:tasks.workunit.client.0.smithi072.stdout:5/558: dwrite d0/d3/d7/d12/f54 [0,4194304] 0 2024-04-15T21:02:49.771 INFO:tasks.workunit.client.1.smithi149.stdout:8/850: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/ff9 [0,4194304] 0 2024-04-15T21:02:49.774 INFO:tasks.workunit.client.0.smithi072.stdout:4/582: write d7/f43 [5098280,71842] 0 2024-04-15T21:02:49.785 INFO:tasks.workunit.client.0.smithi072.stdout:4/583: creat d7/d10/d41/d44/d7a/fc0 x:0 0 0 2024-04-15T21:02:49.787 INFO:tasks.workunit.client.1.smithi149.stdout:7/740: dread d3/d34/db6/dfb/ffd [0,4194304] 0 2024-04-15T21:02:49.792 INFO:tasks.workunit.client.0.smithi072.stdout:4/584: rename d7/d15/c16 to d7/d10/cc1 0 2024-04-15T21:02:49.793 INFO:tasks.workunit.client.0.smithi072.stdout:4/585: truncate d7/d10/d41/d44/d7a/fc0 21198 0 2024-04-15T21:02:49.794 INFO:tasks.workunit.client.0.smithi072.stdout:4/586: truncate d7/d10/d41/d45/f8a 815435 0 2024-04-15T21:02:49.794 INFO:tasks.workunit.client.0.smithi072.stdout:1/577: link d5/db/d2d/d56/d93/l9e d5/d31/lba 0 2024-04-15T21:02:49.800 INFO:tasks.workunit.client.0.smithi072.stdout:5/559: getdents d0/d3/d7 0 2024-04-15T21:02:49.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/587: dwrite d7/d28/d42/da1/da2/fa5 [0,4194304] 0 2024-04-15T21:02:49.806 INFO:tasks.workunit.client.0.smithi072.stdout:2/549: dread d2/d8/fe [4194304,4194304] 0 2024-04-15T21:02:49.808 INFO:tasks.workunit.client.0.smithi072.stdout:5/560: symlink d0/d3/lc3 0 2024-04-15T21:02:49.808 INFO:tasks.workunit.client.0.smithi072.stdout:5/561: chown d0/d3/d7/d94/d86 7955406 1 2024-04-15T21:02:49.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/562: symlink d0/d3/d7/d12/d31/d62/lc4 0 2024-04-15T21:02:49.816 INFO:tasks.workunit.client.1.smithi149.stdout:6/697: fdatasync da/d18/d10/d16/d97/f95 0 2024-04-15T21:02:49.817 INFO:tasks.workunit.client.0.smithi072.stdout:2/550: getdents d2/db3 0 2024-04-15T21:02:49.823 INFO:tasks.workunit.client.0.smithi072.stdout:5/563: dwrite d0/d3/d6/f2b [0,4194304] 0 2024-04-15T21:02:49.826 INFO:tasks.workunit.client.0.smithi072.stdout:2/551: symlink d2/d66/d96/lb4 0 2024-04-15T21:02:49.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/908: mkdir d1/d9/d12f/d140 0 2024-04-15T21:02:49.830 INFO:tasks.workunit.client.1.smithi149.stdout:7/741: mkdir d3/d17/d108 0 2024-04-15T21:02:49.832 INFO:tasks.workunit.client.0.smithi072.stdout:5/564: write d0/d3/d33/d60/fb3 [2809,10557] 0 2024-04-15T21:02:49.834 INFO:tasks.workunit.client.0.smithi072.stdout:2/552: symlink d2/d38/d91/lb5 0 2024-04-15T21:02:49.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/742: rmdir d3/d34/db6/dfb 39 2024-04-15T21:02:49.838 INFO:tasks.workunit.client.0.smithi072.stdout:4/588: dwrite d7/f4f [0,4194304] 0 2024-04-15T21:02:49.841 INFO:tasks.workunit.client.1.smithi149.stdout:5/719: dread d0/d6/d82/da1/d12/d16/da9/f40 [0,4194304] 0 2024-04-15T21:02:49.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/720: dread - d0/d9/d3f/d47/f7a zero size 2024-04-15T21:02:49.844 INFO:tasks.workunit.client.1.smithi149.stdout:7/743: symlink d3/d39/d92/l109 0 2024-04-15T21:02:49.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/589: rename d7/d15/d58/d62/f72 to d7/d10/d41/d45/fc2 0 2024-04-15T21:02:49.851 INFO:tasks.workunit.client.0.smithi072.stdout:2/553: symlink d2/d38/d91/d97/lb6 0 2024-04-15T21:02:49.853 INFO:tasks.workunit.client.0.smithi072.stdout:2/554: truncate d2/d3/fb2 499891 0 2024-04-15T21:02:49.855 INFO:tasks.workunit.client.0.smithi072.stdout:4/590: dwrite d7/d15/d58/f77 [0,4194304] 0 2024-04-15T21:02:49.856 INFO:tasks.workunit.client.1.smithi149.stdout:5/721: creat d0/fe5 x:0 0 0 2024-04-15T21:02:49.856 INFO:tasks.workunit.client.0.smithi072.stdout:5/565: getdents d0/d3/d7/d12/d31/d62/db6 0 2024-04-15T21:02:49.857 INFO:tasks.workunit.client.0.smithi072.stdout:4/591: stat d7/d28/d42/da1/da2/lab 0 2024-04-15T21:02:49.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/722: truncate d0/f56 1602449 0 2024-04-15T21:02:49.861 INFO:tasks.workunit.client.1.smithi149.stdout:5/723: mknod d0/d6/ce6 0 2024-04-15T21:02:49.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/724: mknod d0/d9/ce7 0 2024-04-15T21:02:49.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/698: write da/d18/d10/d16/d97/dbf/d55/fa7 [795413,104216] 0 2024-04-15T21:02:49.868 INFO:tasks.workunit.client.0.smithi072.stdout:4/592: dread d7/d10/d41/d44/d7a/fa6 [0,4194304] 0 2024-04-15T21:02:49.870 INFO:tasks.workunit.client.0.smithi072.stdout:4/593: chown d7/d10/c3d 504555 1 2024-04-15T21:02:49.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/725: dread - d0/d6/d82/da1/d12/d16/da9/d1b/d60/fc0 zero size 2024-04-15T21:02:49.875 INFO:tasks.workunit.client.0.smithi072.stdout:4/594: rmdir d7/d71/db2 39 2024-04-15T21:02:49.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/744: write d3/d39/f79 [1634022,75777] 0 2024-04-15T21:02:49.875 INFO:tasks.workunit.client.1.smithi149.stdout:6/699: dread da/d18/d10/d16/d97/dbf/fcb [0,4194304] 0 2024-04-15T21:02:49.876 INFO:tasks.workunit.client.1.smithi149.stdout:0/909: dwrite d1/d9/d64/d65/d104/d119/fe6 [0,4194304] 0 2024-04-15T21:02:49.880 INFO:tasks.workunit.client.0.smithi072.stdout:5/566: write d0/d3/d6/ff [4722620,61344] 0 2024-04-15T21:02:49.882 INFO:tasks.workunit.client.1.smithi149.stdout:7/745: dread d3/d96/ff1 [0,4194304] 0 2024-04-15T21:02:49.882 INFO:tasks.workunit.client.1.smithi149.stdout:6/700: symlink da/d18/d10/d3f/lda 0 2024-04-15T21:02:49.884 INFO:tasks.workunit.client.0.smithi072.stdout:4/595: link d7/d28/d42/c7d d7/d10/d41/d45/d7c/cc3 0 2024-04-15T21:02:49.885 INFO:tasks.workunit.client.0.smithi072.stdout:4/596: dread - d7/d28/d6d/f92 zero size 2024-04-15T21:02:49.886 INFO:tasks.workunit.client.0.smithi072.stdout:5/567: creat d0/d3/d7/d12/d31/d55/d58/fc5 x:0 0 0 2024-04-15T21:02:49.887 INFO:tasks.workunit.client.1.smithi149.stdout:6/701: symlink da/d11/dbe/ldb 0 2024-04-15T21:02:49.888 INFO:tasks.workunit.client.1.smithi149.stdout:6/702: chown da/d18/c3b 221692 1 2024-04-15T21:02:49.888 INFO:tasks.workunit.client.0.smithi072.stdout:2/555: dread d2/d37/f75 [0,4194304] 0 2024-04-15T21:02:49.888 INFO:tasks.workunit.client.0.smithi072.stdout:4/597: write d7/d10/d41/d45/fc2 [4915169,54639] 0 2024-04-15T21:02:49.889 INFO:tasks.workunit.client.0.smithi072.stdout:2/556: chown d2/d8/daa/l9b 590052 1 2024-04-15T21:02:49.889 INFO:tasks.workunit.client.1.smithi149.stdout:6/703: dread da/d2e/f64 [0,4194304] 0 2024-04-15T21:02:49.892 INFO:tasks.workunit.client.1.smithi149.stdout:7/746: rename d3/d16/d32/d90/dad/dc4/dd6/c102 to d3/d17/d1f/d93/c10a 0 2024-04-15T21:02:49.892 INFO:tasks.workunit.client.1.smithi149.stdout:6/704: symlink da/d11/dcc/ldc 0 2024-04-15T21:02:49.894 INFO:tasks.workunit.client.0.smithi072.stdout:4/598: mkdir d7/d10/d41/dc4 0 2024-04-15T21:02:49.895 INFO:tasks.workunit.client.0.smithi072.stdout:4/599: fsync d7/f38 0 2024-04-15T21:02:49.896 INFO:tasks.workunit.client.1.smithi149.stdout:6/705: link da/d18/d10/d16/d97/f98 da/d32/fdd 0 2024-04-15T21:02:49.898 INFO:tasks.workunit.client.1.smithi149.stdout:6/706: creat da/d18/d10/d3f/fde x:0 0 0 2024-04-15T21:02:49.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/707: creat da/fdf x:0 0 0 2024-04-15T21:02:49.905 INFO:tasks.workunit.client.0.smithi072.stdout:5/568: write d0/d3/d7/d12/d31/d55/d58/f66 [963712,2917] 0 2024-04-15T21:02:49.906 INFO:tasks.workunit.client.0.smithi072.stdout:5/569: chown d0/d3/d7/d12/d31/d49/c5a 1273651 1 2024-04-15T21:02:49.907 INFO:tasks.workunit.client.0.smithi072.stdout:5/570: chown d0/d3/d33/d60/d81/l68 33483566 1 2024-04-15T21:02:49.908 INFO:tasks.workunit.client.1.smithi149.stdout:0/910: dread d1/d29/fef [0,4194304] 0 2024-04-15T21:02:49.909 INFO:tasks.workunit.client.1.smithi149.stdout:6/708: dwrite da/d18/d10/d3f/faa [0,4194304] 0 2024-04-15T21:02:49.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/747: write d3/d17/f19 [838781,108120] 0 2024-04-15T21:02:49.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/748: chown d3/f18 2820001 1 2024-04-15T21:02:49.918 INFO:tasks.workunit.client.0.smithi072.stdout:2/557: dread d2/d37/f49 [0,4194304] 0 2024-04-15T21:02:49.919 INFO:tasks.workunit.client.0.smithi072.stdout:2/558: dread - d2/d64/f87 zero size 2024-04-15T21:02:49.920 INFO:tasks.workunit.client.1.smithi149.stdout:0/911: rename d1/d9/d64/d65/fb4 to d1/d9/d64/d73/f141 0 2024-04-15T21:02:49.921 INFO:tasks.workunit.client.1.smithi149.stdout:7/749: creat d3/d16/d32/f10b x:0 0 0 2024-04-15T21:02:49.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/912: creat d1/d9/d64/d73/f142 x:0 0 0 2024-04-15T21:02:49.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/750: mknod d3/d16/d20/d60/c10c 0 2024-04-15T21:02:49.927 INFO:tasks.workunit.client.1.smithi149.stdout:0/913: mkdir d1/d9/d64/d73/da3/d143 0 2024-04-15T21:02:49.932 INFO:tasks.workunit.client.1.smithi149.stdout:7/751: symlink d3/l10d 0 2024-04-15T21:02:49.934 INFO:tasks.workunit.client.1.smithi149.stdout:7/752: truncate d3/d96/ff1 1034721 0 2024-04-15T21:02:49.935 INFO:tasks.workunit.client.1.smithi149.stdout:6/709: dwrite da/d18/d10/d16/d97/f98 [0,4194304] 0 2024-04-15T21:02:49.937 INFO:tasks.workunit.client.1.smithi149.stdout:0/914: getdents d1/d5/d24/d50/d13/d38/d44 0 2024-04-15T21:02:49.938 INFO:tasks.workunit.client.1.smithi149.stdout:7/753: mkdir d3/d16/d20/d36/d3d/d56/d10e 0 2024-04-15T21:02:49.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/915: creat d1/f144 x:0 0 0 2024-04-15T21:02:49.948 INFO:tasks.workunit.client.1.smithi149.stdout:3/795: sync 2024-04-15T21:02:49.949 INFO:tasks.workunit.client.1.smithi149.stdout:7/754: mknod d3/d34/db6/c10f 0 2024-04-15T21:02:49.950 INFO:tasks.workunit.client.1.smithi149.stdout:7/755: truncate d3/d39/f79 4862031 0 2024-04-15T21:02:49.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/710: creat da/d18/fe0 x:0 0 0 2024-04-15T21:02:49.952 INFO:tasks.workunit.client.1.smithi149.stdout:3/796: dread - d1/f7c zero size 2024-04-15T21:02:49.954 INFO:tasks.workunit.client.1.smithi149.stdout:7/756: mkdir d3/d16/d32/d110 0 2024-04-15T21:02:49.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/757: dread - d3/d16/d20/d9c/fbc zero size 2024-04-15T21:02:49.956 INFO:tasks.workunit.client.1.smithi149.stdout:7/758: fsync d3/d39/f79 0 2024-04-15T21:02:49.958 INFO:tasks.workunit.client.1.smithi149.stdout:3/797: mknod d1/db/d24/d39/d79/d97/cf9 0 2024-04-15T21:02:49.962 INFO:tasks.workunit.client.1.smithi149.stdout:6/711: rename da/d11/d90/cd5 to da/d18/d10/d3f/ce1 0 2024-04-15T21:02:49.966 INFO:tasks.workunit.client.1.smithi149.stdout:7/759: read d3/d16/d20/d36/d3d/f9d [859871,32746] 0 2024-04-15T21:02:49.967 INFO:tasks.workunit.client.1.smithi149.stdout:6/712: creat da/d18/d10/d3f/fe2 x:0 0 0 2024-04-15T21:02:49.970 INFO:tasks.workunit.client.0.smithi072.stdout:5/571: chown d0/d3/d7/d94/d92/cb5 439505100 1 2024-04-15T21:02:49.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/760: chown d3/d16/d20/d36/d3d/c4c 242 1 2024-04-15T21:02:49.974 INFO:tasks.workunit.client.0.smithi072.stdout:2/559: symlink d2/d66/d69/lb7 0 2024-04-15T21:02:49.975 INFO:tasks.workunit.client.1.smithi149.stdout:0/916: symlink d1/d5/d24/d50/d13/d38/l145 0 2024-04-15T21:02:49.975 INFO:tasks.workunit.client.0.smithi072.stdout:5/572: dwrite d0/d3/d7/d12/f99 [0,4194304] 0 2024-04-15T21:02:49.979 INFO:tasks.workunit.client.1.smithi149.stdout:3/798: creat d1/db/d28/ffa x:0 0 0 2024-04-15T21:02:49.981 INFO:tasks.workunit.client.1.smithi149.stdout:7/761: mkdir d3/d16/d111 0 2024-04-15T21:02:49.983 INFO:tasks.workunit.client.1.smithi149.stdout:0/917: rmdir d1/d5/d24/d100 39 2024-04-15T21:02:49.984 INFO:tasks.workunit.client.0.smithi072.stdout:2/560: mkdir d2/d8/d41/db8 0 2024-04-15T21:02:49.984 INFO:tasks.workunit.client.0.smithi072.stdout:7/585: sync 2024-04-15T21:02:49.984 INFO:tasks.workunit.client.0.smithi072.stdout:9/569: sync 2024-04-15T21:02:49.984 INFO:tasks.workunit.client.0.smithi072.stdout:5/573: unlink d0/d3/d7/d12/d31/d49/l6f 0 2024-04-15T21:02:49.987 INFO:tasks.workunit.client.0.smithi072.stdout:5/574: chown d0/f7c 516 1 2024-04-15T21:02:49.988 INFO:tasks.workunit.client.1.smithi149.stdout:3/799: creat d1/db/d28/de7/ffb x:0 0 0 2024-04-15T21:02:49.990 INFO:tasks.workunit.client.0.smithi072.stdout:9/570: unlink d4/d29/l32 0 2024-04-15T21:02:49.991 INFO:tasks.workunit.client.1.smithi149.stdout:7/762: mkdir d3/d112 0 2024-04-15T21:02:49.992 INFO:tasks.workunit.client.0.smithi072.stdout:2/561: symlink d2/d38/d91/lb9 0 2024-04-15T21:02:49.992 INFO:tasks.workunit.client.0.smithi072.stdout:9/571: dread d4/d1f/d2c/d62/f96 [0,4194304] 0 2024-04-15T21:02:49.993 INFO:tasks.workunit.client.1.smithi149.stdout:7/763: truncate d3/d17/fea 470553 0 2024-04-15T21:02:49.993 INFO:tasks.workunit.client.0.smithi072.stdout:9/572: stat d4/d1f/f24 0 2024-04-15T21:02:49.993 INFO:tasks.workunit.client.0.smithi072.stdout:9/573: chown d4/d1f/d2c/c64 1 1 2024-04-15T21:02:49.994 INFO:tasks.workunit.client.1.smithi149.stdout:0/918: truncate d1/d29/dbb/f10b 1617783 0 2024-04-15T21:02:49.994 INFO:tasks.workunit.client.0.smithi072.stdout:9/574: chown f3 29805586 1 2024-04-15T21:02:49.994 INFO:tasks.workunit.client.1.smithi149.stdout:3/800: dwrite d1/db/ff3 [0,4194304] 0 2024-04-15T21:02:49.995 INFO:tasks.workunit.client.0.smithi072.stdout:7/586: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/cb5 0 2024-04-15T21:02:49.995 INFO:tasks.workunit.client.1.smithi149.stdout:0/919: truncate d1/f144 844304 0 2024-04-15T21:02:49.995 INFO:tasks.workunit.client.0.smithi072.stdout:7/587: fsync d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f19 0 2024-04-15T21:02:49.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/801: chown d1/db/d24/d39/l7e 94452 1 2024-04-15T21:02:49.999 INFO:tasks.workunit.client.0.smithi072.stdout:5/575: rename d0/d3/d7/d12/d31/d62/lc4 to d0/d3/d7/d12/d31/d62/db6/lc6 0 2024-04-15T21:02:50.001 INFO:tasks.workunit.client.0.smithi072.stdout:7/588: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3f [0,4194304] 0 2024-04-15T21:02:50.002 INFO:tasks.workunit.client.1.smithi149.stdout:6/713: dwrite da/d18/d10/f68 [4194304,4194304] 0 2024-04-15T21:02:50.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/714: write da/d18/f23 [2190135,16392] 0 2024-04-15T21:02:50.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/802: mknod d1/db/d24/d8a/cfc 0 2024-04-15T21:02:50.013 INFO:tasks.workunit.client.0.smithi072.stdout:9/575: rename d4/d29/d4c/d74/d84/ca4 to d4/d1f/d9e/cb1 0 2024-04-15T21:02:50.014 INFO:tasks.workunit.client.0.smithi072.stdout:9/576: write d4/d29/f36 [4878764,57501] 0 2024-04-15T21:02:50.015 INFO:tasks.workunit.client.0.smithi072.stdout:9/577: chown d4/d1f/l22 17994149 1 2024-04-15T21:02:50.022 INFO:tasks.workunit.client.1.smithi149.stdout:3/803: dread d1/db/d24/d4d/d63/d65/fb1 [0,4194304] 0 2024-04-15T21:02:50.022 INFO:tasks.workunit.client.1.smithi149.stdout:7/764: dread d3/d39/f5d [0,4194304] 0 2024-04-15T21:02:50.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/715: symlink da/le3 0 2024-04-15T21:02:50.023 INFO:tasks.workunit.client.0.smithi072.stdout:2/562: mkdir d2/db3/dba 0 2024-04-15T21:02:50.025 INFO:tasks.workunit.client.0.smithi072.stdout:7/589: rename d2/d7/d25/f75 to d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 0 2024-04-15T21:02:50.029 INFO:tasks.workunit.client.0.smithi072.stdout:5/576: mknod d0/d3/d7/d12/cc7 0 2024-04-15T21:02:50.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/716: write da/d18/f86 [633577,79324] 0 2024-04-15T21:02:50.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/804: fdatasync d1/db/d24/d4d/f82 0 2024-04-15T21:02:50.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/717: creat da/d18/d10/d16/d97/dbf/d55/d82/fe4 x:0 0 0 2024-04-15T21:02:50.036 INFO:tasks.workunit.client.0.smithi072.stdout:7/590: creat d2/d7/d25/d2d/d52/fb7 x:0 0 0 2024-04-15T21:02:50.037 INFO:tasks.workunit.client.1.smithi149.stdout:6/718: truncate da/d18/d10/d3f/fde 864781 0 2024-04-15T21:02:50.037 INFO:tasks.workunit.client.0.smithi072.stdout:7/591: readlink d2/d7/d25/d2d/d46/d5a/d5f/l4d 0 2024-04-15T21:02:50.039 INFO:tasks.workunit.client.1.smithi149.stdout:3/805: mknod d1/db/d24/d39/dc0/cfd 0 2024-04-15T21:02:50.042 INFO:tasks.workunit.client.1.smithi149.stdout:7/765: rename d3/d34/l7f to d3/d16/d20/d60/l113 0 2024-04-15T21:02:50.043 INFO:tasks.workunit.client.1.smithi149.stdout:7/766: dread - d3/d16/d20/fd9 zero size 2024-04-15T21:02:50.046 INFO:tasks.workunit.client.0.smithi072.stdout:7/592: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d43/db8 0 2024-04-15T21:02:50.047 INFO:tasks.workunit.client.0.smithi072.stdout:9/578: link d4/d29/d4c/d91/d93/l97 d4/d29/d4c/d91/lb2 0 2024-04-15T21:02:50.048 INFO:tasks.workunit.client.1.smithi149.stdout:6/719: rmdir da/d18/d10/d16/d97/dbf/d55/d82 39 2024-04-15T21:02:50.049 INFO:tasks.workunit.client.1.smithi149.stdout:6/720: fsync da/d18/d10/d16/d97/dbf/fa4 0 2024-04-15T21:02:50.052 INFO:tasks.workunit.client.0.smithi072.stdout:9/579: rmdir d4/d29/d4c/d91 39 2024-04-15T21:02:50.054 INFO:tasks.workunit.client.0.smithi072.stdout:2/563: dread d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:50.055 INFO:tasks.workunit.client.1.smithi149.stdout:6/721: dwrite da/d18/d10/f68 [4194304,4194304] 0 2024-04-15T21:02:50.056 INFO:tasks.workunit.client.0.smithi072.stdout:7/593: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d26/f29 [0,4194304] 0 2024-04-15T21:02:50.058 INFO:tasks.workunit.client.1.smithi149.stdout:3/806: rename d1/db/d40/da0/dd8/cec to d1/db/d28/cfe 0 2024-04-15T21:02:50.059 INFO:tasks.workunit.client.0.smithi072.stdout:2/564: mkdir d2/d38/d91/dbb 0 2024-04-15T21:02:50.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/722: unlink da/d18/d10/d16/d97/f98 0 2024-04-15T21:02:50.061 INFO:tasks.workunit.client.0.smithi072.stdout:5/577: dread d0/f80 [0,4194304] 0 2024-04-15T21:02:50.062 INFO:tasks.workunit.client.1.smithi149.stdout:3/807: readlink d1/db/d40/d56/d84/d85/le4 0 2024-04-15T21:02:50.062 INFO:tasks.workunit.client.0.smithi072.stdout:9/580: dwrite d4/d76/f7a [0,4194304] 0 2024-04-15T21:02:50.064 INFO:tasks.workunit.client.0.smithi072.stdout:7/594: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d43/db9 0 2024-04-15T21:02:50.065 INFO:tasks.workunit.client.0.smithi072.stdout:2/565: unlink d2/d8/f3a 0 2024-04-15T21:02:50.069 INFO:tasks.workunit.client.0.smithi072.stdout:9/581: mkdir d4/d1f/d9e/db3 0 2024-04-15T21:02:50.071 INFO:tasks.workunit.client.1.smithi149.stdout:7/767: rename d3/d34 to d3/d16/d20/d114 0 2024-04-15T21:02:50.072 INFO:tasks.workunit.client.0.smithi072.stdout:2/566: dwrite d2/d38/f54 [4194304,4194304] 0 2024-04-15T21:02:50.076 INFO:tasks.workunit.client.0.smithi072.stdout:5/578: mknod d0/d3/d6/d2d/d79/cc8 0 2024-04-15T21:02:50.082 INFO:tasks.workunit.client.0.smithi072.stdout:7/595: symlink d2/d7/lba 0 2024-04-15T21:02:50.083 INFO:tasks.workunit.client.0.smithi072.stdout:7/596: write d2/d7/d25/d2d/d52/f9d [568431,120239] 0 2024-04-15T21:02:50.084 INFO:tasks.workunit.client.0.smithi072.stdout:5/579: mknod d0/d3/d7/cc9 0 2024-04-15T21:02:50.084 INFO:tasks.workunit.client.0.smithi072.stdout:5/580: chown d0/d3/d6/d14 25 1 2024-04-15T21:02:50.085 INFO:tasks.workunit.client.1.smithi149.stdout:7/768: dwrite d3/d16/d20/d114/fd1 [4194304,4194304] 0 2024-04-15T21:02:50.087 INFO:tasks.workunit.client.0.smithi072.stdout:5/581: dread d0/f80 [0,4194304] 0 2024-04-15T21:02:50.090 INFO:tasks.workunit.client.0.smithi072.stdout:9/582: link d4/f86 d4/d1f/d31/d42/fb4 0 2024-04-15T21:02:50.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/597: dread - d2/d7/d25/f8b zero size 2024-04-15T21:02:50.092 INFO:tasks.workunit.client.1.smithi149.stdout:6/723: getdents da 0 2024-04-15T21:02:50.094 INFO:tasks.workunit.client.1.smithi149.stdout:6/724: write da/d18/d10/d16/d97/dbf/fa4 [336340,39723] 0 2024-04-15T21:02:50.098 INFO:tasks.workunit.client.1.smithi149.stdout:7/769: write d3/d16/d32/d90/dad/fc8 [819101,87933] 0 2024-04-15T21:02:50.100 INFO:tasks.workunit.client.0.smithi072.stdout:9/583: dread - d4/d29/d4c/d91/d93/fa0 zero size 2024-04-15T21:02:50.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/808: write d1/db/f1d [1502887,12103] 0 2024-04-15T21:02:50.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/725: truncate da/d18/d10/d16/d97/f95 467567 0 2024-04-15T21:02:50.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/598: creat d2/d78/fbb x:0 0 0 2024-04-15T21:02:50.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/567: link d2/d38/d73/f7d d2/d8/fbc 0 2024-04-15T21:02:50.106 INFO:tasks.workunit.client.0.smithi072.stdout:9/584: dwrite d4/d29/d45/fa1 [0,4194304] 0 2024-04-15T21:02:50.107 INFO:tasks.workunit.client.1.smithi149.stdout:7/770: symlink d3/d16/d20/db5/l115 0 2024-04-15T21:02:50.107 INFO:tasks.workunit.client.0.smithi072.stdout:2/568: truncate d2/d64/f87 658940 0 2024-04-15T21:02:50.111 INFO:tasks.workunit.client.1.smithi149.stdout:6/726: creat da/d60/d9b/fe5 x:0 0 0 2024-04-15T21:02:50.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/727: chown da/fdf 473069848 1 2024-04-15T21:02:50.114 INFO:tasks.workunit.client.0.smithi072.stdout:2/569: mkdir d2/d64/dbd 0 2024-04-15T21:02:50.117 INFO:tasks.workunit.client.0.smithi072.stdout:9/585: link d4/f1c d4/d1f/d31/d4d/dae/fb5 0 2024-04-15T21:02:50.119 INFO:tasks.workunit.client.0.smithi072.stdout:2/570: fdatasync d2/d3/f46 0 2024-04-15T21:02:50.120 INFO:tasks.workunit.client.0.smithi072.stdout:9/586: rmdir d4/d1f/d9e 39 2024-04-15T21:02:50.123 INFO:tasks.workunit.client.1.smithi149.stdout:6/728: mknod da/d18/d10/d16/d97/dbf/d55/ce6 0 2024-04-15T21:02:50.124 INFO:tasks.workunit.client.0.smithi072.stdout:6/553: sync 2024-04-15T21:02:50.124 INFO:tasks.workunit.client.1.smithi149.stdout:6/729: fdatasync da/d18/d10/d66/f80 0 2024-04-15T21:02:50.127 INFO:tasks.workunit.client.1.smithi149.stdout:7/771: getdents d3/d16/d20/d36/d3d/da4 0 2024-04-15T21:02:50.130 INFO:tasks.workunit.client.1.smithi149.stdout:7/772: creat d3/da9/f116 x:0 0 0 2024-04-15T21:02:50.131 INFO:tasks.workunit.client.0.smithi072.stdout:6/554: creat d2/d10/d18/fa5 x:0 0 0 2024-04-15T21:02:50.132 INFO:tasks.workunit.client.0.smithi072.stdout:6/555: write d2/d1a/f41 [1404136,86521] 0 2024-04-15T21:02:50.134 INFO:tasks.workunit.client.1.smithi149.stdout:7/773: fdatasync d3/d39/faf 0 2024-04-15T21:02:50.136 INFO:tasks.workunit.client.0.smithi072.stdout:9/587: rename d4/d1f/d9e/cb1 to d4/d29/d4c/d74/cb6 0 2024-04-15T21:02:50.138 INFO:tasks.workunit.client.1.smithi149.stdout:3/809: dread d1/fd [0,4194304] 0 2024-04-15T21:02:50.139 INFO:tasks.workunit.client.1.smithi149.stdout:3/810: chown d1/db/d24/d2b/c8d 7381 1 2024-04-15T21:02:50.141 INFO:tasks.workunit.client.0.smithi072.stdout:9/588: dwrite d4/d1f/d2c/d47/f5f [0,4194304] 0 2024-04-15T21:02:50.141 INFO:tasks.workunit.client.0.smithi072.stdout:9/589: readlink d4/l95 0 2024-04-15T21:02:50.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/556: dread d2/d40/d6e/f36 [0,4194304] 0 2024-04-15T21:02:50.151 INFO:tasks.workunit.client.1.smithi149.stdout:1/714: sync 2024-04-15T21:02:50.151 INFO:tasks.workunit.client.1.smithi149.stdout:8/851: sync 2024-04-15T21:02:50.151 INFO:tasks.workunit.client.1.smithi149.stdout:2/790: sync 2024-04-15T21:02:50.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/716: sync 2024-04-15T21:02:50.152 INFO:tasks.workunit.client.1.smithi149.stdout:4/804: sync 2024-04-15T21:02:50.154 INFO:tasks.workunit.client.0.smithi072.stdout:6/557: rename d2/d10/d11/l79 to d2/d10/d11/d1f/la6 0 2024-04-15T21:02:50.154 INFO:tasks.workunit.client.1.smithi149.stdout:1/715: fdatasync d1/db/dc/d11/d3f/d45/fc1 0 2024-04-15T21:02:50.155 INFO:tasks.workunit.client.1.smithi149.stdout:1/716: stat d1/f6 0 2024-04-15T21:02:50.157 INFO:tasks.workunit.client.1.smithi149.stdout:4/805: creat dc/d2c/d3e/d35/d4b/d6c/d70/dab/f10d x:0 0 0 2024-04-15T21:02:50.160 INFO:tasks.workunit.client.1.smithi149.stdout:2/791: truncate d4/d7/d46/de4/d21/d2c/d32/d4a/fb2 3758237 0 2024-04-15T21:02:50.160 INFO:tasks.workunit.client.1.smithi149.stdout:4/806: fsync dc/d2c/d3e/d15/d5b/f74 0 2024-04-15T21:02:50.162 INFO:tasks.workunit.client.1.smithi149.stdout:9/717: dwrite f1d [4194304,4194304] 0 2024-04-15T21:02:50.162 INFO:tasks.workunit.client.0.smithi072.stdout:9/590: dread d4/d29/f71 [0,4194304] 0 2024-04-15T21:02:50.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:49 smithi072 ceph-mon[29079]: pgmap v9: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 88 MiB/s rd, 219 MiB/s wr, 434 op/s 2024-04-15T21:02:50.163 INFO:tasks.workunit.client.1.smithi149.stdout:2/792: chown d4/d7/d46/de4/d21/d2c/d32 717 1 2024-04-15T21:02:50.164 INFO:tasks.workunit.client.1.smithi149.stdout:8/852: dwrite d2/d5b/dcd/d10a/d20/d6b/d109/f117 [0,4194304] 0 2024-04-15T21:02:50.164 INFO:tasks.workunit.client.1.smithi149.stdout:1/717: rename d1/db/dc/d38/c6e to d1/db/dc/ccc 0 2024-04-15T21:02:50.166 INFO:tasks.workunit.client.1.smithi149.stdout:9/718: stat d23/d46/dcf/deb/d7f/d86/dc5/fc9 0 2024-04-15T21:02:50.166 INFO:tasks.workunit.client.1.smithi149.stdout:4/807: truncate dc/d18/d21/f6b 8450771 0 2024-04-15T21:02:50.167 INFO:tasks.workunit.client.0.smithi072.stdout:9/591: mkdir d4/d1f/db7 0 2024-04-15T21:02:50.169 INFO:tasks.workunit.client.1.smithi149.stdout:4/808: chown dc/d2c/d3e/d35/d4b/d75/db3/f102 63 1 2024-04-15T21:02:50.170 INFO:tasks.workunit.client.1.smithi149.stdout:1/718: chown d1/db/dc/d38/d39/l53 0 1 2024-04-15T21:02:50.171 INFO:tasks.workunit.client.1.smithi149.stdout:8/853: chown d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e 253703 1 2024-04-15T21:02:50.172 INFO:tasks.workunit.client.1.smithi149.stdout:4/809: stat dc/ffe 0 2024-04-15T21:02:50.175 INFO:tasks.workunit.client.1.smithi149.stdout:1/719: write d1/db/d16/d35/f96 [256279,30933] 0 2024-04-15T21:02:50.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/810: mkdir dc/d18/d21/d10e 0 2024-04-15T21:02:50.177 INFO:tasks.workunit.client.1.smithi149.stdout:2/793: dwrite d4/d7/d29/fe3 [0,4194304] 0 2024-04-15T21:02:50.177 INFO:tasks.workunit.client.1.smithi149.stdout:8/854: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d50/c12e 0 2024-04-15T21:02:50.178 INFO:tasks.workunit.client.1.smithi149.stdout:4/811: chown dc/d2c/d3e/d35/d4b/lc3 5 1 2024-04-15T21:02:50.181 INFO:tasks.workunit.client.1.smithi149.stdout:4/812: symlink dc/d18/daa/l10f 0 2024-04-15T21:02:50.184 INFO:tasks.workunit.client.1.smithi149.stdout:1/720: symlink d1/db/d16/d86/lcd 0 2024-04-15T21:02:50.185 INFO:tasks.workunit.client.1.smithi149.stdout:1/721: stat d1/db/dc/fa4 0 2024-04-15T21:02:50.187 INFO:tasks.workunit.client.1.smithi149.stdout:8/855: creat d2/d5b/dcd/d10a/f12f x:0 0 0 2024-04-15T21:02:50.189 INFO:tasks.workunit.client.1.smithi149.stdout:2/794: link d4/d7/d46/de4/db6/f109 d4/f118 0 2024-04-15T21:02:50.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:49 smithi149 ceph-mon[36029]: pgmap v9: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 88 MiB/s rd, 219 MiB/s wr, 434 op/s 2024-04-15T21:02:50.191 INFO:tasks.workunit.client.1.smithi149.stdout:4/813: creat dc/d2c/d3e/f110 x:0 0 0 2024-04-15T21:02:50.194 INFO:tasks.workunit.client.1.smithi149.stdout:4/814: stat dc/d18/d21/d81/f8e 0 2024-04-15T21:02:50.195 INFO:tasks.workunit.client.1.smithi149.stdout:4/815: write dc/d18/d21/d81/f103 [284414,72020] 0 2024-04-15T21:02:50.195 INFO:tasks.workunit.client.1.smithi149.stdout:2/795: getdents d4/d7/d46/de4/d21/d2c/d3e/d9d 0 2024-04-15T21:02:50.205 INFO:tasks.workunit.client.1.smithi149.stdout:7/774: read d3/d16/d20/d36/fbd [3537333,39963] 0 2024-04-15T21:02:50.209 INFO:tasks.workunit.client.1.smithi149.stdout:1/722: dread d1/db/d16/d35/f96 [0,4194304] 0 2024-04-15T21:02:50.215 INFO:tasks.workunit.client.1.smithi149.stdout:7/775: creat d3/d16/d20/f117 x:0 0 0 2024-04-15T21:02:50.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/723: dwrite d1/fb3 [0,4194304] 0 2024-04-15T21:02:50.219 INFO:tasks.workunit.client.1.smithi149.stdout:1/724: write d1/f6 [2940844,42376] 0 2024-04-15T21:02:50.219 INFO:tasks.workunit.client.1.smithi149.stdout:5/726: sync 2024-04-15T21:02:50.219 INFO:tasks.workunit.client.1.smithi149.stdout:0/920: sync 2024-04-15T21:02:50.220 INFO:tasks.workunit.client.1.smithi149.stdout:0/921: read d1/f144 [389006,10983] 0 2024-04-15T21:02:50.223 INFO:tasks.workunit.client.1.smithi149.stdout:7/776: mknod d3/d16/d20/d114/c118 0 2024-04-15T21:02:50.223 INFO:tasks.workunit.client.1.smithi149.stdout:7/777: fsync d3/d16/d20/d6c/feb 0 2024-04-15T21:02:50.224 INFO:tasks.workunit.client.0.smithi072.stdout:5/582: getdents d0/d3/d7/d12/d31/d55/d58 0 2024-04-15T21:02:50.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/727: symlink d0/d6/d2d/le8 0 2024-04-15T21:02:50.229 INFO:tasks.workunit.client.0.smithi072.stdout:2/571: write d2/d38/d73/f7a [397005,84792] 0 2024-04-15T21:02:50.232 INFO:tasks.workunit.client.1.smithi149.stdout:1/725: symlink d1/db/d16/d35/lce 0 2024-04-15T21:02:50.234 INFO:tasks.workunit.client.0.smithi072.stdout:5/583: rename d0/d3/d7/d94/d86/lbe to d0/d3/d7/d12/d31/d62/db6/lca 0 2024-04-15T21:02:50.235 INFO:tasks.workunit.client.1.smithi149.stdout:6/730: dwrite da/d18/d10/d3f/f5c [0,4194304] 0 2024-04-15T21:02:50.236 INFO:tasks.workunit.client.1.smithi149.stdout:6/731: chown da/d11/l9e 384697 1 2024-04-15T21:02:50.238 INFO:tasks.workunit.client.0.smithi072.stdout:9/592: getdents d4/d1f/d9e 0 2024-04-15T21:02:50.238 INFO:tasks.workunit.client.0.smithi072.stdout:9/593: dread - d4/d76/d8f/fb0 zero size 2024-04-15T21:02:50.239 INFO:tasks.workunit.client.0.smithi072.stdout:5/584: mknod d0/d3/d6/d2d/d79/ccb 0 2024-04-15T21:02:50.240 INFO:tasks.workunit.client.0.smithi072.stdout:5/585: chown d0/d3/d6/d14/c17 141 1 2024-04-15T21:02:50.247 INFO:tasks.workunit.client.1.smithi149.stdout:3/811: dwrite d1/fcf [0,4194304] 0 2024-04-15T21:02:50.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/726: creat d1/db/dc/d38/d39/d43/fcf x:0 0 0 2024-04-15T21:02:50.251 INFO:tasks.workunit.client.1.smithi149.stdout:1/727: chown d1/fb3 1763 1 2024-04-15T21:02:50.252 INFO:tasks.workunit.client.0.smithi072.stdout:8/614: sync 2024-04-15T21:02:50.252 INFO:tasks.workunit.client.0.smithi072.stdout:3/581: sync 2024-04-15T21:02:50.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/594: unlink d4/d29/d4c/d74/f7c 0 2024-04-15T21:02:50.258 INFO:tasks.workunit.client.1.smithi149.stdout:3/812: dwrite d1/db/d40/fce [0,4194304] 0 2024-04-15T21:02:50.263 INFO:tasks.workunit.client.1.smithi149.stdout:9/719: dwrite d23/d46/dcf/deb/fb1 [0,4194304] 0 2024-04-15T21:02:50.264 INFO:tasks.workunit.client.0.smithi072.stdout:3/582: creat d1/d15/d32/d78/d99/fb4 x:0 0 0 2024-04-15T21:02:50.273 INFO:tasks.workunit.client.1.smithi149.stdout:8/856: write d2/d5b/dcd/d10a/d25/d57/dd1/d46/f107 [1143155,34794] 0 2024-04-15T21:02:50.274 INFO:tasks.workunit.client.1.smithi149.stdout:4/816: write dc/d18/d21/d81/f8e [868275,96534] 0 2024-04-15T21:02:50.275 INFO:tasks.workunit.client.0.smithi072.stdout:2/572: getdents d2/d3/d5f 0 2024-04-15T21:02:50.277 INFO:tasks.workunit.client.1.smithi149.stdout:1/728: write d1/db/f33 [736133,66573] 0 2024-04-15T21:02:50.279 INFO:tasks.workunit.client.1.smithi149.stdout:8/857: write d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/d9d/dc0/f127 [249594,86418] 0 2024-04-15T21:02:50.282 INFO:tasks.workunit.client.1.smithi149.stdout:7/778: creat d3/d16/d20/d36/f119 x:0 0 0 2024-04-15T21:02:50.284 INFO:tasks.workunit.client.1.smithi149.stdout:2/796: dwrite d4/d7/da/fe [0,4194304] 0 2024-04-15T21:02:50.285 INFO:tasks.workunit.client.0.smithi072.stdout:5/586: link d0/d3/d7/d1f/l22 d0/d3/d33/d60/d81/daf/lcc 0 2024-04-15T21:02:50.286 INFO:tasks.workunit.client.1.smithi149.stdout:3/813: mkdir d1/db/d24/d2b/dff 0 2024-04-15T21:02:50.290 INFO:tasks.workunit.client.1.smithi149.stdout:6/732: dwrite da/d32/f43 [0,4194304] 0 2024-04-15T21:02:50.291 INFO:tasks.workunit.client.0.smithi072.stdout:2/573: symlink d2/d8/d8e/lbe 0 2024-04-15T21:02:50.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/733: readlink da/d18/d10/d3f/lb9 0 2024-04-15T21:02:50.292 INFO:tasks.workunit.client.1.smithi149.stdout:5/728: rmdir d0/d6/d82/dc6 0 2024-04-15T21:02:50.292 INFO:tasks.workunit.client.1.smithi149.stdout:1/729: dwrite d1/d17/d36/f71 [0,4194304] 0 2024-04-15T21:02:50.293 INFO:tasks.workunit.client.1.smithi149.stdout:6/734: chown da/d18/d10/d3f/lac 439881 1 2024-04-15T21:02:50.299 INFO:tasks.workunit.client.0.smithi072.stdout:5/587: mknod d0/d3/d7/d12/d1d/d8c/ccd 0 2024-04-15T21:02:50.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/817: mknod dc/d18/dce/c111 0 2024-04-15T21:02:50.302 INFO:tasks.workunit.client.1.smithi149.stdout:4/818: chown dc/f8a 24 1 2024-04-15T21:02:50.305 INFO:tasks.workunit.client.0.smithi072.stdout:2/574: rename d2/d66/d69/c7e to d2/d37/cbf 0 2024-04-15T21:02:50.305 INFO:tasks.workunit.client.0.smithi072.stdout:1/578: sync 2024-04-15T21:02:50.305 INFO:tasks.workunit.client.0.smithi072.stdout:0/594: sync 2024-04-15T21:02:50.305 INFO:tasks.workunit.client.0.smithi072.stdout:4/600: sync 2024-04-15T21:02:50.306 INFO:tasks.workunit.client.0.smithi072.stdout:8/615: link d3/d4/d3b/f55 d3/d4/fbd 0 2024-04-15T21:02:50.306 INFO:tasks.workunit.client.1.smithi149.stdout:0/922: write d1/d9/f1b [4540111,39722] 0 2024-04-15T21:02:50.308 INFO:tasks.workunit.client.0.smithi072.stdout:1/579: dread - d5/fa3 zero size 2024-04-15T21:02:50.308 INFO:tasks.workunit.client.0.smithi072.stdout:2/575: dread - d2/d8/d41/f8d zero size 2024-04-15T21:02:50.309 INFO:tasks.workunit.client.1.smithi149.stdout:1/730: dread d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:50.309 INFO:tasks.workunit.client.0.smithi072.stdout:5/588: symlink d0/d3/d33/d60/lce 0 2024-04-15T21:02:50.310 INFO:tasks.workunit.client.0.smithi072.stdout:5/589: chown d0/d3/lc3 50648 1 2024-04-15T21:02:50.312 INFO:tasks.workunit.client.0.smithi072.stdout:5/590: chown d0/d3/d6/d2d 26 1 2024-04-15T21:02:50.313 INFO:tasks.workunit.client.0.smithi072.stdout:9/595: truncate d4/d29/d4c/d74/f7f 3882311 0 2024-04-15T21:02:50.314 INFO:tasks.workunit.client.0.smithi072.stdout:1/580: readlink d5/l18 0 2024-04-15T21:02:50.314 INFO:tasks.workunit.client.0.smithi072.stdout:4/601: dwrite d7/d10/d41/d4c/f82 [0,4194304] 0 2024-04-15T21:02:50.316 INFO:tasks.workunit.client.0.smithi072.stdout:8/616: symlink d3/d4/d3b/lbe 0 2024-04-15T21:02:50.317 INFO:tasks.workunit.client.1.smithi149.stdout:2/797: symlink d4/d7/d46/de4/d21/d2c/d63/l119 0 2024-04-15T21:02:50.319 INFO:tasks.workunit.client.0.smithi072.stdout:0/595: unlink d0/d19/d71/d9e/lbe 0 2024-04-15T21:02:50.320 INFO:tasks.workunit.client.1.smithi149.stdout:9/720: dwrite d23/d2b/f65 [0,4194304] 0 2024-04-15T21:02:50.320 INFO:tasks.workunit.client.0.smithi072.stdout:0/596: read - d0/d45/d7a/fbd zero size 2024-04-15T21:02:50.322 INFO:tasks.workunit.client.1.smithi149.stdout:6/735: mkdir da/d2e/de7 0 2024-04-15T21:02:50.325 INFO:tasks.workunit.client.0.smithi072.stdout:5/591: creat d0/d3/d7/d1f/d50/fcf x:0 0 0 2024-04-15T21:02:50.325 INFO:tasks.workunit.client.1.smithi149.stdout:5/729: creat d0/d6/d82/da1/d12/d16/da9/d1b/d61/fe9 x:0 0 0 2024-04-15T21:02:50.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/596: rmdir d4/d1f 39 2024-04-15T21:02:50.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/597: chown d4/f6a 15944771 1 2024-04-15T21:02:50.330 INFO:tasks.workunit.client.0.smithi072.stdout:1/581: symlink d5/d3d/lbb 0 2024-04-15T21:02:50.331 INFO:tasks.workunit.client.1.smithi149.stdout:4/819: symlink dc/d2c/d3e/d35/d4b/de8/dfc/l112 0 2024-04-15T21:02:50.333 INFO:tasks.workunit.client.0.smithi072.stdout:4/602: unlink d7/d24/f35 0 2024-04-15T21:02:50.334 INFO:tasks.workunit.client.0.smithi072.stdout:4/603: read d7/f55 [980086,15477] 0 2024-04-15T21:02:50.335 INFO:tasks.workunit.client.0.smithi072.stdout:2/576: creat d2/da1/fc0 x:0 0 0 2024-04-15T21:02:50.336 INFO:tasks.workunit.client.1.smithi149.stdout:3/814: symlink d1/l100 0 2024-04-15T21:02:50.337 INFO:tasks.workunit.client.0.smithi072.stdout:0/597: dread - d0/d6/d48/fa2 zero size 2024-04-15T21:02:50.338 INFO:tasks.workunit.client.0.smithi072.stdout:5/592: creat d0/d3/d6/d14/fd0 x:0 0 0 2024-04-15T21:02:50.339 INFO:tasks.workunit.client.1.smithi149.stdout:7/779: mkdir d3/d16/d20/d114/db6/d11a 0 2024-04-15T21:02:50.340 INFO:tasks.workunit.client.0.smithi072.stdout:6/558: sync 2024-04-15T21:02:50.340 INFO:tasks.workunit.client.0.smithi072.stdout:7/599: sync 2024-04-15T21:02:50.342 INFO:tasks.workunit.client.0.smithi072.stdout:3/583: truncate d1/d15/f3e 3470644 0 2024-04-15T21:02:50.343 INFO:tasks.workunit.client.0.smithi072.stdout:8/617: dread d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:50.348 INFO:tasks.workunit.client.1.smithi149.stdout:9/721: creat d23/d46/dcf/deb/d7f/d83/ff6 x:0 0 0 2024-04-15T21:02:50.349 INFO:tasks.workunit.client.0.smithi072.stdout:4/604: rmdir d7/d28/d42/d8c/da9/d6b 39 2024-04-15T21:02:50.350 INFO:tasks.workunit.client.1.smithi149.stdout:6/736: rename da/d18/d33/l62 to da/d18/d10/d16/d97/dbf/le8 0 2024-04-15T21:02:50.351 INFO:tasks.workunit.client.1.smithi149.stdout:8/858: write d2/d5b/dcd/d10a/d25/d57/dd1/fad [606331,97255] 0 2024-04-15T21:02:50.356 INFO:tasks.workunit.client.0.smithi072.stdout:5/593: write d0/f80 [4625716,127401] 0 2024-04-15T21:02:50.358 INFO:tasks.workunit.client.1.smithi149.stdout:8/859: dwrite d2/d5b/dcd/d10a/d4e/d9f/fa5 [0,4194304] 0 2024-04-15T21:02:50.359 INFO:tasks.workunit.client.0.smithi072.stdout:9/598: symlink d4/d29/d4c/lb8 0 2024-04-15T21:02:50.359 INFO:tasks.workunit.client.1.smithi149.stdout:8/860: chown d2/d5b/dcd/d10a 422000930 1 2024-04-15T21:02:50.360 INFO:tasks.workunit.client.1.smithi149.stdout:1/731: creat d1/d17/d52/d78/fd0 x:0 0 0 2024-04-15T21:02:50.362 INFO:tasks.workunit.client.1.smithi149.stdout:1/732: write d1/d17/d52/d78/fd0 [204251,34207] 0 2024-04-15T21:02:50.364 INFO:tasks.workunit.client.1.smithi149.stdout:3/815: creat d1/db/d28/de7/f101 x:0 0 0 2024-04-15T21:02:50.366 INFO:tasks.workunit.client.1.smithi149.stdout:8/861: dwrite d2/d16/f65 [4194304,4194304] 0 2024-04-15T21:02:50.367 INFO:tasks.workunit.client.0.smithi072.stdout:1/582: mkdir d5/d31/dbc 0 2024-04-15T21:02:50.368 INFO:tasks.workunit.client.1.smithi149.stdout:0/923: write d1/d5/dda/fc8 [19153,21847] 0 2024-04-15T21:02:50.371 INFO:tasks.workunit.client.1.smithi149.stdout:6/737: creat da/d18/d7d/fe9 x:0 0 0 2024-04-15T21:02:50.372 INFO:tasks.workunit.client.1.smithi149.stdout:6/738: chown da/d18/c92 44715855 1 2024-04-15T21:02:50.380 INFO:tasks.workunit.client.0.smithi072.stdout:2/577: truncate d2/d8/fbc 757692 0 2024-04-15T21:02:50.382 INFO:tasks.workunit.client.1.smithi149.stdout:1/733: mknod d1/d17/d36/d6f/d70/cd1 0 2024-04-15T21:02:50.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/734: readlink d1/db/dc/d38/d39/d88/lc7 0 2024-04-15T21:02:50.383 INFO:tasks.workunit.client.0.smithi072.stdout:2/578: dread d2/d38/d73/f7a [0,4194304] 0 2024-04-15T21:02:50.383 INFO:tasks.workunit.client.0.smithi072.stdout:0/598: rmdir d0/d6/d55 39 2024-04-15T21:02:50.384 INFO:tasks.workunit.client.0.smithi072.stdout:2/579: dread - d2/d38/d73/d80/fa3 zero size 2024-04-15T21:02:50.385 INFO:tasks.workunit.client.1.smithi149.stdout:3/816: chown d1/db/f52 7331632 1 2024-04-15T21:02:50.387 INFO:tasks.workunit.client.0.smithi072.stdout:5/594: mkdir d0/d3/d7/d12/d31/d62/db6/dd1 0 2024-04-15T21:02:50.388 INFO:tasks.workunit.client.0.smithi072.stdout:2/580: dwrite d2/d37/f75 [0,4194304] 0 2024-04-15T21:02:50.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/820: dwrite dc/d2c/d3e/d35/d4b/d6c/f7b [0,4194304] 0 2024-04-15T21:02:50.392 INFO:tasks.workunit.client.1.smithi149.stdout:2/798: creat d4/d7/d46/de4/d21/d3b/f11a x:0 0 0 2024-04-15T21:02:50.392 INFO:tasks.workunit.client.0.smithi072.stdout:6/559: write d2/d10/d18/fa2 [3504669,27480] 0 2024-04-15T21:02:50.394 INFO:tasks.workunit.client.1.smithi149.stdout:8/862: creat d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/f130 x:0 0 0 2024-04-15T21:02:50.395 INFO:tasks.workunit.client.1.smithi149.stdout:8/863: read - d2/d16/fec zero size 2024-04-15T21:02:50.396 INFO:tasks.workunit.client.0.smithi072.stdout:7/600: getdents d2/d7/d25/d2d/d46/d5a/d5f/d43/db8 0 2024-04-15T21:02:50.401 INFO:tasks.workunit.client.0.smithi072.stdout:8/618: write d3/d4/f1e [2096111,50845] 0 2024-04-15T21:02:50.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/583: rename d5/db/d27/d8a to d5/db/d27/d5c/dbd 0 2024-04-15T21:02:50.414 INFO:tasks.workunit.client.0.smithi072.stdout:9/599: dread d4/d1f/d2c/f4f [0,4194304] 0 2024-04-15T21:02:50.415 INFO:tasks.workunit.client.0.smithi072.stdout:0/599: fdatasync d0/d19/f22 0 2024-04-15T21:02:50.419 INFO:tasks.workunit.client.0.smithi072.stdout:4/605: rename d7/d10/d41/d44/d7a/d86/f95 to d7/d71/db2/fc5 0 2024-04-15T21:02:50.420 INFO:tasks.workunit.client.0.smithi072.stdout:4/606: chown d7/d10/c3d 0 1 2024-04-15T21:02:50.420 INFO:tasks.workunit.client.0.smithi072.stdout:4/607: chown d7/d28 2902036 1 2024-04-15T21:02:50.421 INFO:tasks.workunit.client.0.smithi072.stdout:3/584: creat d1/d3f/d4f/fb5 x:0 0 0 2024-04-15T21:02:50.426 INFO:tasks.workunit.client.0.smithi072.stdout:3/585: dread d1/d5b/f97 [0,4194304] 0 2024-04-15T21:02:50.426 INFO:tasks.workunit.client.0.smithi072.stdout:0/600: stat d0/d6/c77 0 2024-04-15T21:02:50.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/581: truncate d2/d3/f43 410854 0 2024-04-15T21:02:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:2/582: chown d2/d38/d73/d80/c95 47 1 2024-04-15T21:02:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:2/583: chown d2/d8/l45 17300051 1 2024-04-15T21:02:50.432 INFO:tasks.workunit.client.0.smithi072.stdout:6/560: rename d2/d40/d56/d6a/d70/c7b to d2/d40/d66/d7f/ca7 0 2024-04-15T21:02:50.433 INFO:tasks.workunit.client.0.smithi072.stdout:9/600: truncate d4/d1f/d2c/f39 585135 0 2024-04-15T21:02:50.437 INFO:tasks.workunit.client.0.smithi072.stdout:2/584: creat d2/d66/d69/fc1 x:0 0 0 2024-04-15T21:02:50.438 INFO:tasks.workunit.client.0.smithi072.stdout:0/601: rename d0/d45 to d0/d45/dd4 22 2024-04-15T21:02:50.441 INFO:tasks.workunit.client.0.smithi072.stdout:7/601: truncate d2/d7/d25/d2d/d46/d5a/d5f/f11 1241765 0 2024-04-15T21:02:50.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/584: dwrite d5/db/d2d/f81 [0,4194304] 0 2024-04-15T21:02:50.442 INFO:tasks.workunit.client.0.smithi072.stdout:8/619: link d3/de/l2b d3/de/d1b/d41/d74/lbf 0 2024-04-15T21:02:50.443 INFO:tasks.workunit.client.0.smithi072.stdout:8/620: chown d3/d4/d4c/c8c 1 1 2024-04-15T21:02:50.444 INFO:tasks.workunit.client.0.smithi072.stdout:0/602: chown d0/d6/f39 12 1 2024-04-15T21:02:50.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/621: dread - d3/de/d1b/fb2 zero size 2024-04-15T21:02:50.446 INFO:tasks.workunit.client.0.smithi072.stdout:2/585: truncate d2/f5a 146598 0 2024-04-15T21:02:50.447 INFO:tasks.workunit.client.0.smithi072.stdout:3/586: write d1/d15/f31 [1685236,56404] 0 2024-04-15T21:02:50.450 INFO:tasks.workunit.client.0.smithi072.stdout:1/585: symlink d5/d3d/d5e/lbe 0 2024-04-15T21:02:50.450 INFO:tasks.workunit.client.0.smithi072.stdout:6/561: write d2/d10/d18/f26 [1434650,35723] 0 2024-04-15T21:02:50.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/603: dwrite d0/fb3 [0,4194304] 0 2024-04-15T21:02:50.451 INFO:tasks.workunit.client.0.smithi072.stdout:1/586: dread - d5/d31/d51/f74 zero size 2024-04-15T21:02:50.452 INFO:tasks.workunit.client.0.smithi072.stdout:2/586: chown d2/d37/cbf 528402 1 2024-04-15T21:02:50.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/587: chown d5/db/d27/d9c/fb4 673153844 1 2024-04-15T21:02:50.455 INFO:tasks.workunit.client.0.smithi072.stdout:7/602: mkdir d2/d7/d25/d2d/d46/d5a/d5f/dbc 0 2024-04-15T21:02:50.457 INFO:tasks.workunit.client.0.smithi072.stdout:8/622: mkdir d3/de/d1b/d41/dae/dc0 0 2024-04-15T21:02:50.457 INFO:tasks.workunit.client.0.smithi072.stdout:0/604: mkdir d0/d74/dd5 0 2024-04-15T21:02:50.458 INFO:tasks.workunit.client.0.smithi072.stdout:2/587: read - d2/d3/f7f zero size 2024-04-15T21:02:50.460 INFO:tasks.workunit.client.0.smithi072.stdout:9/601: getdents d4/d1f/d2c 0 2024-04-15T21:02:50.460 INFO:tasks.workunit.client.0.smithi072.stdout:9/602: fdatasync d4/d1f/d31/d42/fab 0 2024-04-15T21:02:50.461 INFO:tasks.workunit.client.0.smithi072.stdout:1/588: mkdir d5/db/d2d/d85/dbf 0 2024-04-15T21:02:50.461 INFO:tasks.workunit.client.0.smithi072.stdout:9/603: write d4/d1f/d31/f3f [2980648,43952] 0 2024-04-15T21:02:50.462 INFO:tasks.workunit.client.0.smithi072.stdout:7/603: creat d2/d78/fbd x:0 0 0 2024-04-15T21:02:50.465 INFO:tasks.workunit.client.0.smithi072.stdout:1/589: rmdir d5/db/d27/d9c 39 2024-04-15T21:02:50.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/604: symlink d4/d1f/d31/d42/lb9 0 2024-04-15T21:02:50.469 INFO:tasks.workunit.client.0.smithi072.stdout:0/605: rename d0/d19/d2b/ld3 to d0/d6/d55/ld6 0 2024-04-15T21:02:50.470 INFO:tasks.workunit.client.0.smithi072.stdout:7/604: mkdir d2/d7/d25/d81/dbe 0 2024-04-15T21:02:50.471 INFO:tasks.workunit.client.0.smithi072.stdout:2/588: truncate d2/d66/f74 158278 0 2024-04-15T21:02:50.472 INFO:tasks.workunit.client.0.smithi072.stdout:1/590: write d5/db/d27/d9c/fa7 [1043843,76247] 0 2024-04-15T21:02:50.474 INFO:tasks.workunit.client.0.smithi072.stdout:2/589: mkdir d2/d37/dc2 0 2024-04-15T21:02:50.476 INFO:tasks.workunit.client.0.smithi072.stdout:7/605: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/fbf x:0 0 0 2024-04-15T21:02:50.477 INFO:tasks.workunit.client.0.smithi072.stdout:1/591: creat d5/d31/d51/d82/fc0 x:0 0 0 2024-04-15T21:02:50.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/605: creat d4/d29/d4c/d74/fba x:0 0 0 2024-04-15T21:02:50.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/924: creat d1/d9/d64/d65/d104/d119/d43/f146 x:0 0 0 2024-04-15T21:02:50.480 INFO:tasks.workunit.client.1.smithi149.stdout:4/821: dread dc/d18/d21/f4d [0,4194304] 0 2024-04-15T21:02:50.481 INFO:tasks.workunit.client.0.smithi072.stdout:6/562: dwrite d2/d10/d11/d15/f53 [0,4194304] 0 2024-04-15T21:02:50.481 INFO:tasks.workunit.client.1.smithi149.stdout:1/735: rename d1/db/l87 to d1/db/d16/d35/ld2 0 2024-04-15T21:02:50.484 INFO:tasks.workunit.client.0.smithi072.stdout:1/592: creat d5/d3d/fc1 x:0 0 0 2024-04-15T21:02:50.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/817: write d1/db/d24/d39/d79/f83 [757816,960] 0 2024-04-15T21:02:50.485 INFO:tasks.workunit.client.1.smithi149.stdout:1/736: write d1/fb3 [485439,8408] 0 2024-04-15T21:02:50.485 INFO:tasks.workunit.client.0.smithi072.stdout:8/623: dread d3/d4/d3b/f6e [0,4194304] 0 2024-04-15T21:02:50.486 INFO:tasks.workunit.client.1.smithi149.stdout:5/730: link d0/d6/d9f/ca4 d0/d6/d82/da1/d12/d16/da9/cea 0 2024-04-15T21:02:50.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/864: write d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f120 [665368,2462] 0 2024-04-15T21:02:50.487 INFO:tasks.workunit.client.1.smithi149.stdout:2/799: dwrite d4/d7/d46/de4/d21/d2c/d32/d4a/ffc [0,4194304] 0 2024-04-15T21:02:50.490 INFO:tasks.workunit.client.0.smithi072.stdout:9/606: creat d4/d1f/d31/d4d/fbb x:0 0 0 2024-04-15T21:02:50.490 INFO:tasks.workunit.client.0.smithi072.stdout:1/593: write d5/d31/d51/d82/fae [1814181,40780] 0 2024-04-15T21:02:50.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/624: stat d3/d4/d3b/lbe 0 2024-04-15T21:02:50.490 INFO:tasks.workunit.client.0.smithi072.stdout:9/607: readlink d4/d1f/l2a 0 2024-04-15T21:02:50.492 INFO:tasks.workunit.client.1.smithi149.stdout:7/780: getdents d3/d17 0 2024-04-15T21:02:50.492 INFO:tasks.workunit.client.0.smithi072.stdout:0/606: dread d0/f1 [0,4194304] 0 2024-04-15T21:02:50.492 INFO:tasks.workunit.client.0.smithi072.stdout:7/606: mkdir d2/d7/d25/d72/d98/dc0 0 2024-04-15T21:02:50.493 INFO:tasks.workunit.client.0.smithi072.stdout:6/563: mkdir d2/d40/d66/da8 0 2024-04-15T21:02:50.499 INFO:tasks.workunit.client.1.smithi149.stdout:2/800: dwrite d4/d7/d46/de4/d21/d55/dfe/d106/f108 [0,4194304] 0 2024-04-15T21:02:50.504 INFO:tasks.workunit.client.0.smithi072.stdout:1/594: symlink d5/db/d2d/d3a/d1f/lc2 0 2024-04-15T21:02:50.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/739: truncate da/d18/d10/d3f/faa 1224611 0 2024-04-15T21:02:50.510 INFO:tasks.workunit.client.1.smithi149.stdout:6/740: truncate da/d18/d10/d3f/fd4 216042 0 2024-04-15T21:02:50.510 INFO:tasks.workunit.client.1.smithi149.stdout:8/865: creat d2/d5b/dcd/d10a/d25/d32/d45/d77/f131 x:0 0 0 2024-04-15T21:02:50.513 INFO:tasks.workunit.client.0.smithi072.stdout:0/607: mknod d0/d74/d94/cd7 0 2024-04-15T21:02:50.514 INFO:tasks.workunit.client.1.smithi149.stdout:7/781: mkdir d3/d16/d20/d114/d11b 0 2024-04-15T21:02:50.516 INFO:tasks.workunit.client.1.smithi149.stdout:4/822: symlink dc/d18/d21/dfa/d109/l113 0 2024-04-15T21:02:50.516 INFO:tasks.workunit.client.0.smithi072.stdout:2/590: dwrite d2/d8/daa/fa6 [0,4194304] 0 2024-04-15T21:02:50.517 INFO:tasks.workunit.client.0.smithi072.stdout:0/608: dread d0/d6/f39 [0,4194304] 0 2024-04-15T21:02:50.518 INFO:tasks.workunit.client.0.smithi072.stdout:1/595: mkdir d5/db/d2d/d3a/dc3 0 2024-04-15T21:02:50.518 INFO:tasks.workunit.client.0.smithi072.stdout:2/591: write d2/d66/fb0 [719087,102624] 0 2024-04-15T21:02:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:9/608: dread d4/d29/f36 [0,4194304] 0 2024-04-15T21:02:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:2/592: readlink d2/d8/l8b 0 2024-04-15T21:02:50.521 INFO:tasks.workunit.client.0.smithi072.stdout:6/564: symlink d2/d40/d66/da8/la9 0 2024-04-15T21:02:50.522 INFO:tasks.workunit.client.1.smithi149.stdout:6/741: mkdir da/d60/d9b/dea 0 2024-04-15T21:02:50.524 INFO:tasks.workunit.client.1.smithi149.stdout:8/866: mknod d2/d5b/dcd/d10a/d25/d32/d45/d77/c132 0 2024-04-15T21:02:50.525 INFO:tasks.workunit.client.0.smithi072.stdout:0/609: unlink d0/d45/d7a/d70/d59/d8a/d7b/f7e 0 2024-04-15T21:02:50.528 INFO:tasks.workunit.client.1.smithi149.stdout:1/737: rename d1/db/dc/d11/d3f/c46 to d1/d17/d36/d6f/da3/cd3 0 2024-04-15T21:02:50.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/609: fdatasync d4/d1f/f24 0 2024-04-15T21:02:50.533 INFO:tasks.workunit.client.0.smithi072.stdout:1/596: rename d5/db/d27/d5c/c80 to d5/db/d2d/d56/cc4 0 2024-04-15T21:02:50.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/823: mknod dc/d2c/d3e/d7c/dd0/c114 0 2024-04-15T21:02:50.535 INFO:tasks.workunit.client.1.smithi149.stdout:4/824: chown dc/d18 24425 1 2024-04-15T21:02:50.536 INFO:tasks.workunit.client.1.smithi149.stdout:1/738: dread d1/d17/d52/f34 [0,4194304] 0 2024-04-15T21:02:50.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/825: stat dc/d2c/d3e/d7c/dd0/c114 0 2024-04-15T21:02:50.537 INFO:tasks.workunit.client.1.smithi149.stdout:1/739: read d1/fb3 [1824852,87881] 0 2024-04-15T21:02:50.539 INFO:tasks.workunit.client.1.smithi149.stdout:3/818: dwrite d1/fd [0,4194304] 0 2024-04-15T21:02:50.539 INFO:tasks.workunit.client.1.smithi149.stdout:4/826: write dc/d18/d21/f63 [2093589,21190] 0 2024-04-15T21:02:50.540 INFO:tasks.workunit.client.1.smithi149.stdout:3/819: stat d1/d81 0 2024-04-15T21:02:50.541 INFO:tasks.workunit.client.1.smithi149.stdout:0/925: creat d1/d5/d24/d50/d13/d38/d44/d61/f147 x:0 0 0 2024-04-15T21:02:50.546 INFO:tasks.workunit.client.1.smithi149.stdout:6/742: symlink da/d18/d10/d66/leb 0 2024-04-15T21:02:50.546 INFO:tasks.workunit.client.1.smithi149.stdout:0/926: dread d1/d29/f102 [0,4194304] 0 2024-04-15T21:02:50.548 INFO:tasks.workunit.client.0.smithi072.stdout:0/610: dread d0/d45/d7a/d70/d59/d8a/fa7 [0,4194304] 0 2024-04-15T21:02:50.549 INFO:tasks.workunit.client.0.smithi072.stdout:8/625: truncate d3/de/d1b/f57 4057855 0 2024-04-15T21:02:50.550 INFO:tasks.workunit.client.0.smithi072.stdout:8/626: dread - d3/de/f99 zero size 2024-04-15T21:02:50.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/610: mknod d4/d1f/d2c/d62/cbc 0 2024-04-15T21:02:50.553 INFO:tasks.workunit.client.1.smithi149.stdout:5/731: rename d0/d6/d82/da1/d12/d16/c33 to d0/d9/d6c/db4/ceb 0 2024-04-15T21:02:50.553 INFO:tasks.workunit.client.1.smithi149.stdout:2/801: dwrite d4/d7/d10/d36/f47 [0,4194304] 0 2024-04-15T21:02:50.554 INFO:tasks.workunit.client.1.smithi149.stdout:5/732: dread - d0/d9/d3f/dc7/fdb zero size 2024-04-15T21:02:50.558 INFO:tasks.workunit.client.1.smithi149.stdout:7/782: mkdir d3/d16/d20/d36/d3d/d11c 0 2024-04-15T21:02:50.562 INFO:tasks.workunit.client.1.smithi149.stdout:2/802: dwrite d4/f18 [0,4194304] 0 2024-04-15T21:02:50.565 INFO:tasks.workunit.client.0.smithi072.stdout:0/611: creat d0/d19/d96/fd8 x:0 0 0 2024-04-15T21:02:50.567 INFO:tasks.workunit.client.0.smithi072.stdout:6/565: dwrite d2/f2a [0,4194304] 0 2024-04-15T21:02:50.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/566: stat d2/d10/d11/d1f/d60/d63/c8d 0 2024-04-15T21:02:50.571 INFO:tasks.workunit.client.0.smithi072.stdout:8/627: creat d3/d7e/fc1 x:0 0 0 2024-04-15T21:02:50.571 INFO:tasks.workunit.client.0.smithi072.stdout:9/611: creat d4/d29/fbd x:0 0 0 2024-04-15T21:02:50.572 INFO:tasks.workunit.client.1.smithi149.stdout:4/827: read - dc/d2c/d3e/d7c/dba/fc6 zero size 2024-04-15T21:02:50.572 INFO:tasks.workunit.client.0.smithi072.stdout:1/597: mknod d5/d31/cc5 0 2024-04-15T21:02:50.574 INFO:tasks.workunit.client.1.smithi149.stdout:3/820: mkdir d1/db/d102 0 2024-04-15T21:02:50.582 INFO:tasks.workunit.client.0.smithi072.stdout:9/612: unlink d4/d29/d4c/d91/d93/fa0 0 2024-04-15T21:02:50.583 INFO:tasks.workunit.client.0.smithi072.stdout:2/593: link d2/d37/l4e d2/d66/lc3 0 2024-04-15T21:02:50.584 INFO:tasks.workunit.client.0.smithi072.stdout:1/598: dwrite d5/f17 [0,4194304] 0 2024-04-15T21:02:50.592 INFO:tasks.workunit.client.0.smithi072.stdout:6/567: creat d2/da1/faa x:0 0 0 2024-04-15T21:02:50.594 INFO:tasks.workunit.client.0.smithi072.stdout:0/612: mknod d0/d6/cd9 0 2024-04-15T21:02:50.597 INFO:tasks.workunit.client.0.smithi072.stdout:8/628: creat d3/de/d1b/d41/d74/d98/da5/fc2 x:0 0 0 2024-04-15T21:02:50.601 INFO:tasks.workunit.client.0.smithi072.stdout:9/613: dread d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:50.602 INFO:tasks.workunit.client.1.smithi149.stdout:5/733: dread d0/d6/fe [0,4194304] 0 2024-04-15T21:02:50.602 INFO:tasks.workunit.client.0.smithi072.stdout:8/629: dwrite d3/f3c [4194304,4194304] 0 2024-04-15T21:02:50.603 INFO:tasks.workunit.client.0.smithi072.stdout:1/599: symlink d5/db/d27/d5c/dbd/lc6 0 2024-04-15T21:02:50.604 INFO:tasks.workunit.client.0.smithi072.stdout:1/600: fsync d5/db/d2d/f81 0 2024-04-15T21:02:50.606 INFO:tasks.workunit.client.1.smithi149.stdout:3/821: mknod d1/db/d24/d2b/c103 0 2024-04-15T21:02:50.608 INFO:tasks.workunit.client.0.smithi072.stdout:0/613: unlink d0/d19/d2b/d63/c6f 0 2024-04-15T21:02:50.608 INFO:tasks.workunit.client.1.smithi149.stdout:3/822: write d1/db/d24/f5f [5968179,39585] 0 2024-04-15T21:02:50.609 INFO:tasks.workunit.client.1.smithi149.stdout:3/823: write d1/db/d40/fce [146255,36568] 0 2024-04-15T21:02:50.609 INFO:tasks.workunit.client.1.smithi149.stdout:0/927: mkdir d1/d5/d24/d50/d148 0 2024-04-15T21:02:50.611 INFO:tasks.workunit.client.1.smithi149.stdout:3/824: write d1/db/d24/d4d/d63/d65/dc3/fcc [3689881,46215] 0 2024-04-15T21:02:50.612 INFO:tasks.workunit.client.1.smithi149.stdout:8/867: creat d2/d5b/dcd/d10a/d4e/f133 x:0 0 0 2024-04-15T21:02:50.613 INFO:tasks.workunit.client.0.smithi072.stdout:9/614: mkdir d4/d76/d8f/dbe 0 2024-04-15T21:02:50.619 INFO:tasks.workunit.client.1.smithi149.stdout:8/868: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/ff9 [0,4194304] 0 2024-04-15T21:02:50.621 INFO:tasks.workunit.client.1.smithi149.stdout:2/803: mknod d4/d7/d46/de4/d21/d2c/d32/c11b 0 2024-04-15T21:02:50.621 INFO:tasks.workunit.client.1.smithi149.stdout:8/869: truncate d2/d5b/dcd/d10a/d4e/d9f/f123 326686 0 2024-04-15T21:02:50.623 INFO:tasks.workunit.client.1.smithi149.stdout:8/870: write d2/f86 [600750,87901] 0 2024-04-15T21:02:50.630 INFO:tasks.workunit.client.0.smithi072.stdout:0/614: unlink d0/d6/d48/f9c 0 2024-04-15T21:02:50.632 INFO:tasks.workunit.client.0.smithi072.stdout:9/615: mkdir d4/d1f/d31/d4d/dbf 0 2024-04-15T21:02:50.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/825: truncate d1/db/d24/f36 5087428 0 2024-04-15T21:02:50.638 INFO:tasks.workunit.client.0.smithi072.stdout:6/568: write d2/d42/f93 [845892,114569] 0 2024-04-15T21:02:50.639 INFO:tasks.workunit.client.1.smithi149.stdout:3/826: write d1/db/d40/fe8 [534087,62099] 0 2024-04-15T21:02:50.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/743: link da/d18/d10/d16/d97/dbf/d55/l73 da/d11/dbe/lec 0 2024-04-15T21:02:50.639 INFO:tasks.workunit.client.0.smithi072.stdout:6/569: chown d2/d42/c57 0 1 2024-04-15T21:02:50.640 INFO:tasks.workunit.client.0.smithi072.stdout:2/594: dwrite d2/d8/fbc [0,4194304] 0 2024-04-15T21:02:50.641 INFO:tasks.workunit.client.1.smithi149.stdout:7/783: mknod d3/d16/d20/d36/d3d/d56/d10e/c11d 0 2024-04-15T21:02:50.642 INFO:tasks.workunit.client.0.smithi072.stdout:0/615: dread - d0/d6/f2c zero size 2024-04-15T21:02:50.643 INFO:tasks.workunit.client.1.smithi149.stdout:7/784: write d3/d16/d32/fa1 [2594260,57042] 0 2024-04-15T21:02:50.644 INFO:tasks.workunit.client.0.smithi072.stdout:0/616: truncate d0/d6/fc7 142969 0 2024-04-15T21:02:50.644 INFO:tasks.workunit.client.1.smithi149.stdout:1/740: getdents d1/d17/d36 0 2024-04-15T21:02:50.648 INFO:tasks.workunit.client.1.smithi149.stdout:3/827: dwrite d1/db/d28/f51 [0,4194304] 0 2024-04-15T21:02:50.650 INFO:tasks.workunit.client.0.smithi072.stdout:9/616: dwrite d4/d76/d8f/faa [0,4194304] 0 2024-04-15T21:02:50.652 INFO:tasks.workunit.client.1.smithi149.stdout:2/804: dread - d4/d7/d46/de4/d21/d3b/f113 zero size 2024-04-15T21:02:50.652 INFO:tasks.workunit.client.0.smithi072.stdout:1/601: truncate d5/d31/d51/d82/f92 904558 0 2024-04-15T21:02:50.654 INFO:tasks.workunit.client.1.smithi149.stdout:8/871: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda/c134 0 2024-04-15T21:02:50.655 INFO:tasks.workunit.client.1.smithi149.stdout:7/785: dwrite d3/d17/fea [0,4194304] 0 2024-04-15T21:02:50.655 INFO:tasks.workunit.client.0.smithi072.stdout:6/570: creat d2/d40/d56/d95/fab x:0 0 0 2024-04-15T21:02:50.661 INFO:tasks.workunit.client.0.smithi072.stdout:0/617: truncate d0/d6/d55/f8f 291589 0 2024-04-15T21:02:50.665 INFO:tasks.workunit.client.1.smithi149.stdout:4/828: link dc/d2c/d3e/d15/fac dc/d2c/f115 0 2024-04-15T21:02:50.669 INFO:tasks.workunit.client.0.smithi072.stdout:1/602: symlink d5/db/d27/d5c/dbd/lc7 0 2024-04-15T21:02:50.670 INFO:tasks.workunit.client.1.smithi149.stdout:6/744: mkdir da/d18/d10/d3f/ded 0 2024-04-15T21:02:50.673 INFO:tasks.workunit.client.1.smithi149.stdout:1/741: creat d1/d17/d36/d6f/da3/fd4 x:0 0 0 2024-04-15T21:02:50.676 INFO:tasks.workunit.client.0.smithi072.stdout:8/630: link d3/d4/f56 d3/de/d1b/d41/da4/fc3 0 2024-04-15T21:02:50.676 INFO:tasks.workunit.client.1.smithi149.stdout:3/828: rmdir d1/db/d24/d4d/d63/d65 39 2024-04-15T21:02:50.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/786: mkdir d3/d17/d11e 0 2024-04-15T21:02:50.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/631: fsync d3/f1d 0 2024-04-15T21:02:50.682 INFO:tasks.workunit.client.1.smithi149.stdout:4/829: mknod dc/d2c/d3e/d35/d4b/d75/db3/c116 0 2024-04-15T21:02:50.683 INFO:tasks.workunit.client.0.smithi072.stdout:6/571: link d2/d10/d11/l62 d2/d10/d11/d1f/d60/lac 0 2024-04-15T21:02:50.685 INFO:tasks.workunit.client.1.smithi149.stdout:2/805: mknod d4/df6/c11c 0 2024-04-15T21:02:50.688 INFO:tasks.workunit.client.1.smithi149.stdout:9/722: sync 2024-04-15T21:02:50.689 INFO:tasks.workunit.client.0.smithi072.stdout:0/618: getdents d0/d19/d2b 0 2024-04-15T21:02:50.689 INFO:tasks.workunit.client.1.smithi149.stdout:5/734: getdents d0/d9/d3f/d47 0 2024-04-15T21:02:50.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/723: write d23/d2b/d70/d75/faa [938819,9190] 0 2024-04-15T21:02:50.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/742: mkdir d1/db/d14/dd5 0 2024-04-15T21:02:50.692 INFO:tasks.workunit.client.0.smithi072.stdout:6/572: unlink d2/d40/d6e/l5a 0 2024-04-15T21:02:50.693 INFO:tasks.workunit.client.1.smithi149.stdout:1/743: dread d1/d17/d52/f34 [0,4194304] 0 2024-04-15T21:02:50.697 INFO:tasks.workunit.client.1.smithi149.stdout:1/744: truncate d1/db/d16/f5c 2204538 0 2024-04-15T21:02:50.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/632: link d3/d4/d3b/c47 d3/d4/cc4 0 2024-04-15T21:02:50.699 INFO:tasks.workunit.client.1.smithi149.stdout:9/724: dwrite d23/d46/fec [0,4194304] 0 2024-04-15T21:02:50.699 INFO:tasks.workunit.client.1.smithi149.stdout:8/872: rename d2/d16/f9b to d2/d5b/dcd/d10a/d25/d57/dd1/f135 0 2024-04-15T21:02:50.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/595: sync 2024-04-15T21:02:50.712 INFO:tasks.workunit.client.1.smithi149.stdout:6/745: dread da/d18/d10/d16/f6d [0,4194304] 0 2024-04-15T21:02:50.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/596: creat d0/d3/d7/d12/d31/d62/db6/fd2 x:0 0 0 2024-04-15T21:02:50.715 INFO:tasks.workunit.client.1.smithi149.stdout:0/928: dwrite d1/d5/d24/d50/d13/d59/f8d [0,4194304] 0 2024-04-15T21:02:50.716 INFO:tasks.workunit.client.0.smithi072.stdout:6/573: getdents d2/d40/d56/d6a/d70 0 2024-04-15T21:02:50.718 INFO:tasks.workunit.client.0.smithi072.stdout:2/595: write d2/f44 [1175553,42851] 0 2024-04-15T21:02:50.720 INFO:tasks.workunit.client.0.smithi072.stdout:2/596: read d2/d38/d73/d80/f92 [1433899,47064] 0 2024-04-15T21:02:50.723 INFO:tasks.workunit.client.0.smithi072.stdout:5/597: unlink d0/d3/d7/d12/d31/d62/f64 0 2024-04-15T21:02:50.725 INFO:tasks.workunit.client.1.smithi149.stdout:1/745: creat d1/db/dc/d11/d3f/d45/dae/fd6 x:0 0 0 2024-04-15T21:02:50.726 INFO:tasks.workunit.client.0.smithi072.stdout:1/603: dwrite d5/db/f59 [0,4194304] 0 2024-04-15T21:02:50.726 INFO:tasks.workunit.client.1.smithi149.stdout:1/746: truncate d1/db/d16/f5c 2690811 0 2024-04-15T21:02:50.727 INFO:tasks.workunit.client.0.smithi072.stdout:6/574: readlink d2/d10/d11/d1f/d60/lac 0 2024-04-15T21:02:50.728 INFO:tasks.workunit.client.1.smithi149.stdout:9/725: creat d23/d3c/d52/ff7 x:0 0 0 2024-04-15T21:02:50.730 INFO:tasks.workunit.client.1.smithi149.stdout:4/830: rename dc/d2c/d3e/d35/d4b to dc/d2c/d3e/d15/d3f/d117 0 2024-04-15T21:02:50.730 INFO:tasks.workunit.client.1.smithi149.stdout:4/831: read - dc/d18/daa/ff8 zero size 2024-04-15T21:02:50.731 INFO:tasks.workunit.client.0.smithi072.stdout:2/597: chown d2/d38/c29 160 1 2024-04-15T21:02:50.731 INFO:tasks.workunit.client.1.smithi149.stdout:4/832: readlink dc/d18/d21/l88 0 2024-04-15T21:02:50.732 INFO:tasks.workunit.client.1.smithi149.stdout:4/833: dread - dc/d8f/fa6 zero size 2024-04-15T21:02:50.732 INFO:tasks.workunit.client.0.smithi072.stdout:5/598: dread - d0/d3/d7/fb4 zero size 2024-04-15T21:02:50.733 INFO:tasks.workunit.client.1.smithi149.stdout:4/834: write dc/d2c/d3e/d15/d3f/d117/d6c/f7b [971565,76450] 0 2024-04-15T21:02:50.734 INFO:tasks.workunit.client.0.smithi072.stdout:1/604: symlink d5/db/d2d/d56/lc8 0 2024-04-15T21:02:50.736 INFO:tasks.workunit.client.1.smithi149.stdout:2/806: write d4/d7/d93/ff0 [51596,96911] 0 2024-04-15T21:02:50.736 INFO:tasks.workunit.client.0.smithi072.stdout:2/598: dwrite d2/d38/d73/d80/f82 [0,4194304] 0 2024-04-15T21:02:50.737 INFO:tasks.workunit.client.0.smithi072.stdout:6/575: mkdir d2/d42/dad 0 2024-04-15T21:02:50.743 INFO:tasks.workunit.client.1.smithi149.stdout:6/746: symlink da/d18/d10/d3f/lee 0 2024-04-15T21:02:50.745 INFO:tasks.workunit.client.1.smithi149.stdout:6/747: write da/d2e/f50 [3559301,102706] 0 2024-04-15T21:02:50.748 INFO:tasks.workunit.client.0.smithi072.stdout:8/633: truncate d3/de/d1b/d41/d74/f9c 1921577 0 2024-04-15T21:02:50.750 INFO:tasks.workunit.client.0.smithi072.stdout:6/576: dread - d2/d10/f58 zero size 2024-04-15T21:02:50.751 INFO:tasks.workunit.client.1.smithi149.stdout:0/929: creat d1/d5/d24/d50/d13/d59/dd7/f149 x:0 0 0 2024-04-15T21:02:50.753 INFO:tasks.workunit.client.1.smithi149.stdout:1/747: rmdir d1/d17/d52 39 2024-04-15T21:02:50.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/735: dwrite d0/d9/d3f/f93 [0,4194304] 0 2024-04-15T21:02:50.755 INFO:tasks.workunit.client.1.smithi149.stdout:7/787: dread d3/d17/d1f/d93/fdf [0,4194304] 0 2024-04-15T21:02:50.756 INFO:tasks.workunit.client.1.smithi149.stdout:0/930: chown d1/d5/d24/d50/d13/d59/f8d 186802 1 2024-04-15T21:02:50.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/736: write d0/d6/d82/da1/d12/d16/f1d [3898099,274] 0 2024-04-15T21:02:50.761 INFO:tasks.workunit.client.1.smithi149.stdout:4/835: creat dc/ddf/f118 x:0 0 0 2024-04-15T21:02:50.762 INFO:tasks.workunit.client.1.smithi149.stdout:4/836: fdatasync dc/f41 0 2024-04-15T21:02:50.763 INFO:tasks.workunit.client.1.smithi149.stdout:3/829: getdents d1/db/d24/d4d/d63/d65 0 2024-04-15T21:02:50.765 INFO:tasks.workunit.client.1.smithi149.stdout:2/807: mknod d4/d7/d46/de4/d21/d6d/c11d 0 2024-04-15T21:02:50.768 INFO:tasks.workunit.client.0.smithi072.stdout:5/599: dwrite d0/d3/d7/d12/d31/d55/f56 [0,4194304] 0 2024-04-15T21:02:50.770 INFO:tasks.workunit.client.0.smithi072.stdout:2/599: getdents d2/d8/d8e/d90 0 2024-04-15T21:02:50.771 INFO:tasks.workunit.client.0.smithi072.stdout:2/600: read d2/d38/f54 [6659576,89225] 0 2024-04-15T21:02:50.772 INFO:tasks.workunit.client.0.smithi072.stdout:8/634: rmdir d3/de/d1b/d41/da4/d2e/db3 0 2024-04-15T21:02:50.773 INFO:tasks.workunit.client.0.smithi072.stdout:8/635: dread - d3/de/d1b/d3f/fbb zero size 2024-04-15T21:02:50.774 INFO:tasks.workunit.client.1.smithi149.stdout:1/748: dread d1/db/dc/d38/f63 [0,4194304] 0 2024-04-15T21:02:50.785 INFO:tasks.workunit.client.0.smithi072.stdout:2/601: chown d2/f5a 48 1 2024-04-15T21:02:50.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/837: dread dc/f8a [0,4194304] 0 2024-04-15T21:02:50.786 INFO:tasks.workunit.client.0.smithi072.stdout:2/602: stat d2/d3/d5f/f60 0 2024-04-15T21:02:50.789 INFO:tasks.workunit.client.0.smithi072.stdout:6/577: truncate d2/d10/d18/fa2 3940167 0 2024-04-15T21:02:50.789 INFO:tasks.workunit.client.0.smithi072.stdout:6/578: chown d2/d40/d66/da8/la9 24245 1 2024-04-15T21:02:50.789 INFO:tasks.workunit.client.0.smithi072.stdout:5/600: fdatasync d0/d3/d6/d14/f1b 0 2024-04-15T21:02:50.792 INFO:tasks.workunit.client.1.smithi149.stdout:4/838: dread dc/d2c/d3e/d35/ff7 [0,4194304] 0 2024-04-15T21:02:50.795 INFO:tasks.workunit.client.0.smithi072.stdout:8/636: symlink d3/de/d1b/d41/dae/dc0/lc5 0 2024-04-15T21:02:50.800 INFO:tasks.workunit.client.0.smithi072.stdout:6/579: creat d2/d42/fae x:0 0 0 2024-04-15T21:02:50.800 INFO:tasks.workunit.client.0.smithi072.stdout:6/580: chown d2/d42/f8b 1 1 2024-04-15T21:02:50.805 INFO:tasks.workunit.client.0.smithi072.stdout:8/637: mkdir d3/d7e/dc6 0 2024-04-15T21:02:50.807 INFO:tasks.workunit.client.0.smithi072.stdout:5/601: mknod d0/d3/d6/cd3 0 2024-04-15T21:02:50.809 INFO:tasks.workunit.client.0.smithi072.stdout:2/603: dwrite d2/f5a [0,4194304] 0 2024-04-15T21:02:50.817 INFO:tasks.workunit.client.0.smithi072.stdout:8/638: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:50.817 INFO:tasks.workunit.client.0.smithi072.stdout:2/604: symlink d2/d38/d91/d97/lc4 0 2024-04-15T21:02:50.818 INFO:tasks.workunit.client.0.smithi072.stdout:8/639: truncate d3/d4/d3b/fb9 547861 0 2024-04-15T21:02:50.820 INFO:tasks.workunit.client.0.smithi072.stdout:6/581: creat d2/d10/faf x:0 0 0 2024-04-15T21:02:50.834 INFO:tasks.workunit.client.0.smithi072.stdout:3/587: sync 2024-04-15T21:02:50.834 INFO:tasks.workunit.client.0.smithi072.stdout:4/608: sync 2024-04-15T21:02:50.835 INFO:tasks.workunit.client.0.smithi072.stdout:7/607: sync 2024-04-15T21:02:50.837 INFO:tasks.workunit.client.0.smithi072.stdout:7/608: write d2/d7/d25/d2d/d46/d5a/d5f/fb2 [258071,128542] 0 2024-04-15T21:02:50.837 INFO:tasks.workunit.client.0.smithi072.stdout:5/602: rmdir d0/d3/d7/d12/d31/d62/db6/dd1 0 2024-04-15T21:02:50.838 INFO:tasks.workunit.client.0.smithi072.stdout:5/603: stat d0/d3/d6/cd3 0 2024-04-15T21:02:50.839 INFO:tasks.workunit.client.0.smithi072.stdout:5/604: chown d0/d3/d7/d94/c7e 1827 1 2024-04-15T21:02:50.839 INFO:tasks.workunit.client.0.smithi072.stdout:5/605: write d0/f80 [5510975,60113] 0 2024-04-15T21:02:50.841 INFO:tasks.workunit.client.0.smithi072.stdout:3/588: dread d1/f82 [0,4194304] 0 2024-04-15T21:02:50.846 INFO:tasks.workunit.client.0.smithi072.stdout:3/589: dwrite d1/f2b [0,4194304] 0 2024-04-15T21:02:50.847 INFO:tasks.workunit.client.1.smithi149.stdout:6/748: symlink da/d18/d10/d3f/lef 0 2024-04-15T21:02:50.850 INFO:tasks.workunit.client.1.smithi149.stdout:6/749: read da/f1b [3117277,125901] 0 2024-04-15T21:02:50.853 INFO:tasks.workunit.client.1.smithi149.stdout:6/750: write da/d18/fe0 [838248,91546] 0 2024-04-15T21:02:50.854 INFO:tasks.workunit.client.0.smithi072.stdout:7/609: creat d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc1 x:0 0 0 2024-04-15T21:02:50.856 INFO:tasks.workunit.client.0.smithi072.stdout:7/610: read d2/d7/d25/d2d/d46/d5a/d5f/f2a [355443,81947] 0 2024-04-15T21:02:50.858 INFO:tasks.workunit.client.0.smithi072.stdout:3/590: rmdir d1/d15/d32 39 2024-04-15T21:02:50.859 INFO:tasks.workunit.client.0.smithi072.stdout:3/591: readlink d1/d3f/d4f/l86 0 2024-04-15T21:02:50.863 INFO:tasks.workunit.client.1.smithi149.stdout:0/931: unlink d1/d5/d24/d50/d13/fbc 0 2024-04-15T21:02:50.869 INFO:tasks.workunit.client.1.smithi149.stdout:8/873: creat d2/d5b/dcd/d10a/d25/f136 x:0 0 0 2024-04-15T21:02:50.870 INFO:tasks.workunit.client.1.smithi149.stdout:8/874: write d2/d5b/dcd/d10a/d25/d57/f80 [778280,112031] 0 2024-04-15T21:02:50.872 INFO:tasks.workunit.client.0.smithi072.stdout:2/605: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-15T21:02:50.873 INFO:tasks.workunit.client.0.smithi072.stdout:8/640: write d3/f30 [1087215,108672] 0 2024-04-15T21:02:50.874 INFO:tasks.workunit.client.0.smithi072.stdout:6/582: write d2/d10/f58 [987896,38821] 0 2024-04-15T21:02:50.876 INFO:tasks.workunit.client.1.smithi149.stdout:3/830: symlink d1/db/d24/d4d/d63/d65/l104 0 2024-04-15T21:02:50.885 INFO:tasks.workunit.client.0.smithi072.stdout:6/583: mknod d2/d10/d18/d47/cb0 0 2024-04-15T21:02:50.885 INFO:tasks.workunit.client.0.smithi072.stdout:8/641: chown d3/d4/d76/l87 54956 1 2024-04-15T21:02:50.888 INFO:tasks.workunit.client.0.smithi072.stdout:4/609: write d7/d10/f85 [55192,44834] 0 2024-04-15T21:02:50.889 INFO:tasks.workunit.client.1.smithi149.stdout:6/751: creat da/d11/ff0 x:0 0 0 2024-04-15T21:02:50.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/584: dwrite d2/d10/d18/fa5 [0,4194304] 0 2024-04-15T21:02:50.894 INFO:tasks.workunit.client.0.smithi072.stdout:4/610: mknod d7/d15/cc6 0 2024-04-15T21:02:50.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/726: truncate f16 1179103 0 2024-04-15T21:02:50.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/585: dwrite d2/d10/d11/d15/f53 [0,4194304] 0 2024-04-15T21:02:50.901 INFO:tasks.workunit.client.1.smithi149.stdout:0/932: rmdir d1/d29 39 2024-04-15T21:02:50.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/808: getdents d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d102 0 2024-04-15T21:02:50.910 INFO:tasks.workunit.client.0.smithi072.stdout:6/586: readlink d2/d40/l7c 0 2024-04-15T21:02:50.910 INFO:tasks.workunit.client.0.smithi072.stdout:7/611: write d2/d7/d25/d2d/f44 [1484729,11517] 0 2024-04-15T21:02:50.914 INFO:tasks.workunit.client.1.smithi149.stdout:5/737: dwrite d0/d6/d2d/f4a [0,4194304] 0 2024-04-15T21:02:50.916 INFO:tasks.workunit.client.0.smithi072.stdout:3/592: dwrite d1/f74 [4194304,4194304] 0 2024-04-15T21:02:50.918 INFO:tasks.workunit.client.0.smithi072.stdout:2/606: dwrite d2/d8/f36 [4194304,4194304] 0 2024-04-15T21:02:50.919 INFO:tasks.workunit.client.0.smithi072.stdout:8/642: dread d3/d4/fbd [0,4194304] 0 2024-04-15T21:02:50.926 INFO:tasks.workunit.client.0.smithi072.stdout:3/593: dwrite d1/d5b/f60 [0,4194304] 0 2024-04-15T21:02:50.927 INFO:tasks.workunit.client.1.smithi149.stdout:4/839: dwrite dc/d18/dce/fe2 [0,4194304] 0 2024-04-15T21:02:50.930 INFO:tasks.workunit.client.1.smithi149.stdout:6/752: mknod da/d18/d10/d16/d97/dbf/d55/da0/db4/cf1 0 2024-04-15T21:02:50.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/788: rename d3/d39 to d3/d16/d11f 0 2024-04-15T21:02:50.932 INFO:tasks.workunit.client.0.smithi072.stdout:4/611: write d7/d15/d58/d62/f90 [48300,86200] 0 2024-04-15T21:02:50.935 INFO:tasks.workunit.client.0.smithi072.stdout:4/612: write d7/d10/d41/d44/d7a/d86/d76/f96 [841743,22906] 0 2024-04-15T21:02:50.939 INFO:tasks.workunit.client.0.smithi072.stdout:1/605: sync 2024-04-15T21:02:50.939 INFO:tasks.workunit.client.0.smithi072.stdout:9/617: sync 2024-04-15T21:02:50.939 INFO:tasks.workunit.client.0.smithi072.stdout:0/619: sync 2024-04-15T21:02:50.941 INFO:tasks.workunit.client.0.smithi072.stdout:1/606: fsync d5/db/d2d/d3a/d1f/fb6 0 2024-04-15T21:02:50.942 INFO:tasks.workunit.client.1.smithi149.stdout:3/831: link d1/db/d24/f5d d1/db/d102/f105 0 2024-04-15T21:02:50.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/738: dwrite d0/d6/d82/da1/f2e [0,4194304] 0 2024-04-15T21:02:50.944 INFO:tasks.workunit.client.1.smithi149.stdout:5/739: chown d0/d9/d6c/db4 252618 1 2024-04-15T21:02:50.946 INFO:tasks.workunit.client.0.smithi072.stdout:1/607: dwrite d5/db/d27/d9c/fb4 [0,4194304] 0 2024-04-15T21:02:50.947 INFO:tasks.workunit.client.0.smithi072.stdout:1/608: write d5/db/f1a [743203,110023] 0 2024-04-15T21:02:50.954 INFO:tasks.workunit.client.1.smithi149.stdout:2/809: rename d4/d7/d46/de4/d21/d2c/d115 to d4/d7/d10/d36/d11e 0 2024-04-15T21:02:50.955 INFO:tasks.workunit.client.1.smithi149.stdout:6/753: creat da/d18/d7d/ff2 x:0 0 0 2024-04-15T21:02:50.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/875: dread d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/f9e [0,4194304] 0 2024-04-15T21:02:50.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/876: write d2/d5b/dcd/d10a/d4e/d9f/f123 [800675,49385] 0 2024-04-15T21:02:50.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/789: creat d3/d16/d20/d9c/f120 x:0 0 0 2024-04-15T21:02:50.964 INFO:tasks.workunit.client.1.smithi149.stdout:1/749: getdents d1/db/d16 0 2024-04-15T21:02:50.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/740: fsync d0/f8 0 2024-04-15T21:02:50.968 INFO:tasks.workunit.client.1.smithi149.stdout:4/840: truncate dc/d2c/d3e/d15/d3f/d117/f7d 4101354 0 2024-04-15T21:02:50.969 INFO:tasks.workunit.client.1.smithi149.stdout:2/810: mkdir d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d11f 0 2024-04-15T21:02:50.973 INFO:tasks.workunit.client.1.smithi149.stdout:3/832: mkdir d1/db/d24/d39/d79/d97/daf/d106 0 2024-04-15T21:02:50.974 INFO:tasks.workunit.client.1.smithi149.stdout:6/754: dread - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:50.976 INFO:tasks.workunit.client.1.smithi149.stdout:2/811: chown d4/d7/d46/de4/d21/d6d/fd6 33449718 1 2024-04-15T21:02:50.976 INFO:tasks.workunit.client.1.smithi149.stdout:5/741: write d0/d6/d82/da1/d12/d16/f58 [1274755,87069] 0 2024-04-15T21:02:50.978 INFO:tasks.workunit.client.1.smithi149.stdout:8/877: chown d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d 4887 1 2024-04-15T21:02:50.979 INFO:tasks.workunit.client.1.smithi149.stdout:6/755: dread - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:50.979 INFO:tasks.workunit.client.1.smithi149.stdout:7/790: chown d3/cb8 555 1 2024-04-15T21:02:50.982 INFO:tasks.workunit.client.1.smithi149.stdout:7/791: stat d3/d16/d11f/fa3 0 2024-04-15T21:02:50.986 INFO:tasks.workunit.client.1.smithi149.stdout:9/727: dwrite f1b [0,4194304] 0 2024-04-15T21:02:50.990 INFO:tasks.workunit.client.1.smithi149.stdout:0/933: creat d1/d5/dc/f14a x:0 0 0 2024-04-15T21:02:50.993 INFO:tasks.workunit.client.0.smithi072.stdout:5/606: sync 2024-04-15T21:02:50.994 INFO:tasks.workunit.client.1.smithi149.stdout:2/812: creat d4/d7/d46/de4/d21/d2c/d32/d4a/dee/f120 x:0 0 0 2024-04-15T21:02:50.994 INFO:tasks.workunit.client.0.smithi072.stdout:5/607: chown d0/d3/d7/d12/d1d/d8c/ccd 23590 1 2024-04-15T21:02:50.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/756: creat da/d60/d9b/ff3 x:0 0 0 2024-04-15T21:02:51.001 INFO:tasks.workunit.client.1.smithi149.stdout:8/878: symlink d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/l137 0 2024-04-15T21:02:51.002 INFO:tasks.workunit.client.1.smithi149.stdout:8/879: readlink d2/d5b/dcd/d10a/d25/d57/l68 0 2024-04-15T21:02:51.006 INFO:tasks.workunit.client.1.smithi149.stdout:9/728: truncate d23/d2b/f4a 1326586 0 2024-04-15T21:02:51.008 INFO:tasks.workunit.client.1.smithi149.stdout:9/729: write d23/d46/dcf/deb/d7f/d83/ff6 [68480,41381] 0 2024-04-15T21:02:51.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/730: dread d23/d2b/d44/d7e/fcc [0,4194304] 0 2024-04-15T21:02:51.015 INFO:tasks.workunit.client.0.smithi072.stdout:7/612: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d 414062 0 2024-04-15T21:02:51.015 INFO:tasks.workunit.client.1.smithi149.stdout:4/841: write dc/d2c/d3e/d15/d3f/fc7 [731051,70392] 0 2024-04-15T21:02:51.016 INFO:tasks.workunit.client.1.smithi149.stdout:6/757: mknod da/d18/d7d/cf4 0 2024-04-15T21:02:51.020 INFO:tasks.workunit.client.1.smithi149.stdout:3/833: write d1/db/d28/d87/fcd [650721,26301] 0 2024-04-15T21:02:51.023 INFO:tasks.workunit.client.0.smithi072.stdout:3/594: truncate d1/d5b/f75 10234 0 2024-04-15T21:02:51.023 INFO:tasks.workunit.client.1.smithi149.stdout:5/742: write d0/d6/d82/da1/d12/d16/da9/f40 [4728710,43001] 0 2024-04-15T21:02:51.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/934: creat d1/d29/d2c/f14b x:0 0 0 2024-04-15T21:02:51.029 INFO:tasks.workunit.client.0.smithi072.stdout:9/618: unlink d4/d1f/d2c/l69 0 2024-04-15T21:02:51.032 INFO:tasks.workunit.client.1.smithi149.stdout:9/731: rename d23/d71/dbf to d23/d3c/d52/df8 0 2024-04-15T21:02:51.032 INFO:tasks.workunit.client.0.smithi072.stdout:9/619: dread d4/d29/d45/fa1 [0,4194304] 0 2024-04-15T21:02:51.032 INFO:tasks.workunit.client.0.smithi072.stdout:9/620: dread - d4/d1f/d31/d42/fb4 zero size 2024-04-15T21:02:51.033 INFO:tasks.workunit.client.0.smithi072.stdout:9/621: write d4/d1f/d31/f7e [1089422,67376] 0 2024-04-15T21:02:51.033 INFO:tasks.workunit.client.0.smithi072.stdout:0/620: mknod d0/d19/d71/d9e/cda 0 2024-04-15T21:02:51.037 INFO:tasks.workunit.client.1.smithi149.stdout:7/792: write d3/d16/d20/d60/f77 [351982,5035] 0 2024-04-15T21:02:51.039 INFO:tasks.workunit.client.1.smithi149.stdout:4/842: dread dc/fe [0,4194304] 0 2024-04-15T21:02:51.044 INFO:tasks.workunit.client.1.smithi149.stdout:2/813: dwrite d4/d7/d46/de4/d21/fe1 [0,4194304] 0 2024-04-15T21:02:51.045 INFO:tasks.workunit.client.0.smithi072.stdout:7/613: creat d2/d7/d25/d72/fc2 x:0 0 0 2024-04-15T21:02:51.046 INFO:tasks.workunit.client.0.smithi072.stdout:7/614: chown d2/d7/d25/d2d/d46/d5a/d5f/l4d 3 1 2024-04-15T21:02:51.046 INFO:tasks.workunit.client.1.smithi149.stdout:2/814: truncate d4/f7a 801517 0 2024-04-15T21:02:51.050 INFO:tasks.workunit.client.1.smithi149.stdout:5/743: rename d0/d9/l32 to d0/d9/db6/lec 0 2024-04-15T21:02:51.051 INFO:tasks.workunit.client.0.smithi072.stdout:2/607: mknod d2/d8/daa/cc5 0 2024-04-15T21:02:51.052 INFO:tasks.workunit.client.0.smithi072.stdout:2/608: chown d2/d8/d8e/d90/f9f 167090 1 2024-04-15T21:02:51.053 INFO:tasks.workunit.client.1.smithi149.stdout:9/732: symlink d23/d2b/d37/d50/d79/lf9 0 2024-04-15T21:02:51.057 INFO:tasks.workunit.client.0.smithi072.stdout:4/613: mknod d7/d10/d41/d44/d7a/d97/db6/cc7 0 2024-04-15T21:02:51.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/758: write da/d18/d33/f7e [1311694,124194] 0 2024-04-15T21:02:51.065 INFO:tasks.workunit.client.1.smithi149.stdout:3/834: mkdir d1/db/d24/d107 0 2024-04-15T21:02:51.067 INFO:tasks.workunit.client.0.smithi072.stdout:8/643: dwrite d3/de/d1b/f57 [0,4194304] 0 2024-04-15T21:02:51.068 INFO:tasks.workunit.client.0.smithi072.stdout:8/644: fsync d3/f3c 0 2024-04-15T21:02:51.069 INFO:tasks.workunit.client.1.smithi149.stdout:0/935: creat d1/d9/d64/d65/d104/d119/d43/f14c x:0 0 0 2024-04-15T21:02:51.072 INFO:tasks.workunit.client.1.smithi149.stdout:4/843: write dc/d2c/d3e/d7c/dba/fc6 [1016000,119004] 0 2024-04-15T21:02:51.076 INFO:tasks.workunit.client.1.smithi149.stdout:5/744: read d0/d6/d2d/f68 [1422234,52617] 0 2024-04-15T21:02:51.077 INFO:tasks.workunit.client.1.smithi149.stdout:9/733: read - d23/d2b/fa0 zero size 2024-04-15T21:02:51.079 INFO:tasks.workunit.client.0.smithi072.stdout:9/622: dwrite d4/d1f/f54 [0,4194304] 0 2024-04-15T21:02:51.080 INFO:tasks.workunit.client.0.smithi072.stdout:7/615: mkdir d2/d7/d25/d2d/d47/d7e/dc3 0 2024-04-15T21:02:51.081 INFO:tasks.workunit.client.1.smithi149.stdout:8/880: getdents d2/d5b/dcd/d10a/d25 0 2024-04-15T21:02:51.081 INFO:tasks.workunit.client.0.smithi072.stdout:5/608: truncate d0/f35 3158368 0 2024-04-15T21:02:51.082 INFO:tasks.workunit.client.1.smithi149.stdout:0/936: dwrite d1/d5/dc/f10a [0,4194304] 0 2024-04-15T21:02:51.082 INFO:tasks.workunit.client.0.smithi072.stdout:5/609: readlink d0/d3/d33/d60/d81/daf/lbc 0 2024-04-15T21:02:51.083 INFO:tasks.workunit.client.0.smithi072.stdout:5/610: chown d0/d3/d7/d12/d31 8995 1 2024-04-15T21:02:51.084 INFO:tasks.workunit.client.0.smithi072.stdout:7/616: truncate d2/d7/d25/d81/f86 5217739 0 2024-04-15T21:02:51.084 INFO:tasks.workunit.client.1.smithi149.stdout:0/937: chown d1/d5/dfb/f121 8593 1 2024-04-15T21:02:51.084 INFO:tasks.workunit.client.1.smithi149.stdout:7/793: creat d3/d16/d32/d110/f121 x:0 0 0 2024-04-15T21:02:51.085 INFO:tasks.workunit.client.1.smithi149.stdout:0/938: chown d1/d5/d24/c16 5365396 1 2024-04-15T21:02:51.085 INFO:tasks.workunit.client.1.smithi149.stdout:3/835: symlink d1/db/d28/d87/l108 0 2024-04-15T21:02:51.086 INFO:tasks.workunit.client.0.smithi072.stdout:3/595: mknod d1/d15/cb6 0 2024-04-15T21:02:51.091 INFO:tasks.workunit.client.1.smithi149.stdout:4/844: creat dc/d18/d21/f119 x:0 0 0 2024-04-15T21:02:51.091 INFO:tasks.workunit.client.0.smithi072.stdout:0/621: dread d0/d19/f4a [0,4194304] 0 2024-04-15T21:02:51.092 INFO:tasks.workunit.client.1.smithi149.stdout:9/734: read - d23/d46/fd1 zero size 2024-04-15T21:02:51.092 INFO:tasks.workunit.client.0.smithi072.stdout:0/622: fdatasync d0/fb3 0 2024-04-15T21:02:51.093 INFO:tasks.workunit.client.1.smithi149.stdout:5/745: creat d0/d6/d82/db0/fed x:0 0 0 2024-04-15T21:02:51.095 INFO:tasks.workunit.client.1.smithi149.stdout:6/759: symlink da/d2e/de7/lf5 0 2024-04-15T21:02:51.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/587: link d2/d40/d66/d7f/ca7 d2/d10/d11/d1f/cb1 0 2024-04-15T21:02:51.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/588: fsync d2/d1a/f75 0 2024-04-15T21:02:51.097 INFO:tasks.workunit.client.1.smithi149.stdout:3/836: mknod d1/db/d24/d4d/d63/d65/c109 0 2024-04-15T21:02:51.097 INFO:tasks.workunit.client.1.smithi149.stdout:8/881: read d2/f69 [1785765,58067] 0 2024-04-15T21:02:51.098 INFO:tasks.workunit.client.0.smithi072.stdout:9/623: mkdir d4/d29/d4c/d74/d84/dc0 0 2024-04-15T21:02:51.099 INFO:tasks.workunit.client.0.smithi072.stdout:2/609: mknod d2/d66/cc6 0 2024-04-15T21:02:51.099 INFO:tasks.workunit.client.1.smithi149.stdout:8/882: chown d2/d5b/dcd/d10a/d25/d37/lc5 432239 1 2024-04-15T21:02:51.102 INFO:tasks.workunit.client.1.smithi149.stdout:0/939: dread d1/d5/d24/d50/d15/f89 [0,4194304] 0 2024-04-15T21:02:51.106 INFO:tasks.workunit.client.1.smithi149.stdout:9/735: unlink d23/d2b/d37/d50/db3/lbc 0 2024-04-15T21:02:51.108 INFO:tasks.workunit.client.0.smithi072.stdout:4/614: fdatasync d7/d28/f49 0 2024-04-15T21:02:51.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/746: creat d0/d6/d82/da1/d12/d16/da9/d1b/d83/fee x:0 0 0 2024-04-15T21:02:51.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/760: creat da/d18/d10/d16/d97/dbf/d55/da0/ff6 x:0 0 0 2024-04-15T21:02:51.113 INFO:tasks.workunit.client.0.smithi072.stdout:0/623: mkdir d0/d19/d2b/d63/ddb 0 2024-04-15T21:02:51.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/883: mknod d2/d5b/c138 0 2024-04-15T21:02:51.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/815: getdents d4/d7/d46/de4/d21/d5e/dbe/da7 0 2024-04-15T21:02:51.121 INFO:tasks.workunit.client.1.smithi149.stdout:8/884: read d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda/f9a [42222,128894] 0 2024-04-15T21:02:51.122 INFO:tasks.workunit.client.1.smithi149.stdout:4/845: write dc/d2c/d3e/d15/d3f/f87 [2598344,36145] 0 2024-04-15T21:02:51.123 INFO:tasks.workunit.client.0.smithi072.stdout:2/610: read d2/d38/d73/f7a [404427,105639] 0 2024-04-15T21:02:51.124 INFO:tasks.workunit.client.0.smithi072.stdout:2/611: chown d2/d8/d41/db8 24 1 2024-04-15T21:02:51.127 INFO:tasks.workunit.client.1.smithi149.stdout:9/736: creat d23/d3c/db5/ffa x:0 0 0 2024-04-15T21:02:51.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/596: mknod d1/d15/d32/d78/cb7 0 2024-04-15T21:02:51.129 INFO:tasks.workunit.client.1.smithi149.stdout:6/761: write da/d18/d10/d16/d97/dbf/fcb [2773822,27646] 0 2024-04-15T21:02:51.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/611: dwrite d0/d3/d7/f8a [4194304,4194304] 0 2024-04-15T21:02:51.130 INFO:tasks.workunit.client.1.smithi149.stdout:3/837: mknod d1/c10a 0 2024-04-15T21:02:51.131 INFO:tasks.workunit.client.0.smithi072.stdout:4/615: mknod d7/d10/d41/d44/d7a/d97/db6/cc8 0 2024-04-15T21:02:51.132 INFO:tasks.workunit.client.1.smithi149.stdout:7/794: link d3/d16/d20/d36/f119 d3/d16/d20/d114/db6/f122 0 2024-04-15T21:02:51.133 INFO:tasks.workunit.client.0.smithi072.stdout:3/597: dread d1/d15/f3b [0,4194304] 0 2024-04-15T21:02:51.134 INFO:tasks.workunit.client.0.smithi072.stdout:0/624: rename d0/d45/f7f to d0/d97/fdc 0 2024-04-15T21:02:51.134 INFO:tasks.workunit.client.0.smithi072.stdout:1/609: link d5/db/d2d/d56/d93/fa2 d5/fc9 0 2024-04-15T21:02:51.135 INFO:tasks.workunit.client.0.smithi072.stdout:6/589: symlink d2/d42/dad/lb2 0 2024-04-15T21:02:51.135 INFO:tasks.workunit.client.0.smithi072.stdout:1/610: chown d5/db/d2d/d3a/d1f/f78 30892 1 2024-04-15T21:02:51.136 INFO:tasks.workunit.client.1.smithi149.stdout:0/940: symlink d1/d5/d24/d100/l14d 0 2024-04-15T21:02:51.136 INFO:tasks.workunit.client.0.smithi072.stdout:1/611: chown d5/d3d/d5e/c65 333 1 2024-04-15T21:02:51.136 INFO:tasks.workunit.client.0.smithi072.stdout:6/590: write d2/d10/f1d [5901793,30140] 0 2024-04-15T21:02:51.137 INFO:tasks.workunit.client.1.smithi149.stdout:0/941: readlink d1/d9/d64/d65/d104/d119/lfa 0 2024-04-15T21:02:51.137 INFO:tasks.workunit.client.0.smithi072.stdout:9/624: symlink d4/d1f/d9e/db3/lc1 0 2024-04-15T21:02:51.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/612: truncate d5/db/d27/d9c/fa7 1691455 0 2024-04-15T21:02:51.142 INFO:tasks.workunit.client.1.smithi149.stdout:9/737: truncate d23/d3c/f6b 2212656 0 2024-04-15T21:02:51.147 INFO:tasks.workunit.client.0.smithi072.stdout:5/612: creat d0/d3/d33/d85/fd4 x:0 0 0 2024-04-15T21:02:51.151 INFO:tasks.workunit.client.0.smithi072.stdout:5/613: dread d0/d3/d7/d12/f99 [0,4194304] 0 2024-04-15T21:02:51.152 INFO:tasks.workunit.client.0.smithi072.stdout:5/614: stat d0/d3/d7/d1f/l27 0 2024-04-15T21:02:51.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/615: chown d0/d3/d6/f8 856470 1 2024-04-15T21:02:51.153 INFO:tasks.workunit.client.1.smithi149.stdout:4/846: rename dc/d2c/d3e/d15/d3f/d117/l54 to dc/d2c/d3e/d15/d3f/d117/d75/l11a 0 2024-04-15T21:02:51.154 INFO:tasks.workunit.client.0.smithi072.stdout:0/625: dread d0/d19/d2b/f4d [0,4194304] 0 2024-04-15T21:02:51.155 INFO:tasks.workunit.client.0.smithi072.stdout:0/626: chown d0 2 1 2024-04-15T21:02:51.155 INFO:tasks.workunit.client.1.smithi149.stdout:5/747: link d0/d9/f39 d0/d6/d82/da1/d12/d2b/fef 0 2024-04-15T21:02:51.156 INFO:tasks.workunit.client.1.smithi149.stdout:5/748: dread - d0/d6/d82/fa6 zero size 2024-04-15T21:02:51.157 INFO:tasks.workunit.client.0.smithi072.stdout:9/625: chown d4/c10 7312387 1 2024-04-15T21:02:51.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/838: dread d1/db/d24/d39/f61 [0,4194304] 0 2024-04-15T21:02:51.161 INFO:tasks.workunit.client.1.smithi149.stdout:9/738: fdatasync d23/d2b/d70/fae 0 2024-04-15T21:02:51.165 INFO:tasks.workunit.client.1.smithi149.stdout:7/795: getdents d3/d16/d32/d90/de5 0 2024-04-15T21:02:51.166 INFO:tasks.workunit.client.0.smithi072.stdout:2/612: symlink d2/d8/d41/db8/lc7 0 2024-04-15T21:02:51.169 INFO:tasks.workunit.client.1.smithi149.stdout:8/885: creat d2/df/f139 x:0 0 0 2024-04-15T21:02:51.170 INFO:tasks.workunit.client.0.smithi072.stdout:7/617: getdents d2/d7/d25/d2d/d46/d5a/d5f/d43 0 2024-04-15T21:02:51.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/616: write d7/d28/d42/f75 [1589108,66662] 0 2024-04-15T21:02:51.173 INFO:tasks.workunit.client.1.smithi149.stdout:5/749: dread d0/d6/d82/da1/f7f [0,4194304] 0 2024-04-15T21:02:51.177 INFO:tasks.workunit.client.1.smithi149.stdout:6/762: truncate da/d2e/f64 336813 0 2024-04-15T21:02:51.179 INFO:tasks.workunit.client.0.smithi072.stdout:5/616: creat d0/d3/d7/d94/fd5 x:0 0 0 2024-04-15T21:02:51.181 INFO:tasks.workunit.client.1.smithi149.stdout:5/750: dwrite d0/d9/d3f/dc7/fdb [0,4194304] 0 2024-04-15T21:02:51.181 INFO:tasks.workunit.client.0.smithi072.stdout:0/627: fsync d0/d45/d7a/d70/d59/f88 0 2024-04-15T21:02:51.190 INFO:tasks.workunit.client.1.smithi149.stdout:2/816: getdents d4/d7/d46/de4/d21/d5e 0 2024-04-15T21:02:51.191 INFO:tasks.workunit.client.0.smithi072.stdout:1/613: symlink d5/lca 0 2024-04-15T21:02:51.193 INFO:tasks.workunit.client.1.smithi149.stdout:0/942: rename d1/d29/d2c/d4f/f7e to d1/d9/d64/f14e 0 2024-04-15T21:02:51.193 INFO:tasks.workunit.client.1.smithi149.stdout:8/886: write d2/d5b/dcd/d10a/d25/d32/f42 [1119312,7712] 0 2024-04-15T21:02:51.195 INFO:tasks.workunit.client.0.smithi072.stdout:2/613: mkdir d2/d3/d5f/dc8 0 2024-04-15T21:02:51.197 INFO:tasks.workunit.client.0.smithi072.stdout:4/617: mkdir d7/d10/d41/d4c/dc9 0 2024-04-15T21:02:51.199 INFO:tasks.workunit.client.1.smithi149.stdout:9/739: mknod d23/d2b/d70/d75/cfb 0 2024-04-15T21:02:51.200 INFO:tasks.workunit.client.1.smithi149.stdout:9/740: chown d23/d71/fdf 252 1 2024-04-15T21:02:51.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/628: fdatasync d0/d45/f1d 0 2024-04-15T21:02:51.202 INFO:tasks.workunit.client.0.smithi072.stdout:6/591: dwrite d2/d40/f4d [0,4194304] 0 2024-04-15T21:02:51.204 INFO:tasks.workunit.client.0.smithi072.stdout:0/629: chown d0/d6/d6d/dcc 0 1 2024-04-15T21:02:51.207 INFO:tasks.workunit.client.0.smithi072.stdout:2/614: dwrite d2/d8/f72 [0,4194304] 0 2024-04-15T21:02:51.209 INFO:tasks.workunit.client.0.smithi072.stdout:5/617: dwrite d0/d3/d7/d94/d86/fb9 [0,4194304] 0 2024-04-15T21:02:51.209 INFO:tasks.workunit.client.1.smithi149.stdout:5/751: write d0/d6/d82/da1/f7b [1255040,29941] 0 2024-04-15T21:02:51.210 INFO:tasks.workunit.client.0.smithi072.stdout:5/618: fdatasync d0/d3/d7/d1f/d50/fcf 0 2024-04-15T21:02:51.212 INFO:tasks.workunit.client.0.smithi072.stdout:7/618: truncate d2/d7/d25/d2d/d46/d5a/f9b 1477211 0 2024-04-15T21:02:51.213 INFO:tasks.workunit.client.1.smithi149.stdout:4/847: rename dc/d18/dce/c111 to dc/d18/d21/d10e/c11b 0 2024-04-15T21:02:51.214 INFO:tasks.workunit.client.0.smithi072.stdout:9/626: dread d4/d1f/d2c/d47/f79 [0,4194304] 0 2024-04-15T21:02:51.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/943: creat d1/d29/d2c/d4f/f14f x:0 0 0 2024-04-15T21:02:51.216 INFO:tasks.workunit.client.1.smithi149.stdout:0/944: chown d1/d29/fe1 81 1 2024-04-15T21:02:51.224 INFO:tasks.workunit.client.0.smithi072.stdout:0/630: write d0/d19/fc4 [3090022,130051] 0 2024-04-15T21:02:51.224 INFO:tasks.workunit.client.0.smithi072.stdout:0/631: fdatasync d0/d19/d2b/fa3 0 2024-04-15T21:02:51.225 INFO:tasks.workunit.client.1.smithi149.stdout:9/741: truncate d23/d46/f53 596517 0 2024-04-15T21:02:51.225 INFO:tasks.workunit.client.0.smithi072.stdout:6/592: rename d2/d10/f27 to d2/da1/fb3 0 2024-04-15T21:02:51.226 INFO:tasks.workunit.client.0.smithi072.stdout:1/614: mkdir d5/dcb 0 2024-04-15T21:02:51.228 INFO:tasks.workunit.client.1.smithi149.stdout:7/796: fsync d3/d16/da0/fa8 0 2024-04-15T21:02:51.229 INFO:tasks.workunit.client.1.smithi149.stdout:7/797: chown d3/d16/d20/d60/ff5 1 1 2024-04-15T21:02:51.230 INFO:tasks.workunit.client.1.smithi149.stdout:2/817: mknod d4/d7/d46/c121 0 2024-04-15T21:02:51.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/752: fsync d0/d6/d82/da1/d12/d16/da9/fc5 0 2024-04-15T21:02:51.233 INFO:tasks.workunit.client.0.smithi072.stdout:7/619: read d2/f1c [2576026,12839] 0 2024-04-15T21:02:51.234 INFO:tasks.workunit.client.1.smithi149.stdout:5/753: write d0/d6/d82/da1/f7b [2531337,63505] 0 2024-04-15T21:02:51.234 INFO:tasks.workunit.client.0.smithi072.stdout:5/619: read d0/d3/d7/d12/d31/d49/f84 [2103003,50862] 0 2024-04-15T21:02:51.235 INFO:tasks.workunit.client.1.smithi149.stdout:5/754: chown d0/d6/d82/da1/d12/d16/da9/d1b/d9c/fa0 7188 1 2024-04-15T21:02:51.236 INFO:tasks.workunit.client.1.smithi149.stdout:5/755: chown d0/d9/d71/cb9 1201699 1 2024-04-15T21:02:51.239 INFO:tasks.workunit.client.0.smithi072.stdout:7/620: dwrite d2/d7/d25/d72/f9c [0,4194304] 0 2024-04-15T21:02:51.245 INFO:tasks.workunit.client.0.smithi072.stdout:7/621: dwrite d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:02:51.281 INFO:tasks.workunit.client.1.smithi149.stdout:9/742: fdatasync d23/f33 0 2024-04-15T21:02:51.284 INFO:tasks.workunit.client.0.smithi072.stdout:6/593: mknod d2/d40/d56/d6a/d70/cb4 0 2024-04-15T21:02:51.285 INFO:tasks.workunit.client.0.smithi072.stdout:6/594: chown d2/d40/d6e/c29 1578300 1 2024-04-15T21:02:51.286 INFO:tasks.workunit.client.1.smithi149.stdout:7/798: mkdir d3/d16/d11f/d92/d123 0 2024-04-15T21:02:51.287 INFO:tasks.workunit.client.0.smithi072.stdout:1/615: rename d5/db/d2d/d3a/l42 to d5/db/d2d/d85/dbf/lcc 0 2024-04-15T21:02:51.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/887: dwrite d2/d5b/dcd/d10a/d25/d32/d45/f5e [0,4194304] 0 2024-04-15T21:02:51.291 INFO:tasks.workunit.client.1.smithi149.stdout:2/818: creat d4/d7/d46/de4/d21/d6d/f122 x:0 0 0 2024-04-15T21:02:51.292 INFO:tasks.workunit.client.1.smithi149.stdout:6/763: dwrite da/d11/f35 [0,4194304] 0 2024-04-15T21:02:51.293 INFO:tasks.workunit.client.1.smithi149.stdout:6/764: stat da/d18/d10/d66/l84 0 2024-04-15T21:02:51.296 INFO:tasks.workunit.client.1.smithi149.stdout:4/848: write dc/d1a/f4f [3127652,128920] 0 2024-04-15T21:02:51.297 INFO:tasks.workunit.client.0.smithi072.stdout:5/620: fdatasync d0/d3/f4 0 2024-04-15T21:02:51.298 INFO:tasks.workunit.client.1.smithi149.stdout:4/849: write dc/d2c/d3e/d15/d3f/d117/d6c/f7b [2552055,56298] 0 2024-04-15T21:02:51.304 INFO:tasks.workunit.client.0.smithi072.stdout:7/622: dread - d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 zero size 2024-04-15T21:02:51.305 INFO:tasks.workunit.client.0.smithi072.stdout:0/632: write d0/d6/f4e [707178,58837] 0 2024-04-15T21:02:51.305 INFO:tasks.workunit.client.1.smithi149.stdout:8/888: chown d2/c5a 788718 1 2024-04-15T21:02:51.306 INFO:tasks.workunit.client.0.smithi072.stdout:2/615: dwrite d2/d3/d5f/f7c [0,4194304] 0 2024-04-15T21:02:51.306 INFO:tasks.workunit.client.1.smithi149.stdout:2/819: symlink d4/d7/d46/de4/d21/d2c/d32/d4a/l123 0 2024-04-15T21:02:51.306 INFO:tasks.workunit.client.1.smithi149.stdout:8/889: stat d2/d5b/dcd/d10a/d20/f91 0 2024-04-15T21:02:51.308 INFO:tasks.workunit.client.0.smithi072.stdout:6/595: rename d2/d40/d56/f6c to d2/da1/fb5 0 2024-04-15T21:02:51.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/627: dwrite d4/d1f/d31/f63 [0,4194304] 0 2024-04-15T21:02:51.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/618: getdents d7/d71/db2 0 2024-04-15T21:02:51.311 INFO:tasks.workunit.client.0.smithi072.stdout:6/596: chown d2/d1a/f75 3567 1 2024-04-15T21:02:51.312 INFO:tasks.workunit.client.0.smithi072.stdout:4/619: chown d7/d15/d58/d62/d6f/c87 0 1 2024-04-15T21:02:51.317 INFO:tasks.workunit.client.0.smithi072.stdout:4/620: dread d7/d15/d58/d62/f90 [0,4194304] 0 2024-04-15T21:02:51.318 INFO:tasks.workunit.client.0.smithi072.stdout:4/621: chown d7/d10/d41/d45/c5b 162596 1 2024-04-15T21:02:51.319 INFO:tasks.workunit.client.1.smithi149.stdout:4/850: mknod dc/d18/d21/c11c 0 2024-04-15T21:02:51.319 INFO:tasks.workunit.client.0.smithi072.stdout:4/622: stat d7/d28/d42/da1/da2 0 2024-04-15T21:02:51.320 INFO:tasks.workunit.client.0.smithi072.stdout:5/621: creat d0/d3/d6/d14/fd6 x:0 0 0 2024-04-15T21:02:51.322 INFO:tasks.workunit.client.0.smithi072.stdout:4/623: rename d7/d10/d41/d44/d7a/d86/d76 to d7/d10/d41/d44/d7a/d86/d76/d8b/dad/dca 22 2024-04-15T21:02:51.323 INFO:tasks.workunit.client.1.smithi149.stdout:0/945: write d1/d9/fce [758896,47360] 0 2024-04-15T21:02:51.326 INFO:tasks.workunit.client.1.smithi149.stdout:2/820: creat d4/d7/d46/de4/d21/d6d/f124 x:0 0 0 2024-04-15T21:02:51.328 INFO:tasks.workunit.client.0.smithi072.stdout:7/623: write d2/fa [3730134,14793] 0 2024-04-15T21:02:51.328 INFO:tasks.workunit.client.1.smithi149.stdout:7/799: write d3/d16/d20/d60/fb2 [292094,50810] 0 2024-04-15T21:02:51.331 INFO:tasks.workunit.client.0.smithi072.stdout:0/633: creat d0/d45/d7a/d70/d59/fdd x:0 0 0 2024-04-15T21:02:51.333 INFO:tasks.workunit.client.1.smithi149.stdout:7/800: write d3/d17/d1f/d93/f100 [294715,38204] 0 2024-04-15T21:02:51.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/756: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [4194304,4194304] 0 2024-04-15T21:02:51.334 INFO:tasks.workunit.client.0.smithi072.stdout:7/624: dwrite d2/d7/d25/d81/f86 [0,4194304] 0 2024-04-15T21:02:51.337 INFO:tasks.workunit.client.1.smithi149.stdout:5/757: write d0/d6/d82/da1/f5e [746893,94915] 0 2024-04-15T21:02:51.338 INFO:tasks.workunit.client.1.smithi149.stdout:2/821: dwrite d4/d7/d93/f10f [0,4194304] 0 2024-04-15T21:02:51.341 INFO:tasks.workunit.client.0.smithi072.stdout:5/622: symlink d0/d3/d7/d94/ld7 0 2024-04-15T21:02:51.346 INFO:tasks.workunit.client.0.smithi072.stdout:4/624: symlink d7/d10/d41/d44/d7a/d97/db6/lcb 0 2024-04-15T21:02:51.355 INFO:tasks.workunit.client.0.smithi072.stdout:2/616: mknod d2/d8/da2/cc9 0 2024-04-15T21:02:51.356 INFO:tasks.workunit.client.1.smithi149.stdout:4/851: dread dc/d18/d21/f6b [4194304,4194304] 0 2024-04-15T21:02:51.357 INFO:tasks.workunit.client.1.smithi149.stdout:8/890: creat d2/d5b/dcd/d10a/d25/d32/d45/f13a x:0 0 0 2024-04-15T21:02:51.361 INFO:tasks.workunit.client.1.smithi149.stdout:8/891: write d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/ff9 [1479958,129037] 0 2024-04-15T21:02:51.361 INFO:tasks.workunit.client.1.smithi149.stdout:2/822: mknod d4/dc7/c125 0 2024-04-15T21:02:51.362 INFO:tasks.workunit.client.1.smithi149.stdout:6/765: truncate da/d11/f35 5579519 0 2024-04-15T21:02:51.363 INFO:tasks.workunit.client.1.smithi149.stdout:2/823: stat d4/d7/d46/de4/db6/le8 0 2024-04-15T21:02:51.364 INFO:tasks.workunit.client.0.smithi072.stdout:6/597: mknod d2/d10/d11/cb6 0 2024-04-15T21:02:51.364 INFO:tasks.workunit.client.1.smithi149.stdout:8/892: write d2/f1b [3840546,63639] 0 2024-04-15T21:02:51.365 INFO:tasks.workunit.client.0.smithi072.stdout:7/625: creat d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc4 x:0 0 0 2024-04-15T21:02:51.367 INFO:tasks.workunit.client.0.smithi072.stdout:9/628: write d4/d1f/d2c/d47/f79 [1531834,29788] 0 2024-04-15T21:02:51.367 INFO:tasks.workunit.client.1.smithi149.stdout:8/893: stat d2/d5b/dcd/d10a/d25/d37/f3e 0 2024-04-15T21:02:51.368 INFO:tasks.workunit.client.1.smithi149.stdout:4/852: dwrite dc/d2c/d3e/d35/ffb [0,4194304] 0 2024-04-15T21:02:51.369 INFO:tasks.workunit.client.1.smithi149.stdout:4/853: chown dc/d2c/d3e/d35/ff7 4086 1 2024-04-15T21:02:51.376 INFO:tasks.workunit.client.1.smithi149.stdout:2/824: dwrite d4/d7/d46/de4/d21/d2c/d32/d4a/dee/f120 [0,4194304] 0 2024-04-15T21:02:51.378 INFO:tasks.workunit.client.0.smithi072.stdout:4/625: rename d7/fbc to d7/d71/db2/fcc 0 2024-04-15T21:02:51.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/946: truncate d1/d5/dc/f10a 3816631 0 2024-04-15T21:02:51.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/645: sync 2024-04-15T21:02:51.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/854: read dc/d2c/d3e/d15/d5b/fc5 [863400,60518] 0 2024-04-15T21:02:51.387 INFO:tasks.workunit.client.0.smithi072.stdout:5/623: symlink d0/d3/ld8 0 2024-04-15T21:02:51.388 INFO:tasks.workunit.client.1.smithi149.stdout:6/766: mknod da/d18/cf7 0 2024-04-15T21:02:51.389 INFO:tasks.workunit.client.0.smithi072.stdout:5/624: dread - d0/d3/d7/d94/fa1 zero size 2024-04-15T21:02:51.389 INFO:tasks.workunit.client.0.smithi072.stdout:0/634: dwrite d0/d45/f1d [0,4194304] 0 2024-04-15T21:02:51.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/825: mknod d4/d7/d46/de4/d21/d5e/c126 0 2024-04-15T21:02:51.393 INFO:tasks.workunit.client.0.smithi072.stdout:7/626: rename d2/d78/fbd to d2/d7/d25/d2d/d46/fc5 0 2024-04-15T21:02:51.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/947: rmdir d1/d5/dc 39 2024-04-15T21:02:51.397 INFO:tasks.workunit.client.0.smithi072.stdout:5/625: dwrite d0/d3/d7/d94/fd5 [0,4194304] 0 2024-04-15T21:02:51.398 INFO:tasks.workunit.client.0.smithi072.stdout:8/646: symlink d3/de/d1b/d41/da4/d2e/lc7 0 2024-04-15T21:02:51.403 INFO:tasks.workunit.client.1.smithi149.stdout:5/758: truncate d0/d6/d82/da1/d12/d16/f58 3621640 0 2024-04-15T21:02:51.404 INFO:tasks.workunit.client.0.smithi072.stdout:2/617: unlink d2/d66/lc3 0 2024-04-15T21:02:51.405 INFO:tasks.workunit.client.0.smithi072.stdout:2/618: truncate d2/d3/f1d 4335687 0 2024-04-15T21:02:51.410 INFO:tasks.workunit.client.0.smithi072.stdout:6/598: truncate d2/d40/d56/f8a 2835467 0 2024-04-15T21:02:51.411 INFO:tasks.workunit.client.0.smithi072.stdout:6/599: stat d2/d10/d11/d1f/d60/l99 0 2024-04-15T21:02:51.411 INFO:tasks.workunit.client.0.smithi072.stdout:2/619: dwrite d2/d38/d73/d80/f92 [4194304,4194304] 0 2024-04-15T21:02:51.416 INFO:tasks.workunit.client.1.smithi149.stdout:2/826: read d4/d7/da/f1c [4752314,91408] 0 2024-04-15T21:02:51.418 INFO:tasks.workunit.client.0.smithi072.stdout:9/629: rename d4/d1f/d31/d42/fb4 to d4/d29/d4c/d91/fc2 0 2024-04-15T21:02:51.418 INFO:tasks.workunit.client.0.smithi072.stdout:9/630: fdatasync d4/fa7 0 2024-04-15T21:02:51.419 INFO:tasks.workunit.client.1.smithi149.stdout:2/827: chown d4/d7/d46/de4/d21/d3b/d10a/dfd 26900 1 2024-04-15T21:02:51.420 INFO:tasks.workunit.client.1.smithi149.stdout:2/828: chown d4/d7/d29/fd1 447 1 2024-04-15T21:02:51.421 INFO:tasks.workunit.client.1.smithi149.stdout:6/767: dread da/d18/d10/d16/f3c [0,4194304] 0 2024-04-15T21:02:51.426 INFO:tasks.workunit.client.1.smithi149.stdout:5/759: symlink d0/d6/d82/da1/d12/d2b/lf0 0 2024-04-15T21:02:51.430 INFO:tasks.workunit.client.1.smithi149.stdout:4/855: symlink dc/d2c/d3e/l11d 0 2024-04-15T21:02:51.432 INFO:tasks.workunit.client.1.smithi149.stdout:8/894: link d2/d5b/dcd/d10a/d25/d37/c7f d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/c13b 0 2024-04-15T21:02:51.432 INFO:tasks.workunit.client.0.smithi072.stdout:3/598: sync 2024-04-15T21:02:51.432 INFO:tasks.workunit.client.0.smithi072.stdout:1/616: sync 2024-04-15T21:02:51.432 INFO:tasks.workunit.client.0.smithi072.stdout:1/617: chown d5/fa3 15794 1 2024-04-15T21:02:51.433 INFO:tasks.workunit.client.0.smithi072.stdout:3/599: chown d1/d3f/laf 3898662 1 2024-04-15T21:02:51.433 INFO:tasks.workunit.client.1.smithi149.stdout:8/895: chown d2/d5b/dcd/d10a/d25/d37/lc5 3432 1 2024-04-15T21:02:51.433 INFO:tasks.workunit.client.0.smithi072.stdout:3/600: readlink d1/d15/d32/l89 0 2024-04-15T21:02:51.434 INFO:tasks.workunit.client.1.smithi149.stdout:8/896: chown d2/d5b/dcd/d10a/d25/d37/d53/l122 566 1 2024-04-15T21:02:51.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/897: write d2/f8d [3774340,88914] 0 2024-04-15T21:02:51.436 INFO:tasks.workunit.client.0.smithi072.stdout:6/600: rmdir d2/d40 39 2024-04-15T21:02:51.437 INFO:tasks.workunit.client.1.smithi149.stdout:8/898: chown d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/dc6/c11f 215 1 2024-04-15T21:02:51.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/948: mkdir d1/d5/d24/d50/d13/d38/d44/d61/d150 0 2024-04-15T21:02:51.441 INFO:tasks.workunit.client.0.smithi072.stdout:2/620: rmdir d2 39 2024-04-15T21:02:51.442 INFO:tasks.workunit.client.0.smithi072.stdout:6/601: dwrite d2/d10/d18/f94 [0,4194304] 0 2024-04-15T21:02:51.444 INFO:tasks.workunit.client.0.smithi072.stdout:5/626: write d0/d3/d7/d12/d31/f70 [908836,106805] 0 2024-04-15T21:02:51.445 INFO:tasks.workunit.client.0.smithi072.stdout:4/626: rename d7/d10/d41/d44/d7a/d86/d76/d8b/la3 to d7/d10/lcd 0 2024-04-15T21:02:51.448 INFO:tasks.workunit.client.0.smithi072.stdout:1/618: dread d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:51.450 INFO:tasks.workunit.client.1.smithi149.stdout:5/760: unlink d0/d6/d82/da1/d12/d16/da9/d1b/d60/ca3 0 2024-04-15T21:02:51.451 INFO:tasks.workunit.client.0.smithi072.stdout:9/631: fsync d4/f1c 0 2024-04-15T21:02:51.453 INFO:tasks.workunit.client.1.smithi149.stdout:4/856: creat dc/d18/d21/d10e/f11e x:0 0 0 2024-04-15T21:02:51.454 INFO:tasks.workunit.client.0.smithi072.stdout:1/619: dwrite d5/fa3 [0,4194304] 0 2024-04-15T21:02:51.456 INFO:tasks.workunit.client.0.smithi072.stdout:8/647: truncate d3/d4/f56 142449 0 2024-04-15T21:02:51.457 INFO:tasks.workunit.client.1.smithi149.stdout:8/899: rename d2/d5b/dcd/d10a/d25/d37/f3e to d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f13c 0 2024-04-15T21:02:51.458 INFO:tasks.workunit.client.1.smithi149.stdout:5/761: dwrite d0/f4f [0,4194304] 0 2024-04-15T21:02:51.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/829: mknod d4/c127 0 2024-04-15T21:02:51.466 INFO:tasks.workunit.client.1.smithi149.stdout:5/762: dread d0/d6/d2d/f4a [0,4194304] 0 2024-04-15T21:02:51.467 INFO:tasks.workunit.client.1.smithi149.stdout:5/763: stat d0/d9/d3f 0 2024-04-15T21:02:51.470 INFO:tasks.workunit.client.1.smithi149.stdout:0/949: mkdir d1/d9/d12f/d140/d151 0 2024-04-15T21:02:51.471 INFO:tasks.workunit.client.0.smithi072.stdout:6/602: dread d2/d42/f97 [0,4194304] 0 2024-04-15T21:02:51.472 INFO:tasks.workunit.client.0.smithi072.stdout:0/635: link d0/d45/d7a/d70/d59/d8a/d7b/f9a d0/d45/d7a/d70/d59/d8a/d7b/fde 0 2024-04-15T21:02:51.473 INFO:tasks.workunit.client.0.smithi072.stdout:0/636: truncate d0/d97/fbc 574572 0 2024-04-15T21:02:51.473 INFO:tasks.workunit.client.0.smithi072.stdout:0/637: chown d0/d19/f98 0 1 2024-04-15T21:02:51.474 INFO:tasks.workunit.client.0.smithi072.stdout:0/638: truncate d0/d6/fc7 552353 0 2024-04-15T21:02:51.474 INFO:tasks.workunit.client.1.smithi149.stdout:4/857: creat dc/d2c/d3e/d15/d3f/f11f x:0 0 0 2024-04-15T21:02:51.479 INFO:tasks.workunit.client.0.smithi072.stdout:3/601: rename d1/d15/d32/f77 to d1/d3f/da2/fb8 0 2024-04-15T21:02:51.481 INFO:tasks.workunit.client.1.smithi149.stdout:4/858: read dc/d2c/d3e/d15/d5b/f74 [2349527,85693] 0 2024-04-15T21:02:51.483 INFO:tasks.workunit.client.1.smithi149.stdout:6/768: truncate da/f1b 538621 0 2024-04-15T21:02:51.484 INFO:tasks.workunit.client.1.smithi149.stdout:6/769: truncate da/d60/d9b/fe5 239302 0 2024-04-15T21:02:51.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/859: truncate dc/d18/f1d 1035975 0 2024-04-15T21:02:51.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/648: mknod d3/de/d1b/d85/cc8 0 2024-04-15T21:02:51.493 INFO:tasks.workunit.client.1.smithi149.stdout:4/860: dread dc/d18/dce/fe2 [0,4194304] 0 2024-04-15T21:02:51.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/861: write dc/d1a/f9d [3826401,39719] 0 2024-04-15T21:02:51.500 INFO:tasks.workunit.client.1.smithi149.stdout:2/830: dwrite d4/d7/d46/de4/d21/d3b/f113 [0,4194304] 0 2024-04-15T21:02:51.503 INFO:tasks.workunit.client.1.smithi149.stdout:5/764: link d0/d9/d71/ldd d0/d9/d3f/lf1 0 2024-04-15T21:02:51.505 INFO:tasks.workunit.client.0.smithi072.stdout:5/627: mknod d0/d3/d7/d12/cd9 0 2024-04-15T21:02:51.505 INFO:tasks.workunit.client.0.smithi072.stdout:5/628: read - d0/d3/d7/d94/fa1 zero size 2024-04-15T21:02:51.508 INFO:tasks.workunit.client.1.smithi149.stdout:0/950: truncate d1/d9/d64/d73/f141 3181704 0 2024-04-15T21:02:51.509 INFO:tasks.workunit.client.1.smithi149.stdout:0/951: chown d1/d9/d64/d65/d104/d119/d43/de9 2 1 2024-04-15T21:02:51.510 INFO:tasks.workunit.client.1.smithi149.stdout:6/770: truncate da/d18/d10/d16/d97/f95 854200 0 2024-04-15T21:02:51.510 INFO:tasks.workunit.client.0.smithi072.stdout:0/639: write d0/d45/d35/f4f [395381,35598] 0 2024-04-15T21:02:51.511 INFO:tasks.workunit.client.0.smithi072.stdout:3/602: truncate d1/d3f/d4f/d73/f87 2744556 0 2024-04-15T21:02:51.516 INFO:tasks.workunit.client.0.smithi072.stdout:7/627: getdents d2/d7/d25/d2d/d47/d7e 0 2024-04-15T21:02:51.517 INFO:tasks.workunit.client.0.smithi072.stdout:3/603: dwrite d1/d15/d40/f9 [0,4194304] 0 2024-04-15T21:02:51.518 INFO:tasks.workunit.client.0.smithi072.stdout:3/604: dread - d1/d15/d32/fa8 zero size 2024-04-15T21:02:51.519 INFO:tasks.workunit.client.0.smithi072.stdout:8/649: creat d3/de/d1b/d3f/fc9 x:0 0 0 2024-04-15T21:02:51.519 INFO:tasks.workunit.client.0.smithi072.stdout:3/605: write d1/d15/d40/f9 [3810723,74435] 0 2024-04-15T21:02:51.526 INFO:tasks.workunit.client.0.smithi072.stdout:8/650: dwrite d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:51.526 INFO:tasks.workunit.client.1.smithi149.stdout:2/831: mknod d4/d7/d46/c128 0 2024-04-15T21:02:51.527 INFO:tasks.workunit.client.0.smithi072.stdout:8/651: dread - d3/de/d1b/d85/fad zero size 2024-04-15T21:02:51.528 INFO:tasks.workunit.client.0.smithi072.stdout:8/652: write d3/de/f99 [301648,108546] 0 2024-04-15T21:02:51.528 INFO:tasks.workunit.client.1.smithi149.stdout:5/765: rename d0/d6/d82/da1/d12/d2b/fef to d0/d6/d79/ff2 0 2024-04-15T21:02:51.530 INFO:tasks.workunit.client.1.smithi149.stdout:5/766: write d0/f4f [3357816,89397] 0 2024-04-15T21:02:51.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/771: mkdir da/d18/d10/d3f/ded/df8 0 2024-04-15T21:02:51.532 INFO:tasks.workunit.client.1.smithi149.stdout:5/767: write d0/d6/d82/da1/fe3 [75749,108644] 0 2024-04-15T21:02:51.533 INFO:tasks.workunit.client.0.smithi072.stdout:4/627: truncate d7/f38 5372598 0 2024-04-15T21:02:51.534 INFO:tasks.workunit.client.0.smithi072.stdout:4/628: readlink d7/d10/d41/d44/d7a/d86/l83 0 2024-04-15T21:02:51.535 INFO:tasks.workunit.client.0.smithi072.stdout:4/629: fsync d7/d10/d41/d44/f8e 0 2024-04-15T21:02:51.536 INFO:tasks.workunit.client.0.smithi072.stdout:9/632: fdatasync d4/d29/d45/f88 0 2024-04-15T21:02:51.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/862: dwrite dc/d1a/f2b [0,4194304] 0 2024-04-15T21:02:51.542 INFO:tasks.workunit.client.0.smithi072.stdout:6/603: write d2/d10/d11/d1f/d60/f61 [3163591,68173] 0 2024-04-15T21:02:51.542 INFO:tasks.workunit.client.1.smithi149.stdout:4/863: dread dc/d2c/d3e/d15/d3f/fc7 [0,4194304] 0 2024-04-15T21:02:51.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/772: fsync da/d18/f87 0 2024-04-15T21:02:51.552 INFO:tasks.workunit.client.0.smithi072.stdout:3/606: unlink d1/d15/f3b 0 2024-04-15T21:02:51.553 INFO:tasks.workunit.client.0.smithi072.stdout:0/640: dwrite d0/d45/d7a/f3c [0,4194304] 0 2024-04-15T21:02:51.558 INFO:tasks.workunit.client.1.smithi149.stdout:4/864: mkdir dc/d2c/d3e/d15/d3f/d117/d75/d120 0 2024-04-15T21:02:51.560 INFO:tasks.workunit.client.0.smithi072.stdout:8/653: mknod d3/de/d1b/d41/dae/dc0/cca 0 2024-04-15T21:02:51.562 INFO:tasks.workunit.client.0.smithi072.stdout:5/629: truncate d0/d3/d7/f3c 2997611 0 2024-04-15T21:02:51.563 INFO:tasks.workunit.client.1.smithi149.stdout:6/773: symlink da/d11/dcc/lf9 0 2024-04-15T21:02:51.565 INFO:tasks.workunit.client.1.smithi149.stdout:2/832: dread d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/f70 [0,4194304] 0 2024-04-15T21:02:51.567 INFO:tasks.workunit.client.0.smithi072.stdout:4/630: creat d7/d10/d41/d44/d7a/d86/d76/d8b/fce x:0 0 0 2024-04-15T21:02:51.569 INFO:tasks.workunit.client.1.smithi149.stdout:0/952: rename d1/d9/d64/d73/da3 to d1/d5/d24/d50/d152 0 2024-04-15T21:02:51.569 INFO:tasks.workunit.client.0.smithi072.stdout:9/633: dread - d4/d29/d4c/d91/fc2 zero size 2024-04-15T21:02:51.570 INFO:tasks.workunit.client.1.smithi149.stdout:4/865: fdatasync dc/d2c/f115 0 2024-04-15T21:02:51.572 INFO:tasks.workunit.client.0.smithi072.stdout:1/620: link d5/cf d5/db/daa/ccd 0 2024-04-15T21:02:51.572 INFO:tasks.workunit.client.0.smithi072.stdout:1/621: chown d5/db/d2d/d3a/d1f/d63/l73 10 1 2024-04-15T21:02:51.574 INFO:tasks.workunit.client.1.smithi149.stdout:2/833: symlink d4/d7/d46/de4/d21/d5e/dbe/l129 0 2024-04-15T21:02:51.578 INFO:tasks.workunit.client.1.smithi149.stdout:5/768: rename d0/d9/ce7 to d0/d9/d6c/db4/dd1/cf3 0 2024-04-15T21:02:51.581 INFO:tasks.workunit.client.0.smithi072.stdout:0/641: chown d0/d6/d55/ld6 16235 1 2024-04-15T21:02:51.582 INFO:tasks.workunit.client.0.smithi072.stdout:0/642: stat d0/d45/d7a/d70/d59/d8a/f65 0 2024-04-15T21:02:51.583 INFO:tasks.workunit.client.0.smithi072.stdout:0/643: write d0/d45/d7a/fb5 [331000,45251] 0 2024-04-15T21:02:51.583 INFO:tasks.workunit.client.0.smithi072.stdout:2/621: link d2/l35 d2/d3/d5f/dc8/lca 0 2024-04-15T21:02:51.585 INFO:tasks.workunit.client.1.smithi149.stdout:4/866: creat dc/d18/dce/dd7/f121 x:0 0 0 2024-04-15T21:02:51.585 INFO:tasks.workunit.client.1.smithi149.stdout:4/867: fdatasync dc/d2c/d3e/d15/f99 0 2024-04-15T21:02:51.586 INFO:tasks.workunit.client.1.smithi149.stdout:4/868: readlink dc/d8f/lae 0 2024-04-15T21:02:51.586 INFO:tasks.workunit.client.1.smithi149.stdout:6/774: truncate da/d2e/f64 21974 0 2024-04-15T21:02:51.587 INFO:tasks.workunit.client.0.smithi072.stdout:2/622: dread d2/d3/d5f/f7c [0,4194304] 0 2024-04-15T21:02:51.587 INFO:tasks.workunit.client.0.smithi072.stdout:2/623: stat d2/d8/d8e/fa7 0 2024-04-15T21:02:51.588 INFO:tasks.workunit.client.0.smithi072.stdout:7/628: write d2/d7/d25/d2d/d46/d5a/f88 [1443,65439] 0 2024-04-15T21:02:51.590 INFO:tasks.workunit.client.1.smithi149.stdout:2/834: unlink d4/c127 0 2024-04-15T21:02:51.594 INFO:tasks.workunit.client.1.smithi149.stdout:5/769: rename d0/d9/d3f/cbe to d0/d9/db6/cf4 0 2024-04-15T21:02:51.600 INFO:tasks.workunit.client.0.smithi072.stdout:5/630: dwrite d0/d3/d6/d14/f1b [0,4194304] 0 2024-04-15T21:02:51.602 INFO:tasks.workunit.client.0.smithi072.stdout:1/622: creat d5/db/d27/d5c/dbd/fce x:0 0 0 2024-04-15T21:02:51.607 INFO:tasks.workunit.client.1.smithi149.stdout:2/835: dread - d4/d7/d46/de4/db6/fe6 zero size 2024-04-15T21:02:51.611 INFO:tasks.workunit.client.0.smithi072.stdout:3/607: link d1/f6 d1/d15/d40/d9e/fb9 0 2024-04-15T21:02:51.617 INFO:tasks.workunit.client.0.smithi072.stdout:6/604: dwrite d2/d40/d56/d6a/f72 [0,4194304] 0 2024-04-15T21:02:51.617 INFO:tasks.workunit.client.0.smithi072.stdout:8/654: mknod d3/de/d1b/d41/d74/ccb 0 2024-04-15T21:02:51.618 INFO:tasks.workunit.client.0.smithi072.stdout:8/655: readlink d3/d4/d3b/lbe 0 2024-04-15T21:02:51.618 INFO:tasks.workunit.client.0.smithi072.stdout:2/624: symlink d2/d8/d8e/lcb 0 2024-04-15T21:02:51.619 INFO:tasks.workunit.client.0.smithi072.stdout:2/625: chown d2/d38/d73/d80/f92 132934664 1 2024-04-15T21:02:51.619 INFO:tasks.workunit.client.1.smithi149.stdout:2/836: symlink d4/d7/d46/de4/d21/d2c/d3e/d9d/l12a 0 2024-04-15T21:02:51.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/953: getdents d1/d5/dfb 0 2024-04-15T21:02:51.625 INFO:tasks.workunit.client.1.smithi149.stdout:4/869: truncate dc/d2c/d3e/d35/ffb 2473636 0 2024-04-15T21:02:51.626 INFO:tasks.workunit.client.0.smithi072.stdout:0/644: dwrite d0/d19/d71/f76 [0,4194304] 0 2024-04-15T21:02:51.627 INFO:tasks.workunit.client.0.smithi072.stdout:0/645: write d0/fb3 [671097,26067] 0 2024-04-15T21:02:51.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/837: write d4/d7/d46/de4/d21/d5e/dbe/fab [2957092,16549] 0 2024-04-15T21:02:51.628 INFO:tasks.workunit.client.0.smithi072.stdout:4/631: mkdir d7/d10/d41/dcf 0 2024-04-15T21:02:51.630 INFO:tasks.workunit.client.1.smithi149.stdout:0/954: mknod d1/d5/d24/d50/d15/c153 0 2024-04-15T21:02:51.634 INFO:tasks.workunit.client.1.smithi149.stdout:6/775: link da/d18/d10/d66/cca da/d32/cfa 0 2024-04-15T21:02:51.637 INFO:tasks.workunit.client.1.smithi149.stdout:4/870: dwrite dc/f41 [8388608,4194304] 0 2024-04-15T21:02:51.638 INFO:tasks.workunit.client.0.smithi072.stdout:6/605: dread - d2/d10/d18/d47/d6d/f87 zero size 2024-04-15T21:02:51.639 INFO:tasks.workunit.client.1.smithi149.stdout:4/871: fdatasync dc/d2c/d3e/d15/f4a 0 2024-04-15T21:02:51.640 INFO:tasks.workunit.client.1.smithi149.stdout:5/770: dread d0/d6/d82/da1/d12/d16/da9/d1b/f20 [4194304,4194304] 0 2024-04-15T21:02:51.641 INFO:tasks.workunit.client.0.smithi072.stdout:2/626: fdatasync d2/d8/f13 0 2024-04-15T21:02:51.642 INFO:tasks.workunit.client.1.smithi149.stdout:5/771: stat d0/d6/d82/da1/d12/d16/da9/d9b/ld7 0 2024-04-15T21:02:51.645 INFO:tasks.workunit.client.0.smithi072.stdout:0/646: dread d0/d6/d55/f8f [0,4194304] 0 2024-04-15T21:02:51.646 INFO:tasks.workunit.client.0.smithi072.stdout:4/632: creat d7/d10/d41/d4c/fd0 x:0 0 0 2024-04-15T21:02:51.647 INFO:tasks.workunit.client.0.smithi072.stdout:9/634: creat d4/d1f/fc3 x:0 0 0 2024-04-15T21:02:51.648 INFO:tasks.workunit.client.0.smithi072.stdout:8/656: dread d3/de/d1b/f43 [0,4194304] 0 2024-04-15T21:02:51.648 INFO:tasks.workunit.client.1.smithi149.stdout:4/872: mknod dc/d18/d21/dfa/c122 0 2024-04-15T21:02:51.652 INFO:tasks.workunit.client.0.smithi072.stdout:8/657: dread d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:51.652 INFO:tasks.workunit.client.1.smithi149.stdout:5/772: write d0/d6/d82/da1/f7f [5066818,73735] 0 2024-04-15T21:02:51.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/658: write d3/de/d1b/d85/fad [238993,2688] 0 2024-04-15T21:02:51.654 INFO:tasks.workunit.client.0.smithi072.stdout:1/623: write d5/f9 [3386994,64663] 0 2024-04-15T21:02:51.655 INFO:tasks.workunit.client.1.smithi149.stdout:2/838: creat d4/d7/d46/de4/d21/d2c/d32/f12b x:0 0 0 2024-04-15T21:02:51.658 INFO:tasks.workunit.client.0.smithi072.stdout:7/629: write d2/d7/d25/d2d/d46/d5a/d5f/f11 [709234,28313] 0 2024-04-15T21:02:51.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/873: fsync dc/d2c/d3e/d35/f5e 0 2024-04-15T21:02:51.660 INFO:tasks.workunit.client.0.smithi072.stdout:2/627: creat d2/da1/fcc x:0 0 0 2024-04-15T21:02:51.662 INFO:tasks.workunit.client.1.smithi149.stdout:5/773: creat d0/d9/d6c/ff5 x:0 0 0 2024-04-15T21:02:51.664 INFO:tasks.workunit.client.0.smithi072.stdout:2/628: chown d2/d8/d41/db8/lc7 37080590 1 2024-04-15T21:02:51.664 INFO:tasks.workunit.client.0.smithi072.stdout:4/633: mknod d7/d10/d41/d44/d7a/d86/cd1 0 2024-04-15T21:02:51.664 INFO:tasks.workunit.client.0.smithi072.stdout:3/608: dwrite d1/d15/d32/d78/fad [0,4194304] 0 2024-04-15T21:02:51.666 INFO:tasks.workunit.client.0.smithi072.stdout:7/630: write d2/d7/d25/d2d/d46/d5a/d5f/f82 [879302,129659] 0 2024-04-15T21:02:51.668 INFO:tasks.workunit.client.1.smithi149.stdout:0/955: rename d1/d5/d24/d50/d152/f107 to d1/d5/d24/d50/d13/d38/d44/d61/f154 0 2024-04-15T21:02:51.668 INFO:tasks.workunit.client.0.smithi072.stdout:8/659: dwrite d3/d4/f1e [0,4194304] 0 2024-04-15T21:02:51.669 INFO:tasks.workunit.client.1.smithi149.stdout:0/956: readlink d1/d9/d64/d65/d104/d119/lf3 0 2024-04-15T21:02:51.672 INFO:tasks.workunit.client.0.smithi072.stdout:5/631: creat d0/d3/d7/d12/fda x:0 0 0 2024-04-15T21:02:51.672 INFO:tasks.workunit.client.1.smithi149.stdout:6/776: getdents da/d18/d10 0 2024-04-15T21:02:51.676 INFO:tasks.workunit.client.1.smithi149.stdout:2/839: fsync d4/d7/d46/de4/d21/d5e/fc9 0 2024-04-15T21:02:51.678 INFO:tasks.workunit.client.0.smithi072.stdout:6/606: truncate d2/d10/f3c 1583925 0 2024-04-15T21:02:51.680 INFO:tasks.workunit.client.1.smithi149.stdout:0/957: dread - d1/d5/d24/d50/d13/f108 zero size 2024-04-15T21:02:51.684 INFO:tasks.workunit.client.1.smithi149.stdout:5/774: fsync d0/d6/d79/ff2 0 2024-04-15T21:02:51.684 INFO:tasks.workunit.client.0.smithi072.stdout:6/607: dwrite d2/d10/f58 [0,4194304] 0 2024-04-15T21:02:51.688 INFO:tasks.workunit.client.1.smithi149.stdout:2/840: dwrite d4/f18 [4194304,4194304] 0 2024-04-15T21:02:51.690 INFO:tasks.workunit.client.1.smithi149.stdout:2/841: truncate d4/d7/d93/dc3/f105 913530 0 2024-04-15T21:02:51.691 INFO:tasks.workunit.client.1.smithi149.stdout:6/777: fsync da/d32/fdd 0 2024-04-15T21:02:51.697 INFO:tasks.workunit.client.0.smithi072.stdout:3/609: creat d1/d15/d40/d9e/fba x:0 0 0 2024-04-15T21:02:51.697 INFO:tasks.workunit.client.1.smithi149.stdout:6/778: read da/f75 [2670480,46869] 0 2024-04-15T21:02:51.699 INFO:tasks.workunit.client.1.smithi149.stdout:2/842: mknod d4/d7/da/c12c 0 2024-04-15T21:02:51.702 INFO:tasks.workunit.client.0.smithi072.stdout:9/635: symlink d4/d1f/d31/d4d/dbf/lc4 0 2024-04-15T21:02:51.703 INFO:tasks.workunit.client.0.smithi072.stdout:8/660: chown d3/de/d1b/d41/da4/d2e/c79 3 1 2024-04-15T21:02:51.704 INFO:tasks.workunit.client.1.smithi149.stdout:5/775: mknod d0/d6/d82/da1/d12/d16/da9/cf6 0 2024-04-15T21:02:51.704 INFO:tasks.workunit.client.1.smithi149.stdout:6/779: dwrite da/d18/f86 [4194304,4194304] 0 2024-04-15T21:02:51.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/632: mknod d0/d3/d7/d12/d1d/d8c/cdb 0 2024-04-15T21:02:51.706 INFO:tasks.workunit.client.1.smithi149.stdout:2/843: mknod d4/d7/d10/c12d 0 2024-04-15T21:02:51.712 INFO:tasks.workunit.client.0.smithi072.stdout:0/647: rename d0/d45/f62 to d0/d6/fdf 0 2024-04-15T21:02:51.714 INFO:tasks.workunit.client.0.smithi072.stdout:2/629: mknod d2/d8/daa/ccd 0 2024-04-15T21:02:51.715 INFO:tasks.workunit.client.1.smithi149.stdout:2/844: mknod d4/d7/d29/c12e 0 2024-04-15T21:02:51.716 INFO:tasks.workunit.client.0.smithi072.stdout:6/608: mknod d2/d40/d66/d7f/cb7 0 2024-04-15T21:02:51.719 INFO:tasks.workunit.client.1.smithi149.stdout:6/780: mkdir da/d2e/dc3/dfb 0 2024-04-15T21:02:51.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/631: mknod d2/cc6 0 2024-04-15T21:02:51.723 INFO:tasks.workunit.client.0.smithi072.stdout:3/610: mknod d1/d3f/da2/cbb 0 2024-04-15T21:02:51.724 INFO:tasks.workunit.client.0.smithi072.stdout:5/633: truncate d0/d3/d33/d85/f89 219662 0 2024-04-15T21:02:51.726 INFO:tasks.workunit.client.1.smithi149.stdout:6/781: unlink da/d60/d9b/fba 0 2024-04-15T21:02:51.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/636: rename d4/d1f/l26 to d4/d1f/d31/d42/lc5 0 2024-04-15T21:02:51.731 INFO:tasks.workunit.client.0.smithi072.stdout:9/637: stat d4/d29 0 2024-04-15T21:02:51.731 INFO:tasks.workunit.client.1.smithi149.stdout:6/782: creat da/d11/ffc x:0 0 0 2024-04-15T21:02:51.732 INFO:tasks.workunit.client.0.smithi072.stdout:1/624: dwrite d5/f32 [0,4194304] 0 2024-04-15T21:02:51.734 INFO:tasks.workunit.client.0.smithi072.stdout:2/630: mkdir d2/d64/dce 0 2024-04-15T21:02:51.736 INFO:tasks.workunit.client.0.smithi072.stdout:2/631: dread d2/d3/fb2 [0,4194304] 0 2024-04-15T21:02:51.738 INFO:tasks.workunit.client.0.smithi072.stdout:6/609: unlink d2/d10/d11/d1f/d60/f64 0 2024-04-15T21:02:51.738 INFO:tasks.workunit.client.0.smithi072.stdout:6/610: stat d2/l3e 0 2024-04-15T21:02:51.739 INFO:tasks.workunit.client.0.smithi072.stdout:6/611: chown d2/d40/d56/f77 6418 1 2024-04-15T21:02:51.743 INFO:tasks.workunit.client.1.smithi149.stdout:6/783: dwrite da/d18/d10/d16/f3c [4194304,4194304] 0 2024-04-15T21:02:51.746 INFO:tasks.workunit.client.1.smithi149.stdout:5/776: dwrite d0/d6/d82/da1/d12/d16/da9/fac [0,4194304] 0 2024-04-15T21:02:51.747 INFO:tasks.workunit.client.1.smithi149.stdout:6/784: dread - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:51.749 INFO:tasks.workunit.client.1.smithi149.stdout:2/845: write d4/d7/d46/de4/d21/d2c/d32/d4a/fb2 [3347030,85068] 0 2024-04-15T21:02:51.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/777: read d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [796912,13421] 0 2024-04-15T21:02:51.759 INFO:tasks.workunit.client.1.smithi149.stdout:6/785: dread da/d18/d10/d16/d97/dbf/d55/d82/fbc [0,4194304] 0 2024-04-15T21:02:51.764 INFO:tasks.workunit.client.1.smithi149.stdout:2/846: symlink d4/d7/d46/de4/d21/d2c/d58/l12f 0 2024-04-15T21:02:51.767 INFO:tasks.workunit.client.1.smithi149.stdout:6/786: dwrite da/d18/d10/d16/d97/fbb [0,4194304] 0 2024-04-15T21:02:51.775 INFO:tasks.workunit.client.0.smithi072.stdout:6/612: dwrite d2/d40/d56/d6a/f72 [0,4194304] 0 2024-04-15T21:02:51.775 INFO:tasks.workunit.client.0.smithi072.stdout:3/611: fdatasync d1/d15/d32/d2f/d1a/f8d 0 2024-04-15T21:02:51.777 INFO:tasks.workunit.client.0.smithi072.stdout:0/648: mkdir d0/d19/d2b/d63/ddb/de0 0 2024-04-15T21:02:51.777 INFO:tasks.workunit.client.0.smithi072.stdout:3/612: chown d1/d26/f59 60159985 1 2024-04-15T21:02:51.779 INFO:tasks.workunit.client.0.smithi072.stdout:0/649: chown d0/d45/d35 0 1 2024-04-15T21:02:51.779 INFO:tasks.workunit.client.0.smithi072.stdout:4/634: getdents d7/d10/d41/d44 0 2024-04-15T21:02:51.779 INFO:tasks.workunit.client.0.smithi072.stdout:5/634: dread d0/d3/d7/d12/d31/d49/f87 [4194304,4194304] 0 2024-04-15T21:02:51.779 INFO:tasks.workunit.client.0.smithi072.stdout:2/632: read d2/d66/f74 [131656,100828] 0 2024-04-15T21:02:51.798 INFO:tasks.workunit.client.1.smithi149.stdout:5/778: fsync d0/d6/d82/da1/fb2 0 2024-04-15T21:02:51.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/779: fdatasync d0/f3 0 2024-04-15T21:02:51.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/780: write d0/d6/d82/da1/fe3 [508600,72288] 0 2024-04-15T21:02:51.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/847: unlink d4/d7/d46/de4/d21/d5e/dbe/da7/l67 0 2024-04-15T21:02:51.803 INFO:tasks.workunit.client.1.smithi149.stdout:6/787: creat da/d18/d7d/ffd x:0 0 0 2024-04-15T21:02:51.809 INFO:tasks.workunit.client.1.smithi149.stdout:5/781: creat d0/d6/d82/da1/d12/ff7 x:0 0 0 2024-04-15T21:02:51.810 INFO:tasks.workunit.client.1.smithi149.stdout:5/782: chown d0/d9 924 1 2024-04-15T21:02:51.811 INFO:tasks.workunit.client.1.smithi149.stdout:6/788: mknod da/d18/d10/d3f/cfe 0 2024-04-15T21:02:51.812 INFO:tasks.workunit.client.1.smithi149.stdout:5/783: symlink d0/d6/d2d/lf8 0 2024-04-15T21:02:51.815 INFO:tasks.workunit.client.1.smithi149.stdout:2/848: dread d4/d7/d46/de4/d21/d5e/fc9 [0,4194304] 0 2024-04-15T21:02:51.816 INFO:tasks.workunit.client.1.smithi149.stdout:2/849: readlink d4/d7/d46/de4/d21/d6d/l10d 0 2024-04-15T21:02:51.820 INFO:tasks.workunit.client.1.smithi149.stdout:2/850: unlink d4/d7/d93/dc3/c10e 0 2024-04-15T21:02:51.820 INFO:tasks.workunit.client.1.smithi149.stdout:2/851: readlink d4/l97 0 2024-04-15T21:02:51.822 INFO:tasks.workunit.client.1.smithi149.stdout:2/852: creat d4/d7/d29/f130 x:0 0 0 2024-04-15T21:02:51.823 INFO:tasks.workunit.client.1.smithi149.stdout:2/853: chown d4/d7/d46/de4/d21/d2c/d3e/d9d 343 1 2024-04-15T21:02:51.826 INFO:tasks.workunit.client.1.smithi149.stdout:2/854: dread d4/d7/d10/fc1 [0,4194304] 0 2024-04-15T21:02:51.828 INFO:tasks.workunit.client.1.smithi149.stdout:2/855: symlink d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/l131 0 2024-04-15T21:02:51.830 INFO:tasks.workunit.client.1.smithi149.stdout:6/789: write da/d11/f7b [587595,55054] 0 2024-04-15T21:02:51.832 INFO:tasks.workunit.client.1.smithi149.stdout:2/856: rename d4/d7/d93/f10f to d4/d7/f132 0 2024-04-15T21:02:51.833 INFO:tasks.workunit.client.1.smithi149.stdout:6/790: creat da/d18/d10/d16/d97/dbf/d55/da0/fff x:0 0 0 2024-04-15T21:02:51.835 INFO:tasks.workunit.client.1.smithi149.stdout:2/857: mknod d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d11f/c133 0 2024-04-15T21:02:51.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/858: unlink d4/d7/d46/de4/d21/d2c/ca4 0 2024-04-15T21:02:51.840 INFO:tasks.workunit.client.1.smithi149.stdout:2/859: mknod d4/d7/d46/de4/d21/d2c/d32/d4a/c134 0 2024-04-15T21:02:51.844 INFO:tasks.workunit.client.1.smithi149.stdout:2/860: rename d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/fe7 to d4/f135 0 2024-04-15T21:02:51.846 INFO:tasks.workunit.client.1.smithi149.stdout:2/861: read d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/f8f [2474309,73353] 0 2024-04-15T21:02:51.847 INFO:tasks.workunit.client.1.smithi149.stdout:2/862: creat d4/d7/d93/f136 x:0 0 0 2024-04-15T21:02:51.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/863: dread - d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/ff2 zero size 2024-04-15T21:02:51.850 INFO:tasks.workunit.client.1.smithi149.stdout:6/791: dread da/d18/d33/f6f [0,4194304] 0 2024-04-15T21:02:51.852 INFO:tasks.workunit.client.1.smithi149.stdout:2/864: dread d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/fdc [0,4194304] 0 2024-04-15T21:02:51.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/792: symlink da/d18/d10/d16/d97/dbf/d55/da0/db4/l100 0 2024-04-15T21:02:51.853 INFO:tasks.workunit.client.1.smithi149.stdout:2/865: mkdir d4/d7/d93/dc3/d137 0 2024-04-15T21:02:51.858 INFO:tasks.workunit.client.1.smithi149.stdout:2/866: mkdir d4/d7/d46/de4/d21/d2c/d32/d4a/dee/d138 0 2024-04-15T21:02:51.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/793: write da/d18/d10/d16/f9a [685647,2331] 0 2024-04-15T21:02:51.862 INFO:tasks.workunit.client.1.smithi149.stdout:2/867: write d4/d7/d46/de4/d21/d3b/f104 [250504,96483] 0 2024-04-15T21:02:51.864 INFO:tasks.workunit.client.1.smithi149.stdout:2/868: mkdir d4/d7/d10/d36/d139 0 2024-04-15T21:02:51.865 INFO:tasks.workunit.client.1.smithi149.stdout:6/794: symlink da/d18/d10/d16/d97/dbf/d55/l101 0 2024-04-15T21:02:51.866 INFO:tasks.workunit.client.1.smithi149.stdout:2/869: creat d4/df6/f13a x:0 0 0 2024-04-15T21:02:51.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/795: write da/d18/d10/f42 [1165813,38048] 0 2024-04-15T21:02:51.867 INFO:tasks.workunit.client.1.smithi149.stdout:2/870: mkdir d4/d7/d93/d13b 0 2024-04-15T21:02:51.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/796: read - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:51.874 INFO:tasks.workunit.client.1.smithi149.stdout:2/871: write d4/d7/d46/de4/d21/d3b/f43 [12112714,57779] 0 2024-04-15T21:02:51.875 INFO:tasks.workunit.client.1.smithi149.stdout:6/797: dwrite da/d18/d10/d16/d97/dbf/d55/da0/ff6 [0,4194304] 0 2024-04-15T21:02:51.878 INFO:tasks.workunit.client.1.smithi149.stdout:2/872: symlink d4/d7/d46/de4/d21/d3b/d10a/l13c 0 2024-04-15T21:02:51.880 INFO:tasks.workunit.client.1.smithi149.stdout:2/873: read - d4/d7/d46/de4/d21/d55/f76 zero size 2024-04-15T21:02:51.881 INFO:tasks.workunit.client.1.smithi149.stdout:2/874: stat d4/d7/d29/fe3 0 2024-04-15T21:02:51.886 INFO:tasks.workunit.client.1.smithi149.stdout:2/875: link d4/d7/d46/de4/d21/d6d/l10d d4/d7/d46/de4/d21/d2c/d32/l13d 0 2024-04-15T21:02:51.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/876: mkdir d4/d7/d46/de4/d21/d55/dfe/d106/d13e 0 2024-04-15T21:02:51.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/877: fdatasync d4/d7/d46/de4/d21/d55/dfe/d106/f108 0 2024-04-15T21:02:51.893 INFO:tasks.workunit.client.1.smithi149.stdout:2/878: getdents d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d11f 0 2024-04-15T21:02:51.895 INFO:tasks.workunit.client.1.smithi149.stdout:2/879: unlink d4/d7/d46/de4/d21/d55/d94/faf 0 2024-04-15T21:02:51.896 INFO:tasks.workunit.client.1.smithi149.stdout:6/798: fdatasync da/d18/d10/d16/d97/dbf/d55/da0/ff6 0 2024-04-15T21:02:51.898 INFO:tasks.workunit.client.1.smithi149.stdout:6/799: creat da/d11/d90/f102 x:0 0 0 2024-04-15T21:02:51.901 INFO:tasks.workunit.client.1.smithi149.stdout:2/880: getdents d4/d7/d46/de4/d21/d55/dfe/d106 0 2024-04-15T21:02:51.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/800: rename da/d18/d10/d16/d97/dbf/fcb to da/d18/d10/f103 0 2024-04-15T21:02:51.904 INFO:tasks.workunit.client.1.smithi149.stdout:2/881: fdatasync d4/d7/d46/de4/d21/d2c/d58/f96 0 2024-04-15T21:02:51.906 INFO:tasks.workunit.client.1.smithi149.stdout:2/882: fsync d4/d7/d46/de4/d21/d5e/fc9 0 2024-04-15T21:02:51.908 INFO:tasks.workunit.client.1.smithi149.stdout:2/883: readlink d4/d7/d46/de4/d21/d2c/d3e/d9d/la9 0 2024-04-15T21:02:51.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/884: truncate d4/d7/d10/d36/f47 947390 0 2024-04-15T21:02:51.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/801: dwrite da/d18/d10/d3f/fd9 [0,4194304] 0 2024-04-15T21:02:51.920 INFO:tasks.workunit.client.1.smithi149.stdout:6/802: mkdir da/d11/d104 0 2024-04-15T21:02:51.923 INFO:tasks.workunit.client.1.smithi149.stdout:2/885: mknod d4/d7/d29/dff/c13f 0 2024-04-15T21:02:51.924 INFO:tasks.workunit.client.1.smithi149.stdout:6/803: symlink da/d2e/de7/l105 0 2024-04-15T21:02:51.925 INFO:tasks.workunit.client.1.smithi149.stdout:2/886: creat d4/df6/f140 x:0 0 0 2024-04-15T21:02:51.925 INFO:tasks.workunit.client.1.smithi149.stdout:6/804: fdatasync da/d18/d33/f7e 0 2024-04-15T21:02:51.927 INFO:tasks.workunit.client.1.smithi149.stdout:6/805: readlink da/d32/ld1 0 2024-04-15T21:02:51.928 INFO:tasks.workunit.client.1.smithi149.stdout:6/806: readlink da/d18/d10/d66/l5a 0 2024-04-15T21:02:51.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/887: read d4/d7/da/fa2 [210813,111408] 0 2024-04-15T21:02:51.929 INFO:tasks.workunit.client.1.smithi149.stdout:6/807: chown da/d18/d10/d3f/l96 202874772 1 2024-04-15T21:02:51.930 INFO:tasks.workunit.client.1.smithi149.stdout:2/888: creat d4/d7/d46/de4/d21/d55/f141 x:0 0 0 2024-04-15T21:02:51.933 INFO:tasks.workunit.client.1.smithi149.stdout:6/808: dread da/d18/d10/d16/d97/dbf/d55/d82/fbc [0,4194304] 0 2024-04-15T21:02:51.939 INFO:tasks.workunit.client.1.smithi149.stdout:6/809: dwrite da/d11/f35 [0,4194304] 0 2024-04-15T21:02:51.941 INFO:tasks.workunit.client.1.smithi149.stdout:2/889: dwrite d4/d7/d46/fe2 [0,4194304] 0 2024-04-15T21:02:51.942 INFO:tasks.workunit.client.1.smithi149.stdout:6/810: mkdir da/d11/dbe/dc1/d106 0 2024-04-15T21:02:51.948 INFO:tasks.workunit.client.1.smithi149.stdout:2/890: rename d4/d7/d46/de4/d21/d2c/d32/d4a/f79 to d4/d7/d46/de4/d21/d2c/d32/d4a/f142 0 2024-04-15T21:02:51.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/839: sync 2024-04-15T21:02:51.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/900: sync 2024-04-15T21:02:51.963 INFO:tasks.workunit.client.1.smithi149.stdout:7/801: sync 2024-04-15T21:02:51.963 INFO:tasks.workunit.client.1.smithi149.stdout:1/750: sync 2024-04-15T21:02:51.963 INFO:tasks.workunit.client.1.smithi149.stdout:9/743: sync 2024-04-15T21:02:51.964 INFO:tasks.workunit.client.1.smithi149.stdout:3/840: readlink d1/db/l35 0 2024-04-15T21:02:51.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/751: rename d1/db/d16/d35/c3b to d1/db/d16/d35/cd7 0 2024-04-15T21:02:51.969 INFO:tasks.workunit.client.1.smithi149.stdout:8/901: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f13d x:0 0 0 2024-04-15T21:02:51.970 INFO:tasks.workunit.client.1.smithi149.stdout:7/802: fdatasync d3/d16/f86 0 2024-04-15T21:02:51.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/811: dread da/d18/d10/d16/d97/dbf/d55/da0/db4/fc0 [0,4194304] 0 2024-04-15T21:02:51.973 INFO:tasks.workunit.client.1.smithi149.stdout:8/902: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/c13e 0 2024-04-15T21:02:51.975 INFO:tasks.workunit.client.1.smithi149.stdout:7/803: creat d3/f124 x:0 0 0 2024-04-15T21:02:51.976 INFO:tasks.workunit.client.1.smithi149.stdout:1/752: creat d1/d17/d52/fd8 x:0 0 0 2024-04-15T21:02:51.978 INFO:tasks.workunit.client.1.smithi149.stdout:6/812: rmdir da/d18/d10/d16/d97/dbf/d55/d82 39 2024-04-15T21:02:51.984 INFO:tasks.workunit.client.1.smithi149.stdout:8/903: dwrite d2/d5b/dcd/d10a/f90 [4194304,4194304] 0 2024-04-15T21:02:51.985 INFO:tasks.workunit.client.1.smithi149.stdout:6/813: rmdir da/d60 39 2024-04-15T21:02:51.989 INFO:tasks.workunit.client.0.smithi072.stdout:8/661: rename d3/de/d1b/d41/d74/f9c to d3/fcc 0 2024-04-15T21:02:51.989 INFO:tasks.workunit.client.0.smithi072.stdout:9/638: mknod d4/d1f/d31/cc6 0 2024-04-15T21:02:51.990 INFO:tasks.workunit.client.0.smithi072.stdout:2/633: dread - d2/d3/f63 zero size 2024-04-15T21:02:51.991 INFO:tasks.workunit.client.0.smithi072.stdout:5/635: chown d0/d3/d33/d60/lce 252 1 2024-04-15T21:02:51.994 INFO:tasks.workunit.client.0.smithi072.stdout:7/632: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3d [0,4194304] 0 2024-04-15T21:02:51.997 INFO:tasks.workunit.client.1.smithi149.stdout:9/744: dwrite d23/d2b/fa0 [0,4194304] 0 2024-04-15T21:02:51.997 INFO:tasks.workunit.client.1.smithi149.stdout:7/804: dwrite d3/d16/d32/d90/fb0 [0,4194304] 0 2024-04-15T21:02:51.998 INFO:tasks.workunit.client.0.smithi072.stdout:2/634: dwrite d2/f5a [0,4194304] 0 2024-04-15T21:02:52.001 INFO:tasks.workunit.client.1.smithi149.stdout:3/841: dwrite d1/db/d24/d2b/f1b [0,4194304] 0 2024-04-15T21:02:52.005 INFO:tasks.workunit.client.0.smithi072.stdout:8/662: dread d3/de/d1b/d41/da4/f9a [4194304,4194304] 0 2024-04-15T21:02:52.020 INFO:tasks.workunit.client.1.smithi149.stdout:7/805: truncate d3/d17/fc6 968805 0 2024-04-15T21:02:52.024 INFO:tasks.workunit.client.1.smithi149.stdout:8/904: dread d2/d5b/dcd/d10a/d25/d57/dd1/d46/fbc [0,4194304] 0 2024-04-15T21:02:52.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/745: write d23/d3c/d52/f58 [464858,122831] 0 2024-04-15T21:02:52.035 INFO:tasks.workunit.client.1.smithi149.stdout:8/905: unlink d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f8a 0 2024-04-15T21:02:52.036 INFO:tasks.workunit.client.1.smithi149.stdout:3/842: link d1/db/d24/d39/f47 d1/db/d28/d87/dbd/f10b 0 2024-04-15T21:02:52.038 INFO:tasks.workunit.client.1.smithi149.stdout:9/746: creat d23/d2b/d37/d50/db3/ffc x:0 0 0 2024-04-15T21:02:52.039 INFO:tasks.workunit.client.1.smithi149.stdout:9/747: chown d23/d3c/c3f 28330 1 2024-04-15T21:02:52.040 INFO:tasks.workunit.client.1.smithi149.stdout:9/748: dread - d23/d2b/d37/d50/db3/ffc zero size 2024-04-15T21:02:52.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/906: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f13f x:0 0 0 2024-04-15T21:02:52.043 INFO:tasks.workunit.client.1.smithi149.stdout:7/806: creat d3/d17/f125 x:0 0 0 2024-04-15T21:02:52.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/907: fdatasync d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/f9e 0 2024-04-15T21:02:52.052 INFO:tasks.workunit.client.1.smithi149.stdout:7/807: creat d3/d112/f126 x:0 0 0 2024-04-15T21:02:52.053 INFO:tasks.workunit.client.0.smithi072.stdout:6/613: dread d2/d42/f5d [0,4194304] 0 2024-04-15T21:02:52.053 INFO:tasks.workunit.client.1.smithi149.stdout:7/808: readlink d3/d16/d20/l82 0 2024-04-15T21:02:52.053 INFO:tasks.workunit.client.1.smithi149.stdout:9/749: link d23/d2b/d44/d7e/f9b d23/d3c/db5/ffd 0 2024-04-15T21:02:52.055 INFO:tasks.workunit.client.1.smithi149.stdout:7/809: chown d3/d16/d20/d114/fa2 131 1 2024-04-15T21:02:52.055 INFO:tasks.workunit.client.1.smithi149.stdout:9/750: chown d23/d3c/d52/df8/fd8 14339271 1 2024-04-15T21:02:52.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/843: getdents d1/db/d23 0 2024-04-15T21:02:52.056 INFO:tasks.workunit.client.1.smithi149.stdout:7/810: chown d3/d16/d20/d9c/f55 711 1 2024-04-15T21:02:52.058 INFO:tasks.workunit.client.0.smithi072.stdout:0/650: creat d0/d45/d7a/fe1 x:0 0 0 2024-04-15T21:02:52.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/814: truncate da/d18/d33/f6f 933190 0 2024-04-15T21:02:52.062 INFO:tasks.workunit.client.1.smithi149.stdout:8/908: creat d2/d5b/dcd/d10a/f140 x:0 0 0 2024-04-15T21:02:52.063 INFO:tasks.workunit.client.1.smithi149.stdout:9/751: dwrite d23/d2b/d37/d6d/f74 [0,4194304] 0 2024-04-15T21:02:52.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/844: fdatasync d1/db/d28/d87/dbd/f6d 0 2024-04-15T21:02:52.073 INFO:tasks.workunit.client.0.smithi072.stdout:5/636: readlink d0/d3/d7/d12/d31/d62/db6/lca 0 2024-04-15T21:02:52.074 INFO:tasks.workunit.client.0.smithi072.stdout:5/637: read - d0/d3/d7/d12/d31/d55/f39 zero size 2024-04-15T21:02:52.074 INFO:tasks.workunit.client.1.smithi149.stdout:9/752: mknod d23/d2b/d37/cfe 0 2024-04-15T21:02:52.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:51 smithi072 ceph-mon[29079]: pgmap v10: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 201 MiB/s wr, 397 op/s 2024-04-15T21:02:52.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:51 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:52.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/638: chown d0/d3/d7/d1f/l27 100993680 1 2024-04-15T21:02:52.076 INFO:tasks.workunit.client.0.smithi072.stdout:5/639: dread d0/f7c [0,4194304] 0 2024-04-15T21:02:52.077 INFO:tasks.workunit.client.0.smithi072.stdout:5/640: chown d0/d3/d7/d12/d31/d49 0 1 2024-04-15T21:02:52.080 INFO:tasks.workunit.client.1.smithi149.stdout:3/845: creat d1/db/d24/d4d/d63/db6/f10c x:0 0 0 2024-04-15T21:02:52.081 INFO:tasks.workunit.client.1.smithi149.stdout:3/846: write d1/db/d28/de7/f101 [943337,104570] 0 2024-04-15T21:02:52.081 INFO:tasks.workunit.client.1.smithi149.stdout:3/847: stat d1/db/d102 0 2024-04-15T21:02:52.082 INFO:tasks.workunit.client.1.smithi149.stdout:3/848: fsync d1/db/d28/f51 0 2024-04-15T21:02:52.082 INFO:tasks.workunit.client.0.smithi072.stdout:6/614: unlink d2/d42/f5d 0 2024-04-15T21:02:52.083 INFO:tasks.workunit.client.1.smithi149.stdout:7/811: creat d3/d16/d20/d36/d3d/d11c/f127 x:0 0 0 2024-04-15T21:02:52.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/651: creat d0/d19/d2b/d63/fe2 x:0 0 0 2024-04-15T21:02:52.090 INFO:tasks.workunit.client.0.smithi072.stdout:0/652: dwrite d0/d6/d6d/fc1 [0,4194304] 0 2024-04-15T21:02:52.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/633: creat d2/d7/d25/d81/dbe/fc7 x:0 0 0 2024-04-15T21:02:52.094 INFO:tasks.workunit.client.0.smithi072.stdout:2/635: symlink d2/d66/d69/lcf 0 2024-04-15T21:02:52.095 INFO:tasks.workunit.client.0.smithi072.stdout:2/636: fdatasync d2/d8/d8e/d90/f9f 0 2024-04-15T21:02:52.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/812: write d3/d17/d1f/f22 [3547052,418] 0 2024-04-15T21:02:52.096 INFO:tasks.workunit.client.0.smithi072.stdout:5/641: fdatasync d0/d3/d33/d60/d81/f2a 0 2024-04-15T21:02:52.096 INFO:tasks.workunit.client.0.smithi072.stdout:3/613: sync 2024-04-15T21:02:52.096 INFO:tasks.workunit.client.0.smithi072.stdout:1/625: sync 2024-04-15T21:02:52.098 INFO:tasks.workunit.client.0.smithi072.stdout:1/626: chown d5/d31/d51/f74 7101157 1 2024-04-15T21:02:52.098 INFO:tasks.workunit.client.0.smithi072.stdout:5/642: write d0/d3/d7/d94/d86/fb9 [1031237,104343] 0 2024-04-15T21:02:52.099 INFO:tasks.workunit.client.0.smithi072.stdout:1/627: write d5/db/d2d/d3a/f88 [617401,51774] 0 2024-04-15T21:02:52.099 INFO:tasks.workunit.client.0.smithi072.stdout:5/643: stat d0/d3/d7/d94/d92/da0/da7/fbd 0 2024-04-15T21:02:52.105 INFO:tasks.workunit.client.1.smithi149.stdout:3/849: truncate d1/db/d24/d39/f47 587799 0 2024-04-15T21:02:52.106 INFO:tasks.workunit.client.1.smithi149.stdout:3/850: chown d1/db/d24/d4d/d63/d65/f9c 1223721 1 2024-04-15T21:02:52.107 INFO:tasks.workunit.client.0.smithi072.stdout:9/639: link d4/c6 d4/d29/d4c/d74/d84/cc7 0 2024-04-15T21:02:52.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/851: write d1/db/d24/d8a/f8c [4365846,116704] 0 2024-04-15T21:02:52.109 INFO:tasks.workunit.client.1.smithi149.stdout:7/813: creat d3/d17/d1f/d93/f128 x:0 0 0 2024-04-15T21:02:52.109 INFO:tasks.workunit.client.1.smithi149.stdout:8/909: write d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/fb6 [328217,35161] 0 2024-04-15T21:02:52.110 INFO:tasks.workunit.client.0.smithi072.stdout:0/653: creat d0/d45/d7a/d70/d59/d8a/d7b/daa/fe3 x:0 0 0 2024-04-15T21:02:52.113 INFO:tasks.workunit.client.0.smithi072.stdout:7/634: creat d2/d7/d25/d2d/d46/fc8 x:0 0 0 2024-04-15T21:02:52.116 INFO:tasks.workunit.client.1.smithi149.stdout:9/753: rename d23/d3c/d87/d9a/cc1 to d23/d3c/d7a/da5/dbd/cff 0 2024-04-15T21:02:52.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/814: dwrite d3/d16/d20/d60/fb2 [0,4194304] 0 2024-04-15T21:02:52.117 INFO:tasks.workunit.client.1.smithi149.stdout:4/874: sync 2024-04-15T21:02:52.117 INFO:tasks.workunit.client.1.smithi149.stdout:9/754: chown d23/d2b/d37/l9f 16017966 1 2024-04-15T21:02:52.118 INFO:tasks.workunit.client.1.smithi149.stdout:7/815: dread - d3/d17/d1f/d93/f128 zero size 2024-04-15T21:02:52.119 INFO:tasks.workunit.client.1.smithi149.stdout:4/875: write dc/d18/d21/d10e/f11e [811952,28177] 0 2024-04-15T21:02:52.119 INFO:tasks.workunit.client.1.smithi149.stdout:6/815: write da/d11/f1a [1554603,116508] 0 2024-04-15T21:02:52.122 INFO:tasks.workunit.client.0.smithi072.stdout:2/637: rename d2/d8/da2/cc9 to d2/d8/d8e/cd0 0 2024-04-15T21:02:52.122 INFO:tasks.workunit.client.0.smithi072.stdout:4/635: truncate d7/d23/f2a 2283666 0 2024-04-15T21:02:52.122 INFO:tasks.workunit.client.0.smithi072.stdout:2/638: chown d2/c53 0 1 2024-04-15T21:02:52.123 INFO:tasks.workunit.client.1.smithi149.stdout:4/876: dread - dc/d2c/d3e/d15/d3f/f11f zero size 2024-04-15T21:02:52.124 INFO:tasks.workunit.client.1.smithi149.stdout:3/852: rmdir d1/db/d40/d56 39 2024-04-15T21:02:52.126 INFO:tasks.workunit.client.1.smithi149.stdout:3/853: readlink d1/db/d24/d4d/d63/lc4 0 2024-04-15T21:02:52.128 INFO:tasks.workunit.client.1.smithi149.stdout:8/910: mkdir d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/d141 0 2024-04-15T21:02:52.128 INFO:tasks.workunit.client.1.smithi149.stdout:6/816: dwrite da/d11/fb2 [4194304,4194304] 0 2024-04-15T21:02:52.132 INFO:tasks.workunit.client.0.smithi072.stdout:1/628: fsync d5/db/d27/f47 0 2024-04-15T21:02:52.138 INFO:tasks.workunit.client.1.smithi149.stdout:6/817: dwrite da/d11/ffc [0,4194304] 0 2024-04-15T21:02:52.138 INFO:tasks.workunit.client.1.smithi149.stdout:7/816: truncate d3/d16/d20/d60/fcd 1043707 0 2024-04-15T21:02:52.141 INFO:tasks.workunit.client.1.smithi149.stdout:4/877: dread dc/d2c/d3e/d35/ffb [0,4194304] 0 2024-04-15T21:02:52.145 INFO:tasks.workunit.client.1.smithi149.stdout:3/854: unlink d1/fa 0 2024-04-15T21:02:52.153 INFO:tasks.workunit.client.0.smithi072.stdout:3/614: dread d1/d15/d32/f5a [0,4194304] 0 2024-04-15T21:02:52.154 INFO:tasks.workunit.client.0.smithi072.stdout:4/636: mknod d7/d10/cd2 0 2024-04-15T21:02:52.154 INFO:tasks.workunit.client.0.smithi072.stdout:3/615: write d1/f14 [7937452,76364] 0 2024-04-15T21:02:52.154 INFO:tasks.workunit.client.0.smithi072.stdout:4/637: chown d7/d10/d41/fb4 276773955 1 2024-04-15T21:02:52.155 INFO:tasks.workunit.client.0.smithi072.stdout:3/616: readlink d1/d15/d32/d2f/l3c 0 2024-04-15T21:02:52.155 INFO:tasks.workunit.client.1.smithi149.stdout:6/818: write da/d18/d10/f8b [7707773,66447] 0 2024-04-15T21:02:52.156 INFO:tasks.workunit.client.0.smithi072.stdout:2/639: symlink d2/d8/d41/db8/ld1 0 2024-04-15T21:02:52.156 INFO:tasks.workunit.client.0.smithi072.stdout:4/638: read d7/d24/f1e [1513247,65574] 0 2024-04-15T21:02:52.158 INFO:tasks.workunit.client.0.smithi072.stdout:4/639: write d7/d10/d41/d4c/f82 [615355,123685] 0 2024-04-15T21:02:52.160 INFO:tasks.workunit.client.1.smithi149.stdout:4/878: symlink dc/d2c/d3e/d35/db4/l123 0 2024-04-15T21:02:52.161 INFO:tasks.workunit.client.1.smithi149.stdout:4/879: fdatasync dc/d18/d21/f119 0 2024-04-15T21:02:52.161 INFO:tasks.workunit.client.1.smithi149.stdout:4/880: chown dc/d2c/d3e/c50 3142 1 2024-04-15T21:02:52.162 INFO:tasks.workunit.client.0.smithi072.stdout:4/640: dread d7/d10/d41/d44/d7a/d86/d76/f96 [0,4194304] 0 2024-04-15T21:02:52.163 INFO:tasks.workunit.client.0.smithi072.stdout:8/663: getdents d3/de/d1b/d44 0 2024-04-15T21:02:52.168 INFO:tasks.workunit.client.0.smithi072.stdout:9/640: creat d4/d29/d4c/d74/d84/dc0/fc8 x:0 0 0 2024-04-15T21:02:52.168 INFO:tasks.workunit.client.0.smithi072.stdout:5/644: dwrite d0/d3/d7/d12/f51 [0,4194304] 0 2024-04-15T21:02:52.169 INFO:tasks.workunit.client.0.smithi072.stdout:5/645: write d0/d3/d6/f9f [2120256,88424] 0 2024-04-15T21:02:52.170 INFO:tasks.workunit.client.0.smithi072.stdout:0/654: fdatasync d0/d6/f80 0 2024-04-15T21:02:52.171 INFO:tasks.workunit.client.0.smithi072.stdout:0/655: readlink d0/d45/d7a/la5 0 2024-04-15T21:02:52.171 INFO:tasks.workunit.client.0.smithi072.stdout:5/646: read - d0/d3/d7/d94/fa1 zero size 2024-04-15T21:02:52.180 INFO:tasks.workunit.client.1.smithi149.stdout:9/755: dwrite f17 [0,4194304] 0 2024-04-15T21:02:52.181 INFO:tasks.workunit.client.1.smithi149.stdout:4/881: dread dc/d1a/f30 [0,4194304] 0 2024-04-15T21:02:52.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/756: dread f17 [0,4194304] 0 2024-04-15T21:02:52.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/819: mknod da/d18/d10/d3f/ded/df8/c107 0 2024-04-15T21:02:52.189 INFO:tasks.workunit.client.1.smithi149.stdout:6/820: write da/d11/ff0 [141425,80663] 0 2024-04-15T21:02:52.189 INFO:tasks.workunit.client.0.smithi072.stdout:2/640: fsync d2/d3/f7f 0 2024-04-15T21:02:52.190 INFO:tasks.workunit.client.0.smithi072.stdout:7/635: truncate d2/fa 1979963 0 2024-04-15T21:02:52.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:51 smithi149 ceph-mon[36029]: pgmap v10: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 201 MiB/s wr, 397 op/s 2024-04-15T21:02:52.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:51 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:02:52.193 INFO:tasks.workunit.client.0.smithi072.stdout:5/647: dread d0/fa [0,4194304] 0 2024-04-15T21:02:52.195 INFO:tasks.workunit.client.1.smithi149.stdout:8/911: getdents d2/d5b/dcd/d10a/d25/d57/dd1/d50/dff 0 2024-04-15T21:02:52.198 INFO:tasks.workunit.client.1.smithi149.stdout:4/882: read - dc/d2c/fdd zero size 2024-04-15T21:02:52.199 INFO:tasks.workunit.client.0.smithi072.stdout:8/664: symlink d3/de/d1b/d85/lcd 0 2024-04-15T21:02:52.202 INFO:tasks.workunit.client.0.smithi072.stdout:6/615: getdents d2 0 2024-04-15T21:02:52.203 INFO:tasks.workunit.client.0.smithi072.stdout:9/641: chown d4/c6 10 1 2024-04-15T21:02:52.204 INFO:tasks.workunit.client.1.smithi149.stdout:9/757: rmdir d23/d3c/d7a/da5/dbd 39 2024-04-15T21:02:52.209 INFO:tasks.workunit.client.1.smithi149.stdout:7/817: getdents d3 0 2024-04-15T21:02:52.210 INFO:tasks.workunit.client.1.smithi149.stdout:8/912: mknod d2/d5b/dcd/d10a/d25/d57/dd1/df3/c142 0 2024-04-15T21:02:52.213 INFO:tasks.workunit.client.0.smithi072.stdout:0/656: rename d0/d45/d7a/d70/d59/d8a/d8b/db8/fe to d0/d19/d71/d9e/fe4 0 2024-04-15T21:02:52.216 INFO:tasks.workunit.client.0.smithi072.stdout:2/641: creat d2/d8/d8e/d90/fd2 x:0 0 0 2024-04-15T21:02:52.217 INFO:tasks.workunit.client.1.smithi149.stdout:6/821: mknod da/d60/d9b/c108 0 2024-04-15T21:02:52.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/855: dwrite d1/db/d24/d39/f47 [0,4194304] 0 2024-04-15T21:02:52.219 INFO:tasks.workunit.client.1.smithi149.stdout:7/818: rename d3/d16/d20/d114/db6 to d3/d129 0 2024-04-15T21:02:52.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/913: symlink d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/l143 0 2024-04-15T21:02:52.222 INFO:tasks.workunit.client.0.smithi072.stdout:4/641: mknod d7/d15/dac/cd3 0 2024-04-15T21:02:52.226 INFO:tasks.workunit.client.0.smithi072.stdout:8/665: unlink d3/de/f24 0 2024-04-15T21:02:52.227 INFO:tasks.workunit.client.1.smithi149.stdout:6/822: stat da/d18/d10/d16/d97/l9f 0 2024-04-15T21:02:52.228 INFO:tasks.workunit.client.0.smithi072.stdout:6/616: creat d2/d42/dad/fb8 x:0 0 0 2024-04-15T21:02:52.231 INFO:tasks.workunit.client.1.smithi149.stdout:8/914: creat d2/d5b/f144 x:0 0 0 2024-04-15T21:02:52.234 INFO:tasks.workunit.client.1.smithi149.stdout:9/758: link d23/d46/dcf/deb/c8e d23/d2b/dd3/c100 0 2024-04-15T21:02:52.234 INFO:tasks.workunit.client.0.smithi072.stdout:3/617: link d1/f28 d1/d5b/fbc 0 2024-04-15T21:02:52.237 INFO:tasks.workunit.client.1.smithi149.stdout:3/856: mkdir d1/db/d40/d56/d84/d10d 0 2024-04-15T21:02:52.239 INFO:tasks.workunit.client.1.smithi149.stdout:4/883: getdents dc/d18/d21/d81 0 2024-04-15T21:02:52.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/884: fsync dc/d2c/d3e/d15/d5b/f71 0 2024-04-15T21:02:52.242 INFO:tasks.workunit.client.1.smithi149.stdout:8/915: mkdir d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/d145 0 2024-04-15T21:02:52.243 INFO:tasks.workunit.client.0.smithi072.stdout:5/648: mkdir d0/d3/d7/d12/ddc 0 2024-04-15T21:02:52.247 INFO:tasks.workunit.client.0.smithi072.stdout:4/642: unlink d7/d10/d41/d45/c4a 0 2024-04-15T21:02:52.247 INFO:tasks.workunit.client.1.smithi149.stdout:0/958: sync 2024-04-15T21:02:52.248 INFO:tasks.workunit.client.0.smithi072.stdout:4/643: write d7/d10/d41/d45/d93/fb8 [596051,118071] 0 2024-04-15T21:02:52.248 INFO:tasks.workunit.client.0.smithi072.stdout:4/644: fsync d7/d10/f85 0 2024-04-15T21:02:52.249 INFO:tasks.workunit.client.1.smithi149.stdout:9/759: dread d23/d2b/f65 [0,4194304] 0 2024-04-15T21:02:52.251 INFO:tasks.workunit.client.1.smithi149.stdout:3/857: fdatasync d1/db/d40/d56/d84/d85/f93 0 2024-04-15T21:02:52.253 INFO:tasks.workunit.client.0.smithi072.stdout:8/666: creat d3/de/d1b/d41/dae/dc0/fce x:0 0 0 2024-04-15T21:02:52.254 INFO:tasks.workunit.client.0.smithi072.stdout:8/667: readlink d3/l29 0 2024-04-15T21:02:52.255 INFO:tasks.workunit.client.1.smithi149.stdout:0/959: dwrite d1/d29/d2c/f14b [0,4194304] 0 2024-04-15T21:02:52.257 INFO:tasks.workunit.client.1.smithi149.stdout:4/885: mknod dc/d18/d21/dfa/c124 0 2024-04-15T21:02:52.260 INFO:tasks.workunit.client.0.smithi072.stdout:1/629: sync 2024-04-15T21:02:52.260 INFO:tasks.workunit.client.1.smithi149.stdout:8/916: fdatasync d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/feb 0 2024-04-15T21:02:52.261 INFO:tasks.workunit.client.1.smithi149.stdout:8/917: write d2/f8d [2836884,19368] 0 2024-04-15T21:02:52.262 INFO:tasks.workunit.client.0.smithi072.stdout:0/657: write d0/d45/d7a/d70/d59/d8a/fa6 [978148,128882] 0 2024-04-15T21:02:52.264 INFO:tasks.workunit.client.1.smithi149.stdout:6/823: write da/d60/f9c [3178446,78443] 0 2024-04-15T21:02:52.265 INFO:tasks.workunit.client.1.smithi149.stdout:7/819: dread - d3/d16/d11f/fa3 zero size 2024-04-15T21:02:52.266 INFO:tasks.workunit.client.0.smithi072.stdout:2/642: mknod d2/d37/dc2/cd3 0 2024-04-15T21:02:52.267 INFO:tasks.workunit.client.1.smithi149.stdout:9/760: rmdir d23/d2b/d44/d7e 39 2024-04-15T21:02:52.270 INFO:tasks.workunit.client.1.smithi149.stdout:9/761: read f1f [1171741,17539] 0 2024-04-15T21:02:52.271 INFO:tasks.workunit.client.0.smithi072.stdout:5/649: readlink d0/d3/d7/d94/d92/da0/da7/lb0 0 2024-04-15T21:02:52.273 INFO:tasks.workunit.client.1.smithi149.stdout:3/858: rmdir d1/db/d23 39 2024-04-15T21:02:52.274 INFO:tasks.workunit.client.0.smithi072.stdout:4/645: unlink d7/d10/d41/d45/fc2 0 2024-04-15T21:02:52.275 INFO:tasks.workunit.client.0.smithi072.stdout:4/646: write d7/f4f [3831925,3584] 0 2024-04-15T21:02:52.275 INFO:tasks.workunit.client.0.smithi072.stdout:6/617: write d2/d1a/f55 [711614,29083] 0 2024-04-15T21:02:52.276 INFO:tasks.workunit.client.0.smithi072.stdout:8/668: symlink d3/d4/d4d/lcf 0 2024-04-15T21:02:52.276 INFO:tasks.workunit.client.0.smithi072.stdout:4/647: readlink d7/d15/d58/l9b 0 2024-04-15T21:02:52.278 INFO:tasks.workunit.client.0.smithi072.stdout:9/642: creat d4/d29/d4c/d74/fc9 x:0 0 0 2024-04-15T21:02:52.279 INFO:tasks.workunit.client.0.smithi072.stdout:9/643: truncate d4/d29/d4c/d74/fc9 527838 0 2024-04-15T21:02:52.279 INFO:tasks.workunit.client.0.smithi072.stdout:9/644: chown d4/d1f/d31/c49 0 1 2024-04-15T21:02:52.280 INFO:tasks.workunit.client.0.smithi072.stdout:1/630: rmdir d5/db/d2d/d85 39 2024-04-15T21:02:52.286 INFO:tasks.workunit.client.1.smithi149.stdout:7/820: chown d3/d16/d20/d36/l28 30268 1 2024-04-15T21:02:52.287 INFO:tasks.workunit.client.0.smithi072.stdout:3/618: rename d1/d3f/d7f/la1 to d1/d5b/lbd 0 2024-04-15T21:02:52.289 INFO:tasks.workunit.client.0.smithi072.stdout:3/619: read d1/d15/d32/d78/fa5 [1282413,6571] 0 2024-04-15T21:02:52.290 INFO:tasks.workunit.client.1.smithi149.stdout:6/824: write da/d11/d90/fa6 [105007,30752] 0 2024-04-15T21:02:52.290 INFO:tasks.workunit.client.1.smithi149.stdout:1/753: sync 2024-04-15T21:02:52.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/784: sync 2024-04-15T21:02:52.290 INFO:tasks.workunit.client.1.smithi149.stdout:2/891: sync 2024-04-15T21:02:52.292 INFO:tasks.workunit.client.0.smithi072.stdout:2/643: mknod d2/d38/d91/d97/cd4 0 2024-04-15T21:02:52.292 INFO:tasks.workunit.client.1.smithi149.stdout:5/785: dread - d0/d9/d3f/d47/f7a zero size 2024-04-15T21:02:52.295 INFO:tasks.workunit.client.0.smithi072.stdout:7/636: getdents d2 0 2024-04-15T21:02:52.297 INFO:tasks.workunit.client.0.smithi072.stdout:2/644: dwrite d2/d8/f36 [4194304,4194304] 0 2024-04-15T21:02:52.297 INFO:tasks.workunit.client.1.smithi149.stdout:3/859: creat d1/db/d40/da0/dd8/f10e x:0 0 0 2024-04-15T21:02:52.298 INFO:tasks.workunit.client.1.smithi149.stdout:3/860: chown d1/db/d24/d4d/d63/db6/f10c 3 1 2024-04-15T21:02:52.300 INFO:tasks.workunit.client.0.smithi072.stdout:2/645: read d2/d3/f5 [3599693,60543] 0 2024-04-15T21:02:52.302 INFO:tasks.workunit.client.0.smithi072.stdout:6/618: mkdir d2/d42/db9 0 2024-04-15T21:02:52.304 INFO:tasks.workunit.client.1.smithi149.stdout:8/918: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/da4/f146 x:0 0 0 2024-04-15T21:02:52.305 INFO:tasks.workunit.client.0.smithi072.stdout:4/648: mknod d7/d10/d41/d44/cd4 0 2024-04-15T21:02:52.306 INFO:tasks.workunit.client.1.smithi149.stdout:8/919: chown d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/ff9 0 1 2024-04-15T21:02:52.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/645: truncate d4/f11 777233 0 2024-04-15T21:02:52.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/886: write dc/d18/dce/fec [23246,61112] 0 2024-04-15T21:02:52.313 INFO:tasks.workunit.client.1.smithi149.stdout:2/892: rename d4/d7/d46/de4/d21/fc2 to d4/df6/f143 0 2024-04-15T21:02:52.314 INFO:tasks.workunit.client.1.smithi149.stdout:2/893: read d4/d7/da/fa2 [42890,4262] 0 2024-04-15T21:02:52.317 INFO:tasks.workunit.client.0.smithi072.stdout:7/637: read d2/fa [1771693,41125] 0 2024-04-15T21:02:52.318 INFO:tasks.workunit.client.0.smithi072.stdout:5/650: unlink d0/d3/d7/d1f/d4c/f5d 0 2024-04-15T21:02:52.321 INFO:tasks.workunit.client.1.smithi149.stdout:2/894: dwrite d4/d7/d46/de4/d21/d6d/f124 [0,4194304] 0 2024-04-15T21:02:52.324 INFO:tasks.workunit.client.0.smithi072.stdout:4/649: creat d7/d10/d41/d44/d7a/d86/d76/fd5 x:0 0 0 2024-04-15T21:02:52.328 INFO:tasks.workunit.client.1.smithi149.stdout:8/920: creat d2/d5b/dcd/d10a/d25/d57/dd1/df3/f147 x:0 0 0 2024-04-15T21:02:52.328 INFO:tasks.workunit.client.0.smithi072.stdout:1/631: dwrite d5/db/d2d/d3a/d1f/f9a [0,4194304] 0 2024-04-15T21:02:52.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/646: mkdir d4/d1f/d31/d9b/dca 0 2024-04-15T21:02:52.334 INFO:tasks.workunit.client.1.smithi149.stdout:5/786: dwrite d0/d6/d82/da1/d12/d16/da9/fb5 [0,4194304] 0 2024-04-15T21:02:52.424 INFO:tasks.workunit.client.1.smithi149.stdout:4/887: mkdir dc/d18/d21/d10e/d125 0 2024-04-15T21:02:52.433 INFO:tasks.workunit.client.1.smithi149.stdout:1/754: link d1/db/dc/fa4 d1/d17/d36/d6f/fd9 0 2024-04-15T21:02:52.435 INFO:tasks.workunit.client.0.smithi072.stdout:7/638: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9 0 2024-04-15T21:02:52.441 INFO:tasks.workunit.client.1.smithi149.stdout:1/755: dwrite d1/db/dc/d11/d3f/d45/dae/fd6 [0,4194304] 0 2024-04-15T21:02:52.441 INFO:tasks.workunit.client.0.smithi072.stdout:7/639: dwrite d2/d7/d25/d81/dbe/fc7 [0,4194304] 0 2024-04-15T21:02:52.441 INFO:tasks.workunit.client.1.smithi149.stdout:7/821: write d3/f5 [8873808,68146] 0 2024-04-15T21:02:52.442 INFO:tasks.workunit.client.0.smithi072.stdout:5/651: write d0/d3/d7/d12/f99 [1255856,103324] 0 2024-04-15T21:02:52.456 INFO:tasks.workunit.client.1.smithi149.stdout:0/960: getdents d1/d5/d24/d50/de2 0 2024-04-15T21:02:52.465 INFO:tasks.workunit.client.1.smithi149.stdout:0/961: dwrite d1/d9/d64/d65/faf [4194304,4194304] 0 2024-04-15T21:02:52.466 INFO:tasks.workunit.client.0.smithi072.stdout:1/632: dread d5/f70 [0,4194304] 0 2024-04-15T21:02:52.469 INFO:tasks.workunit.client.0.smithi072.stdout:1/633: chown d5/db/d2d/d3a/d1f/d63/l73 3 1 2024-04-15T21:02:52.470 INFO:tasks.workunit.client.0.smithi072.stdout:9/647: creat d4/d29/d4c/d91/d93/fcb x:0 0 0 2024-04-15T21:02:52.476 INFO:tasks.workunit.client.1.smithi149.stdout:8/921: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f148 x:0 0 0 2024-04-15T21:02:52.477 INFO:tasks.workunit.client.0.smithi072.stdout:0/658: getdents d0/d6/d6d/dcc 0 2024-04-15T21:02:52.481 INFO:tasks.workunit.client.0.smithi072.stdout:3/620: rmdir d1/d15/d40/d9e/da7 0 2024-04-15T21:02:52.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/787: symlink d0/d6/d2d/lf9 0 2024-04-15T21:02:52.487 INFO:tasks.workunit.client.1.smithi149.stdout:4/888: dread - dc/d2c/d3e/d35/fdc zero size 2024-04-15T21:02:52.489 INFO:tasks.workunit.client.0.smithi072.stdout:7/640: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38 39 2024-04-15T21:02:52.490 INFO:tasks.workunit.client.1.smithi149.stdout:2/895: symlink d4/d7/d10/l144 0 2024-04-15T21:02:52.494 INFO:tasks.workunit.client.0.smithi072.stdout:5/652: mknod d0/d3/d7/d94/d5f/cdd 0 2024-04-15T21:02:52.500 INFO:tasks.workunit.client.0.smithi072.stdout:4/650: symlink d7/d71/ld6 0 2024-04-15T21:02:52.505 INFO:tasks.workunit.client.1.smithi149.stdout:0/962: symlink d1/d29/d2c/l155 0 2024-04-15T21:02:52.508 INFO:tasks.workunit.client.1.smithi149.stdout:5/788: mknod d0/d9/d6c/db4/dd1/cfa 0 2024-04-15T21:02:52.509 INFO:tasks.workunit.client.0.smithi072.stdout:2/646: sync 2024-04-15T21:02:52.510 INFO:tasks.workunit.client.0.smithi072.stdout:2/647: dread d2/d38/d73/f7a [0,4194304] 0 2024-04-15T21:02:52.510 INFO:tasks.workunit.client.0.smithi072.stdout:0/659: rename d0/d45/d7a/d70/d59/d8a/fa6 to d0/d19/d2b/d63/ddb/fe5 0 2024-04-15T21:02:52.511 INFO:tasks.workunit.client.0.smithi072.stdout:2/648: write d2/d66/d69/fc1 [811659,72914] 0 2024-04-15T21:02:52.512 INFO:tasks.workunit.client.1.smithi149.stdout:4/889: creat dc/d2c/d3e/d15/d3f/d117/d75/d80/f126 x:0 0 0 2024-04-15T21:02:52.513 INFO:tasks.workunit.client.1.smithi149.stdout:4/890: dread - dc/d2c/d3e/d35/fdc zero size 2024-04-15T21:02:52.513 INFO:tasks.workunit.client.0.smithi072.stdout:3/621: fsync d1/d15/d32/d2f/f33 0 2024-04-15T21:02:52.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/891: chown dc/d2c/d3e/d15/d3f/d117/d75/d80/le0 508617581 1 2024-04-15T21:02:52.517 INFO:tasks.workunit.client.1.smithi149.stdout:7/822: getdents d3/d16/d20/dab/dd4 0 2024-04-15T21:02:52.519 INFO:tasks.workunit.client.1.smithi149.stdout:7/823: write d3/d16/d20/d6c/feb [1265494,4313] 0 2024-04-15T21:02:52.519 INFO:tasks.workunit.client.0.smithi072.stdout:5/653: mkdir d0/d3/d7/d12/d31/d49/dde 0 2024-04-15T21:02:52.520 INFO:tasks.workunit.client.0.smithi072.stdout:5/654: dread - d0/d3/d7/d12/d31/d62/db6/fd2 zero size 2024-04-15T21:02:52.522 INFO:tasks.workunit.client.1.smithi149.stdout:0/963: fsync d1/d5/fc4 0 2024-04-15T21:02:52.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/651: creat d7/d10/d41/d44/d7a/d86/d76/d8b/fd7 x:0 0 0 2024-04-15T21:02:52.526 INFO:tasks.workunit.client.0.smithi072.stdout:9/648: mkdir d4/d1f/d31/dcc 0 2024-04-15T21:02:52.528 INFO:tasks.workunit.client.1.smithi149.stdout:5/789: mkdir d0/d6/d82/da1/d12/d16/da9/d9b/db7/dfb 0 2024-04-15T21:02:52.530 INFO:tasks.workunit.client.1.smithi149.stdout:2/896: fdatasync d4/f65 0 2024-04-15T21:02:52.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/649: dwrite d4/d1f/fc3 [0,4194304] 0 2024-04-15T21:02:52.531 INFO:tasks.workunit.client.1.smithi149.stdout:5/790: dread d0/d6/d82/da1/d12/d16/da9/d1b/f20 [4194304,4194304] 0 2024-04-15T21:02:52.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/892: mknod dc/ddf/c127 0 2024-04-15T21:02:52.533 INFO:tasks.workunit.client.1.smithi149.stdout:7/824: truncate d3/d16/da0/fa8 4680888 0 2024-04-15T21:02:52.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/825: chown d3/d16/d20/d114 7162489 1 2024-04-15T21:02:52.536 INFO:tasks.workunit.client.0.smithi072.stdout:0/660: fdatasync d0/d19/f22 0 2024-04-15T21:02:52.536 INFO:tasks.workunit.client.0.smithi072.stdout:0/661: fsync d0/d97/fbf 0 2024-04-15T21:02:52.538 INFO:tasks.workunit.client.0.smithi072.stdout:2/649: symlink d2/d38/d91/ld5 0 2024-04-15T21:02:52.540 INFO:tasks.workunit.client.0.smithi072.stdout:1/634: unlink d5/d31/d51/f74 0 2024-04-15T21:02:52.544 INFO:tasks.workunit.client.1.smithi149.stdout:5/791: mknod d0/d6/d82/da1/d12/d16/da9/d1b/cfc 0 2024-04-15T21:02:52.547 INFO:tasks.workunit.client.1.smithi149.stdout:7/826: rename d3/d16/d20/d36/d3d/d11c/f127 to d3/d16/d20/d60/f12a 0 2024-04-15T21:02:52.549 INFO:tasks.workunit.client.1.smithi149.stdout:2/897: fdatasync d4/f135 0 2024-04-15T21:02:52.551 INFO:tasks.workunit.client.1.smithi149.stdout:4/893: rmdir dc/d2c/d3e/d35 39 2024-04-15T21:02:52.552 INFO:tasks.workunit.client.1.smithi149.stdout:5/792: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/fd4 [0,4194304] 0 2024-04-15T21:02:52.561 INFO:tasks.workunit.client.0.smithi072.stdout:0/662: mkdir d0/d19/d71/de6 0 2024-04-15T21:02:52.563 INFO:tasks.workunit.client.1.smithi149.stdout:5/793: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d61/fe9 [0,4194304] 0 2024-04-15T21:02:52.565 INFO:tasks.workunit.client.0.smithi072.stdout:2/650: mknod d2/db3/cd6 0 2024-04-15T21:02:52.567 INFO:tasks.workunit.client.0.smithi072.stdout:2/651: truncate d2/d8/fb1 121179 0 2024-04-15T21:02:52.567 INFO:tasks.workunit.client.0.smithi072.stdout:1/635: mknod d5/db/d27/d5c/dbd/ccf 0 2024-04-15T21:02:52.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/827: truncate d3/d17/d1f/f25 199598 0 2024-04-15T21:02:52.575 INFO:tasks.workunit.client.1.smithi149.stdout:7/828: write d3/d16/d20/d60/fb2 [2751978,118822] 0 2024-04-15T21:02:52.581 INFO:tasks.workunit.client.0.smithi072.stdout:1/636: rename d5/l18 to d5/db/d27/d5c/dbd/ld0 0 2024-04-15T21:02:52.586 INFO:tasks.workunit.client.1.smithi149.stdout:7/829: chown d3/ff 5715829 1 2024-04-15T21:02:52.588 INFO:tasks.workunit.client.0.smithi072.stdout:1/637: dread - d5/d31/d51/f7a zero size 2024-04-15T21:02:52.588 INFO:tasks.workunit.client.1.smithi149.stdout:7/830: read d3/d16/d11f/f5d [2091537,67101] 0 2024-04-15T21:02:52.588 INFO:tasks.workunit.client.0.smithi072.stdout:1/638: stat d5/d3d/lbb 0 2024-04-15T21:02:52.589 INFO:tasks.workunit.client.0.smithi072.stdout:0/663: dread d0/d6/fb0 [0,4194304] 0 2024-04-15T21:02:52.593 INFO:tasks.workunit.client.0.smithi072.stdout:1/639: chown d5/db/f55 968385646 1 2024-04-15T21:02:52.595 INFO:tasks.workunit.client.0.smithi072.stdout:0/664: dwrite d0/d97/fbc [0,4194304] 0 2024-04-15T21:02:52.599 INFO:tasks.workunit.client.1.smithi149.stdout:7/831: link d3/d16/d20/d36/d3d/d56/l9b d3/d112/l12b 0 2024-04-15T21:02:52.604 INFO:tasks.workunit.client.0.smithi072.stdout:2/652: dread d2/d66/f68 [0,4194304] 0 2024-04-15T21:02:52.613 INFO:tasks.workunit.client.1.smithi149.stdout:7/832: dwrite d3/d16/d6e/ff2 [0,4194304] 0 2024-04-15T21:02:52.624 INFO:tasks.workunit.client.0.smithi072.stdout:8/669: creat d3/de/d1b/d41/d74/fd0 x:0 0 0 2024-04-15T21:02:52.628 INFO:tasks.workunit.client.0.smithi072.stdout:8/670: rename d3/de/c63 to d3/de/cd1 0 2024-04-15T21:02:52.629 INFO:tasks.workunit.client.0.smithi072.stdout:8/671: fdatasync d3/d4/f91 0 2024-04-15T21:02:52.632 INFO:tasks.workunit.client.1.smithi149.stdout:6/825: dwrite da/d18/d10/d3f/faa [0,4194304] 0 2024-04-15T21:02:52.635 INFO:tasks.workunit.client.0.smithi072.stdout:8/672: dwrite d3/de/d1b/d41/d74/fd0 [0,4194304] 0 2024-04-15T21:02:52.641 INFO:tasks.workunit.client.1.smithi149.stdout:6/826: symlink da/d18/d7d/l109 0 2024-04-15T21:02:52.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/827: fdatasync da/d18/d10/d16/d97/dbf/d55/fd2 0 2024-04-15T21:02:52.645 INFO:tasks.workunit.client.0.smithi072.stdout:8/673: symlink d3/d4/ld2 0 2024-04-15T21:02:52.653 INFO:tasks.workunit.client.1.smithi149.stdout:6/828: dread da/d11/f7b [0,4194304] 0 2024-04-15T21:02:52.656 INFO:tasks.workunit.client.1.smithi149.stdout:5/794: dread d0/d6/d82/da1/d12/f27 [0,4194304] 0 2024-04-15T21:02:52.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/619: sync 2024-04-15T21:02:52.780 INFO:tasks.workunit.client.0.smithi072.stdout:8/674: mknod d3/d7e/cd3 0 2024-04-15T21:02:52.781 INFO:tasks.workunit.client.0.smithi072.stdout:6/620: symlink d2/d40/d6e/lba 0 2024-04-15T21:02:52.785 INFO:tasks.workunit.client.1.smithi149.stdout:6/829: mknod da/d18/d10/d66/c10a 0 2024-04-15T21:02:52.788 INFO:tasks.workunit.client.1.smithi149.stdout:5/795: rmdir d0/d9/d3f 39 2024-04-15T21:02:52.792 INFO:tasks.workunit.client.1.smithi149.stdout:3/861: truncate d1/db/d24/d39/d79/f83 3723355 0 2024-04-15T21:02:52.795 INFO:tasks.workunit.client.0.smithi072.stdout:6/621: creat d2/d40/fbb x:0 0 0 2024-04-15T21:02:52.797 INFO:tasks.workunit.client.1.smithi149.stdout:6/830: dread da/d18/d10/d66/f57 [0,4194304] 0 2024-04-15T21:02:52.797 INFO:tasks.workunit.client.1.smithi149.stdout:6/831: chown da/d32 25004172 1 2024-04-15T21:02:52.799 INFO:tasks.workunit.client.0.smithi072.stdout:6/622: fsync d2/d10/d11/f4b 0 2024-04-15T21:02:52.800 INFO:tasks.workunit.client.0.smithi072.stdout:6/623: fsync d2/d10/d11/d15/f53 0 2024-04-15T21:02:52.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/675: getdents d3/de/d94 0 2024-04-15T21:02:52.805 INFO:tasks.workunit.client.0.smithi072.stdout:3/622: sync 2024-04-15T21:02:52.805 INFO:tasks.workunit.client.0.smithi072.stdout:2/653: sync 2024-04-15T21:02:52.807 INFO:tasks.workunit.client.0.smithi072.stdout:6/624: mkdir d2/d40/d66/dbc 0 2024-04-15T21:02:52.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/676: truncate d3/d4/d3b/f55 155963 0 2024-04-15T21:02:52.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/677: fdatasync d3/de/d1b/d3f/fc9 0 2024-04-15T21:02:52.811 INFO:tasks.workunit.client.0.smithi072.stdout:2/654: readlink d2/d66/d96/l99 0 2024-04-15T21:02:52.815 INFO:tasks.workunit.client.0.smithi072.stdout:6/625: dread d2/d10/d11/d1f/f4c [0,4194304] 0 2024-04-15T21:02:52.818 INFO:tasks.workunit.client.0.smithi072.stdout:8/678: fdatasync f1 0 2024-04-15T21:02:52.823 INFO:tasks.workunit.client.0.smithi072.stdout:3/623: mknod d1/d3f/d4f/da3/cbe 0 2024-04-15T21:02:52.826 INFO:tasks.workunit.client.0.smithi072.stdout:6/626: creat d2/d40/d56/d95/fbd x:0 0 0 2024-04-15T21:02:52.827 INFO:tasks.workunit.client.0.smithi072.stdout:8/679: dread d3/de/d1b/d41/f95 [0,4194304] 0 2024-04-15T21:02:52.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/756: write d1/db/dc/d38/d39/d43/f1f [1831218,104482] 0 2024-04-15T21:02:52.832 INFO:tasks.workunit.client.0.smithi072.stdout:6/627: dwrite d2/d40/f4d [4194304,4194304] 0 2024-04-15T21:02:52.838 INFO:tasks.workunit.client.0.smithi072.stdout:3/624: rename d1/d3f/d7f/d8c to d1/d5b/dbf 0 2024-04-15T21:02:52.845 INFO:tasks.workunit.client.0.smithi072.stdout:3/625: rename d1/d15/d32/d2f/d1a/f8d to d1/d3f/fc0 0 2024-04-15T21:02:52.848 INFO:tasks.workunit.client.0.smithi072.stdout:3/626: creat d1/d3f/fc1 x:0 0 0 2024-04-15T21:02:52.851 INFO:tasks.workunit.client.0.smithi072.stdout:7/641: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f2a [8388608,4194304] 0 2024-04-15T21:02:52.854 INFO:tasks.workunit.client.1.smithi149.stdout:8/922: truncate d2/d5b/dcd/d10a/d20/f91 2010710 0 2024-04-15T21:02:52.854 INFO:tasks.workunit.client.0.smithi072.stdout:3/627: read d1/d15/d32/d2f/f33 [3441360,31139] 0 2024-04-15T21:02:52.856 INFO:tasks.workunit.client.0.smithi072.stdout:3/628: write d1/d15/d32/d78/d99/fb4 [159977,61604] 0 2024-04-15T21:02:52.857 INFO:tasks.workunit.client.1.smithi149.stdout:9/762: creat d23/d46/dcf/deb/f101 x:0 0 0 2024-04-15T21:02:52.863 INFO:tasks.workunit.client.1.smithi149.stdout:8/923: dread d2/d5b/dcd/d10a/f14 [4194304,4194304] 0 2024-04-15T21:02:52.864 INFO:tasks.workunit.client.0.smithi072.stdout:3/629: mkdir d1/d15/d40/dc2 0 2024-04-15T21:02:52.866 INFO:tasks.workunit.client.1.smithi149.stdout:7/833: truncate d3/d16/d11f/d92/f107 3559257 0 2024-04-15T21:02:52.867 INFO:tasks.workunit.client.1.smithi149.stdout:7/834: chown d3/d16/d20/d114/l3c 10 1 2024-04-15T21:02:52.867 INFO:tasks.workunit.client.1.smithi149.stdout:1/757: mknod d1/db/dc/d38/d39/d88/db4/cda 0 2024-04-15T21:02:52.869 INFO:tasks.workunit.client.0.smithi072.stdout:3/630: symlink d1/d15/d32/d2f/lc3 0 2024-04-15T21:02:52.870 INFO:tasks.workunit.client.1.smithi149.stdout:5/796: link d0/d9/d3f/f93 d0/d6/d2d/ffd 0 2024-04-15T21:02:52.870 INFO:tasks.workunit.client.1.smithi149.stdout:5/797: chown d0/d9/d71 2566 1 2024-04-15T21:02:52.872 INFO:tasks.workunit.client.1.smithi149.stdout:8/924: mknod d2/d5b/dcd/d10a/d25/d57/dd1/df3/c149 0 2024-04-15T21:02:52.875 INFO:tasks.workunit.client.0.smithi072.stdout:3/631: mkdir d1/d3f/d4f/d73/db3/dc4 0 2024-04-15T21:02:52.877 INFO:tasks.workunit.client.1.smithi149.stdout:6/832: creat da/d18/d10/d16/d97/f10b x:0 0 0 2024-04-15T21:02:52.877 INFO:tasks.workunit.client.1.smithi149.stdout:6/833: chown da/d18/d10/d16/d97/fcd 3323 1 2024-04-15T21:02:52.880 INFO:tasks.workunit.client.0.smithi072.stdout:4/652: write d7/d28/d42/f65 [1578143,57348] 0 2024-04-15T21:02:52.883 INFO:tasks.workunit.client.0.smithi072.stdout:3/632: link d1/d15/d40/f27 d1/d3f/d4f/d73/fc5 0 2024-04-15T21:02:52.885 INFO:tasks.workunit.client.0.smithi072.stdout:4/653: symlink d7/d28/d42/d8c/ld8 0 2024-04-15T21:02:52.888 INFO:tasks.workunit.client.1.smithi149.stdout:8/925: link d2/d5b/dcd/d10a/d25/d32/d45/d77/f131 d2/d5b/dcd/d10a/d25/d32/d45/d77/f14a 0 2024-04-15T21:02:52.888 INFO:tasks.workunit.client.1.smithi149.stdout:8/926: read - d2/d5b/dcd/d10a/d25/f136 zero size 2024-04-15T21:02:52.892 INFO:tasks.workunit.client.1.smithi149.stdout:7/835: rmdir d3/d16/d20/d36/d3d/d11c 0 2024-04-15T21:02:52.894 INFO:tasks.workunit.client.1.smithi149.stdout:6/834: getdents da/d18/d10 0 2024-04-15T21:02:52.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/927: link d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/c105 d2/d16/c14b 0 2024-04-15T21:02:52.899 INFO:tasks.workunit.client.1.smithi149.stdout:6/835: rename da/f1b to da/d18/d10/d3f/ded/f10c 0 2024-04-15T21:02:52.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/928: chown d2/c1e 14679 1 2024-04-15T21:02:52.901 INFO:tasks.workunit.client.1.smithi149.stdout:2/898: dwrite d4/d7/d29/f4f [0,4194304] 0 2024-04-15T21:02:52.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/836: chown da/d11/l3d 58686 1 2024-04-15T21:02:52.903 INFO:tasks.workunit.client.1.smithi149.stdout:2/899: dread - d4/d7/d46/de4/d21/d55/f141 zero size 2024-04-15T21:02:52.904 INFO:tasks.workunit.client.0.smithi072.stdout:9/650: truncate d4/d1f/d31/f7e 598982 0 2024-04-15T21:02:52.908 INFO:tasks.workunit.client.0.smithi072.stdout:9/651: dwrite d4/d29/d4c/d74/f9c [0,4194304] 0 2024-04-15T21:02:52.911 INFO:tasks.workunit.client.1.smithi149.stdout:4/894: truncate dc/d2c/d3e/d15/d5b/f6d 1477107 0 2024-04-15T21:02:52.915 INFO:tasks.workunit.client.1.smithi149.stdout:8/929: rename d2/d5b/dcd/d10a/d25/d37/c7f to d2/d5b/dcd/d10a/d25/d32/d45/d77/d121/c14c 0 2024-04-15T21:02:52.918 INFO:tasks.workunit.client.1.smithi149.stdout:2/900: symlink d4/d7/d46/de4/d21/d55/d94/l145 0 2024-04-15T21:02:52.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/901: chown d4/d7/d46/de4/d21/d2c/d32/d4a/dee/f120 46 1 2024-04-15T21:02:52.926 INFO:tasks.workunit.client.0.smithi072.stdout:5/655: creat d0/d3/d7/d12/fdf x:0 0 0 2024-04-15T21:02:52.926 INFO:tasks.workunit.client.1.smithi149.stdout:2/902: mkdir d4/d7/d46/de4/d21/d2c/d58/d146 0 2024-04-15T21:02:52.928 INFO:tasks.workunit.client.1.smithi149.stdout:4/895: dread dc/d2c/d3e/d35/d3a/f40 [0,4194304] 0 2024-04-15T21:02:52.930 INFO:tasks.workunit.client.0.smithi072.stdout:5/656: creat d0/d3/d33/d60/fe0 x:0 0 0 2024-04-15T21:02:52.931 INFO:tasks.workunit.client.1.smithi149.stdout:6/837: link da/d18/d10/d16/caf da/d18/d10/d16/d97/c10d 0 2024-04-15T21:02:52.932 INFO:tasks.workunit.client.1.smithi149.stdout:6/838: fsync da/d18/d33/fa8 0 2024-04-15T21:02:52.932 INFO:tasks.workunit.client.1.smithi149.stdout:8/930: creat d2/d5b/dcd/d10a/d4e/f14d x:0 0 0 2024-04-15T21:02:52.933 INFO:tasks.workunit.client.0.smithi072.stdout:1/640: truncate d5/f8 2130780 0 2024-04-15T21:02:52.934 INFO:tasks.workunit.client.0.smithi072.stdout:1/641: write d5/d31/d51/f83 [2600484,49557] 0 2024-04-15T21:02:52.935 INFO:tasks.workunit.client.0.smithi072.stdout:0/665: dwrite d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:52.936 INFO:tasks.workunit.client.1.smithi149.stdout:4/896: dwrite dc/deb/fef [0,4194304] 0 2024-04-15T21:02:52.936 INFO:tasks.workunit.client.0.smithi072.stdout:1/642: chown d5/db/d2d/d56/c66 60045 1 2024-04-15T21:02:52.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/897: stat dc/d1a/l95 0 2024-04-15T21:02:52.940 INFO:tasks.workunit.client.1.smithi149.stdout:6/839: dread da/d18/f86 [4194304,4194304] 0 2024-04-15T21:02:52.941 INFO:tasks.workunit.client.1.smithi149.stdout:6/840: write da/d2e/f50 [865127,6889] 0 2024-04-15T21:02:52.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/841: dread da/d18/d10/d66/f57 [0,4194304] 0 2024-04-15T21:02:52.954 INFO:tasks.workunit.client.1.smithi149.stdout:4/898: unlink dc/d2c/d3e/d35/db4/cb6 0 2024-04-15T21:02:52.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/643: mknod d5/db/d2d/d3a/d1f/d63/cd1 0 2024-04-15T21:02:52.957 INFO:tasks.workunit.client.0.smithi072.stdout:5/657: mkdir d0/d3/d7/d94/de1 0 2024-04-15T21:02:52.963 INFO:tasks.workunit.client.1.smithi149.stdout:6/842: creat da/d60/d9b/dea/f10e x:0 0 0 2024-04-15T21:02:52.964 INFO:tasks.workunit.client.1.smithi149.stdout:6/843: chown da/d18/d10/d66/l84 16 1 2024-04-15T21:02:52.964 INFO:tasks.workunit.client.1.smithi149.stdout:4/899: mkdir dc/d18/d128 0 2024-04-15T21:02:52.965 INFO:tasks.workunit.client.0.smithi072.stdout:5/658: link d0/d3/d7/cc9 d0/d3/d7/d12/ddc/ce2 0 2024-04-15T21:02:52.967 INFO:tasks.workunit.client.1.smithi149.stdout:4/900: read dc/d18/d21/d10e/f11e [756687,121521] 0 2024-04-15T21:02:52.968 INFO:tasks.workunit.client.0.smithi072.stdout:5/659: symlink d0/d3/d7/d94/le3 0 2024-04-15T21:02:52.970 INFO:tasks.workunit.client.0.smithi072.stdout:5/660: mknod d0/d3/d7/d1f/d50/ce4 0 2024-04-15T21:02:52.970 INFO:tasks.workunit.client.0.smithi072.stdout:5/661: chown d0/d3/d33/d85/cc1 4619 1 2024-04-15T21:02:52.971 INFO:tasks.workunit.client.1.smithi149.stdout:6/844: dwrite da/d18/d10/d3f/fde [0,4194304] 0 2024-04-15T21:02:52.971 INFO:tasks.workunit.client.0.smithi072.stdout:5/662: write d0/d3/d7/d12/d31/d55/d58/f66 [3234091,34075] 0 2024-04-15T21:02:52.978 INFO:tasks.workunit.client.1.smithi149.stdout:2/903: mknod d4/d7/d46/c147 0 2024-04-15T21:02:52.980 INFO:tasks.workunit.client.1.smithi149.stdout:2/904: chown d4/d7/d10/l7b 31475 1 2024-04-15T21:02:52.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/845: dwrite da/d18/d33/fa8 [0,4194304] 0 2024-04-15T21:02:52.984 INFO:tasks.workunit.client.1.smithi149.stdout:4/901: link dc/d2c/d3e/c42 dc/d2c/d3e/d35/c129 0 2024-04-15T21:02:52.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/846: rmdir da/d18/d10/d16/d97/dbf/d55 39 2024-04-15T21:02:52.988 INFO:tasks.workunit.client.0.smithi072.stdout:5/663: dread d0/d3/d7/d12/d31/d55/d58/f65 [0,4194304] 0 2024-04-15T21:02:52.989 INFO:tasks.workunit.client.1.smithi149.stdout:6/847: write da/d18/d10/d16/d97/f10b [466784,66701] 0 2024-04-15T21:02:52.998 INFO:tasks.workunit.client.1.smithi149.stdout:2/905: rename d4/d7/d93/fad to d4/d7/d46/de4/f148 0 2024-04-15T21:02:53.001 INFO:tasks.workunit.client.1.smithi149.stdout:6/848: creat da/d11/dbe/dc1/d106/f10f x:0 0 0 2024-04-15T21:02:53.002 INFO:tasks.workunit.client.1.smithi149.stdout:6/849: truncate da/d18/d10/d3f/faa 4255544 0 2024-04-15T21:02:53.009 INFO:tasks.workunit.client.1.smithi149.stdout:6/850: dwrite da/d18/d10/d16/d97/dbf/fc9 [0,4194304] 0 2024-04-15T21:02:53.019 INFO:tasks.workunit.client.1.smithi149.stdout:6/851: symlink da/d32/l110 0 2024-04-15T21:02:53.026 INFO:tasks.workunit.client.1.smithi149.stdout:6/852: truncate da/d18/d33/f7e 851954 0 2024-04-15T21:02:53.027 INFO:tasks.workunit.client.1.smithi149.stdout:6/853: write da/d11/ff0 [935587,95805] 0 2024-04-15T21:02:53.028 INFO:tasks.workunit.client.1.smithi149.stdout:6/854: write da/d18/d10/d3f/fd4 [667822,125552] 0 2024-04-15T21:02:53.029 INFO:tasks.workunit.client.0.smithi072.stdout:7/642: sync 2024-04-15T21:02:53.029 INFO:tasks.workunit.client.0.smithi072.stdout:2/655: write d2/d8/daa/fa6 [2239632,120307] 0 2024-04-15T21:02:53.030 INFO:tasks.workunit.client.0.smithi072.stdout:7/643: chown d2/d7/lba 328651179 1 2024-04-15T21:02:53.033 INFO:tasks.workunit.client.0.smithi072.stdout:2/656: dread d2/d8/f72 [0,4194304] 0 2024-04-15T21:02:53.034 INFO:tasks.workunit.client.1.smithi149.stdout:6/855: dread da/d11/ff0 [0,4194304] 0 2024-04-15T21:02:53.036 INFO:tasks.workunit.client.0.smithi072.stdout:7/644: mknod d2/d7/d25/d4c/cca 0 2024-04-15T21:02:53.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/856: dwrite da/d18/d7d/ff2 [0,4194304] 0 2024-04-15T21:02:53.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/857: dread da/d11/ff0 [0,4194304] 0 2024-04-15T21:02:53.045 INFO:tasks.workunit.client.0.smithi072.stdout:2/657: getdents d2/d8 0 2024-04-15T21:02:53.046 INFO:tasks.workunit.client.0.smithi072.stdout:8/680: dwrite d3/de/d1b/d41/da4/f8b [0,4194304] 0 2024-04-15T21:02:53.046 INFO:tasks.workunit.client.0.smithi072.stdout:2/658: readlink d2/d38/d91/ld5 0 2024-04-15T21:02:53.047 INFO:tasks.workunit.client.0.smithi072.stdout:2/659: stat d2/d8 0 2024-04-15T21:02:53.047 INFO:tasks.workunit.client.0.smithi072.stdout:6/628: write d2/d10/d11/d1f/f32 [417913,92824] 0 2024-04-15T21:02:53.048 INFO:tasks.workunit.client.0.smithi072.stdout:6/629: chown d2/d1a/f5f 51642199 1 2024-04-15T21:02:53.050 INFO:tasks.workunit.client.0.smithi072.stdout:6/630: fdatasync d2/d10/d11/d1f/d60/f61 0 2024-04-15T21:02:53.050 INFO:tasks.workunit.client.0.smithi072.stdout:7/645: link d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d d2/fcb 0 2024-04-15T21:02:53.053 INFO:tasks.workunit.client.0.smithi072.stdout:6/631: write d2/d10/d11/d1f/d60/f9f [316471,120477] 0 2024-04-15T21:02:53.055 INFO:tasks.workunit.client.1.smithi149.stdout:6/858: rename da/d18/d10/d16/d97/l9f to da/d18/l111 0 2024-04-15T21:02:53.058 INFO:tasks.workunit.client.0.smithi072.stdout:2/660: getdents d2/da8 0 2024-04-15T21:02:53.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/681: dwrite d3/de/f99 [0,4194304] 0 2024-04-15T21:02:53.059 INFO:tasks.workunit.client.0.smithi072.stdout:2/661: fsync d2/f44 0 2024-04-15T21:02:53.061 INFO:tasks.workunit.client.0.smithi072.stdout:6/632: rename d2/d10/d11/f2e to d2/d10/d11/d15/fbe 0 2024-04-15T21:02:53.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/859: dwrite da/d18/d10/d16/d97/dbf/fb3 [0,4194304] 0 2024-04-15T21:02:53.064 INFO:tasks.workunit.client.0.smithi072.stdout:8/682: truncate d3/f1d 872534 0 2024-04-15T21:02:53.068 INFO:tasks.workunit.client.1.smithi149.stdout:3/862: write d1/db/f6e [1276449,58656] 0 2024-04-15T21:02:53.068 INFO:tasks.workunit.client.0.smithi072.stdout:6/633: unlink d2/d40/fbb 0 2024-04-15T21:02:53.069 INFO:tasks.workunit.client.0.smithi072.stdout:6/634: readlink d2/d40/d56/d95/l9e 0 2024-04-15T21:02:53.069 INFO:tasks.workunit.client.0.smithi072.stdout:8/683: mknod d3/cd4 0 2024-04-15T21:02:53.077 INFO:tasks.workunit.client.1.smithi149.stdout:3/863: mknod d1/db/d24/d107/c10f 0 2024-04-15T21:02:53.081 INFO:tasks.workunit.client.0.smithi072.stdout:2/662: rename d2/d38/d91/d97 to d2/dd7 0 2024-04-15T21:02:53.084 INFO:tasks.workunit.client.1.smithi149.stdout:3/864: truncate d1/db/d24/d2b/f6b 459550 0 2024-04-15T21:02:53.086 INFO:tasks.workunit.client.1.smithi149.stdout:5/798: write d0/d6/fe [2113302,27220] 0 2024-04-15T21:02:53.086 INFO:tasks.workunit.client.0.smithi072.stdout:2/663: rmdir d2/d37 39 2024-04-15T21:02:53.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/763: dwrite d23/d3c/d87/d9a/dad/fce [0,4194304] 0 2024-04-15T21:02:53.091 INFO:tasks.workunit.client.0.smithi072.stdout:3/633: write d1/f43 [4008627,81096] 0 2024-04-15T21:02:53.093 INFO:tasks.workunit.client.0.smithi072.stdout:4/654: write d7/d15/f33 [1926525,46873] 0 2024-04-15T21:02:53.096 INFO:tasks.workunit.client.1.smithi149.stdout:9/764: write d23/f24 [9365048,28690] 0 2024-04-15T21:02:53.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/634: dwrite d1/d15/f4d [0,4194304] 0 2024-04-15T21:02:53.104 INFO:tasks.workunit.client.0.smithi072.stdout:3/635: dwrite d1/d15/d40/f22 [0,4194304] 0 2024-04-15T21:02:53.104 INFO:tasks.workunit.client.1.smithi149.stdout:9/765: dwrite f1b [0,4194304] 0 2024-04-15T21:02:53.112 INFO:tasks.workunit.client.1.smithi149.stdout:9/766: write f17 [2075954,50663] 0 2024-04-15T21:02:53.115 INFO:tasks.workunit.client.0.smithi072.stdout:9/652: dwrite d4/d29/d4c/d74/f7f [0,4194304] 0 2024-04-15T21:02:53.116 INFO:tasks.workunit.client.0.smithi072.stdout:9/653: dread - d4/d29/fbd zero size 2024-04-15T21:02:53.117 INFO:tasks.workunit.client.0.smithi072.stdout:3/636: fdatasync d1/f10 0 2024-04-15T21:02:53.119 INFO:tasks.workunit.client.0.smithi072.stdout:3/637: write d1/d15/d32/d78/d99/fb4 [783500,94669] 0 2024-04-15T21:02:53.125 INFO:tasks.workunit.client.1.smithi149.stdout:9/767: rename d23/d3c/d87/de8 to d23/d2b/d37/d6d/db8/d102 0 2024-04-15T21:02:53.126 INFO:tasks.workunit.client.1.smithi149.stdout:9/768: fdatasync f17 0 2024-04-15T21:02:53.127 INFO:tasks.workunit.client.0.smithi072.stdout:2/664: getdents d2/d3/d5f 0 2024-04-15T21:02:53.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/964: sync 2024-04-15T21:02:53.136 INFO:tasks.workunit.client.1.smithi149.stdout:9/769: mkdir d23/d2b/d37/d50/d103 0 2024-04-15T21:02:53.139 INFO:tasks.workunit.client.0.smithi072.stdout:0/666: write d0/d45/d7a/f15 [229046,24421] 0 2024-04-15T21:02:53.139 INFO:tasks.workunit.client.0.smithi072.stdout:3/638: readlink d1/d5b/lbd 0 2024-04-15T21:02:53.142 INFO:tasks.workunit.client.1.smithi149.stdout:9/770: creat d23/d2b/d37/d6d/de3/f104 x:0 0 0 2024-04-15T21:02:53.143 INFO:tasks.workunit.client.1.smithi149.stdout:8/931: dwrite d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/fa8 [0,4194304] 0 2024-04-15T21:02:53.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/965: getdents d1/d5/d24/d50/d13/d38/d44/d61/d150 0 2024-04-15T21:02:53.148 INFO:tasks.workunit.client.0.smithi072.stdout:9/654: fsync d4/d1f/d2c/f57 0 2024-04-15T21:02:53.150 INFO:tasks.workunit.client.0.smithi072.stdout:1/644: dwrite d5/f70 [0,4194304] 0 2024-04-15T21:02:53.150 INFO:tasks.workunit.client.1.smithi149.stdout:9/771: read d23/d2b/d37/d50/faf [1363124,70666] 0 2024-04-15T21:02:53.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/772: chown d23/d46/f49 93987 1 2024-04-15T21:02:53.151 INFO:tasks.workunit.client.0.smithi072.stdout:0/667: creat d0/d6/d55/fe7 x:0 0 0 2024-04-15T21:02:53.156 INFO:tasks.workunit.client.1.smithi149.stdout:8/932: mkdir d2/d14e 0 2024-04-15T21:02:53.159 INFO:tasks.workunit.client.0.smithi072.stdout:2/665: symlink d2/d38/d91/dbb/ld8 0 2024-04-15T21:02:53.159 INFO:tasks.workunit.client.1.smithi149.stdout:9/773: creat d23/d46/dcf/deb/d7f/d83/f105 x:0 0 0 2024-04-15T21:02:53.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/774: readlink d23/d46/dcf/deb/lc0 0 2024-04-15T21:02:53.161 INFO:tasks.workunit.client.1.smithi149.stdout:8/933: dread - d2/d5b/dcd/d10a/d20/d6b/f102 zero size 2024-04-15T21:02:53.164 INFO:tasks.workunit.client.0.smithi072.stdout:1/645: creat d5/db/d2d/d3a/d1f/d63/fd2 x:0 0 0 2024-04-15T21:02:53.164 INFO:tasks.workunit.client.1.smithi149.stdout:8/934: write d2/d5b/dcd/d10a/d25/d37/d53/daf/ff8 [859159,91803] 0 2024-04-15T21:02:53.165 INFO:tasks.workunit.client.0.smithi072.stdout:1/646: fdatasync d5/f32 0 2024-04-15T21:02:53.165 INFO:tasks.workunit.client.1.smithi149.stdout:9/775: fsync d23/d2b/f65 0 2024-04-15T21:02:53.166 INFO:tasks.workunit.client.0.smithi072.stdout:0/668: mknod d0/d19/d71/d9e/ce8 0 2024-04-15T21:02:53.166 INFO:tasks.workunit.client.0.smithi072.stdout:1/647: fdatasync d5/d31/fab 0 2024-04-15T21:02:53.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/666: dwrite d2/d3/f5d [0,4194304] 0 2024-04-15T21:02:53.169 INFO:tasks.workunit.client.0.smithi072.stdout:1/648: stat d5/db/d2d/d3a/f50 0 2024-04-15T21:02:53.169 INFO:tasks.workunit.client.1.smithi149.stdout:8/935: read d2/f86 [495712,62673] 0 2024-04-15T21:02:53.170 INFO:tasks.workunit.client.0.smithi072.stdout:0/669: dread - d0/d19/dcd/fbb zero size 2024-04-15T21:02:53.171 INFO:tasks.workunit.client.1.smithi149.stdout:4/902: dwrite dc/d2c/f115 [0,4194304] 0 2024-04-15T21:02:53.172 INFO:tasks.workunit.client.0.smithi072.stdout:1/649: dread - d5/d3d/d5e/fac zero size 2024-04-15T21:02:53.173 INFO:tasks.workunit.client.0.smithi072.stdout:5/664: dwrite d0/fa [0,4194304] 0 2024-04-15T21:02:53.184 INFO:tasks.workunit.client.0.smithi072.stdout:3/639: dread d1/d5b/f6a [0,4194304] 0 2024-04-15T21:02:53.185 INFO:tasks.workunit.client.1.smithi149.stdout:4/903: creat dc/d2c/f12a x:0 0 0 2024-04-15T21:02:53.189 INFO:tasks.workunit.client.0.smithi072.stdout:2/667: symlink d2/d8/d41/ld9 0 2024-04-15T21:02:53.190 INFO:tasks.workunit.client.1.smithi149.stdout:2/906: dwrite d4/d7/d46/de4/d21/d6d/fd6 [0,4194304] 0 2024-04-15T21:02:53.192 INFO:tasks.workunit.client.0.smithi072.stdout:0/670: fsync d0/d45/d7a/f84 0 2024-04-15T21:02:53.193 INFO:tasks.workunit.client.1.smithi149.stdout:0/966: dread d1/d5/d24/d50/d13/d38/d44/d61/f154 [0,4194304] 0 2024-04-15T21:02:53.194 INFO:tasks.workunit.client.0.smithi072.stdout:0/671: dread - d0/d19/d96/fd8 zero size 2024-04-15T21:02:53.196 INFO:tasks.workunit.client.0.smithi072.stdout:2/668: dwrite d2/d3/f1d [0,4194304] 0 2024-04-15T21:02:53.199 INFO:tasks.workunit.client.0.smithi072.stdout:1/650: chown d5/c1b 15256 1 2024-04-15T21:02:53.200 INFO:tasks.workunit.client.0.smithi072.stdout:1/651: chown d5/db/d2d/d3a/f88 8584784 1 2024-04-15T21:02:53.200 INFO:tasks.workunit.client.1.smithi149.stdout:0/967: fsync d1/d9/d64/d65/d104/d119/fe6 0 2024-04-15T21:02:53.200 INFO:tasks.workunit.client.1.smithi149.stdout:4/904: dwrite dc/d2c/d3e/d15/d5b/f74 [4194304,4194304] 0 2024-04-15T21:02:53.201 INFO:tasks.workunit.client.0.smithi072.stdout:9/655: creat d4/d29/d4c/d74/fcd x:0 0 0 2024-04-15T21:02:53.203 INFO:tasks.workunit.client.0.smithi072.stdout:5/665: symlink d0/d3/d7/d94/d92/da0/le5 0 2024-04-15T21:02:53.206 INFO:tasks.workunit.client.1.smithi149.stdout:2/907: rename d4/d7/d46/de4/d21/d2c/d32/d4a/c77 to d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/c149 0 2024-04-15T21:02:53.214 INFO:tasks.workunit.client.1.smithi149.stdout:0/968: unlink d1/d29/l7c 0 2024-04-15T21:02:53.215 INFO:tasks.workunit.client.1.smithi149.stdout:8/936: dread d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/fe1 [0,4194304] 0 2024-04-15T21:02:53.218 INFO:tasks.workunit.client.1.smithi149.stdout:4/905: fsync dc/d2c/d3e/d35/d3a/f60 0 2024-04-15T21:02:53.219 INFO:tasks.workunit.client.1.smithi149.stdout:4/906: fsync dc/d2c/d3e/d7c/dba/fc6 0 2024-04-15T21:02:53.219 INFO:tasks.workunit.client.0.smithi072.stdout:0/672: write d0/d19/d2b/d63/ddb/fe5 [1111303,27724] 0 2024-04-15T21:02:53.223 INFO:tasks.workunit.client.1.smithi149.stdout:0/969: fsync d1/d5/d24/d50/d15/f89 0 2024-04-15T21:02:53.228 INFO:tasks.workunit.client.1.smithi149.stdout:8/937: symlink d2/d5b/dcd/d10a/d20/d6b/d109/l14f 0 2024-04-15T21:02:53.234 INFO:tasks.workunit.client.1.smithi149.stdout:2/908: getdents d4/d7/d10/d36/d11e 0 2024-04-15T21:02:53.238 INFO:tasks.workunit.client.0.smithi072.stdout:5/666: link d0/d3/d7/d12/d31/d49/f87 d0/d3/d33/d60/fe6 0 2024-04-15T21:02:53.242 INFO:tasks.workunit.client.0.smithi072.stdout:5/667: rmdir d0/d3/d7/d12/d31/d62 39 2024-04-15T21:02:53.243 INFO:tasks.workunit.client.1.smithi149.stdout:8/938: rmdir d2/d5b/dcd/d10a/d25/d37/d53/daf 39 2024-04-15T21:02:53.246 INFO:tasks.workunit.client.0.smithi072.stdout:7/646: dwrite d2/d7/d25/d72/f92 [4194304,4194304] 0 2024-04-15T21:02:53.249 INFO:tasks.workunit.client.0.smithi072.stdout:5/668: dread d0/d3/d33/d60/fe6 [4194304,4194304] 0 2024-04-15T21:02:53.250 INFO:tasks.workunit.client.1.smithi149.stdout:8/939: write d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/f13f [187366,40213] 0 2024-04-15T21:02:53.253 INFO:tasks.workunit.client.0.smithi072.stdout:5/669: dread d0/d3/d7/d12/d31/f70 [0,4194304] 0 2024-04-15T21:02:53.254 INFO:tasks.workunit.client.0.smithi072.stdout:5/670: stat d0/d3/d7/d12/d1d/f74 0 2024-04-15T21:02:53.256 INFO:tasks.workunit.client.1.smithi149.stdout:0/970: dread d1/d9/d64/d65/d104/d119/d54/f8c [0,4194304] 0 2024-04-15T21:02:53.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/940: mknod d2/d5b/dcd/d10a/d25/c150 0 2024-04-15T21:02:53.260 INFO:tasks.workunit.client.0.smithi072.stdout:8/684: write d3/de/d81/f86 [1036236,105947] 0 2024-04-15T21:02:53.261 INFO:tasks.workunit.client.1.smithi149.stdout:0/971: fdatasync d1/d9/d64/d65/d104/d119/f93 0 2024-04-15T21:02:53.263 INFO:tasks.workunit.client.0.smithi072.stdout:6/635: dwrite d2/d10/d11/d1f/f28 [0,4194304] 0 2024-04-15T21:02:53.264 INFO:tasks.workunit.client.1.smithi149.stdout:5/799: write d0/fc4 [1032282,46526] 0 2024-04-15T21:02:53.269 INFO:tasks.workunit.client.1.smithi149.stdout:0/972: symlink d1/d29/dbb/l156 0 2024-04-15T21:02:53.271 INFO:tasks.workunit.client.0.smithi072.stdout:4/655: dwrite d7/d15/d58/d62/f90 [0,4194304] 0 2024-04-15T21:02:53.272 INFO:tasks.workunit.client.1.smithi149.stdout:5/800: creat d0/d6/d82/da1/d12/d16/da9/d1b/ffe x:0 0 0 2024-04-15T21:02:53.273 INFO:tasks.workunit.client.0.smithi072.stdout:7/647: getdents d2/d7/d25/d2d/d46/d5a/d5f/d26 0 2024-04-15T21:02:53.274 INFO:tasks.workunit.client.1.smithi149.stdout:0/973: mkdir d1/d5/d24/d50/de2/d11e/d157 0 2024-04-15T21:02:53.277 INFO:tasks.workunit.client.0.smithi072.stdout:5/671: link d0/d3/d7/d94/d5f/lb7 d0/d3/d33/d60/d81/le7 0 2024-04-15T21:02:53.283 INFO:tasks.workunit.client.0.smithi072.stdout:8/685: rename d3/de/c7b to d3/d4/d76/cd5 0 2024-04-15T21:02:53.288 INFO:tasks.workunit.client.1.smithi149.stdout:5/801: link d0/d6/d82/da1/d12/d16/da9/d1b/f20 d0/d6/d82/da1/d12/d16/da9/d1b/d83/fff 0 2024-04-15T21:02:53.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/802: write d0/d6/d82/da1/f2e [492403,50623] 0 2024-04-15T21:02:53.291 INFO:tasks.workunit.client.0.smithi072.stdout:5/672: dread d0/d3/d33/d60/d81/daf/f82 [0,4194304] 0 2024-04-15T21:02:53.291 INFO:tasks.workunit.client.0.smithi072.stdout:6/636: rename c0 to d2/d40/d66/da8/cbf 0 2024-04-15T21:02:53.293 INFO:tasks.workunit.client.0.smithi072.stdout:8/686: symlink d3/de/d1b/d41/d74/d98/da5/ld6 0 2024-04-15T21:02:53.294 INFO:tasks.workunit.client.1.smithi149.stdout:5/803: write d0/d6/d82/da1/d12/f27 [3724877,118289] 0 2024-04-15T21:02:53.298 INFO:tasks.workunit.client.0.smithi072.stdout:6/637: rename d2/d40/d6e/lba to d2/d42/db9/lc0 0 2024-04-15T21:02:53.298 INFO:tasks.workunit.client.1.smithi149.stdout:9/776: write d23/d2b/d37/f4b [4336101,64839] 0 2024-04-15T21:02:53.298 INFO:tasks.workunit.client.1.smithi149.stdout:5/804: rmdir d0/d6/d82/da1/d12/d16/da9/d1b/d9c 39 2024-04-15T21:02:53.300 INFO:tasks.workunit.client.1.smithi149.stdout:5/805: read d0/d6/d82/da1/f7f [265858,56965] 0 2024-04-15T21:02:53.301 INFO:tasks.workunit.client.0.smithi072.stdout:5/673: fsync d0/d3/d7/f3c 0 2024-04-15T21:02:53.306 INFO:tasks.workunit.client.0.smithi072.stdout:8/687: rename d3/de/d1b/f57 to d3/de/d94/fd7 0 2024-04-15T21:02:53.310 INFO:tasks.workunit.client.0.smithi072.stdout:4/656: getdents d7/d15/d58 0 2024-04-15T21:02:53.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/657: dread d7/d10/f85 [0,4194304] 0 2024-04-15T21:02:53.315 INFO:tasks.workunit.client.0.smithi072.stdout:8/688: rename d3/l70 to d3/de/d1b/d41/d74/d98/ld8 0 2024-04-15T21:02:53.320 INFO:tasks.workunit.client.0.smithi072.stdout:2/669: write d2/d3/f46 [1111308,40584] 0 2024-04-15T21:02:53.320 INFO:tasks.workunit.client.0.smithi072.stdout:5/674: link d0/d3/c9b d0/d3/d7/d12/d1d/d8c/ce8 0 2024-04-15T21:02:53.323 INFO:tasks.workunit.client.0.smithi072.stdout:2/670: rmdir d2/d8/d8e/d90 39 2024-04-15T21:02:53.324 INFO:tasks.workunit.client.0.smithi072.stdout:1/652: write d5/db/d27/f62 [131739,43635] 0 2024-04-15T21:02:53.324 INFO:tasks.workunit.client.0.smithi072.stdout:5/675: symlink d0/d3/d33/le9 0 2024-04-15T21:02:53.327 INFO:tasks.workunit.client.0.smithi072.stdout:2/671: rename d2/d38/d73/f7a to d2/d66/d96/fda 0 2024-04-15T21:02:53.328 INFO:tasks.workunit.client.0.smithi072.stdout:2/672: stat d2/d8/fe 0 2024-04-15T21:02:53.329 INFO:tasks.workunit.client.0.smithi072.stdout:4/658: dread d7/f4f [0,4194304] 0 2024-04-15T21:02:53.330 INFO:tasks.workunit.client.0.smithi072.stdout:5/676: rename d0/d3/d33/d60/f8b to d0/d3/d7/d1f/d4c/fea 0 2024-04-15T21:02:53.330 INFO:tasks.workunit.client.0.smithi072.stdout:4/659: read d7/d10/d41/d45/f8a [450332,29207] 0 2024-04-15T21:02:53.331 INFO:tasks.workunit.client.0.smithi072.stdout:3/640: truncate d1/d5b/f84 552739 0 2024-04-15T21:02:53.331 INFO:tasks.workunit.client.0.smithi072.stdout:5/677: readlink d0/d3/d7/d94/d92/da0/da7/lb0 0 2024-04-15T21:02:53.332 INFO:tasks.workunit.client.0.smithi072.stdout:2/673: write d2/d38/f48 [3387285,5807] 0 2024-04-15T21:02:53.336 INFO:tasks.workunit.client.1.smithi149.stdout:4/907: dwrite dc/d2c/d3e/d15/d5b/fc5 [0,4194304] 0 2024-04-15T21:02:53.337 INFO:tasks.workunit.client.0.smithi072.stdout:0/673: write d0/d6/f41 [1832378,41078] 0 2024-04-15T21:02:53.342 INFO:tasks.workunit.client.0.smithi072.stdout:4/660: creat d7/d10/d41/dcf/fd9 x:0 0 0 2024-04-15T21:02:53.342 INFO:tasks.workunit.client.0.smithi072.stdout:4/661: stat d7 0 2024-04-15T21:02:53.344 INFO:tasks.workunit.client.0.smithi072.stdout:5/678: stat d0/d3/c9b 0 2024-04-15T21:02:53.344 INFO:tasks.workunit.client.0.smithi072.stdout:5/679: chown d0/d3/d7/d12/f51 27443 1 2024-04-15T21:02:53.345 INFO:tasks.workunit.client.0.smithi072.stdout:5/680: readlink d0/d3/ld8 0 2024-04-15T21:02:53.346 INFO:tasks.workunit.client.0.smithi072.stdout:2/674: rename d2/d38/l65 to d2/d64/ldb 0 2024-04-15T21:02:53.348 INFO:tasks.workunit.client.0.smithi072.stdout:0/674: creat d0/d19/d2b/d63/fe9 x:0 0 0 2024-04-15T21:02:53.348 INFO:tasks.workunit.client.0.smithi072.stdout:9/656: sync 2024-04-15T21:02:53.353 INFO:tasks.workunit.client.0.smithi072.stdout:0/675: dwrite d0/d45/d7a/fbd [0,4194304] 0 2024-04-15T21:02:53.355 INFO:tasks.workunit.client.1.smithi149.stdout:8/941: getdents d2/d5b/dcd/d10a/d25/d57/dd1/d50/dff 0 2024-04-15T21:02:53.356 INFO:tasks.workunit.client.1.smithi149.stdout:8/942: stat d2/d16/cc9 0 2024-04-15T21:02:53.357 INFO:tasks.workunit.client.1.smithi149.stdout:8/943: fdatasync d2/d5b/dcd/d10a/d25/d57/f80 0 2024-04-15T21:02:53.361 INFO:tasks.workunit.client.1.smithi149.stdout:0/974: truncate d1/d29/d2c/f14b 166219 0 2024-04-15T21:02:53.362 INFO:tasks.workunit.client.0.smithi072.stdout:7/648: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 [5074616,99809] 0 2024-04-15T21:02:53.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/975: mkdir d1/d9/d12f/d158 0 2024-04-15T21:02:53.367 INFO:tasks.workunit.client.0.smithi072.stdout:9/657: creat d4/d1f/d31/d9b/dca/fce x:0 0 0 2024-04-15T21:02:53.369 INFO:tasks.workunit.client.1.smithi149.stdout:0/976: creat d1/d5/d24/d100/f159 x:0 0 0 2024-04-15T21:02:53.369 INFO:tasks.workunit.client.1.smithi149.stdout:9/777: write d23/d2b/d37/d50/d69/fdc [708581,26318] 0 2024-04-15T21:02:53.370 INFO:tasks.workunit.client.1.smithi149.stdout:8/944: creat d2/d5b/dcd/d10a/d25/d57/dd1/f151 x:0 0 0 2024-04-15T21:02:53.374 INFO:tasks.workunit.client.0.smithi072.stdout:2/675: creat d2/d66/fdc x:0 0 0 2024-04-15T21:02:53.377 INFO:tasks.workunit.client.1.smithi149.stdout:5/806: dwrite d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:53.377 INFO:tasks.workunit.client.1.smithi149.stdout:8/945: creat d2/d5b/dcd/d10a/d25/d57/dd1/d50/f152 x:0 0 0 2024-04-15T21:02:53.378 INFO:tasks.workunit.client.0.smithi072.stdout:6/638: dwrite d2/d40/f86 [0,4194304] 0 2024-04-15T21:02:53.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/778: dread f21 [0,4194304] 0 2024-04-15T21:02:53.379 INFO:tasks.workunit.client.0.smithi072.stdout:7/649: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc 0 2024-04-15T21:02:53.385 INFO:tasks.workunit.client.1.smithi149.stdout:8/946: creat d2/d5b/dd6/f153 x:0 0 0 2024-04-15T21:02:53.386 INFO:tasks.workunit.client.0.smithi072.stdout:8/689: truncate d3/de/d1b/f43 881162 0 2024-04-15T21:02:53.395 INFO:tasks.workunit.client.0.smithi072.stdout:1/653: dwrite d5/db/d2d/d3a/d1f/f79 [0,4194304] 0 2024-04-15T21:02:53.395 INFO:tasks.workunit.client.0.smithi072.stdout:6/639: mkdir d2/d40/d56/d6a/d70/dc1 0 2024-04-15T21:02:53.395 INFO:tasks.workunit.client.1.smithi149.stdout:5/807: dread d0/d6/d82/da1/d12/f64 [0,4194304] 0 2024-04-15T21:02:53.400 INFO:tasks.workunit.client.1.smithi149.stdout:4/908: write dc/fa2 [991035,81777] 0 2024-04-15T21:02:53.402 INFO:tasks.workunit.client.1.smithi149.stdout:9/779: rename f17 to d23/d3c/d7a/da5/dbd/f106 0 2024-04-15T21:02:53.403 INFO:tasks.workunit.client.0.smithi072.stdout:8/690: mkdir d3/dd9 0 2024-04-15T21:02:53.404 INFO:tasks.workunit.client.0.smithi072.stdout:8/691: fdatasync d3/ff 0 2024-04-15T21:02:53.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/977: getdents d1/d9/d64/df0 0 2024-04-15T21:02:53.407 INFO:tasks.workunit.client.0.smithi072.stdout:3/641: dwrite d1/d15/f3e [0,4194304] 0 2024-04-15T21:02:53.409 INFO:tasks.workunit.client.0.smithi072.stdout:9/658: creat d4/d29/d4c/fcf x:0 0 0 2024-04-15T21:02:53.410 INFO:tasks.workunit.client.0.smithi072.stdout:4/662: write d7/d10/f11 [1131272,3482] 0 2024-04-15T21:02:53.414 INFO:tasks.workunit.client.0.smithi072.stdout:6/640: mknod d2/d40/d66/cc2 0 2024-04-15T21:02:53.415 INFO:tasks.workunit.client.0.smithi072.stdout:6/641: read - d2/d10/faf zero size 2024-04-15T21:02:53.415 INFO:tasks.workunit.client.0.smithi072.stdout:5/681: dwrite d0/d3/d33/d60/d81/daf/f82 [0,4194304] 0 2024-04-15T21:02:53.418 INFO:tasks.workunit.client.0.smithi072.stdout:0/676: write d0/d6/d6d/f83 [80399,103871] 0 2024-04-15T21:02:53.419 INFO:tasks.workunit.client.1.smithi149.stdout:4/909: mkdir dc/d2c/d3e/d15/d3f/d117/d6c/d12b 0 2024-04-15T21:02:53.421 INFO:tasks.workunit.client.0.smithi072.stdout:7/650: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/fcd x:0 0 0 2024-04-15T21:02:53.422 INFO:tasks.workunit.client.1.smithi149.stdout:9/780: chown d23/d2b/l31 455627831 1 2024-04-15T21:02:53.426 INFO:tasks.workunit.client.1.smithi149.stdout:0/978: truncate d1/d9/d64/d73/ff4 488302 0 2024-04-15T21:02:53.429 INFO:tasks.workunit.client.0.smithi072.stdout:8/692: rename d3/de/d94 to d3/d7e/dda 0 2024-04-15T21:02:53.435 INFO:tasks.workunit.client.0.smithi072.stdout:9/659: read d4/d1f/d2c/f2d [4317520,102882] 0 2024-04-15T21:02:53.436 INFO:tasks.workunit.client.0.smithi072.stdout:4/663: fdatasync d7/d28/f49 0 2024-04-15T21:02:53.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/654: truncate d5/f8 2580085 0 2024-04-15T21:02:53.441 INFO:tasks.workunit.client.1.smithi149.stdout:5/808: creat d0/d6/d82/da1/d12/d16/da9/f100 x:0 0 0 2024-04-15T21:02:53.443 INFO:tasks.workunit.client.1.smithi149.stdout:4/910: creat dc/d18/d21/d10e/d125/f12c x:0 0 0 2024-04-15T21:02:53.447 INFO:tasks.workunit.client.1.smithi149.stdout:5/809: chown d0/d6/d82/da1/d12/d16/da9/d1b/ccc 1902 1 2024-04-15T21:02:53.448 INFO:tasks.workunit.client.1.smithi149.stdout:8/947: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/f96 [0,4194304] 0 2024-04-15T21:02:53.452 INFO:tasks.workunit.client.1.smithi149.stdout:4/911: mkdir dc/d1a/d12d 0 2024-04-15T21:02:53.453 INFO:tasks.workunit.client.0.smithi072.stdout:7/651: dread d2/d7/d25/d2d/d47/f4a [0,4194304] 0 2024-04-15T21:02:53.458 INFO:tasks.workunit.client.1.smithi149.stdout:5/810: dwrite d0/d6/d82/da1/f2e [0,4194304] 0 2024-04-15T21:02:53.459 INFO:tasks.workunit.client.0.smithi072.stdout:3/642: write d1/d26/fab [215792,53682] 0 2024-04-15T21:02:53.460 INFO:tasks.workunit.client.0.smithi072.stdout:8/693: mkdir d3/ddb 0 2024-04-15T21:02:53.464 INFO:tasks.workunit.client.1.smithi149.stdout:0/979: write d1/d29/d2c/d4f/d95/f125 [970403,122837] 0 2024-04-15T21:02:53.467 INFO:tasks.workunit.client.1.smithi149.stdout:5/811: rename d0/d6/d2d/ffd to d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8/f101 0 2024-04-15T21:02:53.470 INFO:tasks.workunit.client.0.smithi072.stdout:4/664: truncate d7/d10/d41/d4c/f9c 175704 0 2024-04-15T21:02:53.472 INFO:tasks.workunit.client.1.smithi149.stdout:0/980: creat d1/d5/d24/d50/de2/d11e/f15a x:0 0 0 2024-04-15T21:02:53.473 INFO:tasks.workunit.client.0.smithi072.stdout:0/677: write d0/d6/f39 [701094,80053] 0 2024-04-15T21:02:53.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/812: dwrite d0/d6/fe [0,4194304] 0 2024-04-15T21:02:53.475 INFO:tasks.workunit.client.0.smithi072.stdout:5/682: creat d0/d3/d7/d94/de1/feb x:0 0 0 2024-04-15T21:02:53.479 INFO:tasks.workunit.client.1.smithi149.stdout:0/981: symlink d1/d9/d64/d65/l15b 0 2024-04-15T21:02:53.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/813: mkdir d0/d6/d82/da1/d12/d16/da9/d1b/d83/d102 0 2024-04-15T21:02:53.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/814: write d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8/fe4 [135289,300] 0 2024-04-15T21:02:53.485 INFO:tasks.workunit.client.1.smithi149.stdout:0/982: creat d1/d5/d24/d50/d13/d38/f15c x:0 0 0 2024-04-15T21:02:53.486 INFO:tasks.workunit.client.0.smithi072.stdout:7/652: truncate d2/d7/f9a 936490 0 2024-04-15T21:02:53.487 INFO:tasks.workunit.client.0.smithi072.stdout:2/676: link d2/d38/l4b d2/d8/d8e/ldd 0 2024-04-15T21:02:53.489 INFO:tasks.workunit.client.0.smithi072.stdout:3/643: creat d1/d15/d40/d9e/fc6 x:0 0 0 2024-04-15T21:02:53.489 INFO:tasks.workunit.client.1.smithi149.stdout:8/948: dwrite d2/d5b/dcd/d10a/d25/f33 [0,4194304] 0 2024-04-15T21:02:53.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/815: mkdir d0/d6/dc8/d103 0 2024-04-15T21:02:53.492 INFO:tasks.workunit.client.0.smithi072.stdout:6/642: truncate d2/d40/d56/d6a/d70/f44 2196047 0 2024-04-15T21:02:53.501 INFO:tasks.workunit.client.0.smithi072.stdout:4/665: creat d7/d10/d41/d44/d7a/fda x:0 0 0 2024-04-15T21:02:53.503 INFO:tasks.workunit.client.1.smithi149.stdout:8/949: creat d2/d5b/dcd/d10a/d25/d57/dd1/d50/d5d/d6d/d128/f154 x:0 0 0 2024-04-15T21:02:53.506 INFO:tasks.workunit.client.1.smithi149.stdout:5/816: creat d0/d6/d82/da1/d12/d16/da9/f104 x:0 0 0 2024-04-15T21:02:53.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/983: write d1/d5/d24/d50/d13/d38/d44/d61/f154 [1399705,107247] 0 2024-04-15T21:02:53.508 INFO:tasks.workunit.client.0.smithi072.stdout:0/678: stat d0/d45/d35/d3a/f6c 0 2024-04-15T21:02:53.508 INFO:tasks.workunit.client.0.smithi072.stdout:8/694: write d3/de/d1b/f93 [5633744,10901] 0 2024-04-15T21:02:53.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/679: dread - d0/d19/d96/fc6 zero size 2024-04-15T21:02:53.511 INFO:tasks.workunit.client.0.smithi072.stdout:1/655: write d5/d31/d51/d82/f92 [318038,90324] 0 2024-04-15T21:02:53.511 INFO:tasks.workunit.client.1.smithi149.stdout:0/984: truncate d1/d9/f35 3098749 0 2024-04-15T21:02:53.514 INFO:tasks.workunit.client.1.smithi149.stdout:1/758: sync 2024-04-15T21:02:53.515 INFO:tasks.workunit.client.0.smithi072.stdout:3/644: rename d1/d15/d32/d78/d99 to d1/d15/d40/d9e/dc7 0 2024-04-15T21:02:53.516 INFO:tasks.workunit.client.1.smithi149.stdout:1/759: chown d1/db/dc/l1b 19848220 1 2024-04-15T21:02:53.516 INFO:tasks.workunit.client.0.smithi072.stdout:6/643: unlink d2/d10/d11/d1f/d60/d63/c8e 0 2024-04-15T21:02:53.518 INFO:tasks.workunit.client.1.smithi149.stdout:1/760: fdatasync d1/db/dc/d11/d3e/fba 0 2024-04-15T21:02:53.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/950: dread d2/d5b/dcd/d10a/f14 [0,4194304] 0 2024-04-15T21:02:53.521 INFO:tasks.workunit.client.1.smithi149.stdout:8/951: readlink d2/d5b/dcd/d10a/d20/d6b/l7d 0 2024-04-15T21:02:53.524 INFO:tasks.workunit.client.1.smithi149.stdout:1/761: creat d1/db/dc/d38/d39/d8c/fdb x:0 0 0 2024-04-15T21:02:53.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/762: fsync d1/d17/d36/d6f/fb0 0 2024-04-15T21:02:53.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/763: write d1/db/dc/d38/d39/d43/f1f [2939130,96418] 0 2024-04-15T21:02:53.528 INFO:tasks.workunit.client.1.smithi149.stdout:5/817: dread d0/d6/d82/da1/d12/d2b/f9e [0,4194304] 0 2024-04-15T21:02:53.530 INFO:tasks.workunit.client.1.smithi149.stdout:8/952: mknod d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/d9d/c155 0 2024-04-15T21:02:53.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/660: truncate d4/d29/d45/fa1 2341622 0 2024-04-15T21:02:53.536 INFO:tasks.workunit.client.0.smithi072.stdout:3/645: mknod d1/d5b/cc8 0 2024-04-15T21:02:53.537 INFO:tasks.workunit.client.0.smithi072.stdout:3/646: fdatasync d1/d15/d40/d9e/dc7/fb4 0 2024-04-15T21:02:53.537 INFO:tasks.workunit.client.1.smithi149.stdout:5/818: rmdir d0/d9/d6c 39 2024-04-15T21:02:53.539 INFO:tasks.workunit.client.0.smithi072.stdout:6/644: dread d2/d10/d18/f26 [0,4194304] 0 2024-04-15T21:02:53.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/645: write d2/d10/d11/d1f/f28 [4649170,105568] 0 2024-04-15T21:02:53.541 INFO:tasks.workunit.client.0.smithi072.stdout:0/680: write d0/d19/f4a [2467552,80861] 0 2024-04-15T21:02:53.542 INFO:tasks.workunit.client.0.smithi072.stdout:7/653: dread d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:53.544 INFO:tasks.workunit.client.0.smithi072.stdout:5/683: creat d0/d3/d7/d12/fec x:0 0 0 2024-04-15T21:02:53.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/985: link d1/d5/c9b d1/d5/d24/d50/c15d 0 2024-04-15T21:02:53.546 INFO:tasks.workunit.client.0.smithi072.stdout:9/661: mknod d4/d1f/d31/d42/cd0 0 2024-04-15T21:02:53.552 INFO:tasks.workunit.client.0.smithi072.stdout:8/695: rename d3/d4/fbd to d3/d4/d76/d8f/fdc 0 2024-04-15T21:02:53.553 INFO:tasks.workunit.client.1.smithi149.stdout:8/953: creat d2/d5b/dcd/d10a/d25/d32/d45/d77/f156 x:0 0 0 2024-04-15T21:02:53.554 INFO:tasks.workunit.client.0.smithi072.stdout:4/666: dwrite d7/d10/d41/d44/d7a/fa6 [0,4194304] 0 2024-04-15T21:02:53.555 INFO:tasks.workunit.client.1.smithi149.stdout:0/986: symlink d1/d5/dda/l15e 0 2024-04-15T21:02:53.557 INFO:tasks.workunit.client.0.smithi072.stdout:3/647: creat d1/d5b/fc9 x:0 0 0 2024-04-15T21:02:53.558 INFO:tasks.workunit.client.1.smithi149.stdout:1/764: truncate d1/db/dc/d11/f9b 3145793 0 2024-04-15T21:02:53.559 INFO:tasks.workunit.client.0.smithi072.stdout:5/684: dread d0/d3/d7/d12/d31/d55/d58/f66 [0,4194304] 0 2024-04-15T21:02:53.561 INFO:tasks.workunit.client.1.smithi149.stdout:8/954: dread - d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f13d zero size 2024-04-15T21:02:53.561 INFO:tasks.workunit.client.0.smithi072.stdout:5/685: write d0/d3/d7/d1f/d4c/fbf [4177326,8128] 0 2024-04-15T21:02:53.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/819: dwrite d0/d9/d3f/d47/f7a [0,4194304] 0 2024-04-15T21:02:53.565 INFO:tasks.workunit.client.0.smithi072.stdout:7/654: fsync d2/d7/d25/d2d/d46/d5a/d5f/d43/f53 0 2024-04-15T21:02:53.566 INFO:tasks.workunit.client.0.smithi072.stdout:7/655: fsync d2/d7/d25/d72/f92 0 2024-04-15T21:02:53.567 INFO:tasks.workunit.client.0.smithi072.stdout:7/656: dread - d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab zero size 2024-04-15T21:02:53.568 INFO:tasks.workunit.client.0.smithi072.stdout:9/662: rmdir d4/d1f/d31/d9b 39 2024-04-15T21:02:53.568 INFO:tasks.workunit.client.0.smithi072.stdout:9/663: chown d4/d29/d4c/d91 8990 1 2024-04-15T21:02:53.569 INFO:tasks.workunit.client.1.smithi149.stdout:1/765: creat d1/d17/fdc x:0 0 0 2024-04-15T21:02:53.572 INFO:tasks.workunit.client.1.smithi149.stdout:5/820: rename d0/d6/d82/da1/d12/d16/da9/d1b/d83/l86 to d0/d6/d82/da1/d12/d16/da9/d9b/db7/dfb/l105 0 2024-04-15T21:02:53.575 INFO:tasks.workunit.client.0.smithi072.stdout:2/677: rename d2/d37/dc2 to d2/d8/d41/dde 0 2024-04-15T21:02:53.577 INFO:tasks.workunit.client.0.smithi072.stdout:2/678: write d2/d38/d73/f7d [2290988,90979] 0 2024-04-15T21:02:53.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/987: dwrite d1/d9/d64/d65/d104/d119/d92/ff5 [0,4194304] 0 2024-04-15T21:02:53.583 INFO:tasks.workunit.client.0.smithi072.stdout:6/646: mkdir d2/d40/dc3 0 2024-04-15T21:02:53.585 INFO:tasks.workunit.client.1.smithi149.stdout:5/821: symlink d0/d9/d6c/db4/dd1/l106 0 2024-04-15T21:02:53.589 INFO:tasks.workunit.client.1.smithi149.stdout:8/955: dwrite d2/d5b/dcd/d10a/d25/d37/d53/daf/db4/fbe [0,4194304] 0 2024-04-15T21:02:53.591 INFO:tasks.workunit.client.1.smithi149.stdout:1/766: rename d1/db/f2b to d1/fdd 0 2024-04-15T21:02:53.595 INFO:tasks.workunit.client.0.smithi072.stdout:0/681: link d0/d19/d2b/d63/fe2 d0/fea 0 2024-04-15T21:02:53.596 INFO:tasks.workunit.client.1.smithi149.stdout:5/822: dread d0/d6/d82/da1/d12/d16/da9/d1b/d61/fe9 [0,4194304] 0 2024-04-15T21:02:53.596 INFO:tasks.workunit.client.0.smithi072.stdout:0/682: chown d0/d45/d35/d3a/c49 38702523 1 2024-04-15T21:02:53.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/823: stat d0/d6/d82/da1/d12/d16/da9/d1b/d60 0 2024-04-15T21:02:53.600 INFO:tasks.workunit.client.1.smithi149.stdout:0/988: symlink d1/d9/d64/d65/d104/d119/df7/l15f 0 2024-04-15T21:02:53.601 INFO:tasks.workunit.client.1.smithi149.stdout:0/989: readlink d1/d9/d64/le5 0 2024-04-15T21:02:53.605 INFO:tasks.workunit.client.1.smithi149.stdout:0/990: dread d1/d29/d2c/d4f/d95/f125 [0,4194304] 0 2024-04-15T21:02:53.606 INFO:tasks.workunit.client.0.smithi072.stdout:7/657: mkdir d2/d7/d25/d81/dce 0 2024-04-15T21:02:53.607 INFO:tasks.workunit.client.1.smithi149.stdout:5/824: dread - d0/d9/d3f/fc1 zero size 2024-04-15T21:02:53.609 INFO:tasks.workunit.client.0.smithi072.stdout:1/656: getdents d5 0 2024-04-15T21:02:53.609 INFO:tasks.workunit.client.0.smithi072.stdout:7/658: fdatasync d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab 0 2024-04-15T21:02:53.610 INFO:tasks.workunit.client.0.smithi072.stdout:5/686: dwrite d0/f59 [4194304,4194304] 0 2024-04-15T21:02:53.613 INFO:tasks.workunit.client.1.smithi149.stdout:8/956: mkdir d2/d5b/df4/d157 0 2024-04-15T21:02:53.614 INFO:tasks.workunit.client.0.smithi072.stdout:4/667: symlink d7/d23/d6c/daf/ldb 0 2024-04-15T21:02:53.614 INFO:tasks.workunit.client.1.smithi149.stdout:5/825: dwrite d0/d6/d82/da1/d12/d16/da9/f104 [0,4194304] 0 2024-04-15T21:02:53.615 INFO:tasks.workunit.client.1.smithi149.stdout:1/767: symlink d1/d17/lde 0 2024-04-15T21:02:53.617 INFO:tasks.workunit.client.1.smithi149.stdout:1/768: chown d1/db/dc/d11/d3f/d45/dae/fd6 68820730 1 2024-04-15T21:02:53.618 INFO:tasks.workunit.client.0.smithi072.stdout:2/679: write d2/d3/fb2 [288962,50363] 0 2024-04-15T21:02:53.619 INFO:tasks.workunit.client.1.smithi149.stdout:1/769: chown d1/db/dc/lb2 4824 1 2024-04-15T21:02:53.621 INFO:tasks.workunit.client.1.smithi149.stdout:1/770: write d1/db/d14/d6b/fbf [945216,19337] 0 2024-04-15T21:02:53.622 INFO:tasks.workunit.client.1.smithi149.stdout:1/771: stat d1/d17/d36/l91 0 2024-04-15T21:02:53.624 INFO:tasks.workunit.client.0.smithi072.stdout:2/680: dwrite d2/f12 [4194304,4194304] 0 2024-04-15T21:02:53.625 INFO:tasks.workunit.client.1.smithi149.stdout:1/772: chown d1/db/dc/d11/c59 16427297 1 2024-04-15T21:02:53.627 INFO:tasks.workunit.client.1.smithi149.stdout:0/991: mkdir d1/d5/d24/d50/d13/d38/d44/d160 0 2024-04-15T21:02:53.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/826: truncate d0/d6/d82/da1/d12/d16/da9/d1b/d83/f90 483345 0 2024-04-15T21:02:53.633 INFO:tasks.workunit.client.0.smithi072.stdout:2/681: dwrite d2/d8/f36 [4194304,4194304] 0 2024-04-15T21:02:53.634 INFO:tasks.workunit.client.0.smithi072.stdout:9/664: symlink d4/d1f/db7/ld1 0 2024-04-15T21:02:53.634 INFO:tasks.workunit.client.1.smithi149.stdout:1/773: symlink d1/db/d16/ldf 0 2024-04-15T21:02:53.634 INFO:tasks.workunit.client.1.smithi149.stdout:1/774: chown d1/d17 149631206 1 2024-04-15T21:02:53.635 INFO:tasks.workunit.client.0.smithi072.stdout:2/682: stat d2/d64/lab 0 2024-04-15T21:02:53.635 INFO:tasks.workunit.client.0.smithi072.stdout:7/659: unlink d2/d7/d25/d81/c83 0 2024-04-15T21:02:53.636 INFO:tasks.workunit.client.1.smithi149.stdout:0/992: unlink d1/d5/d24/d50/d13/d59/dd7/f87 0 2024-04-15T21:02:53.637 INFO:tasks.workunit.client.1.smithi149.stdout:8/957: mknod d2/d5b/df4/d157/c158 0 2024-04-15T21:02:53.638 INFO:tasks.workunit.client.0.smithi072.stdout:8/696: link d3/de/d1b/d41/dae/dc0/cca d3/d7e/cdd 0 2024-04-15T21:02:53.640 INFO:tasks.workunit.client.1.smithi149.stdout:5/827: truncate d0/d6/d82/da1/d12/d16/f54 273112 0 2024-04-15T21:02:53.641 INFO:tasks.workunit.client.0.smithi072.stdout:5/687: fsync d0/d3/d7/d94/d92/da0/da7/fbd 0 2024-04-15T21:02:53.642 INFO:tasks.workunit.client.0.smithi072.stdout:5/688: truncate d0/d3/d7/d12/fda 54060 0 2024-04-15T21:02:53.644 INFO:tasks.workunit.client.0.smithi072.stdout:4/668: readlink d7/d23/d6c/l39 0 2024-04-15T21:02:53.644 INFO:tasks.workunit.client.0.smithi072.stdout:4/669: chown d7/d15/d58/d62/d6f/lb5 41 1 2024-04-15T21:02:53.650 INFO:tasks.workunit.client.0.smithi072.stdout:3/648: creat d1/d3f/d7f/fca x:0 0 0 2024-04-15T21:02:53.651 INFO:tasks.workunit.client.1.smithi149.stdout:8/958: rename d2/d5b/dcd/d10a/d25/d57/dd1/df3/l112 to d2/d5b/dcd/d10a/d4e/d9f/dd8/l159 0 2024-04-15T21:02:53.653 INFO:tasks.workunit.client.0.smithi072.stdout:9/665: mkdir d4/d1f/d31/d4d/dbf/dd2 0 2024-04-15T21:02:53.656 INFO:tasks.workunit.client.0.smithi072.stdout:1/657: mkdir d5/db/d2d/d3a/dc3/dd3 0 2024-04-15T21:02:53.656 INFO:tasks.workunit.client.0.smithi072.stdout:8/697: dread - d3/de/d1b/d41/da4/d2e/f9d zero size 2024-04-15T21:02:53.656 INFO:tasks.workunit.client.1.smithi149.stdout:8/959: symlink d2/d5b/dcd/d10a/d25/d32/d45/l15a 0 2024-04-15T21:02:53.657 INFO:tasks.workunit.client.0.smithi072.stdout:8/698: readlink d3/de/d1b/d41/dae/dc0/lc5 0 2024-04-15T21:02:53.659 INFO:tasks.workunit.client.0.smithi072.stdout:4/670: mknod d7/d15/d58/cdc 0 2024-04-15T21:02:53.662 INFO:tasks.workunit.client.1.smithi149.stdout:8/960: creat d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f15b x:0 0 0 2024-04-15T21:02:53.665 INFO:tasks.workunit.client.0.smithi072.stdout:0/683: rename d0/d19/d2b/d63/f7c to d0/d6/feb 0 2024-04-15T21:02:53.666 INFO:tasks.workunit.client.0.smithi072.stdout:0/684: write d0/d19/fc4 [2039426,71943] 0 2024-04-15T21:02:53.668 INFO:tasks.workunit.client.1.smithi149.stdout:8/961: mknod d2/d5b/dcd/d10a/d25/d57/dd1/c15c 0 2024-04-15T21:02:53.671 INFO:tasks.workunit.client.1.smithi149.stdout:0/993: dread d1/d5/f7d [0,4194304] 0 2024-04-15T21:02:53.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/994: readlink d1/d5/d24/l1d 0 2024-04-15T21:02:53.673 INFO:tasks.workunit.client.1.smithi149.stdout:8/962: write d2/d5b/dcd/d10a/d25/fbf [3526060,92782] 0 2024-04-15T21:02:53.673 INFO:tasks.workunit.client.1.smithi149.stdout:8/963: stat d2/d16/c5c 0 2024-04-15T21:02:53.674 INFO:tasks.workunit.client.0.smithi072.stdout:4/671: mkdir d7/d15/ddd 0 2024-04-15T21:02:53.675 INFO:tasks.workunit.client.1.smithi149.stdout:8/964: readlink d2/d5b/dcd/d10a/d25/d57/dd1/le6 0 2024-04-15T21:02:53.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/647: getdents d2/d40 0 2024-04-15T21:02:53.679 INFO:tasks.workunit.client.0.smithi072.stdout:3/649: fdatasync d1/d15/d32/f50 0 2024-04-15T21:02:53.679 INFO:tasks.workunit.client.0.smithi072.stdout:4/672: dread d7/d10/d41/d45/d93/fb8 [0,4194304] 0 2024-04-15T21:02:53.680 INFO:tasks.workunit.client.1.smithi149.stdout:8/965: creat d2/d5b/dcd/d10a/d20/d6b/f15d x:0 0 0 2024-04-15T21:02:53.681 INFO:tasks.workunit.client.0.smithi072.stdout:4/673: write d7/d10/f11 [912742,116862] 0 2024-04-15T21:02:53.681 INFO:tasks.workunit.client.1.smithi149.stdout:8/966: chown d2/d16/fec 790362 1 2024-04-15T21:02:53.681 INFO:tasks.workunit.client.1.smithi149.stdout:7/836: sync 2024-04-15T21:02:53.682 INFO:tasks.workunit.client.0.smithi072.stdout:5/689: rename d0/d3/d7/d12/d31/d55/f39 to d0/d3/d33/d60/d81/fed 0 2024-04-15T21:02:53.683 INFO:tasks.workunit.client.0.smithi072.stdout:4/674: dread d7/d10/d41/d44/d7a/fc0 [0,4194304] 0 2024-04-15T21:02:53.684 INFO:tasks.workunit.client.0.smithi072.stdout:9/666: mknod d4/cd3 0 2024-04-15T21:02:53.685 INFO:tasks.workunit.client.0.smithi072.stdout:4/675: read d7/d28/d42/da1/da2/fa5 [1441544,96482] 0 2024-04-15T21:02:53.685 INFO:tasks.workunit.client.1.smithi149.stdout:1/775: dwrite d1/db/dc/d11/fad [0,4194304] 0 2024-04-15T21:02:53.685 INFO:tasks.workunit.client.1.smithi149.stdout:5/828: write d0/d6/d82/da1/d12/f6e [399719,21304] 0 2024-04-15T21:02:53.689 INFO:tasks.workunit.client.0.smithi072.stdout:0/685: creat d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/fec x:0 0 0 2024-04-15T21:02:53.698 INFO:tasks.workunit.client.1.smithi149.stdout:7/837: getdents d3/d16/d111 0 2024-04-15T21:02:53.699 INFO:tasks.workunit.client.0.smithi072.stdout:6/648: dread d2/d40/d6e/f4e [4194304,4194304] 0 2024-04-15T21:02:53.699 INFO:tasks.workunit.client.0.smithi072.stdout:2/683: dwrite d2/d38/f56 [4194304,4194304] 0 2024-04-15T21:02:53.700 INFO:tasks.workunit.client.0.smithi072.stdout:2/684: stat d2/d3/d5f/f60 0 2024-04-15T21:02:53.702 INFO:tasks.workunit.client.0.smithi072.stdout:1/658: write d5/db/d2d/d3a/f2e [4922401,20677] 0 2024-04-15T21:02:53.706 INFO:tasks.workunit.client.0.smithi072.stdout:1/659: chown d5/db/d2d/d3a/d1f/f98 2045 1 2024-04-15T21:02:53.708 INFO:tasks.workunit.client.0.smithi072.stdout:5/690: write d0/d3/f83 [1083222,52373] 0 2024-04-15T21:02:53.709 INFO:tasks.workunit.client.0.smithi072.stdout:4/676: dread d7/d71/db2/fc5 [0,4194304] 0 2024-04-15T21:02:53.709 INFO:tasks.workunit.client.0.smithi072.stdout:0/686: dread d0/d19/d71/d9e/fb9 [0,4194304] 0 2024-04-15T21:02:53.713 INFO:tasks.workunit.client.0.smithi072.stdout:5/691: dread d0/d3/d33/d85/fa8 [0,4194304] 0 2024-04-15T21:02:53.714 INFO:tasks.workunit.client.0.smithi072.stdout:0/687: truncate d0/d19/d96/fc6 326563 0 2024-04-15T21:02:53.714 INFO:tasks.workunit.client.0.smithi072.stdout:8/699: dwrite d3/de/d1b/d41/da4/d2e/f9d [0,4194304] 0 2024-04-15T21:02:53.716 INFO:tasks.workunit.client.1.smithi149.stdout:1/776: write d1/f3 [4467323,63741] 0 2024-04-15T21:02:53.716 INFO:tasks.workunit.client.0.smithi072.stdout:9/667: dread d4/d1f/d31/f63 [0,4194304] 0 2024-04-15T21:02:53.717 INFO:tasks.workunit.client.0.smithi072.stdout:9/668: chown d4/d1f/d2c 276472 1 2024-04-15T21:02:53.718 INFO:tasks.workunit.client.1.smithi149.stdout:7/838: truncate d3/d16/d20/d60/fcd 1396848 0 2024-04-15T21:02:53.723 INFO:tasks.workunit.client.1.smithi149.stdout:1/777: mkdir d1/d17/d5e/de0 0 2024-04-15T21:02:53.725 INFO:tasks.workunit.client.0.smithi072.stdout:6/649: creat d2/d10/d11/d1f/d60/d63/fc4 x:0 0 0 2024-04-15T21:02:53.726 INFO:tasks.workunit.client.1.smithi149.stdout:8/967: write d2/d5b/dcd/d10a/d25/f4a [1361354,66351] 0 2024-04-15T21:02:53.726 INFO:tasks.workunit.client.0.smithi072.stdout:6/650: chown d2/d40/d56/f77 1 1 2024-04-15T21:02:53.726 INFO:tasks.workunit.client.0.smithi072.stdout:6/651: chown d2/d1a/c37 21 1 2024-04-15T21:02:53.728 INFO:tasks.workunit.client.0.smithi072.stdout:3/650: rename d1/d15/d32/l57 to d1/d3f/da2/lcb 0 2024-04-15T21:02:53.729 INFO:tasks.workunit.client.1.smithi149.stdout:5/829: write d0/f89 [1561897,57134] 0 2024-04-15T21:02:53.730 INFO:tasks.workunit.client.1.smithi149.stdout:5/830: chown d0/d6/d82/da1/d12/ff7 54 1 2024-04-15T21:02:53.731 INFO:tasks.workunit.client.1.smithi149.stdout:5/831: write d0/f3a [4750887,10781] 0 2024-04-15T21:02:53.734 INFO:tasks.workunit.client.1.smithi149.stdout:1/778: truncate d1/db/dc/d11/f9b 3845505 0 2024-04-15T21:02:53.735 INFO:tasks.workunit.client.1.smithi149.stdout:1/779: write d1/d17/fdc [324792,41789] 0 2024-04-15T21:02:53.735 INFO:tasks.workunit.client.0.smithi072.stdout:1/660: rmdir d5/db 39 2024-04-15T21:02:53.745 INFO:tasks.workunit.client.1.smithi149.stdout:5/832: creat d0/d6/d82/da1/d12/d16/da9/f107 x:0 0 0 2024-04-15T21:02:53.745 INFO:tasks.workunit.client.0.smithi072.stdout:5/692: dread d0/d3/d6/d14/f1b [0,4194304] 0 2024-04-15T21:02:53.747 INFO:tasks.workunit.client.1.smithi149.stdout:1/780: mkdir d1/db/d16/d86/de1 0 2024-04-15T21:02:53.747 INFO:tasks.workunit.client.0.smithi072.stdout:5/693: truncate d0/d3/d7/fb4 827700 0 2024-04-15T21:02:53.747 INFO:tasks.workunit.client.1.smithi149.stdout:7/839: dread d3/d17/f8a [0,4194304] 0 2024-04-15T21:02:53.749 INFO:tasks.workunit.client.1.smithi149.stdout:1/781: write d1/d17/d36/d6f/fb0 [1328048,5421] 0 2024-04-15T21:02:53.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/968: dread d2/d5b/dcd/d10a/d4e/d9f/fcc [0,4194304] 0 2024-04-15T21:02:53.752 INFO:tasks.workunit.client.0.smithi072.stdout:9/669: fdatasync d4/d1f/d2c/d62/f81 0 2024-04-15T21:02:53.753 INFO:tasks.workunit.client.0.smithi072.stdout:9/670: readlink d4/d1f/d9e/db3/lc1 0 2024-04-15T21:02:53.753 INFO:tasks.workunit.client.1.smithi149.stdout:5/833: creat d0/d6/d82/db0/ddc/f108 x:0 0 0 2024-04-15T21:02:53.758 INFO:tasks.workunit.client.0.smithi072.stdout:2/685: rename d2/d8/daa/ccd to d2/d3/d5f/dc8/cdf 0 2024-04-15T21:02:53.760 INFO:tasks.workunit.client.0.smithi072.stdout:3/651: dread - d1/d26/f47 zero size 2024-04-15T21:02:53.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/969: mknod d2/d5b/dcd/d10a/d25/d57/dd1/df3/c15e 0 2024-04-15T21:02:53.770 INFO:tasks.workunit.client.1.smithi149.stdout:5/834: mknod d0/d6/d82/da1/d12/d16/da9/d1b/d83/c109 0 2024-04-15T21:02:53.771 INFO:tasks.workunit.client.0.smithi072.stdout:8/700: unlink d3/de/d1b/d41/da4/l9f 0 2024-04-15T21:02:53.772 INFO:tasks.workunit.client.1.smithi149.stdout:7/840: dread d3/fb [0,4194304] 0 2024-04-15T21:02:53.773 INFO:tasks.workunit.client.0.smithi072.stdout:5/694: dread d0/d3/d7/d1f/f29 [0,4194304] 0 2024-04-15T21:02:53.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/782: dwrite d1/db/dc/fa4 [0,4194304] 0 2024-04-15T21:02:53.777 INFO:tasks.workunit.client.0.smithi072.stdout:9/671: unlink d4/d29/d4c/d74/fba 0 2024-04-15T21:02:53.788 INFO:tasks.workunit.client.0.smithi072.stdout:4/677: link d7/d10/d41/d45/c5b d7/d24/cde 0 2024-04-15T21:02:53.788 INFO:tasks.workunit.client.0.smithi072.stdout:6/652: truncate d2/d10/d11/d1f/f32 6840614 0 2024-04-15T21:02:53.789 INFO:tasks.workunit.client.0.smithi072.stdout:3/652: dread d1/d3f/f67 [0,4194304] 0 2024-04-15T21:02:53.790 INFO:tasks.workunit.client.0.smithi072.stdout:6/653: chown d2/d10/d11/d1f/f4c 247350 1 2024-04-15T21:02:53.792 INFO:tasks.workunit.client.0.smithi072.stdout:5/695: readlink d0/d3/d33/d60/d81/daf/lcc 0 2024-04-15T21:02:53.806 INFO:tasks.workunit.client.0.smithi072.stdout:0/688: getdents d0/d19/dcd 0 2024-04-15T21:02:53.807 INFO:tasks.workunit.client.0.smithi072.stdout:3/653: creat d1/d3f/d4f/da3/fcc x:0 0 0 2024-04-15T21:02:53.807 INFO:tasks.workunit.client.0.smithi072.stdout:6/654: mknod d2/d10/d11/d1f/d60/cc5 0 2024-04-15T21:02:53.813 INFO:tasks.workunit.client.0.smithi072.stdout:1/661: creat d5/fd4 x:0 0 0 2024-04-15T21:02:53.825 INFO:tasks.workunit.client.0.smithi072.stdout:3/654: creat d1/d15/d40/d9e/dc7/fcd x:0 0 0 2024-04-15T21:02:53.827 INFO:tasks.workunit.client.0.smithi072.stdout:3/655: chown d1/d15/d40/f1c 1936731 1 2024-04-15T21:02:53.828 INFO:tasks.workunit.client.0.smithi072.stdout:2/686: link d2/d66/f74 d2/d8/d8e/fe0 0 2024-04-15T21:02:53.829 INFO:tasks.workunit.client.0.smithi072.stdout:2/687: readlink d2/d8/d41/db8/lc7 0 2024-04-15T21:02:53.830 INFO:tasks.workunit.client.0.smithi072.stdout:8/701: dwrite d3/d4/d3b/f65 [4194304,4194304] 0 2024-04-15T21:02:53.831 INFO:tasks.workunit.client.0.smithi072.stdout:2/688: dread - d2/d66/fdc zero size 2024-04-15T21:02:53.832 INFO:tasks.workunit.client.0.smithi072.stdout:2/689: readlink d2/l4d 0 2024-04-15T21:02:53.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/912: sync 2024-04-15T21:02:53.834 INFO:tasks.workunit.client.1.smithi149.stdout:9/781: sync 2024-04-15T21:02:53.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/860: sync 2024-04-15T21:02:53.834 INFO:tasks.workunit.client.1.smithi149.stdout:2/909: sync 2024-04-15T21:02:53.834 INFO:tasks.workunit.client.1.smithi149.stdout:3/865: sync 2024-04-15T21:02:53.836 INFO:tasks.workunit.client.1.smithi149.stdout:9/782: chown d23/d2b/d37/cfe 2758838 1 2024-04-15T21:02:53.836 INFO:tasks.workunit.client.0.smithi072.stdout:9/672: dwrite d4/f6a [0,4194304] 0 2024-04-15T21:02:53.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/673: readlink d4/l41 0 2024-04-15T21:02:53.839 INFO:tasks.workunit.client.1.smithi149.stdout:9/783: truncate d23/d2b/d37/d50/fa2 8975903 0 2024-04-15T21:02:53.842 INFO:tasks.workunit.client.0.smithi072.stdout:2/690: dwrite d2/f12 [4194304,4194304] 0 2024-04-15T21:02:53.843 INFO:tasks.workunit.client.0.smithi072.stdout:8/702: dwrite d3/de/d1b/d85/fad [0,4194304] 0 2024-04-15T21:02:53.843 INFO:tasks.workunit.client.1.smithi149.stdout:3/866: dread d1/db/f52 [0,4194304] 0 2024-04-15T21:02:53.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/678: truncate d7/d28/d42/f75 1332847 0 2024-04-15T21:02:53.853 INFO:tasks.workunit.client.0.smithi072.stdout:9/674: mknod d4/d29/d4c/d91/d93/cd4 0 2024-04-15T21:02:53.856 INFO:tasks.workunit.client.0.smithi072.stdout:8/703: mkdir d3/d4/d76/dde 0 2024-04-15T21:02:53.859 INFO:tasks.workunit.client.0.smithi072.stdout:0/689: getdents d0/d45/d7a/d70/d59/d8a/d8b 0 2024-04-15T21:02:53.860 INFO:tasks.workunit.client.1.smithi149.stdout:8/970: fdatasync d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/f43 0 2024-04-15T21:02:53.862 INFO:tasks.workunit.client.0.smithi072.stdout:5/696: dwrite d0/d3/d7/d12/d31/d62/d8e/f9e [0,4194304] 0 2024-04-15T21:02:53.863 INFO:tasks.workunit.client.1.smithi149.stdout:1/783: readlink d1/db/d14/l61 0 2024-04-15T21:02:53.863 INFO:tasks.workunit.client.0.smithi072.stdout:3/656: creat d1/fce x:0 0 0 2024-04-15T21:02:53.866 INFO:tasks.workunit.client.0.smithi072.stdout:8/704: write d3/de/d1b/d41/dae/dc0/fce [129722,54431] 0 2024-04-15T21:02:53.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/913: creat dc/d2c/f12e x:0 0 0 2024-04-15T21:02:53.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/861: mknod da/d18/d10/c112 0 2024-04-15T21:02:53.868 INFO:tasks.workunit.client.1.smithi149.stdout:0/995: sync 2024-04-15T21:02:53.869 INFO:tasks.workunit.client.0.smithi072.stdout:6/655: dwrite d2/d1a/f1b [0,4194304] 0 2024-04-15T21:02:53.870 INFO:tasks.workunit.client.0.smithi072.stdout:9/675: write d4/d1f/d31/d9b/dca/fce [999736,101086] 0 2024-04-15T21:02:53.872 INFO:tasks.workunit.client.0.smithi072.stdout:2/691: dwrite d2/d8/f28 [0,4194304] 0 2024-04-15T21:02:53.872 INFO:tasks.workunit.client.1.smithi149.stdout:3/867: dread d1/db/d24/d2b/f6b [0,4194304] 0 2024-04-15T21:02:53.874 INFO:tasks.workunit.client.1.smithi149.stdout:8/971: creat d2/d5b/dcd/d10a/d25/d57/dd1/df3/f15f x:0 0 0 2024-04-15T21:02:53.874 INFO:tasks.workunit.client.0.smithi072.stdout:0/690: write d0/d19/d96/fc6 [291168,13773] 0 2024-04-15T21:02:53.874 INFO:tasks.workunit.client.0.smithi072.stdout:5/697: read d0/d3/d33/d85/fa8 [132183,31196] 0 2024-04-15T21:02:53.875 INFO:tasks.workunit.client.1.smithi149.stdout:1/784: creat d1/db/dc/d38/fe2 x:0 0 0 2024-04-15T21:02:53.876 INFO:tasks.workunit.client.0.smithi072.stdout:1/662: dwrite d5/fa3 [0,4194304] 0 2024-04-15T21:02:53.877 INFO:tasks.workunit.client.0.smithi072.stdout:8/705: unlink d3/d4/d3b/f3d 0 2024-04-15T21:02:53.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/698: stat d0/d3/d33/d60/d81/f2a 0 2024-04-15T21:02:53.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/692: write d2/d38/d73/d80/fa3 [660412,119607] 0 2024-04-15T21:02:53.879 INFO:tasks.workunit.client.0.smithi072.stdout:3/657: symlink d1/d15/d32/d2f/d1a/lcf 0 2024-04-15T21:02:53.881 INFO:tasks.workunit.client.0.smithi072.stdout:4/679: dwrite d7/d23/d6c/f79 [4194304,4194304] 0 2024-04-15T21:02:53.881 INFO:tasks.workunit.client.0.smithi072.stdout:2/693: readlink d2/d3/l89 0 2024-04-15T21:02:53.882 INFO:tasks.workunit.client.1.smithi149.stdout:6/862: creat da/d18/d7d/f113 x:0 0 0 2024-04-15T21:02:53.882 INFO:tasks.workunit.client.0.smithi072.stdout:5/699: readlink d0/d3/d7/d1f/d50/l6a 0 2024-04-15T21:02:53.896 INFO:tasks.workunit.client.1.smithi149.stdout:3/868: stat d1/db/d23/f3a 0 2024-04-15T21:02:53.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/996: truncate d1/d9/d64/d65/d104/d119/f93 1277220 0 2024-04-15T21:02:53.906 INFO:tasks.workunit.client.0.smithi072.stdout:2/694: dread d2/d38/d73/d80/f82 [0,4194304] 0 2024-04-15T21:02:53.908 INFO:tasks.workunit.client.0.smithi072.stdout:8/706: rename c2 to d3/de/d1b/d44/cdf 0 2024-04-15T21:02:53.912 INFO:tasks.workunit.client.1.smithi149.stdout:8/972: rename d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/c13e to d2/d5b/dcd/d10a/d20/d6b/dfb/c160 0 2024-04-15T21:02:53.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:53 smithi072 ceph-mon[29079]: pgmap v11: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 86 MiB/s rd, 215 MiB/s wr, 416 op/s 2024-04-15T21:02:53.914 INFO:tasks.workunit.client.1.smithi149.stdout:7/841: getdents d3/d16/d11f/d92 0 2024-04-15T21:02:53.914 INFO:tasks.workunit.client.1.smithi149.stdout:8/973: stat d2/d5b/dcd/d10a/d25/d37 0 2024-04-15T21:02:53.914 INFO:tasks.workunit.client.0.smithi072.stdout:5/700: truncate d0/d3/d7/d12/d1d/f74 726071 0 2024-04-15T21:02:53.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/997: truncate d1/d29/d2c/d4f/d95/f125 306016 0 2024-04-15T21:02:53.917 INFO:tasks.workunit.client.1.smithi149.stdout:5/835: dwrite d0/d6/d82/da1/d12/d16/da9/d9b/fa7 [0,4194304] 0 2024-04-15T21:02:53.920 INFO:tasks.workunit.client.0.smithi072.stdout:5/701: dwrite d0/d3/d7/d94/d86/fb9 [0,4194304] 0 2024-04-15T21:02:53.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/910: write d4/dc7/fe9 [315395,57271] 0 2024-04-15T21:02:53.922 INFO:tasks.workunit.client.1.smithi149.stdout:2/911: chown d4/d7/d46/de4/d21/d2c/d63/l119 1375 1 2024-04-15T21:02:53.926 INFO:tasks.workunit.client.0.smithi072.stdout:5/702: dwrite d0/d3/d7/d12/d31/d49/fad [0,4194304] 0 2024-04-15T21:02:53.927 INFO:tasks.workunit.client.1.smithi149.stdout:9/784: dread d23/d46/f73 [0,4194304] 0 2024-04-15T21:02:53.927 INFO:tasks.workunit.client.0.smithi072.stdout:5/703: chown d0/d3/d7/d12/d31/d55/d58/f66 884975 1 2024-04-15T21:02:53.928 INFO:tasks.workunit.client.1.smithi149.stdout:6/863: rename da/d18/d7d/f113 to da/d11/d90/f114 0 2024-04-15T21:02:53.930 INFO:tasks.workunit.client.0.smithi072.stdout:3/658: unlink d1/d15/c94 0 2024-04-15T21:02:53.930 INFO:tasks.workunit.client.0.smithi072.stdout:7/660: sync 2024-04-15T21:02:53.931 INFO:tasks.workunit.client.0.smithi072.stdout:7/661: stat d2/d7/d25/d2d/d46/d5a/f8f 0 2024-04-15T21:02:53.933 INFO:tasks.workunit.client.1.smithi149.stdout:7/842: symlink d3/d16/d11f/d92/l12c 0 2024-04-15T21:02:53.937 INFO:tasks.workunit.client.0.smithi072.stdout:3/659: dwrite d1/d26/fab [0,4194304] 0 2024-04-15T21:02:53.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/836: creat d0/d6/d82/f10a x:0 0 0 2024-04-15T21:02:53.939 INFO:tasks.workunit.client.1.smithi149.stdout:5/837: chown d0/d6/d82/da1/d12/d16/da9/d1b/d61/fe9 4275770 1 2024-04-15T21:02:53.941 INFO:tasks.workunit.client.1.smithi149.stdout:1/785: creat d1/d17/d52/fe3 x:0 0 0 2024-04-15T21:02:53.942 INFO:tasks.workunit.client.0.smithi072.stdout:4/680: getdents d7/d15/ddd 0 2024-04-15T21:02:53.948 INFO:tasks.workunit.client.1.smithi149.stdout:4/914: getdents dc/d18/d21/d10e/d125 0 2024-04-15T21:02:53.952 INFO:tasks.workunit.client.0.smithi072.stdout:1/663: dread d5/db/d27/d5c/f64 [0,4194304] 0 2024-04-15T21:02:53.954 INFO:tasks.workunit.client.0.smithi072.stdout:6/656: dwrite d2/fc [0,4194304] 0 2024-04-15T21:02:53.955 INFO:tasks.workunit.client.0.smithi072.stdout:6/657: write d2/d10/d11/d1f/f28 [66216,21243] 0 2024-04-15T21:02:53.956 INFO:tasks.workunit.client.1.smithi149.stdout:9/785: symlink d23/d2b/d37/d6d/de3/l107 0 2024-04-15T21:02:53.957 INFO:tasks.workunit.client.0.smithi072.stdout:0/691: link d0/d45/d35/c3d d0/d74/d94/ced 0 2024-04-15T21:02:53.959 INFO:tasks.workunit.client.0.smithi072.stdout:6/658: truncate d2/d40/d56/d95/fbd 787452 0 2024-04-15T21:02:53.959 INFO:tasks.workunit.client.0.smithi072.stdout:0/692: truncate d0/d6/d6d/f83 803497 0 2024-04-15T21:02:53.959 INFO:tasks.workunit.client.0.smithi072.stdout:9/676: write d4/d1f/d31/d4d/f5c [665807,115212] 0 2024-04-15T21:02:53.990 INFO:tasks.workunit.client.1.smithi149.stdout:6/864: truncate da/f75 3141518 0 2024-04-15T21:02:53.996 INFO:tasks.workunit.client.1.smithi149.stdout:8/974: mkdir d2/d5b/dcd/d10a/d25/d32/d45/d161 0 2024-04-15T21:02:53.996 INFO:tasks.workunit.client.0.smithi072.stdout:7/662: rmdir d2/d7/d25/d2d 39 2024-04-15T21:02:53.997 INFO:tasks.workunit.client.0.smithi072.stdout:2/695: fsync d2/d3/f4c 0 2024-04-15T21:02:53.998 INFO:tasks.workunit.client.1.smithi149.stdout:8/975: read d2/d5b/dcd/d10a/d25/d37/d53/daf/ff8 [1054148,10088] 0 2024-04-15T21:02:53.999 INFO:tasks.workunit.client.1.smithi149.stdout:1/786: mknod d1/db/dc/d38/d39/d88/db4/ce4 0 2024-04-15T21:02:53.999 INFO:tasks.workunit.client.1.smithi149.stdout:8/976: dread - d2/d5b/dcd/d10a/d20/d6b/f102 zero size 2024-04-15T21:02:54.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/915: mknod dc/d2c/d3e/d7c/c12f 0 2024-04-15T21:02:54.004 INFO:tasks.workunit.client.0.smithi072.stdout:3/660: dread d1/d15/d32/fa4 [0,4194304] 0 2024-04-15T21:02:54.004 INFO:tasks.workunit.client.1.smithi149.stdout:0/998: write d1/d5/d24/d50/d13/d38/f68 [2076310,87100] 0 2024-04-15T21:02:54.008 INFO:tasks.workunit.client.1.smithi149.stdout:9/786: unlink d23/d2b/d37/d50/d79/cc3 0 2024-04-15T21:02:54.012 INFO:tasks.workunit.client.0.smithi072.stdout:6/659: mknod d2/d42/cc6 0 2024-04-15T21:02:54.012 INFO:tasks.workunit.client.0.smithi072.stdout:5/704: write d0/d3/d33/d60/f8f [3332700,90926] 0 2024-04-15T21:02:54.013 INFO:tasks.workunit.client.1.smithi149.stdout:7/843: mknod d3/da9/c12d 0 2024-04-15T21:02:54.018 INFO:tasks.workunit.client.0.smithi072.stdout:0/693: chown d0/d19/dcd/ld0 10202 1 2024-04-15T21:02:54.018 INFO:tasks.workunit.client.0.smithi072.stdout:0/694: chown d0/d19/d71/d9e/fb9 0 1 2024-04-15T21:02:54.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/977: mkdir d2/d5b/dcd/d10a/d25/d57/dd1/d46/d162 0 2024-04-15T21:02:54.024 INFO:tasks.workunit.client.0.smithi072.stdout:8/707: dwrite d3/d4/d76/d8f/fdc [0,4194304] 0 2024-04-15T21:02:54.026 INFO:tasks.workunit.client.0.smithi072.stdout:4/681: dwrite d7/f55 [0,4194304] 0 2024-04-15T21:02:54.028 INFO:tasks.workunit.client.1.smithi149.stdout:2/912: dwrite d4/d7/da/f4e [0,4194304] 0 2024-04-15T21:02:54.038 INFO:tasks.workunit.client.1.smithi149.stdout:4/916: dread dc/d18/f62 [0,4194304] 0 2024-04-15T21:02:54.039 INFO:tasks.workunit.client.1.smithi149.stdout:3/869: rename d1/db/d24/d2b/l4f to d1/l110 0 2024-04-15T21:02:54.043 INFO:tasks.workunit.client.1.smithi149.stdout:7/844: creat d3/d16/d6e/f12e x:0 0 0 2024-04-15T21:02:54.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/978: creat d2/d5b/dcd/d10a/d20/d6b/d109/f163 x:0 0 0 2024-04-15T21:02:54.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/917: dwrite dc/d18/d21/f119 [0,4194304] 0 2024-04-15T21:02:54.055 INFO:tasks.workunit.client.1.smithi149.stdout:4/918: read dc/d2c/d3e/d15/d3f/f6e [3983800,108127] 0 2024-04-15T21:02:54.056 INFO:tasks.workunit.client.1.smithi149.stdout:1/787: rename d1/db/dc/lb2 to d1/d17/d5e/le5 0 2024-04-15T21:02:54.057 INFO:tasks.workunit.client.1.smithi149.stdout:8/979: dwrite d2/d5b/dcd/d10a/d25/d57/dd1/df3/f147 [0,4194304] 0 2024-04-15T21:02:54.057 INFO:tasks.workunit.client.1.smithi149.stdout:3/870: rmdir d1/db/d24/d8a 39 2024-04-15T21:02:54.059 INFO:tasks.workunit.client.1.smithi149.stdout:4/919: chown dc/d2c/d3e/d15/l61 694287733 1 2024-04-15T21:02:54.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/865: read - da/d18/d10/d16/d97/dbf/d55/fd2 zero size 2024-04-15T21:02:54.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/787: dread d23/d2b/d44/d7e/f9b [0,4194304] 0 2024-04-15T21:02:54.062 INFO:tasks.workunit.client.1.smithi149.stdout:4/920: write dc/d2c/d3e/d15/d3f/db0/fb5 [3369565,19566] 0 2024-04-15T21:02:54.063 INFO:tasks.workunit.client.1.smithi149.stdout:9/788: chown d23/d3c/d7a/da5 5656792 1 2024-04-15T21:02:54.064 INFO:tasks.workunit.client.1.smithi149.stdout:4/921: chown dc/d2c/d3e/d15/fde 0 1 2024-04-15T21:02:54.065 INFO:tasks.workunit.client.1.smithi149.stdout:4/922: chown dc/deb/fef 17 1 2024-04-15T21:02:54.071 INFO:tasks.workunit.client.1.smithi149.stdout:8/980: dread d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/d9d/dc0/f127 [0,4194304] 0 2024-04-15T21:02:54.075 INFO:tasks.workunit.client.1.smithi149.stdout:3/871: fdatasync d1/db/d28/f44 0 2024-04-15T21:02:54.077 INFO:tasks.workunit.client.1.smithi149.stdout:0/999: write d1/d29/dbb/f10b [2074115,52502] 0 2024-04-15T21:02:54.078 INFO:tasks.workunit.client.1.smithi149.stdout:6/866: rmdir da/d11/dcc 39 2024-04-15T21:02:54.080 INFO:tasks.workunit.client.1.smithi149.stdout:7/845: unlink d3/d96/ff1 0 2024-04-15T21:02:54.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/789: unlink d23/d2b/d37/f4b 0 2024-04-15T21:02:54.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/790: readlink d23/d2b/d37/d6d/l89 0 2024-04-15T21:02:54.085 INFO:tasks.workunit.client.1.smithi149.stdout:4/923: fsync dc/d8f/d91/f97 0 2024-04-15T21:02:54.087 INFO:tasks.workunit.client.1.smithi149.stdout:2/913: rmdir d4/d7/d93/d13b 0 2024-04-15T21:02:54.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/914: dread d4/d7/d29/f4f [0,4194304] 0 2024-04-15T21:02:54.092 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:53 smithi149 ceph-mon[36029]: pgmap v11: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 86 MiB/s rd, 215 MiB/s wr, 416 op/s 2024-04-15T21:02:54.092 INFO:tasks.workunit.client.1.smithi149.stdout:2/915: dread - d4/d7/d29/f130 zero size 2024-04-15T21:02:54.095 INFO:tasks.workunit.client.0.smithi072.stdout:7/663: write d2/d7/d25/d2d/f44 [1007868,128343] 0 2024-04-15T21:02:54.100 INFO:tasks.workunit.client.1.smithi149.stdout:9/791: creat d23/d46/dcf/deb/d7f/d86/f108 x:0 0 0 2024-04-15T21:02:54.103 INFO:tasks.workunit.client.1.smithi149.stdout:4/924: mknod dc/deb/c130 0 2024-04-15T21:02:54.104 INFO:tasks.workunit.client.0.smithi072.stdout:6/660: read d2/d40/d56/d6a/d70/f44 [1510999,102897] 0 2024-04-15T21:02:54.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/981: mknod d2/df/c164 0 2024-04-15T21:02:54.108 INFO:tasks.workunit.client.1.smithi149.stdout:8/982: chown d2/d5b/dcd/d10a/d25/d37/d53/daf/led 191936625 1 2024-04-15T21:02:54.109 INFO:tasks.workunit.client.0.smithi072.stdout:0/695: creat d0/d19/d2b/fee x:0 0 0 2024-04-15T21:02:54.111 INFO:tasks.workunit.client.0.smithi072.stdout:9/677: mknod d4/d1f/d31/d4d/dbf/dd2/cd5 0 2024-04-15T21:02:54.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/846: rename d3/d16/d20/d36/c29 to d3/d16/d11f/d92/d123/c12f 0 2024-04-15T21:02:54.118 INFO:tasks.workunit.client.0.smithi072.stdout:9/678: dwrite d4/d1f/d2c/d62/f6c [0,4194304] 0 2024-04-15T21:02:54.119 INFO:tasks.workunit.client.1.smithi149.stdout:4/925: dread dc/fe3 [0,4194304] 0 2024-04-15T21:02:54.119 INFO:tasks.workunit.client.0.smithi072.stdout:4/682: fdatasync d7/d28/f8f 0 2024-04-15T21:02:54.120 INFO:tasks.workunit.client.0.smithi072.stdout:1/664: dwrite d5/db/f52 [0,4194304] 0 2024-04-15T21:02:54.121 INFO:tasks.workunit.client.1.smithi149.stdout:9/792: truncate d23/d3c/d7a/fc2 2616380 0 2024-04-15T21:02:54.121 INFO:tasks.workunit.client.0.smithi072.stdout:1/665: chown d5/db/d2d/d3a/f13 45616 1 2024-04-15T21:02:54.122 INFO:tasks.workunit.client.1.smithi149.stdout:1/788: truncate d1/db/d16/f7c 3789493 0 2024-04-15T21:02:54.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/793: chown d23/d2b/d37/d50/d79 36992 1 2024-04-15T21:02:54.129 INFO:tasks.workunit.client.0.smithi072.stdout:7/664: symlink d2/d7/d25/d4c/lcf 0 2024-04-15T21:02:54.130 INFO:tasks.workunit.client.1.smithi149.stdout:8/983: readlink d2/d5b/dcd/d10a/d20/l52 0 2024-04-15T21:02:54.132 INFO:tasks.workunit.client.1.smithi149.stdout:3/872: creat d1/db/d24/d4d/f111 x:0 0 0 2024-04-15T21:02:54.134 INFO:tasks.workunit.client.0.smithi072.stdout:3/661: mkdir d1/d3f/d4f/d73/db3/dc4/dd0 0 2024-04-15T21:02:54.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/916: rename d4/d7/d46/de4/f24 to d4/df6/f14a 0 2024-04-15T21:02:54.142 INFO:tasks.workunit.client.0.smithi072.stdout:6/661: dwrite d2/da1/fb5 [0,4194304] 0 2024-04-15T21:02:54.143 INFO:tasks.workunit.client.1.smithi149.stdout:1/789: dread - d1/fc2 zero size 2024-04-15T21:02:54.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/926: read dc/d2c/d3e/d7c/dba/fcb [3379419,100307] 0 2024-04-15T21:02:54.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/927: stat dc/d2c/d3e/d35/c46 0 2024-04-15T21:02:54.147 INFO:tasks.workunit.client.1.smithi149.stdout:9/794: unlink d23/d2b/d37/d50/f57 0 2024-04-15T21:02:54.148 INFO:tasks.workunit.client.0.smithi072.stdout:8/708: truncate d3/de/f25 8631283 0 2024-04-15T21:02:54.152 INFO:tasks.workunit.client.0.smithi072.stdout:8/709: read d3/f30 [2470371,46457] 0 2024-04-15T21:02:54.157 INFO:tasks.workunit.client.1.smithi149.stdout:6/867: getdents da/d32 0 2024-04-15T21:02:54.159 INFO:tasks.workunit.client.0.smithi072.stdout:2/696: creat d2/d66/fe1 x:0 0 0 2024-04-15T21:02:54.159 INFO:tasks.workunit.client.0.smithi072.stdout:2/697: readlink d2/d64/l83 0 2024-04-15T21:02:54.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/705: rename d0/d3/d7/d12/d31/d55/l67 to d0/d3/lee 0 2024-04-15T21:02:54.163 INFO:tasks.workunit.client.1.smithi149.stdout:3/873: write d1/db/d24/d4d/f82 [1775940,59018] 0 2024-04-15T21:02:54.164 INFO:tasks.workunit.client.0.smithi072.stdout:9/679: dwrite d4/d29/d4c/d91/fc2 [0,4194304] 0 2024-04-15T21:02:54.166 INFO:tasks.workunit.client.1.smithi149.stdout:8/984: dwrite d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/fc8 [0,4194304] 0 2024-04-15T21:02:54.166 INFO:tasks.workunit.client.0.smithi072.stdout:3/662: dread d1/d15/d32/f50 [0,4194304] 0 2024-04-15T21:02:54.169 INFO:tasks.workunit.client.0.smithi072.stdout:6/662: creat d2/d42/db9/fc7 x:0 0 0 2024-04-15T21:02:54.169 INFO:tasks.workunit.client.1.smithi149.stdout:1/790: creat d1/db/dc/d38/fe6 x:0 0 0 2024-04-15T21:02:54.170 INFO:tasks.workunit.client.1.smithi149.stdout:4/928: mknod dc/d1a/dc8/dd9/c131 0 2024-04-15T21:02:54.172 INFO:tasks.workunit.client.1.smithi149.stdout:1/791: write d1/db/dc/d38/d39/d43/f54 [4696225,88702] 0 2024-04-15T21:02:54.176 INFO:tasks.workunit.client.0.smithi072.stdout:0/696: write d0/d6/feb [2315073,116392] 0 2024-04-15T21:02:54.180 INFO:tasks.workunit.client.1.smithi149.stdout:6/868: stat da/d18/d10/d3f/c5e 0 2024-04-15T21:02:54.181 INFO:tasks.workunit.client.1.smithi149.stdout:7/847: rename d3/d16/d11f/d92/cd8 to d3/d16/da0/c130 0 2024-04-15T21:02:54.183 INFO:tasks.workunit.client.0.smithi072.stdout:2/698: chown d2/d8/d8e/d90/caf 1173445 1 2024-04-15T21:02:54.184 INFO:tasks.workunit.client.0.smithi072.stdout:2/699: chown d2/d38/l8f 1350081 1 2024-04-15T21:02:54.184 INFO:tasks.workunit.client.1.smithi149.stdout:4/929: mknod dc/d8f/c132 0 2024-04-15T21:02:54.188 INFO:tasks.workunit.client.1.smithi149.stdout:9/795: write d23/d46/f9c [853467,95243] 0 2024-04-15T21:02:54.192 INFO:tasks.workunit.client.1.smithi149.stdout:2/917: rename d4/d7/d10/l144 to d4/d7/d46/de4/d21/l14b 0 2024-04-15T21:02:54.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/663: truncate d1/d26/f59 939912 0 2024-04-15T21:02:54.198 INFO:tasks.workunit.client.0.smithi072.stdout:3/664: dwrite d1/d26/f58 [4194304,4194304] 0 2024-04-15T21:02:54.199 INFO:tasks.workunit.client.0.smithi072.stdout:3/665: dread - d1/fce zero size 2024-04-15T21:02:54.201 INFO:tasks.workunit.client.0.smithi072.stdout:7/665: rmdir d2/d7/d25/d2d/d47/d7e/dc3 0 2024-04-15T21:02:54.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/700: stat d2/d37/l59 0 2024-04-15T21:02:54.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/706: mkdir d0/d3/d7/d12/d31/def 0 2024-04-15T21:02:54.203 INFO:tasks.workunit.client.0.smithi072.stdout:5/707: write d0/d3/d7/f8a [888402,19960] 0 2024-04-15T21:02:54.205 INFO:tasks.workunit.client.0.smithi072.stdout:3/666: unlink d1/d15/d32/f5a 0 2024-04-15T21:02:54.210 INFO:tasks.workunit.client.0.smithi072.stdout:5/708: rmdir d0/d3/d7/d12/d31/d49/dde 0 2024-04-15T21:02:54.210 INFO:tasks.workunit.client.0.smithi072.stdout:5/709: stat d0/d3/d7/d12/f1a 0 2024-04-15T21:02:54.213 INFO:tasks.workunit.client.0.smithi072.stdout:5/710: rmdir d0/d3/d7/d12/d1d/d8c 39 2024-04-15T21:02:54.214 INFO:tasks.workunit.client.0.smithi072.stdout:5/711: dread d0/d3/d7/d12/d1d/f74 [0,4194304] 0 2024-04-15T21:02:54.216 INFO:tasks.workunit.client.0.smithi072.stdout:5/712: unlink d0/d3/d33/d60/d81/daf/fa5 0 2024-04-15T21:02:54.218 INFO:tasks.workunit.client.0.smithi072.stdout:5/713: truncate d0/d3/d7/d12/d31/d55/d58/f65 1480425 0 2024-04-15T21:02:54.244 INFO:tasks.workunit.client.1.smithi149.stdout:1/792: mknod d1/db/d16/d86/de1/ce7 0 2024-04-15T21:02:54.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/848: dread d3/d16/d20/d6c/fa6 [0,4194304] 0 2024-04-15T21:02:54.245 INFO:tasks.workunit.client.1.smithi149.stdout:4/930: rename dc/d2c/d3e/d15/d3f/d117/d75/db3/f102 to dc/d8f/d91/f133 0 2024-04-15T21:02:54.250 INFO:tasks.workunit.client.1.smithi149.stdout:2/918: creat d4/d7/d46/de4/d21/d2c/d32/d4a/dee/d138/f14c x:0 0 0 2024-04-15T21:02:54.252 INFO:tasks.workunit.client.1.smithi149.stdout:8/985: dwrite d2/f1f [0,4194304] 0 2024-04-15T21:02:54.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/793: symlink d1/db/dc/d38/d39/d43/le8 0 2024-04-15T21:02:54.258 INFO:tasks.workunit.client.1.smithi149.stdout:4/931: rename dc/d18/d21/l88 to dc/d1a/dc8/dd9/l134 0 2024-04-15T21:02:54.262 INFO:tasks.workunit.client.0.smithi072.stdout:5/714: fsync d0/d3/d7/f8a 0 2024-04-15T21:02:54.263 INFO:tasks.workunit.client.1.smithi149.stdout:8/986: fsync d2/d5b/dcd/d10a/d25/d57/dd1/d50/d8e/f9e 0 2024-04-15T21:02:54.268 INFO:tasks.workunit.client.1.smithi149.stdout:1/794: creat d1/db/dc/d11/d3f/fe9 x:0 0 0 2024-04-15T21:02:54.269 INFO:tasks.workunit.client.1.smithi149.stdout:4/932: creat dc/d18/d21/f135 x:0 0 0 2024-04-15T21:02:54.270 INFO:tasks.workunit.client.0.smithi072.stdout:0/697: write d0/d45/d35/d3a/f50 [197137,123612] 0 2024-04-15T21:02:54.271 INFO:tasks.workunit.client.0.smithi072.stdout:8/710: write d3/de/d1b/d41/da4/f51 [1042465,117607] 0 2024-04-15T21:02:54.271 INFO:tasks.workunit.client.1.smithi149.stdout:9/796: dread f16 [0,4194304] 0 2024-04-15T21:02:54.272 INFO:tasks.workunit.client.1.smithi149.stdout:9/797: chown f1b 8 1 2024-04-15T21:02:54.275 INFO:tasks.workunit.client.0.smithi072.stdout:5/715: rename d0/d3/f83 to d0/d3/d7/ff0 0 2024-04-15T21:02:54.278 INFO:tasks.workunit.client.1.smithi149.stdout:8/987: mknod d2/d5b/dcd/d10a/d25/d37/d53/daf/d85/d35/da4/c165 0 2024-04-15T21:02:54.279 INFO:tasks.workunit.client.0.smithi072.stdout:9/680: write d4/d1f/d2c/f4f [5156502,109224] 0 2024-04-15T21:02:54.281 INFO:tasks.workunit.client.1.smithi149.stdout:1/795: mkdir d1/db/dc/d11/d3f/d45/dea 0 2024-04-15T21:02:54.282 INFO:tasks.workunit.client.0.smithi072.stdout:8/711: mknod d3/d4/d76/d8f/ce0 0 2024-04-15T21:02:54.283 INFO:tasks.workunit.client.0.smithi072.stdout:6/663: write d2/d40/d56/f8a [2245309,72014] 0 2024-04-15T21:02:54.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/796: creat d1/d17/d5e/feb x:0 0 0 2024-04-15T21:02:54.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/797: dread - d1/d17/d5e/feb zero size 2024-04-15T21:02:54.294 INFO:tasks.workunit.client.1.smithi149.stdout:7/849: write d3/d16/d32/d90/dad/dc4/fe7 [1042819,102331] 0 2024-04-15T21:02:54.298 INFO:tasks.workunit.client.0.smithi072.stdout:2/701: write d2/d8/f72 [5124231,23183] 0 2024-04-15T21:02:54.299 INFO:tasks.workunit.client.0.smithi072.stdout:0/698: creat d0/d74/dd5/fef x:0 0 0 2024-04-15T21:02:54.299 INFO:tasks.workunit.client.1.smithi149.stdout:2/919: write d4/d7/d93/fd2 [4474003,93622] 0 2024-04-15T21:02:54.301 INFO:tasks.workunit.client.1.smithi149.stdout:7/850: creat d3/d16/d6e/f131 x:0 0 0 2024-04-15T21:02:54.302 INFO:tasks.workunit.client.1.smithi149.stdout:8/988: link d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda/c125 d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/d145/c166 0 2024-04-15T21:02:54.303 INFO:tasks.workunit.client.1.smithi149.stdout:8/989: stat d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda 0 2024-04-15T21:02:54.304 INFO:tasks.workunit.client.0.smithi072.stdout:7/666: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e [0,4194304] 0 2024-04-15T21:02:54.305 INFO:tasks.workunit.client.0.smithi072.stdout:3/667: dwrite d1/d15/d32/d2f/d1a/f1d [0,4194304] 0 2024-04-15T21:02:54.306 INFO:tasks.workunit.client.1.smithi149.stdout:4/933: getdents dc/d2c/d3e/d15/d3f/d117/de8/dfc 0 2024-04-15T21:02:54.312 INFO:tasks.workunit.client.0.smithi072.stdout:2/702: creat d2/dd7/fe2 x:0 0 0 2024-04-15T21:02:54.314 INFO:tasks.workunit.client.1.smithi149.stdout:8/990: symlink d2/d16/l167 0 2024-04-15T21:02:54.316 INFO:tasks.workunit.client.1.smithi149.stdout:8/991: readlink d2/d5b/dcd/d10a/d25/d57/dd1/d46/l7c 0 2024-04-15T21:02:54.317 INFO:tasks.workunit.client.1.smithi149.stdout:9/798: write d23/d71/fea [1504285,91698] 0 2024-04-15T21:02:54.318 INFO:tasks.workunit.client.1.smithi149.stdout:9/799: readlink d23/d3c/l40 0 2024-04-15T21:02:54.319 INFO:tasks.workunit.client.1.smithi149.stdout:8/992: truncate d2/d5b/dd6/f153 465213 0 2024-04-15T21:02:54.320 INFO:tasks.workunit.client.0.smithi072.stdout:8/712: unlink d3/de/f38 0 2024-04-15T21:02:54.321 INFO:tasks.workunit.client.0.smithi072.stdout:8/713: fsync d3/de/d1b/d41/da4/d2e/f9d 0 2024-04-15T21:02:54.321 INFO:tasks.workunit.client.1.smithi149.stdout:4/934: unlink dc/d2c/d3e/d15/d3f/d117/d75/c9f 0 2024-04-15T21:02:54.322 INFO:tasks.workunit.client.1.smithi149.stdout:8/993: dread - d2/d5b/dcd/d10a/d25/d37/d53/daf/d92/f13d zero size 2024-04-15T21:02:54.323 INFO:tasks.workunit.client.0.smithi072.stdout:0/699: fdatasync d0/d19/d58/f5a 0 2024-04-15T21:02:54.324 INFO:tasks.workunit.client.0.smithi072.stdout:7/667: dread d2/d7/d25/d4c/f59 [4194304,4194304] 0 2024-04-15T21:02:54.326 INFO:tasks.workunit.client.0.smithi072.stdout:7/668: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab 413779 0 2024-04-15T21:02:54.328 INFO:tasks.workunit.client.1.smithi149.stdout:9/800: dwrite d23/d3c/d52/ff7 [0,4194304] 0 2024-04-15T21:02:54.329 INFO:tasks.workunit.client.0.smithi072.stdout:3/668: fsync d1/d5b/dbf/fa6 0 2024-04-15T21:02:54.329 INFO:tasks.workunit.client.0.smithi072.stdout:3/669: stat d1/d15/d32/d2f/l3c 0 2024-04-15T21:02:54.330 INFO:tasks.workunit.client.0.smithi072.stdout:3/670: write d1/d15/d32/d78/fad [2724032,87485] 0 2024-04-15T21:02:54.331 INFO:tasks.workunit.client.1.smithi149.stdout:4/935: symlink dc/d2c/d3e/d7c/dba/l136 0 2024-04-15T21:02:54.333 INFO:tasks.workunit.client.0.smithi072.stdout:6/664: write d2/d40/d56/d6a/f88 [993689,71525] 0 2024-04-15T21:02:54.340 INFO:tasks.workunit.client.0.smithi072.stdout:9/681: rename d4/d1f/l4b to d4/d29/d4c/ld6 0 2024-04-15T21:02:54.343 INFO:tasks.workunit.client.1.smithi149.stdout:8/994: rename d2/d5b/dcd/d10a/d25/d57/dd1/d46/d74/d145 to d2/d5b/df4/d168 0 2024-04-15T21:02:54.346 INFO:tasks.workunit.client.1.smithi149.stdout:1/798: dwrite d1/f79 [0,4194304] 0 2024-04-15T21:02:54.346 INFO:tasks.workunit.client.0.smithi072.stdout:2/703: creat d2/d3/d5f/fe3 x:0 0 0 2024-04-15T21:02:54.349 INFO:tasks.workunit.client.0.smithi072.stdout:5/716: dwrite d0/d3/d7/d12/d31/d55/d58/f63 [0,4194304] 0 2024-04-15T21:02:54.354 INFO:tasks.workunit.client.0.smithi072.stdout:2/704: dwrite d2/d64/fac [0,4194304] 0 2024-04-15T21:02:54.357 INFO:tasks.workunit.client.1.smithi149.stdout:2/920: dwrite d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/fdc [0,4194304] 0 2024-04-15T21:02:54.363 INFO:tasks.workunit.client.0.smithi072.stdout:0/700: rmdir d0/d6/d55 39 2024-04-15T21:02:54.365 INFO:tasks.workunit.client.1.smithi149.stdout:9/801: dread d23/d2b/d37/d50/fa2 [4194304,4194304] 0 2024-04-15T21:02:54.371 INFO:tasks.workunit.client.1.smithi149.stdout:8/995: creat d2/d5b/dcd/d10a/d25/d57/f169 x:0 0 0 2024-04-15T21:02:54.372 INFO:tasks.workunit.client.0.smithi072.stdout:7/669: rmdir d2/d7/d25/d2d/d46/d5a 39 2024-04-15T21:02:54.380 INFO:tasks.workunit.client.0.smithi072.stdout:3/671: symlink d1/d15/d32/d2f/d1a/ld1 0 2024-04-15T21:02:54.381 INFO:tasks.workunit.client.0.smithi072.stdout:3/672: fsync d1/d15/d40/f13 0 2024-04-15T21:02:54.381 INFO:tasks.workunit.client.1.smithi149.stdout:4/936: write dc/d18/f62 [3861322,58175] 0 2024-04-15T21:02:54.386 INFO:tasks.workunit.client.0.smithi072.stdout:9/682: creat d4/d1f/d31/d4d/dbf/dd2/fd7 x:0 0 0 2024-04-15T21:02:54.387 INFO:tasks.workunit.client.0.smithi072.stdout:9/683: write d4/d29/d4c/fcf [221493,89536] 0 2024-04-15T21:02:54.390 INFO:tasks.workunit.client.0.smithi072.stdout:5/717: write d0/d3/d7/d94/d86/fb9 [464257,105856] 0 2024-04-15T21:02:54.391 INFO:tasks.workunit.client.1.smithi149.stdout:4/937: creat dc/d18/d21/f137 x:0 0 0 2024-04-15T21:02:54.393 INFO:tasks.workunit.client.1.smithi149.stdout:9/802: mkdir d23/d3c/d87/d9a/d109 0 2024-04-15T21:02:54.394 INFO:tasks.workunit.client.1.smithi149.stdout:9/803: chown d23/d2b/d44/l4d 0 1 2024-04-15T21:02:54.395 INFO:tasks.workunit.client.1.smithi149.stdout:9/804: chown d23/d71/cc8 5661790 1 2024-04-15T21:02:54.397 INFO:tasks.workunit.client.0.smithi072.stdout:7/670: mknod d2/d7/d25/d81/cd0 0 2024-04-15T21:02:54.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/921: creat d4/d7/f14d x:0 0 0 2024-04-15T21:02:54.400 INFO:tasks.workunit.client.0.smithi072.stdout:2/705: dread d2/d8/d8e/fa7 [0,4194304] 0 2024-04-15T21:02:54.400 INFO:tasks.workunit.client.1.smithi149.stdout:2/922: stat d4/d7/d46/de4/d21/d55/dfe/l100 0 2024-04-15T21:02:54.406 INFO:tasks.workunit.client.0.smithi072.stdout:6/665: dread d2/d42/f45 [0,4194304] 0 2024-04-15T21:02:54.406 INFO:tasks.workunit.client.0.smithi072.stdout:6/666: chown d2/d10/d11/d1f/f4c 3 1 2024-04-15T21:02:54.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/805: mknod d23/d2b/d37/d6d/db8/d102/c10a 0 2024-04-15T21:02:54.409 INFO:tasks.workunit.client.0.smithi072.stdout:8/714: rename d3/de/d1b/d41/d74/lbf to d3/d4/d76/d8f/le1 0 2024-04-15T21:02:54.410 INFO:tasks.workunit.client.1.smithi149.stdout:2/923: truncate d4/d7/d46/de4/f56 4957069 0 2024-04-15T21:02:54.411 INFO:tasks.workunit.client.1.smithi149.stdout:4/938: dread dc/d2c/d3e/d35/f86 [0,4194304] 0 2024-04-15T21:02:54.412 INFO:tasks.workunit.client.1.smithi149.stdout:8/996: truncate d2/f8d 3531052 0 2024-04-15T21:02:54.414 INFO:tasks.workunit.client.0.smithi072.stdout:8/715: dwrite d3/de/d1b/d41/da4/f8b [0,4194304] 0 2024-04-15T21:02:54.414 INFO:tasks.workunit.client.0.smithi072.stdout:8/716: chown d3/l29 133338981 1 2024-04-15T21:02:54.416 INFO:tasks.workunit.client.1.smithi149.stdout:2/924: dread d4/d7/da/fa2 [0,4194304] 0 2024-04-15T21:02:54.418 INFO:tasks.workunit.client.1.smithi149.stdout:4/939: rename dc/d18/d21/dfa/c122 to dc/d1a/dc8/c138 0 2024-04-15T21:02:54.422 INFO:tasks.workunit.client.0.smithi072.stdout:6/667: creat d2/d40/d56/d6a/d70/fc8 x:0 0 0 2024-04-15T21:02:54.426 INFO:tasks.workunit.client.0.smithi072.stdout:3/673: rename d1/f82 to d1/d3f/fd2 0 2024-04-15T21:02:54.426 INFO:tasks.workunit.client.1.smithi149.stdout:4/940: dwrite dc/d2c/d3e/d15/d5b/f71 [0,4194304] 0 2024-04-15T21:02:54.428 INFO:tasks.workunit.client.1.smithi149.stdout:4/941: stat dc/d2c/d3e/d35/fcd 0 2024-04-15T21:02:54.429 INFO:tasks.workunit.client.1.smithi149.stdout:8/997: mkdir d2/d14e/d16a 0 2024-04-15T21:02:54.431 INFO:tasks.workunit.client.0.smithi072.stdout:9/684: mkdir d4/d1f/d2c/dd8 0 2024-04-15T21:02:54.432 INFO:tasks.workunit.client.0.smithi072.stdout:9/685: chown d4/d1f/d31/d4d/fbb 102207357 1 2024-04-15T21:02:54.432 INFO:tasks.workunit.client.0.smithi072.stdout:8/717: creat d3/d4/d76/fe2 x:0 0 0 2024-04-15T21:02:54.433 INFO:tasks.workunit.client.0.smithi072.stdout:8/718: write d3/d4/f91 [2132620,125697] 0 2024-04-15T21:02:54.434 INFO:tasks.workunit.client.1.smithi149.stdout:9/806: dwrite d23/d2b/d37/d50/fa2 [0,4194304] 0 2024-04-15T21:02:54.435 INFO:tasks.workunit.client.0.smithi072.stdout:5/718: symlink d0/d3/d6/lf1 0 2024-04-15T21:02:54.437 INFO:tasks.workunit.client.0.smithi072.stdout:5/719: dread d0/d3/d33/d60/fb3 [0,4194304] 0 2024-04-15T21:02:54.440 INFO:tasks.workunit.client.1.smithi149.stdout:2/925: write d4/f135 [1810201,27409] 0 2024-04-15T21:02:54.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/942: dwrite dc/d2c/d3e/d15/d3f/f11f [0,4194304] 0 2024-04-15T21:02:54.445 INFO:tasks.workunit.client.0.smithi072.stdout:6/668: mkdir d2/d42/db9/dc9 0 2024-04-15T21:02:54.446 INFO:tasks.workunit.client.1.smithi149.stdout:8/998: mkdir d2/d5b/dcd/d10a/d4e/d9f/d129/d16b 0 2024-04-15T21:02:54.446 INFO:tasks.workunit.client.0.smithi072.stdout:6/669: chown d2/d40/d66/l74 1098683 1 2024-04-15T21:02:54.449 INFO:tasks.workunit.client.1.smithi149.stdout:9/807: mknod d23/d46/dcf/deb/d7f/d83/c10b 0 2024-04-15T21:02:54.450 INFO:tasks.workunit.client.0.smithi072.stdout:3/674: symlink d1/d5b/ld3 0 2024-04-15T21:02:54.453 INFO:tasks.workunit.client.0.smithi072.stdout:9/686: creat d4/d1f/d9e/fd9 x:0 0 0 2024-04-15T21:02:54.453 INFO:tasks.workunit.client.0.smithi072.stdout:9/687: stat d4/l41 0 2024-04-15T21:02:54.454 INFO:tasks.workunit.client.0.smithi072.stdout:3/675: dread d1/d3f/f8a [0,4194304] 0 2024-04-15T21:02:54.457 INFO:tasks.workunit.client.0.smithi072.stdout:4/683: sync 2024-04-15T21:02:54.457 INFO:tasks.workunit.client.0.smithi072.stdout:1/666: sync 2024-04-15T21:02:54.458 INFO:tasks.workunit.client.0.smithi072.stdout:0/701: link d0/d6/d55/f8f d0/d45/d35/ff0 0 2024-04-15T21:02:54.459 INFO:tasks.workunit.client.0.smithi072.stdout:0/702: stat d0/d19/d71/d9e 0 2024-04-15T21:02:54.461 INFO:tasks.workunit.client.0.smithi072.stdout:2/706: rename d2/d3/f43 to d2/d37/fe4 0 2024-04-15T21:02:54.466 INFO:tasks.workunit.client.0.smithi072.stdout:8/719: fdatasync d3/de/d1b/f43 0 2024-04-15T21:02:54.467 INFO:tasks.workunit.client.1.smithi149.stdout:8/999: getdents d2/d5b/dcd/d10a/d25/d57/dd1/d46/dce/dda 0 2024-04-15T21:02:54.471 INFO:tasks.workunit.client.0.smithi072.stdout:7/671: getdents d2/d7/d25/d2d/d52 0 2024-04-15T21:02:54.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/838: sync 2024-04-15T21:02:54.478 INFO:tasks.workunit.client.0.smithi072.stdout:4/684: creat d7/d10/d41/d44/d7a/fdf x:0 0 0 2024-04-15T21:02:54.478 INFO:tasks.workunit.client.0.smithi072.stdout:6/670: creat d2/d40/d66/dbc/fca x:0 0 0 2024-04-15T21:02:54.479 INFO:tasks.workunit.client.0.smithi072.stdout:0/703: creat d0/d6/d55/ff1 x:0 0 0 2024-04-15T21:02:54.479 INFO:tasks.workunit.client.0.smithi072.stdout:2/707: unlink d2/d66/d69/lb7 0 2024-04-15T21:02:54.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/688: mkdir d4/d1f/d2c/d47/dda 0 2024-04-15T21:02:54.480 INFO:tasks.workunit.client.0.smithi072.stdout:2/708: fdatasync d2/d8/f28 0 2024-04-15T21:02:54.481 INFO:tasks.workunit.client.0.smithi072.stdout:2/709: truncate d2/d8/f28 8575328 0 2024-04-15T21:02:54.482 INFO:tasks.workunit.client.1.smithi149.stdout:2/926: dwrite d4/d7/d46/de4/d21/d2c/d3e/fd8 [0,4194304] 0 2024-04-15T21:02:54.482 INFO:tasks.workunit.client.0.smithi072.stdout:8/720: symlink d3/d4/d76/le3 0 2024-04-15T21:02:54.484 INFO:tasks.workunit.client.0.smithi072.stdout:1/667: symlink d5/d31/d51/d82/ld5 0 2024-04-15T21:02:54.489 INFO:tasks.workunit.client.0.smithi072.stdout:7/672: creat d2/d7/d25/d72/fd1 x:0 0 0 2024-04-15T21:02:54.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/943: dwrite dc/d2c/d3e/d15/d3f/d117/d75/d80/fc4 [0,4194304] 0 2024-04-15T21:02:54.492 INFO:tasks.workunit.client.1.smithi149.stdout:9/808: dwrite f21 [0,4194304] 0 2024-04-15T21:02:54.499 INFO:tasks.workunit.client.1.smithi149.stdout:5/839: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d83/fee [0,4194304] 0 2024-04-15T21:02:54.499 INFO:tasks.workunit.client.1.smithi149.stdout:2/927: symlink d4/d7/d93/l14e 0 2024-04-15T21:02:54.500 INFO:tasks.workunit.client.1.smithi149.stdout:5/840: readlink d0/d6/d82/da1/d12/l2f 0 2024-04-15T21:02:54.506 INFO:tasks.workunit.client.1.smithi149.stdout:9/809: rmdir d23/d3c/d7a 39 2024-04-15T21:02:54.508 INFO:tasks.workunit.client.0.smithi072.stdout:0/704: mknod d0/d19/d96/dad/cf2 0 2024-04-15T21:02:54.508 INFO:tasks.workunit.client.0.smithi072.stdout:4/685: mkdir d7/d10/d41/d45/d93/de0 0 2024-04-15T21:02:54.509 INFO:tasks.workunit.client.0.smithi072.stdout:4/686: chown d7/d28/d6d 15218243 1 2024-04-15T21:02:54.513 INFO:tasks.workunit.client.1.smithi149.stdout:4/944: unlink dc/d1a/f9d 0 2024-04-15T21:02:54.514 INFO:tasks.workunit.client.0.smithi072.stdout:0/705: dwrite d0/d19/fc4 [0,4194304] 0 2024-04-15T21:02:54.514 INFO:tasks.workunit.client.0.smithi072.stdout:6/671: rename d2/d40/d56/d6a/d70 to d2/d40/dcb 0 2024-04-15T21:02:54.518 INFO:tasks.workunit.client.0.smithi072.stdout:2/710: mknod d2/db3/ce5 0 2024-04-15T21:02:54.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/928: symlink d4/d7/d46/de4/d21/d2c/d32/d4a/dbd/d11f/l14f 0 2024-04-15T21:02:54.521 INFO:tasks.workunit.client.0.smithi072.stdout:8/721: rmdir d3/d4/d3b 39 2024-04-15T21:02:54.521 INFO:tasks.workunit.client.1.smithi149.stdout:2/929: chown d4/d7/da/c12c 74 1 2024-04-15T21:02:54.523 INFO:tasks.workunit.client.1.smithi149.stdout:2/930: chown d4/d7/d46/de4/d21/d5e/fc9 12 1 2024-04-15T21:02:54.527 INFO:tasks.workunit.client.0.smithi072.stdout:1/668: write d5/f17 [1864088,103694] 0 2024-04-15T21:02:54.529 INFO:tasks.workunit.client.1.smithi149.stdout:5/841: unlink d0/c74 0 2024-04-15T21:02:54.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/689: mkdir d4/d29/d45/ddb 0 2024-04-15T21:02:54.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/690: chown d4/d29/fbd 6813 1 2024-04-15T21:02:54.532 INFO:tasks.workunit.client.0.smithi072.stdout:4/687: truncate d7/d10/d41/d45/f8a 1151539 0 2024-04-15T21:02:54.533 INFO:tasks.workunit.client.1.smithi149.stdout:4/945: getdents dc/d18/dce/dd8 0 2024-04-15T21:02:54.533 INFO:tasks.workunit.client.0.smithi072.stdout:4/688: stat d7/d24/lb9 0 2024-04-15T21:02:54.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/946: truncate dc/d2c/d3e/d35/f86 4709224 0 2024-04-15T21:02:54.534 INFO:tasks.workunit.client.0.smithi072.stdout:9/691: dread d4/f6a [0,4194304] 0 2024-04-15T21:02:54.535 INFO:tasks.workunit.client.1.smithi149.stdout:5/842: mknod d0/d6/d9f/c10b 0 2024-04-15T21:02:54.536 INFO:tasks.workunit.client.0.smithi072.stdout:6/672: symlink d2/d42/db9/lcc 0 2024-04-15T21:02:54.538 INFO:tasks.workunit.client.1.smithi149.stdout:2/931: unlink d4/d7/d46/de4/d21/f3a 0 2024-04-15T21:02:54.539 INFO:tasks.workunit.client.0.smithi072.stdout:2/711: symlink d2/d64/le6 0 2024-04-15T21:02:54.539 INFO:tasks.workunit.client.0.smithi072.stdout:9/692: dwrite d4/d29/d4c/d91/d93/fac [0,4194304] 0 2024-04-15T21:02:54.542 INFO:tasks.workunit.client.1.smithi149.stdout:4/947: dwrite dc/d18/d21/f135 [0,4194304] 0 2024-04-15T21:02:54.543 INFO:tasks.workunit.client.1.smithi149.stdout:4/948: readlink dc/d8f/lb1 0 2024-04-15T21:02:54.545 INFO:tasks.workunit.client.0.smithi072.stdout:3/676: getdents d1/d3f/d4f/d73 0 2024-04-15T21:02:54.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/712: dwrite d2/d38/d73/d80/f92 [0,4194304] 0 2024-04-15T21:02:54.557 INFO:tasks.workunit.client.1.smithi149.stdout:9/810: write d23/d2b/d44/f63 [966172,109098] 0 2024-04-15T21:02:54.557 INFO:tasks.workunit.client.1.smithi149.stdout:4/949: rmdir dc/d8f/d91 39 2024-04-15T21:02:54.557 INFO:tasks.workunit.client.1.smithi149.stdout:9/811: chown d23 128 1 2024-04-15T21:02:54.558 INFO:tasks.workunit.client.0.smithi072.stdout:4/689: rmdir d7/d71/db2 39 2024-04-15T21:02:54.559 INFO:tasks.workunit.client.0.smithi072.stdout:1/669: dwrite d5/db/d27/f62 [0,4194304] 0 2024-04-15T21:02:54.563 INFO:tasks.workunit.client.0.smithi072.stdout:9/693: dread d4/d1f/d2c/d47/f5f [0,4194304] 0 2024-04-15T21:02:54.563 INFO:tasks.workunit.client.1.smithi149.stdout:9/812: truncate d23/d2b/d70/fae 785926 0 2024-04-15T21:02:54.564 INFO:tasks.workunit.client.0.smithi072.stdout:9/694: write d4/d1f/fc3 [4352692,43344] 0 2024-04-15T21:02:54.566 INFO:tasks.workunit.client.1.smithi149.stdout:4/950: dread dc/d2c/d3e/d35/d3a/f65 [0,4194304] 0 2024-04-15T21:02:54.572 INFO:tasks.workunit.client.1.smithi149.stdout:5/843: write d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [8147323,42056] 0 2024-04-15T21:02:54.574 INFO:tasks.workunit.client.0.smithi072.stdout:3/677: truncate d1/f10 3627243 0 2024-04-15T21:02:54.577 INFO:tasks.workunit.client.0.smithi072.stdout:2/713: read d2/d3/f4c [1470198,50576] 0 2024-04-15T21:02:54.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/722: dwrite d3/de/d1b/d41/fa9 [0,4194304] 0 2024-04-15T21:02:54.578 INFO:tasks.workunit.client.1.smithi149.stdout:4/951: mknod dc/d2c/d3e/d7c/dd0/c139 0 2024-04-15T21:02:54.581 INFO:tasks.workunit.client.1.smithi149.stdout:4/952: stat dc/d2c/d3e/d15/d5b/f74 0 2024-04-15T21:02:54.582 INFO:tasks.workunit.client.0.smithi072.stdout:7/673: dwrite d2/d7/d25/d72/f85 [0,4194304] 0 2024-04-15T21:02:54.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/932: dwrite d4/d7/d46/de4/d21/d2c/fec [0,4194304] 0 2024-04-15T21:02:54.583 INFO:tasks.workunit.client.0.smithi072.stdout:4/690: unlink d7/f43 0 2024-04-15T21:02:54.584 INFO:tasks.workunit.client.0.smithi072.stdout:3/678: dwrite d1/d15/d40/d9e/fc6 [0,4194304] 0 2024-04-15T21:02:54.586 INFO:tasks.workunit.client.0.smithi072.stdout:0/706: dread d0/d19/d71/d9e/fe4 [0,4194304] 0 2024-04-15T21:02:54.587 INFO:tasks.workunit.client.1.smithi149.stdout:5/844: dread d0/d6/fd2 [0,4194304] 0 2024-04-15T21:02:54.592 INFO:tasks.workunit.client.1.smithi149.stdout:5/845: write d0/d6/d82/da1/d12/d16/da9/fac [1502345,57390] 0 2024-04-15T21:02:54.597 INFO:tasks.workunit.client.1.smithi149.stdout:4/953: dread dc/d2c/d3e/d15/d3f/d117/d75/d80/fc4 [0,4194304] 0 2024-04-15T21:02:54.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/846: mknod d0/d6/d82/da1/c10c 0 2024-04-15T21:02:54.605 INFO:tasks.workunit.client.0.smithi072.stdout:5/720: sync 2024-04-15T21:02:54.606 INFO:tasks.workunit.client.1.smithi149.stdout:4/954: symlink dc/d1a/dc8/l13a 0 2024-04-15T21:02:54.608 INFO:tasks.workunit.client.1.smithi149.stdout:4/955: write dc/d2c/d3e/d15/d3f/d117/d6c/f7b [106911,18913] 0 2024-04-15T21:02:54.608 INFO:tasks.workunit.client.1.smithi149.stdout:7/851: sync 2024-04-15T21:02:54.608 INFO:tasks.workunit.client.1.smithi149.stdout:6/869: sync 2024-04-15T21:02:54.608 INFO:tasks.workunit.client.1.smithi149.stdout:5/847: truncate d0/d6/fd2 1310443 0 2024-04-15T21:02:54.610 INFO:tasks.workunit.client.1.smithi149.stdout:3/874: sync 2024-04-15T21:02:54.610 INFO:tasks.workunit.client.1.smithi149.stdout:1/799: sync 2024-04-15T21:02:54.611 INFO:tasks.workunit.client.1.smithi149.stdout:4/956: chown dc/d2c/d3e/d35/fcd 0 1 2024-04-15T21:02:54.615 INFO:tasks.workunit.client.1.smithi149.stdout:9/813: write d23/d2b/d70/d75/f95 [3089608,84417] 0 2024-04-15T21:02:54.620 INFO:tasks.workunit.client.0.smithi072.stdout:3/679: dwrite d1/d15/d32/fa8 [0,4194304] 0 2024-04-15T21:02:54.620 INFO:tasks.workunit.client.0.smithi072.stdout:1/670: unlink d5/d3d/d5e/c76 0 2024-04-15T21:02:54.621 INFO:tasks.workunit.client.1.smithi149.stdout:6/870: mknod da/d2e/dc3/c115 0 2024-04-15T21:02:54.622 INFO:tasks.workunit.client.0.smithi072.stdout:1/671: fdatasync d5/db/d2d/f8b 0 2024-04-15T21:02:54.625 INFO:tasks.workunit.client.0.smithi072.stdout:6/673: creat d2/d10/d18/fcd x:0 0 0 2024-04-15T21:02:54.626 INFO:tasks.workunit.client.0.smithi072.stdout:6/674: readlink d2/l5 0 2024-04-15T21:02:54.631 INFO:tasks.workunit.client.0.smithi072.stdout:2/714: unlink d2/d66/l71 0 2024-04-15T21:02:54.633 INFO:tasks.workunit.client.1.smithi149.stdout:1/800: creat d1/db/dc/d38/d39/fec x:0 0 0 2024-04-15T21:02:54.637 INFO:tasks.workunit.client.0.smithi072.stdout:2/715: dwrite d2/d66/fb0 [0,4194304] 0 2024-04-15T21:02:54.637 INFO:tasks.workunit.client.0.smithi072.stdout:5/721: rename d0/d3/d7/d12/d31/d55/f21 to d0/d3/d7/d94/d92/ff2 0 2024-04-15T21:02:54.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/871: readlink da/d18/d7d/lc6 0 2024-04-15T21:02:54.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/872: dread - da/d11/d90/f102 zero size 2024-04-15T21:02:54.641 INFO:tasks.workunit.client.0.smithi072.stdout:4/691: mkdir d7/d10/d41/d44/d7a/d86/d76/d8b/dad/de1 0 2024-04-15T21:02:54.642 INFO:tasks.workunit.client.0.smithi072.stdout:5/722: dwrite d0/d3/d7/d12/d31/d55/d58/f63 [0,4194304] 0 2024-04-15T21:02:54.649 INFO:tasks.workunit.client.0.smithi072.stdout:5/723: dwrite d0/d3/d7/d12/d31/d55/f56 [0,4194304] 0 2024-04-15T21:02:54.649 INFO:tasks.workunit.client.1.smithi149.stdout:1/801: rmdir d1/d17/d52 39 2024-04-15T21:02:54.650 INFO:tasks.workunit.client.1.smithi149.stdout:1/802: fsync d1/d17/d36/d6f/da3/fd4 0 2024-04-15T21:02:54.653 INFO:tasks.workunit.client.1.smithi149.stdout:4/957: mkdir dc/d2c/d3e/d15/d3f/d117/d6c/d70/df9/d13b 0 2024-04-15T21:02:54.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/958: dread dc/d18/d21/f135 [0,4194304] 0 2024-04-15T21:02:54.662 INFO:tasks.workunit.client.1.smithi149.stdout:6/873: mkdir da/d32/d116 0 2024-04-15T21:02:54.664 INFO:tasks.workunit.client.1.smithi149.stdout:7/852: truncate d3/d16/d20/d114/fd1 500035 0 2024-04-15T21:02:54.666 INFO:tasks.workunit.client.1.smithi149.stdout:2/933: fdatasync d4/d7/d46/de4/d21/d2c/d32/fef 0 2024-04-15T21:02:54.669 INFO:tasks.workunit.client.0.smithi072.stdout:1/672: rename d5/db/f4f to d5/db/d2d/d56/fd6 0 2024-04-15T21:02:54.670 INFO:tasks.workunit.client.0.smithi072.stdout:1/673: chown d5/d31/c67 5 1 2024-04-15T21:02:54.671 INFO:tasks.workunit.client.0.smithi072.stdout:2/716: symlink d2/d8/d41/le7 0 2024-04-15T21:02:54.672 INFO:tasks.workunit.client.1.smithi149.stdout:4/959: truncate dc/d1a/f78 80988 0 2024-04-15T21:02:54.673 INFO:tasks.workunit.client.1.smithi149.stdout:1/803: dwrite d1/db/d16/f5c [0,4194304] 0 2024-04-15T21:02:54.674 INFO:tasks.workunit.client.1.smithi149.stdout:4/960: write dc/d2c/d3e/d35/fcd [1172439,72171] 0 2024-04-15T21:02:54.676 INFO:tasks.workunit.client.1.smithi149.stdout:5/848: getdents d0/d6/dc8 0 2024-04-15T21:02:54.676 INFO:tasks.workunit.client.0.smithi072.stdout:9/695: truncate d4/d1f/d2c/d62/f6c 1855589 0 2024-04-15T21:02:54.677 INFO:tasks.workunit.client.1.smithi149.stdout:5/849: chown d0/d6/d2d/c7d 129920 1 2024-04-15T21:02:54.679 INFO:tasks.workunit.client.0.smithi072.stdout:7/674: creat d2/d7/d25/d2d/d47/fd2 x:0 0 0 2024-04-15T21:02:54.682 INFO:tasks.workunit.client.0.smithi072.stdout:4/692: creat d7/d10/d41/d44/d7a/d86/d76/d8b/fe2 x:0 0 0 2024-04-15T21:02:54.692 INFO:tasks.workunit.client.0.smithi072.stdout:5/724: mknod d0/d3/d7/d12/d31/d62/d8e/cf3 0 2024-04-15T21:02:54.697 INFO:tasks.workunit.client.1.smithi149.stdout:1/804: creat d1/db/dc/d11/d3e/fed x:0 0 0 2024-04-15T21:02:54.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/805: write d1/db/d14/f9d [242331,29113] 0 2024-04-15T21:02:54.701 INFO:tasks.workunit.client.1.smithi149.stdout:1/806: read - d1/db/dc/d38/d39/d43/fcf zero size 2024-04-15T21:02:54.702 INFO:tasks.workunit.client.0.smithi072.stdout:8/723: getdents d3/d4/d4d 0 2024-04-15T21:02:54.704 INFO:tasks.workunit.client.0.smithi072.stdout:2/717: unlink d2/d8/d41/le7 0 2024-04-15T21:02:54.705 INFO:tasks.workunit.client.0.smithi072.stdout:2/718: fsync d2/d3/f46 0 2024-04-15T21:02:54.706 INFO:tasks.workunit.client.0.smithi072.stdout:2/719: chown d2/d66/f68 3144 1 2024-04-15T21:02:54.711 INFO:tasks.workunit.client.0.smithi072.stdout:0/707: getdents d0/d74 0 2024-04-15T21:02:54.712 INFO:tasks.workunit.client.0.smithi072.stdout:3/680: dwrite d1/d3f/fd2 [0,4194304] 0 2024-04-15T21:02:54.713 INFO:tasks.workunit.client.0.smithi072.stdout:0/708: chown d0/d45/d7a/d70/d59/d8a/d8b/db8/f34 1 1 2024-04-15T21:02:54.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/725: read - d0/d3/d33/fac zero size 2024-04-15T21:02:54.718 INFO:tasks.workunit.client.0.smithi072.stdout:6/675: rename d2/l5 to d2/d40/dc3/lce 0 2024-04-15T21:02:54.722 INFO:tasks.workunit.client.0.smithi072.stdout:8/724: unlink d3/d4/d4d/lcf 0 2024-04-15T21:02:54.727 INFO:tasks.workunit.client.1.smithi149.stdout:1/807: dread d1/d17/d52/d78/fd0 [0,4194304] 0 2024-04-15T21:02:54.727 INFO:tasks.workunit.client.0.smithi072.stdout:8/725: read d3/d4/d4d/f73 [1291925,18755] 0 2024-04-15T21:02:54.728 INFO:tasks.workunit.client.1.smithi149.stdout:1/808: chown d1/db/dc/d38/d39/d88 0 1 2024-04-15T21:02:54.730 INFO:tasks.workunit.client.1.smithi149.stdout:6/874: rename da/d60/lc7 to da/d11/l117 0 2024-04-15T21:02:54.731 INFO:tasks.workunit.client.1.smithi149.stdout:6/875: fsync da/fdf 0 2024-04-15T21:02:54.731 INFO:tasks.workunit.client.0.smithi072.stdout:9/696: mkdir d4/d29/d45/ddc 0 2024-04-15T21:02:54.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/693: mknod d7/d10/d41/d45/d93/de0/ce3 0 2024-04-15T21:02:54.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/853: dwrite d3/d16/d20/d36/d3d/f9d [0,4194304] 0 2024-04-15T21:02:54.738 INFO:tasks.workunit.client.0.smithi072.stdout:2/720: dread d2/d8/fe [0,4194304] 0 2024-04-15T21:02:54.742 INFO:tasks.workunit.client.1.smithi149.stdout:4/961: link dc/d2c/d3e/d15/d3f/d117/de8/dfc/l112 dc/d18/dce/dd7/l13c 0 2024-04-15T21:02:54.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/850: dwrite d0/d9/db6/f7e [0,4194304] 0 2024-04-15T21:02:54.750 INFO:tasks.workunit.client.0.smithi072.stdout:0/709: truncate d0/d19/d2b/fba 630205 0 2024-04-15T21:02:54.752 INFO:tasks.workunit.client.1.smithi149.stdout:7/854: fdatasync d3/d16/d11f/f7d 0 2024-04-15T21:02:54.758 INFO:tasks.workunit.client.1.smithi149.stdout:6/876: rename da/d18/d33/c77 to da/d2e/dc3/dfb/c118 0 2024-04-15T21:02:54.761 INFO:tasks.workunit.client.1.smithi149.stdout:2/934: link d4/d7/d46/de4/d21/d3b/l5a d4/d7/d46/de4/d21/d55/dfe/d106/l150 0 2024-04-15T21:02:54.763 INFO:tasks.workunit.client.0.smithi072.stdout:8/726: rename d3/d4/d4c/c7d to d3/d7e/dda/ce4 0 2024-04-15T21:02:54.765 INFO:tasks.workunit.client.0.smithi072.stdout:6/676: write d2/fe [1229862,64038] 0 2024-04-15T21:02:54.769 INFO:tasks.workunit.client.0.smithi072.stdout:4/694: creat d7/d10/d41/d45/d93/de0/fe4 x:0 0 0 2024-04-15T21:02:54.774 INFO:tasks.workunit.client.1.smithi149.stdout:5/851: fsync d0/d9/d3f/fc1 0 2024-04-15T21:02:54.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/962: write dc/d2c/d3e/f47 [6656818,75859] 0 2024-04-15T21:02:54.778 INFO:tasks.workunit.client.0.smithi072.stdout:3/681: creat d1/d3f/d4f/d73/db3/dc4/dd0/fd4 x:0 0 0 2024-04-15T21:02:54.778 INFO:tasks.workunit.client.0.smithi072.stdout:7/675: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 336184 0 2024-04-15T21:02:54.779 INFO:tasks.workunit.client.1.smithi149.stdout:1/809: dwrite d1/d17/d36/d6f/fb0 [0,4194304] 0 2024-04-15T21:02:54.779 INFO:tasks.workunit.client.0.smithi072.stdout:7/676: chown d2/l15 0 1 2024-04-15T21:02:54.782 INFO:tasks.workunit.client.1.smithi149.stdout:6/877: creat da/d2e/de7/f119 x:0 0 0 2024-04-15T21:02:54.784 INFO:tasks.workunit.client.0.smithi072.stdout:0/710: unlink d0/d6/fc7 0 2024-04-15T21:02:54.786 INFO:tasks.workunit.client.1.smithi149.stdout:2/935: symlink d4/d7/d46/de4/d21/d2c/d58/l151 0 2024-04-15T21:02:54.788 INFO:tasks.workunit.client.0.smithi072.stdout:1/674: sync 2024-04-15T21:02:54.790 INFO:tasks.workunit.client.0.smithi072.stdout:8/727: mkdir d3/d4/d4c/de5 0 2024-04-15T21:02:54.793 INFO:tasks.workunit.client.0.smithi072.stdout:5/726: dwrite d0/f35 [0,4194304] 0 2024-04-15T21:02:54.794 INFO:tasks.workunit.client.0.smithi072.stdout:4/695: rmdir d7/d24 39 2024-04-15T21:02:54.798 INFO:tasks.workunit.client.0.smithi072.stdout:7/677: read d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 [402439,27271] 0 2024-04-15T21:02:54.799 INFO:tasks.workunit.client.0.smithi072.stdout:9/697: dwrite d4/d1f/d2c/f8c [0,4194304] 0 2024-04-15T21:02:54.803 INFO:tasks.workunit.client.0.smithi072.stdout:0/711: mknod d0/d6/d6d/dcc/cf3 0 2024-04-15T21:02:54.803 INFO:tasks.workunit.client.0.smithi072.stdout:0/712: chown d0/d6/d55/ld6 62930 1 2024-04-15T21:02:54.806 INFO:tasks.workunit.client.0.smithi072.stdout:0/713: read d0/d19/d96/fc6 [211914,3288] 0 2024-04-15T21:02:54.812 INFO:tasks.workunit.client.0.smithi072.stdout:0/714: dwrite d0/fb3 [0,4194304] 0 2024-04-15T21:02:54.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/727: fsync d0/d3/d33/d60/d81/f2a 0 2024-04-15T21:02:54.816 INFO:tasks.workunit.client.0.smithi072.stdout:5/728: chown d0/d3/d33/fac 44038 1 2024-04-15T21:02:54.817 INFO:tasks.workunit.client.0.smithi072.stdout:3/682: truncate d1/d15/f98 2911780 0 2024-04-15T21:02:54.820 INFO:tasks.workunit.client.0.smithi072.stdout:9/698: read d4/d1f/d31/d4d/f7b [46884,59246] 0 2024-04-15T21:02:54.820 INFO:tasks.workunit.client.0.smithi072.stdout:7/678: mknod d2/d7/d25/d2d/d46/d5a/d5f/d43/cd3 0 2024-04-15T21:02:54.821 INFO:tasks.workunit.client.0.smithi072.stdout:8/728: dread d3/d4/d76/fb8 [0,4194304] 0 2024-04-15T21:02:54.824 INFO:tasks.workunit.client.0.smithi072.stdout:6/677: rename d2/l8 to d2/d10/d11/lcf 0 2024-04-15T21:02:54.826 INFO:tasks.workunit.client.0.smithi072.stdout:0/715: creat d0/d74/dd5/ff4 x:0 0 0 2024-04-15T21:02:54.826 INFO:tasks.workunit.client.0.smithi072.stdout:0/716: fdatasync d0/d19/f4a 0 2024-04-15T21:02:54.827 INFO:tasks.workunit.client.0.smithi072.stdout:4/696: mknod d7/d28/ce5 0 2024-04-15T21:02:54.829 INFO:tasks.workunit.client.0.smithi072.stdout:2/721: getdents d2/d66/d96 0 2024-04-15T21:02:54.830 INFO:tasks.workunit.client.0.smithi072.stdout:1/675: write d5/d31/f37 [1015398,115376] 0 2024-04-15T21:02:54.831 INFO:tasks.workunit.client.0.smithi072.stdout:1/676: dread - d5/d3d/fb3 zero size 2024-04-15T21:02:54.834 INFO:tasks.workunit.client.0.smithi072.stdout:3/683: mkdir d1/d3f/d4f/d73/db3/dd5 0 2024-04-15T21:02:54.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/963: rmdir dc/deb 39 2024-04-15T21:02:54.836 INFO:tasks.workunit.client.0.smithi072.stdout:9/699: write d4/d1f/d31/f63 [2532033,10642] 0 2024-04-15T21:02:54.882 INFO:tasks.workunit.client.1.smithi149.stdout:7/855: mknod d3/d16/d20/d36/d3d/c132 0 2024-04-15T21:02:54.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/810: read d1/d17/d52/d6c/f7a [288473,30255] 0 2024-04-15T21:02:54.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/811: chown d1/d17/d4d 52 1 2024-04-15T21:02:54.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/878: creat da/d18/d10/d3f/ded/f11a x:0 0 0 2024-04-15T21:02:54.887 INFO:tasks.workunit.client.1.smithi149.stdout:6/879: dread - da/d2e/de7/f119 zero size 2024-04-15T21:02:54.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/964: creat dc/d2c/d3e/d35/db4/f13d x:0 0 0 2024-04-15T21:02:54.893 INFO:tasks.workunit.client.1.smithi149.stdout:6/880: dwrite da/d18/d7d/ffd [0,4194304] 0 2024-04-15T21:02:54.898 INFO:tasks.workunit.client.0.smithi072.stdout:2/722: creat d2/d3/d5f/dc8/fe8 x:0 0 0 2024-04-15T21:02:54.899 INFO:tasks.workunit.client.1.smithi149.stdout:7/856: rename d3/d16/d11f/f5d to d3/d16/da0/f133 0 2024-04-15T21:02:54.901 INFO:tasks.workunit.client.0.smithi072.stdout:1/677: unlink d5/db/d2d/d3a/c45 0 2024-04-15T21:02:54.903 INFO:tasks.workunit.client.1.smithi149.stdout:2/936: symlink d4/l152 0 2024-04-15T21:02:54.904 INFO:tasks.workunit.client.1.smithi149.stdout:2/937: stat d4/d7/d46/de4/d21/d55/dfe/d106/l10c 0 2024-04-15T21:02:54.904 INFO:tasks.workunit.client.0.smithi072.stdout:3/684: symlink d1/d3f/d4f/d73/db3/dc4/dd0/ld6 0 2024-04-15T21:02:54.908 INFO:tasks.workunit.client.0.smithi072.stdout:9/700: dread d4/d1f/d2c/d62/f81 [0,4194304] 0 2024-04-15T21:02:54.908 INFO:tasks.workunit.client.1.smithi149.stdout:4/965: rmdir dc/d18/dce/dd7 39 2024-04-15T21:02:54.912 INFO:tasks.workunit.client.1.smithi149.stdout:6/881: mkdir da/d18/d10/d3f/ded/d11b 0 2024-04-15T21:02:54.916 INFO:tasks.workunit.client.0.smithi072.stdout:0/717: symlink d0/d45/d7a/d70/d59/d8a/lf5 0 2024-04-15T21:02:54.918 INFO:tasks.workunit.client.0.smithi072.stdout:4/697: symlink d7/d10/d41/d45/d7c/le6 0 2024-04-15T21:02:54.919 INFO:tasks.workunit.client.1.smithi149.stdout:2/938: mkdir d4/d7/d10/d153 0 2024-04-15T21:02:54.919 INFO:tasks.workunit.client.0.smithi072.stdout:4/698: write d7/d10/d41/d44/d7a/fda [826194,114125] 0 2024-04-15T21:02:54.919 INFO:tasks.workunit.client.0.smithi072.stdout:2/723: fdatasync d2/d8/d8e/fa7 0 2024-04-15T21:02:54.920 INFO:tasks.workunit.client.0.smithi072.stdout:2/724: fdatasync d2/d8/f36 0 2024-04-15T21:02:54.925 INFO:tasks.workunit.client.0.smithi072.stdout:7/679: write d2/fa [1202128,122998] 0 2024-04-15T21:02:54.925 INFO:tasks.workunit.client.1.smithi149.stdout:7/857: mknod d3/d16/d20/d36/d3d/da4/c134 0 2024-04-15T21:02:54.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/812: link d1/db/dc/d11/d3e/la1 d1/db/dc/d38/d39/d43/daa/d8a/lee 0 2024-04-15T21:02:54.926 INFO:tasks.workunit.client.0.smithi072.stdout:3/685: creat d1/d5b/fd7 x:0 0 0 2024-04-15T21:02:54.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/939: chown d4/d7/d46/de4/d21/d2c/d32/cce 6499 1 2024-04-15T21:02:54.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/858: dwrite d3/d17/d1f/f22 [4194304,4194304] 0 2024-04-15T21:02:54.932 INFO:tasks.workunit.client.1.smithi149.stdout:4/966: rename dc/d2c/d3e/d15/d3f/d117/d75/c9a to dc/d18/d21/c13e 0 2024-04-15T21:02:54.935 INFO:tasks.workunit.client.0.smithi072.stdout:0/718: fdatasync d0/d45/d7a/d70/d59/d8a/fa7 0 2024-04-15T21:02:54.938 INFO:tasks.workunit.client.1.smithi149.stdout:1/813: mknod d1/d17/d5e/cef 0 2024-04-15T21:02:54.939 INFO:tasks.workunit.client.0.smithi072.stdout:6/678: sync 2024-04-15T21:02:54.940 INFO:tasks.workunit.client.1.smithi149.stdout:5/852: dwrite d0/d6/d82/da1/d12/d16/f58 [0,4194304] 0 2024-04-15T21:02:54.940 INFO:tasks.workunit.client.0.smithi072.stdout:4/699: mkdir d7/d28/d6d/de7 0 2024-04-15T21:02:54.940 INFO:tasks.workunit.client.0.smithi072.stdout:4/700: chown d7/d10/d41/d44/f73 504 1 2024-04-15T21:02:54.943 INFO:tasks.workunit.client.1.smithi149.stdout:2/940: stat d4/d7/d46/de4/c7c 0 2024-04-15T21:02:54.944 INFO:tasks.workunit.client.1.smithi149.stdout:7/859: chown d3/d16/c3e 73713 1 2024-04-15T21:02:54.945 INFO:tasks.workunit.client.0.smithi072.stdout:8/729: write d3/fcc [2008338,22491] 0 2024-04-15T21:02:54.947 INFO:tasks.workunit.client.1.smithi149.stdout:6/882: rename da/d11/c51 to da/d11/d90/c11c 0 2024-04-15T21:02:54.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/729: getdents d0/d3/d6/d2d/d79 0 2024-04-15T21:02:54.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/730: chown d0/d3/d6/f8 1746436 1 2024-04-15T21:02:54.953 INFO:tasks.workunit.client.1.smithi149.stdout:6/883: dread da/d18/d10/d16/d97/dbf/d55/fa7 [0,4194304] 0 2024-04-15T21:02:54.954 INFO:tasks.workunit.client.0.smithi072.stdout:7/680: mknod d2/d7/d25/d81/dbe/cd4 0 2024-04-15T21:02:54.956 INFO:tasks.workunit.client.0.smithi072.stdout:1/678: rename d5/db/d27/d5c/c90 to d5/db/d2d/d85/cd7 0 2024-04-15T21:02:54.958 INFO:tasks.workunit.client.0.smithi072.stdout:3/686: creat d1/d5b/dbf/fd8 x:0 0 0 2024-04-15T21:02:54.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/967: rename dc/d2c/d3e/l11d to dc/d2c/d3e/d15/d3f/d117/de8/l13f 0 2024-04-15T21:02:54.961 INFO:tasks.workunit.client.0.smithi072.stdout:9/701: mkdir d4/d29/d45/ddc/ddd 0 2024-04-15T21:02:54.961 INFO:tasks.workunit.client.0.smithi072.stdout:9/702: readlink d4/l5d 0 2024-04-15T21:02:54.964 INFO:tasks.workunit.client.1.smithi149.stdout:3/875: sync 2024-04-15T21:02:54.966 INFO:tasks.workunit.client.0.smithi072.stdout:4/701: fsync d7/d10/d41/f51 0 2024-04-15T21:02:54.968 INFO:tasks.workunit.client.1.smithi149.stdout:2/941: mknod d4/d7/d46/de4/c154 0 2024-04-15T21:02:54.968 INFO:tasks.workunit.client.0.smithi072.stdout:2/725: write d2/d3/f17 [89983,20090] 0 2024-04-15T21:02:54.969 INFO:tasks.workunit.client.0.smithi072.stdout:8/730: creat d3/fe6 x:0 0 0 2024-04-15T21:02:54.970 INFO:tasks.workunit.client.1.smithi149.stdout:1/814: write d1/db/f37 [1997008,55709] 0 2024-04-15T21:02:54.970 INFO:tasks.workunit.client.0.smithi072.stdout:8/731: write d3/de/d1b/d41/da4/f8e [6507563,79434] 0 2024-04-15T21:02:54.971 INFO:tasks.workunit.client.1.smithi149.stdout:6/884: symlink da/d11/dbe/l11d 0 2024-04-15T21:02:54.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/815: dread - d1/db/dc/d38/fe2 zero size 2024-04-15T21:02:54.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/860: truncate d3/d16/d20/d36/d3d/f80 4263894 0 2024-04-15T21:02:54.976 INFO:tasks.workunit.client.0.smithi072.stdout:7/681: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dd5 0 2024-04-15T21:02:54.977 INFO:tasks.workunit.client.0.smithi072.stdout:7/682: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c9e 59192520 1 2024-04-15T21:02:54.978 INFO:tasks.workunit.client.0.smithi072.stdout:7/683: chown d2/d7/d25/c2c 76978414 1 2024-04-15T21:02:54.980 INFO:tasks.workunit.client.1.smithi149.stdout:3/876: fsync d1/db/d24/d39/d79/d97/fc7 0 2024-04-15T21:02:54.980 INFO:tasks.workunit.client.1.smithi149.stdout:3/877: readlink d1/l18 0 2024-04-15T21:02:54.982 INFO:tasks.workunit.client.1.smithi149.stdout:5/853: creat d0/d6/d82/da1/d12/d16/da9/f10d x:0 0 0 2024-04-15T21:02:54.983 INFO:tasks.workunit.client.1.smithi149.stdout:5/854: readlink d0/d6/d82/da1/d12/d2b/lf0 0 2024-04-15T21:02:54.984 INFO:tasks.workunit.client.0.smithi072.stdout:0/719: truncate d0/d19/d2b/fba 678731 0 2024-04-15T21:02:54.985 INFO:tasks.workunit.client.0.smithi072.stdout:9/703: dread d4/d1f/d2c/d62/f96 [0,4194304] 0 2024-04-15T21:02:54.987 INFO:tasks.workunit.client.0.smithi072.stdout:9/704: write d4/d29/d4c/d74/fcd [844299,22767] 0 2024-04-15T21:02:54.988 INFO:tasks.workunit.client.0.smithi072.stdout:6/679: rename d2/d10/d18/fa2 to d2/d40/d56/d6a/fd0 0 2024-04-15T21:02:54.990 INFO:tasks.workunit.client.1.smithi149.stdout:1/816: fdatasync d1/db/dc/d38/d39/d43/f7b 0 2024-04-15T21:02:54.990 INFO:tasks.workunit.client.1.smithi149.stdout:5/855: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/ffe [0,4194304] 0 2024-04-15T21:02:54.992 INFO:tasks.workunit.client.0.smithi072.stdout:6/680: dread d2/fc [0,4194304] 0 2024-04-15T21:02:54.993 INFO:tasks.workunit.client.1.smithi149.stdout:7/861: mkdir d3/d16/d11f/d92/d123/d135 0 2024-04-15T21:02:54.993 INFO:tasks.workunit.client.0.smithi072.stdout:4/702: dread - d7/d28/d42/f70 zero size 2024-04-15T21:02:55.001 INFO:tasks.workunit.client.1.smithi149.stdout:3/878: mkdir d1/db/d24/d4d/d63/db6/d112 0 2024-04-15T21:02:55.002 INFO:tasks.workunit.client.0.smithi072.stdout:5/731: truncate d0/d3/d7/d1f/f29 819482 0 2024-04-15T21:02:55.002 INFO:tasks.workunit.client.0.smithi072.stdout:3/687: dread d1/d15/d32/d2f/f5c [0,4194304] 0 2024-04-15T21:02:55.002 INFO:tasks.workunit.client.0.smithi072.stdout:1/679: symlink d5/d31/ld8 0 2024-04-15T21:02:55.003 INFO:tasks.workunit.client.0.smithi072.stdout:1/680: write d5/f17 [4156287,117558] 0 2024-04-15T21:02:55.004 INFO:tasks.workunit.client.1.smithi149.stdout:2/942: mkdir d4/d7/d46/de4/d21/d3b/d10a/dfd/d112/d155 0 2024-04-15T21:02:55.006 INFO:tasks.workunit.client.0.smithi072.stdout:7/684: truncate d2/d7/f55 709786 0 2024-04-15T21:02:55.006 INFO:tasks.workunit.client.1.smithi149.stdout:4/968: truncate dc/d2c/d3e/f47 7382792 0 2024-04-15T21:02:55.007 INFO:tasks.workunit.client.1.smithi149.stdout:4/969: stat dc/d2c/d3e/d7c 0 2024-04-15T21:02:55.009 INFO:tasks.workunit.client.0.smithi072.stdout:7/685: read d2/d7/d25/d72/f9f [337684,102446] 0 2024-04-15T21:02:55.010 INFO:tasks.workunit.client.0.smithi072.stdout:7/686: chown d2/d78/fa4 51 1 2024-04-15T21:02:55.013 INFO:tasks.workunit.client.1.smithi149.stdout:5/856: creat d0/d9/d3f/dc7/f10e x:0 0 0 2024-04-15T21:02:55.014 INFO:tasks.workunit.client.1.smithi149.stdout:6/885: dwrite da/d18/d10/f103 [4194304,4194304] 0 2024-04-15T21:02:55.015 INFO:tasks.workunit.client.1.smithi149.stdout:7/862: rename d3/d16/d20/d36/d3d/d56/d10e/c11d to d3/d17/d11e/c136 0 2024-04-15T21:02:55.017 INFO:tasks.workunit.client.0.smithi072.stdout:2/726: rename d2/d66/d69/fc1 to d2/dd7/fe9 0 2024-04-15T21:02:55.018 INFO:tasks.workunit.client.0.smithi072.stdout:2/727: write d2/d37/f49 [2315244,65565] 0 2024-04-15T21:02:55.019 INFO:tasks.workunit.client.0.smithi072.stdout:2/728: chown d2/d8/daa/cc5 797 1 2024-04-15T21:02:55.025 INFO:tasks.workunit.client.1.smithi149.stdout:3/879: rmdir d1/d81 39 2024-04-15T21:02:55.027 INFO:tasks.workunit.client.0.smithi072.stdout:4/703: unlink d7/d10/d41/d45/d93/ca0 0 2024-04-15T21:02:55.028 INFO:tasks.workunit.client.1.smithi149.stdout:2/943: mknod d4/d7/d46/de4/d21/c156 0 2024-04-15T21:02:55.029 INFO:tasks.workunit.client.1.smithi149.stdout:1/817: write d1/db/dc/d11/d3f/d45/f57 [3430339,31561] 0 2024-04-15T21:02:55.030 INFO:tasks.workunit.client.1.smithi149.stdout:2/944: write d4/d7/d46/de4/d21/d3b/f11a [1038375,91833] 0 2024-04-15T21:02:55.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/886: creat da/d2e/f11e x:0 0 0 2024-04-15T21:02:55.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/887: chown da/d11/f7b 4056135 1 2024-04-15T21:02:55.045 INFO:tasks.workunit.client.1.smithi149.stdout:3/880: symlink d1/db/d23/l113 0 2024-04-15T21:02:55.056 INFO:tasks.workunit.client.1.smithi149.stdout:6/888: symlink da/d18/d10/d16/d97/dbf/l11f 0 2024-04-15T21:02:55.058 INFO:tasks.workunit.client.1.smithi149.stdout:2/945: write d4/d7/d46/f57 [5534953,25226] 0 2024-04-15T21:02:55.060 INFO:tasks.workunit.client.1.smithi149.stdout:4/970: getdents dc/d2c/d3e/d15/d3f/d117/d6c 0 2024-04-15T21:02:55.062 INFO:tasks.workunit.client.1.smithi149.stdout:6/889: rmdir da/d2e/dc3/dfb 39 2024-04-15T21:02:55.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/890: fdatasync da/d11/f35 0 2024-04-15T21:02:55.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/891: write da/d18/d10/d3f/fde [1918242,25425] 0 2024-04-15T21:02:55.068 INFO:tasks.workunit.client.1.smithi149.stdout:4/971: creat dc/d2c/d3e/d15/d3f/d117/de8/dfc/f140 x:0 0 0 2024-04-15T21:02:55.068 INFO:tasks.workunit.client.1.smithi149.stdout:7/863: dwrite d3/d129/dfb/ffd [0,4194304] 0 2024-04-15T21:02:55.071 INFO:tasks.workunit.client.1.smithi149.stdout:7/864: write d3/d16/d20/d6c/feb [704314,98376] 0 2024-04-15T21:02:55.073 INFO:tasks.workunit.client.1.smithi149.stdout:6/892: unlink f8 0 2024-04-15T21:02:55.074 INFO:tasks.workunit.client.1.smithi149.stdout:6/893: fsync da/d18/d10/d3f/faa 0 2024-04-15T21:02:55.075 INFO:tasks.workunit.client.1.smithi149.stdout:3/881: link d1/db/d23/f3a d1/db/d24/f114 0 2024-04-15T21:02:55.079 INFO:tasks.workunit.client.1.smithi149.stdout:4/972: rmdir dc/d2c/d3e/d15/d5b 39 2024-04-15T21:02:55.090 INFO:tasks.workunit.client.1.smithi149.stdout:3/882: rmdir d1/db/d24/d39/dc0 39 2024-04-15T21:02:55.093 INFO:tasks.workunit.client.0.smithi072.stdout:3/688: creat d1/d3f/d4f/d73/fd9 x:0 0 0 2024-04-15T21:02:55.093 INFO:tasks.workunit.client.1.smithi149.stdout:4/973: rmdir dc/d2c/d3e/d15/d3f/d117/d6c/d70/df9 39 2024-04-15T21:02:55.094 INFO:tasks.workunit.client.0.smithi072.stdout:5/732: mknod d0/d3/d7/d12/d31/d62/db6/cf4 0 2024-04-15T21:02:55.096 INFO:tasks.workunit.client.1.smithi149.stdout:6/894: symlink da/d18/l120 0 2024-04-15T21:02:55.097 INFO:tasks.workunit.client.1.smithi149.stdout:6/895: stat da/c38 0 2024-04-15T21:02:55.099 INFO:tasks.workunit.client.1.smithi149.stdout:3/883: truncate d1/fba 37333 0 2024-04-15T21:02:55.099 INFO:tasks.workunit.client.0.smithi072.stdout:0/720: getdents d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2 0 2024-04-15T21:02:55.100 INFO:tasks.workunit.client.1.smithi149.stdout:2/946: getdents d4/d7/d46/de4/d21 0 2024-04-15T21:02:55.102 INFO:tasks.workunit.client.1.smithi149.stdout:4/974: dread dc/d1a/f78 [0,4194304] 0 2024-04-15T21:02:55.104 INFO:tasks.workunit.client.1.smithi149.stdout:6/896: mknod da/d18/d10/d16/c121 0 2024-04-15T21:02:55.106 INFO:tasks.workunit.client.1.smithi149.stdout:3/884: read - d1/db/fe6 zero size 2024-04-15T21:02:55.107 INFO:tasks.workunit.client.0.smithi072.stdout:1/681: sync 2024-04-15T21:02:55.108 INFO:tasks.workunit.client.1.smithi149.stdout:4/975: dwrite dc/ddf/f118 [0,4194304] 0 2024-04-15T21:02:55.113 INFO:tasks.workunit.client.0.smithi072.stdout:6/681: unlink d2/d40/f4d 0 2024-04-15T21:02:55.113 INFO:tasks.workunit.client.0.smithi072.stdout:6/682: stat d2/d10/d18/f96 0 2024-04-15T21:02:55.114 INFO:tasks.workunit.client.0.smithi072.stdout:6/683: write d2/da1/faa [696262,71474] 0 2024-04-15T21:02:55.115 INFO:tasks.workunit.client.1.smithi149.stdout:6/897: read - da/d18/d10/d16/d97/dbf/d55/d82/fe4 zero size 2024-04-15T21:02:55.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/865: dwrite d3/d16/d20/d114/fd1 [0,4194304] 0 2024-04-15T21:02:55.118 INFO:tasks.workunit.client.0.smithi072.stdout:8/732: creat d3/d4/fe7 x:0 0 0 2024-04-15T21:02:55.120 INFO:tasks.workunit.client.0.smithi072.stdout:8/733: write d3/d7e/fc1 [229854,85260] 0 2024-04-15T21:02:55.123 INFO:tasks.workunit.client.1.smithi149.stdout:3/885: rename d1/db/d24/d4d/d63/faa to d1/db/d24/d39/d79/d97/daf/f115 0 2024-04-15T21:02:55.127 INFO:tasks.workunit.client.0.smithi072.stdout:3/689: read d1/d3f/d4f/f68 [1691444,61135] 0 2024-04-15T21:02:55.127 INFO:tasks.workunit.client.1.smithi149.stdout:6/898: rmdir da 39 2024-04-15T21:02:55.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/690: write d1/d3f/fd2 [4449478,48082] 0 2024-04-15T21:02:55.128 INFO:tasks.workunit.client.0.smithi072.stdout:0/721: mkdir d0/d19/d96/dad/dc8/df6 0 2024-04-15T21:02:55.130 INFO:tasks.workunit.client.1.smithi149.stdout:4/976: fsync dc/d2c/d3e/f47 0 2024-04-15T21:02:55.131 INFO:tasks.workunit.client.0.smithi072.stdout:9/705: creat d4/d1f/d2c/fde x:0 0 0 2024-04-15T21:02:55.133 INFO:tasks.workunit.client.1.smithi149.stdout:2/947: write d4/d7/d46/de4/d21/d55/ffb [407106,81995] 0 2024-04-15T21:02:55.136 INFO:tasks.workunit.client.0.smithi072.stdout:4/704: mkdir d7/d10/d41/dc4/de8 0 2024-04-15T21:02:55.138 INFO:tasks.workunit.client.0.smithi072.stdout:6/684: readlink d2/d40/dc3/lce 0 2024-04-15T21:02:55.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/977: dread - dc/d2c/d3e/d15/d3f/d117/d75/d80/fea zero size 2024-04-15T21:02:55.139 INFO:tasks.workunit.client.1.smithi149.stdout:4/978: chown dc/d2c/d3e/d35/d3a/l9c 10 1 2024-04-15T21:02:55.143 INFO:tasks.workunit.client.0.smithi072.stdout:0/722: symlink d0/d19/d71/lf7 0 2024-04-15T21:02:55.145 INFO:tasks.workunit.client.1.smithi149.stdout:3/886: mknod d1/db/d24/c116 0 2024-04-15T21:02:55.146 INFO:tasks.workunit.client.1.smithi149.stdout:3/887: read d1/db/d24/f5f [3813907,844] 0 2024-04-15T21:02:55.147 INFO:tasks.workunit.client.1.smithi149.stdout:6/899: unlink da/d18/d7d/lbd 0 2024-04-15T21:02:55.151 INFO:tasks.workunit.client.1.smithi149.stdout:2/948: creat d4/d7/d10/d36/d139/f157 x:0 0 0 2024-04-15T21:02:55.153 INFO:tasks.workunit.client.1.smithi149.stdout:4/979: rename dc/d2c/d3e/d15/d3f/d117/de8/dfc/l112 to dc/d2c/d3e/d15/d3f/d117/d75/l141 0 2024-04-15T21:02:55.154 INFO:tasks.workunit.client.1.smithi149.stdout:4/980: fdatasync dc/d2c/d3e/d35/db4/f13d 0 2024-04-15T21:02:55.163 INFO:tasks.workunit.client.0.smithi072.stdout:1/682: write d5/d3d/f75 [2536666,115530] 0 2024-04-15T21:02:55.163 INFO:tasks.workunit.client.1.smithi149.stdout:6/900: symlink da/d18/d10/d3f/ded/d11b/l122 0 2024-04-15T21:02:55.164 INFO:tasks.workunit.client.1.smithi149.stdout:7/866: getdents d3/d16/d32/d90/dad/dc4/dde 0 2024-04-15T21:02:55.164 INFO:tasks.workunit.client.1.smithi149.stdout:3/888: dread d1/db/d24/d4d/d63/d65/dc3/fcc [0,4194304] 0 2024-04-15T21:02:55.165 INFO:tasks.workunit.client.1.smithi149.stdout:6/901: fsync da/d18/d7d/fe9 0 2024-04-15T21:02:55.166 INFO:tasks.workunit.client.0.smithi072.stdout:2/729: rename d2/d38/l5c to d2/d8/daa/lea 0 2024-04-15T21:02:55.166 INFO:tasks.workunit.client.1.smithi149.stdout:6/902: readlink da/d18/d7d/lb6 0 2024-04-15T21:02:55.167 INFO:tasks.workunit.client.0.smithi072.stdout:2/730: readlink d2/d3/l89 0 2024-04-15T21:02:55.167 INFO:tasks.workunit.client.1.smithi149.stdout:2/949: symlink d4/d7/d93/dc3/d137/l158 0 2024-04-15T21:02:55.168 INFO:tasks.workunit.client.1.smithi149.stdout:4/981: mknod dc/d2c/d3e/d15/d3f/d117/d6c/d70/c142 0 2024-04-15T21:02:55.168 INFO:tasks.workunit.client.0.smithi072.stdout:6/685: dread d2/d10/f58 [0,4194304] 0 2024-04-15T21:02:55.171 INFO:tasks.workunit.client.1.smithi149.stdout:3/889: rmdir d1/db/d28 39 2024-04-15T21:02:55.174 INFO:tasks.workunit.client.1.smithi149.stdout:7/867: dwrite d3/d16/d32/f10b [0,4194304] 0 2024-04-15T21:02:55.179 INFO:tasks.workunit.client.1.smithi149.stdout:4/982: truncate dc/d2c/d3e/d35/d3a/f65 429448 0 2024-04-15T21:02:55.180 INFO:tasks.workunit.client.1.smithi149.stdout:9/814: sync 2024-04-15T21:02:55.181 INFO:tasks.workunit.client.1.smithi149.stdout:3/890: symlink d1/db/d24/d4d/d63/d65/l117 0 2024-04-15T21:02:55.183 INFO:tasks.workunit.client.1.smithi149.stdout:3/891: write d1/db/d24/d39/f47 [3051575,90508] 0 2024-04-15T21:02:55.187 INFO:tasks.workunit.client.1.smithi149.stdout:2/950: creat d4/d7/d46/de4/d21/d55/dfe/d106/d13e/f159 x:0 0 0 2024-04-15T21:02:55.190 INFO:tasks.workunit.client.1.smithi149.stdout:9/815: unlink d23/d3c/d52/c97 0 2024-04-15T21:02:55.193 INFO:tasks.workunit.client.1.smithi149.stdout:3/892: dread d1/db/d24/f114 [0,4194304] 0 2024-04-15T21:02:55.195 INFO:tasks.workunit.client.1.smithi149.stdout:2/951: creat d4/d7/d46/de4/d21/d55/f15a x:0 0 0 2024-04-15T21:02:55.195 INFO:tasks.workunit.client.1.smithi149.stdout:7/868: write d3/d16/d20/fcc [472605,52520] 0 2024-04-15T21:02:55.198 INFO:tasks.workunit.client.1.smithi149.stdout:6/903: truncate da/d18/d10/d16/d97/dbf/fa5 3653329 0 2024-04-15T21:02:55.199 INFO:tasks.workunit.client.1.smithi149.stdout:3/893: creat d1/db/d24/d107/f118 x:0 0 0 2024-04-15T21:02:55.200 INFO:tasks.workunit.client.0.smithi072.stdout:7/687: sync 2024-04-15T21:02:55.201 INFO:tasks.workunit.client.0.smithi072.stdout:4/705: symlink d7/d71/db2/le9 0 2024-04-15T21:02:55.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/723: dwrite d0/d19/d58/f5a [0,4194304] 0 2024-04-15T21:02:55.202 INFO:tasks.workunit.client.1.smithi149.stdout:7/869: dread d3/d16/d20/d36/d3d/f9d [0,4194304] 0 2024-04-15T21:02:55.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/733: rename d0/d3/d6/f9f to d0/d3/d7/d12/d31/d62/ff5 0 2024-04-15T21:02:55.206 INFO:tasks.workunit.client.0.smithi072.stdout:0/724: dread d0/fb3 [0,4194304] 0 2024-04-15T21:02:55.207 INFO:tasks.workunit.client.1.smithi149.stdout:4/983: dwrite dc/d2c/d3e/d7c/dba/fcb [0,4194304] 0 2024-04-15T21:02:55.207 INFO:tasks.workunit.client.0.smithi072.stdout:3/691: getdents d1/d15 0 2024-04-15T21:02:55.208 INFO:tasks.workunit.client.0.smithi072.stdout:3/692: chown d1/d3f/fd2 454 1 2024-04-15T21:02:55.217 INFO:tasks.workunit.client.1.smithi149.stdout:9/816: symlink d23/d3c/d7a/da5/l10c 0 2024-04-15T21:02:55.225 INFO:tasks.workunit.client.0.smithi072.stdout:4/706: unlink d7/d15/f20 0 2024-04-15T21:02:55.225 INFO:tasks.workunit.client.0.smithi072.stdout:4/707: readlink d7/d10/l67 0 2024-04-15T21:02:55.228 INFO:tasks.workunit.client.1.smithi149.stdout:6/904: dwrite da/d18/d33/fa8 [4194304,4194304] 0 2024-04-15T21:02:55.230 INFO:tasks.workunit.client.1.smithi149.stdout:6/905: rename da/d18/d10/d3f to da/d18/d10/d3f/d123 22 2024-04-15T21:02:55.230 INFO:tasks.workunit.client.1.smithi149.stdout:4/984: creat dc/ddf/f143 x:0 0 0 2024-04-15T21:02:55.232 INFO:tasks.workunit.client.0.smithi072.stdout:5/734: rename d0/l1e to d0/d3/d33/d60/d81/lf6 0 2024-04-15T21:02:55.236 INFO:tasks.workunit.client.0.smithi072.stdout:0/725: mkdir d0/d45/d7a/d70/d59/d8a/d7b/df8 0 2024-04-15T21:02:55.239 INFO:tasks.workunit.client.0.smithi072.stdout:6/686: mknod d2/d40/d66/dbc/cd1 0 2024-04-15T21:02:55.240 INFO:tasks.workunit.client.0.smithi072.stdout:6/687: stat d2/d10/d11/d1f/d60/l82 0 2024-04-15T21:02:55.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/870: creat d3/d16/d32/d90/de5/f137 x:0 0 0 2024-04-15T21:02:55.241 INFO:tasks.workunit.client.0.smithi072.stdout:6/688: chown d2/d40/d56/f85 13846 1 2024-04-15T21:02:55.242 INFO:tasks.workunit.client.1.smithi149.stdout:4/985: unlink dc/d2c/d3e/d35/db4/l123 0 2024-04-15T21:02:55.244 INFO:tasks.workunit.client.0.smithi072.stdout:4/708: mknod d7/d10/d41/d44/d7a/d86/d76/d8b/dad/cea 0 2024-04-15T21:02:55.245 INFO:tasks.workunit.client.1.smithi149.stdout:6/906: mknod da/d2e/de7/c124 0 2024-04-15T21:02:55.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/735: dread - d0/d3/d6/d2d/f96 zero size 2024-04-15T21:02:55.247 INFO:tasks.workunit.client.0.smithi072.stdout:1/683: write d5/fb8 [693507,67522] 0 2024-04-15T21:02:55.249 INFO:tasks.workunit.client.0.smithi072.stdout:1/684: stat d5/db/d2d/d3a/d1f/d63/f68 0 2024-04-15T21:02:55.249 INFO:tasks.workunit.client.1.smithi149.stdout:2/952: dwrite d4/d7/d46/de4/f56 [0,4194304] 0 2024-04-15T21:02:55.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/871: rename d3/d16/d20/d6c/d91 to d3/d16/d20/d36/d3d/da4/d138 0 2024-04-15T21:02:55.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/731: link d2/d8/d41/db8/ld1 d2/d64/dce/leb 0 2024-04-15T21:02:55.253 INFO:tasks.workunit.client.1.smithi149.stdout:3/894: dwrite d1/db/d40/d56/d84/f9f [4194304,4194304] 0 2024-04-15T21:02:55.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/907: mkdir da/d11/dbe/dc1/d125 0 2024-04-15T21:02:55.259 INFO:tasks.workunit.client.0.smithi072.stdout:7/688: write d2/d7/d25/d2d/d46/d5a/d5f/f13 [7786781,73232] 0 2024-04-15T21:02:55.265 INFO:tasks.workunit.client.1.smithi149.stdout:4/986: mkdir dc/d1a/d12d/d144 0 2024-04-15T21:02:55.267 INFO:tasks.workunit.client.1.smithi149.stdout:4/987: chown dc/d2c/d3e/d15/d3f/d117/de8/dfc/l106 12316 1 2024-04-15T21:02:55.267 INFO:tasks.workunit.client.0.smithi072.stdout:6/689: dread d2/d40/fa3 [0,4194304] 0 2024-04-15T21:02:55.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/988: write dc/d2c/d3e/f110 [727263,27978] 0 2024-04-15T21:02:55.273 INFO:tasks.workunit.client.0.smithi072.stdout:1/685: write d5/db/d2d/d3a/d1f/d63/fa9 [1046146,75713] 0 2024-04-15T21:02:55.274 INFO:tasks.workunit.client.0.smithi072.stdout:2/732: readlink d2/la4 0 2024-04-15T21:02:55.274 INFO:tasks.workunit.client.0.smithi072.stdout:1/686: write d5/d3d/f6a [915808,129111] 0 2024-04-15T21:02:55.275 INFO:tasks.workunit.client.1.smithi149.stdout:9/817: dwrite d23/d2b/d44/f64 [4194304,4194304] 0 2024-04-15T21:02:55.283 INFO:tasks.workunit.client.0.smithi072.stdout:0/726: write d0/d45/d35/d3a/f99 [262549,23414] 0 2024-04-15T21:02:55.283 INFO:tasks.workunit.client.1.smithi149.stdout:3/895: dread d1/d81/ff2 [0,4194304] 0 2024-04-15T21:02:55.286 INFO:tasks.workunit.client.0.smithi072.stdout:4/709: mknod d7/d23/ceb 0 2024-04-15T21:02:55.287 INFO:tasks.workunit.client.0.smithi072.stdout:3/693: truncate d1/d15/d40/f22 5320794 0 2024-04-15T21:02:55.289 INFO:tasks.workunit.client.1.smithi149.stdout:6/908: unlink da/d18/d33/f6f 0 2024-04-15T21:02:55.292 INFO:tasks.workunit.client.1.smithi149.stdout:7/872: dread d3/f78 [0,4194304] 0 2024-04-15T21:02:55.293 INFO:tasks.workunit.client.1.smithi149.stdout:9/818: creat d23/d3c/d52/df8/f10d x:0 0 0 2024-04-15T21:02:55.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/819: write d23/d46/dcf/deb/d7f/d83/f105 [757453,59425] 0 2024-04-15T21:02:55.295 INFO:tasks.workunit.client.1.smithi149.stdout:3/896: creat d1/db/d24/d39/d79/f119 x:0 0 0 2024-04-15T21:02:55.298 INFO:tasks.workunit.client.1.smithi149.stdout:2/953: link d4/d7/d46/de4/db6/fc4 d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/f15b 0 2024-04-15T21:02:55.302 INFO:tasks.workunit.client.0.smithi072.stdout:6/690: symlink d2/d10/ld2 0 2024-04-15T21:02:55.308 INFO:tasks.workunit.client.1.smithi149.stdout:2/954: rename d4/d7/d46/de4/d21/d2c/d32/d4a to d4/d7/d46/de4/d21/d3b/d10a/d15c 0 2024-04-15T21:02:55.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/955: chown d4/d7/da/c2d 93473 1 2024-04-15T21:02:55.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/989: write dc/d2c/d3e/d35/ff7 [188651,112602] 0 2024-04-15T21:02:55.310 INFO:tasks.workunit.client.0.smithi072.stdout:4/710: creat d7/d10/d41/dc4/de8/fec x:0 0 0 2024-04-15T21:02:55.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/711: dread - d7/d10/d41/d45/d93/de0/fe4 zero size 2024-04-15T21:02:55.312 INFO:tasks.workunit.client.1.smithi149.stdout:6/909: creat da/d32/d116/f126 x:0 0 0 2024-04-15T21:02:55.313 INFO:tasks.workunit.client.0.smithi072.stdout:5/736: truncate d0/f80 4874766 0 2024-04-15T21:02:55.316 INFO:tasks.workunit.client.1.smithi149.stdout:3/897: rename d1/db/d28/d87/dbd/f8f to d1/db/d40/da0/f11a 0 2024-04-15T21:02:55.318 INFO:tasks.workunit.client.0.smithi072.stdout:6/691: mknod d2/d40/d56/cd3 0 2024-04-15T21:02:55.320 INFO:tasks.workunit.client.1.smithi149.stdout:7/873: dread d3/d96/f9a [0,4194304] 0 2024-04-15T21:02:55.322 INFO:tasks.workunit.client.1.smithi149.stdout:4/990: symlink dc/d18/d21/dfa/d109/l145 0 2024-04-15T21:02:55.322 INFO:tasks.workunit.client.0.smithi072.stdout:2/733: write d2/d8/d8e/d90/fa5 [492884,68917] 0 2024-04-15T21:02:55.326 INFO:tasks.workunit.client.1.smithi149.stdout:6/910: chown da/d18/d10/d16/d97/fbb 1029 1 2024-04-15T21:02:55.328 INFO:tasks.workunit.client.1.smithi149.stdout:6/911: readlink da/d2e/de7/l105 0 2024-04-15T21:02:55.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/820: dwrite d23/d71/fef [0,4194304] 0 2024-04-15T21:02:55.334 INFO:tasks.workunit.client.1.smithi149.stdout:7/874: mkdir d3/d16/d11f/d92/d123/d139 0 2024-04-15T21:02:55.336 INFO:tasks.workunit.client.1.smithi149.stdout:4/991: rmdir dc/d2c/d3e/d35 39 2024-04-15T21:02:55.337 INFO:tasks.workunit.client.1.smithi149.stdout:4/992: read - dc/d8f/fa6 zero size 2024-04-15T21:02:55.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/898: mkdir d1/db/d24/d39/dc0/d11b 0 2024-04-15T21:02:55.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/875: write d3/d16/d20/d6c/fc7 [645719,116499] 0 2024-04-15T21:02:55.345 INFO:tasks.workunit.client.1.smithi149.stdout:3/899: fdatasync d1/fdf 0 2024-04-15T21:02:55.347 INFO:tasks.workunit.client.0.smithi072.stdout:8/734: sync 2024-04-15T21:02:55.347 INFO:tasks.workunit.client.0.smithi072.stdout:9/706: sync 2024-04-15T21:02:55.348 INFO:tasks.workunit.client.1.smithi149.stdout:7/876: chown d3/d16/d20/d36/d3d/f9d 2026569008 1 2024-04-15T21:02:55.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/912: creat da/d18/d10/d66/f127 x:0 0 0 2024-04-15T21:02:55.348 INFO:tasks.workunit.client.1.smithi149.stdout:2/956: dwrite d4/d7/d46/de4/d21/d3b/d10a/d15c/f88 [0,4194304] 0 2024-04-15T21:02:55.348 INFO:tasks.workunit.client.1.smithi149.stdout:4/993: symlink dc/d18/dce/l146 0 2024-04-15T21:02:55.350 INFO:tasks.workunit.client.1.smithi149.stdout:3/900: write d1/db/d28/f51 [3110146,99093] 0 2024-04-15T21:02:55.358 INFO:tasks.workunit.client.0.smithi072.stdout:7/689: getdents d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38 0 2024-04-15T21:02:55.360 INFO:tasks.workunit.client.0.smithi072.stdout:4/712: mknod d7/d28/d42/da1/ced 0 2024-04-15T21:02:55.360 INFO:tasks.workunit.client.0.smithi072.stdout:1/687: write d5/f96 [921086,42063] 0 2024-04-15T21:02:55.360 INFO:tasks.workunit.client.0.smithi072.stdout:5/737: unlink d0/d3/d33/d60/lce 0 2024-04-15T21:02:55.361 INFO:tasks.workunit.client.0.smithi072.stdout:6/692: mkdir d2/d10/d11/d1f/d60/d63/dd4 0 2024-04-15T21:02:55.362 INFO:tasks.workunit.client.1.smithi149.stdout:7/877: getdents d3/d17 0 2024-04-15T21:02:55.362 INFO:tasks.workunit.client.0.smithi072.stdout:2/734: unlink d2/d38/l4b 0 2024-04-15T21:02:55.363 INFO:tasks.workunit.client.0.smithi072.stdout:4/713: write d7/d28/d42/f65 [819707,69365] 0 2024-04-15T21:02:55.363 INFO:tasks.workunit.client.1.smithi149.stdout:3/901: link d1/c2d d1/db/d24/d39/dc0/d11b/c11c 0 2024-04-15T21:02:55.364 INFO:tasks.workunit.client.1.smithi149.stdout:3/902: fdatasync d1/fcf 0 2024-04-15T21:02:55.365 INFO:tasks.workunit.client.0.smithi072.stdout:3/694: dwrite d1/d15/d40/f27 [4194304,4194304] 0 2024-04-15T21:02:55.366 INFO:tasks.workunit.client.0.smithi072.stdout:9/707: mkdir d4/d29/d4c/d91/ddf 0 2024-04-15T21:02:55.367 INFO:tasks.workunit.client.0.smithi072.stdout:9/708: write d4/d1f/d31/f63 [4602854,115893] 0 2024-04-15T21:02:55.369 INFO:tasks.workunit.client.0.smithi072.stdout:9/709: truncate d4/d1f/d31/d4d/fbb 982650 0 2024-04-15T21:02:55.369 INFO:tasks.workunit.client.1.smithi149.stdout:2/957: rename d4/d7/d46/de4/d21/d6d/fd6 to d4/d7/d46/de4/d21/d2c/f15d 0 2024-04-15T21:02:55.372 INFO:tasks.workunit.client.1.smithi149.stdout:7/878: unlink d3/d16/d11f/f7d 0 2024-04-15T21:02:55.378 INFO:tasks.workunit.client.1.smithi149.stdout:9/821: truncate d23/d3c/f4e 6875092 0 2024-04-15T21:02:55.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/735: symlink d3/de/d1b/d41/d74/d98/da5/le8 0 2024-04-15T21:02:55.384 INFO:tasks.workunit.client.1.smithi149.stdout:6/913: write da/d18/d10/d16/d97/dbf/d55/fa7 [49282,55313] 0 2024-04-15T21:02:55.386 INFO:tasks.workunit.client.1.smithi149.stdout:7/879: creat d3/d16/d32/d90/de5/f13a x:0 0 0 2024-04-15T21:02:55.387 INFO:tasks.workunit.client.1.smithi149.stdout:9/822: mkdir d23/d2b/d37/d6d/db8/d102/d10e 0 2024-04-15T21:02:55.387 INFO:tasks.workunit.client.0.smithi072.stdout:7/690: truncate d2/d7/f55 713855 0 2024-04-15T21:02:55.389 INFO:tasks.workunit.client.0.smithi072.stdout:3/695: truncate d1/f17 3601252 0 2024-04-15T21:02:55.390 INFO:tasks.workunit.client.0.smithi072.stdout:3/696: dread - d1/d5b/fc9 zero size 2024-04-15T21:02:55.391 INFO:tasks.workunit.client.0.smithi072.stdout:9/710: write d4/d29/f71 [1658886,40366] 0 2024-04-15T21:02:55.391 INFO:tasks.workunit.client.0.smithi072.stdout:5/738: fsync d0/f80 0 2024-04-15T21:02:55.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/691: dread d2/f1c [4194304,4194304] 0 2024-04-15T21:02:55.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/880: rmdir d3/d17/d11e 39 2024-04-15T21:02:55.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/994: dwrite dc/d2c/fdd [0,4194304] 0 2024-04-15T21:02:55.394 INFO:tasks.workunit.client.1.smithi149.stdout:9/823: write d23/d71/fea [3397597,98957] 0 2024-04-15T21:02:55.396 INFO:tasks.workunit.client.1.smithi149.stdout:6/914: rename da/c54 to da/d11/dbe/dc1/d106/c128 0 2024-04-15T21:02:55.399 INFO:tasks.workunit.client.0.smithi072.stdout:4/714: mkdir d7/d23/d6c/dee 0 2024-04-15T21:02:55.400 INFO:tasks.workunit.client.0.smithi072.stdout:1/688: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:55.412 INFO:tasks.workunit.client.0.smithi072.stdout:7/692: fsync d2/d7/d25/d2d/d47/f5c 0 2024-04-15T21:02:55.414 INFO:tasks.workunit.client.0.smithi072.stdout:5/739: rename d0/d3/d7/d1f/d50/ca3 to d0/d3/d7/d94/d92/cf7 0 2024-04-15T21:02:55.416 INFO:tasks.workunit.client.0.smithi072.stdout:4/715: creat d7/d10/d41/d44/d7a/d97/fef x:0 0 0 2024-04-15T21:02:55.418 INFO:tasks.workunit.client.0.smithi072.stdout:1/689: creat d5/db/d2d/d56/fd9 x:0 0 0 2024-04-15T21:02:55.420 INFO:tasks.workunit.client.0.smithi072.stdout:9/711: unlink d4/d29/f9f 0 2024-04-15T21:02:55.421 INFO:tasks.workunit.client.0.smithi072.stdout:9/712: fsync d4/d29/d4c/d91/d93/fcb 0 2024-04-15T21:02:55.421 INFO:tasks.workunit.client.0.smithi072.stdout:8/736: dread d3/de/d1b/d41/d74/fd0 [0,4194304] 0 2024-04-15T21:02:55.423 INFO:tasks.workunit.client.0.smithi072.stdout:7/693: symlink d2/d7/d25/d72/d98/ld6 0 2024-04-15T21:02:55.427 INFO:tasks.workunit.client.0.smithi072.stdout:4/716: read d7/f54 [9624,118939] 0 2024-04-15T21:02:55.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/735: write d2/d8/daa/f84 [4260888,21544] 0 2024-04-15T21:02:55.429 INFO:tasks.workunit.client.0.smithi072.stdout:1/690: truncate d5/db/d2d/d3a/f13 395041 0 2024-04-15T21:02:55.430 INFO:tasks.workunit.client.0.smithi072.stdout:3/697: link d1/d3f/d4f/c90 d1/d15/d32/d2f/cda 0 2024-04-15T21:02:55.430 INFO:tasks.workunit.client.0.smithi072.stdout:2/736: read d2/d38/d73/d80/fa3 [348740,101397] 0 2024-04-15T21:02:55.437 INFO:tasks.workunit.client.0.smithi072.stdout:3/698: dwrite d1/d15/d40/d9e/dc7/fcd [0,4194304] 0 2024-04-15T21:02:55.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/691: fdatasync d5/db/f12 0 2024-04-15T21:02:55.441 INFO:tasks.workunit.client.0.smithi072.stdout:2/737: rmdir d2/d64/dce 39 2024-04-15T21:02:55.443 INFO:tasks.workunit.client.0.smithi072.stdout:1/692: dread d5/db/f28 [0,4194304] 0 2024-04-15T21:02:55.447 INFO:tasks.workunit.client.0.smithi072.stdout:4/717: rename d7/d28/d42/d8c/da9/d6b to d7/d15/df0 0 2024-04-15T21:02:55.453 INFO:tasks.workunit.client.0.smithi072.stdout:7/694: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 [784393,23177] 0 2024-04-15T21:02:55.454 INFO:tasks.workunit.client.0.smithi072.stdout:5/740: truncate d0/f35 3186123 0 2024-04-15T21:02:55.455 INFO:tasks.workunit.client.0.smithi072.stdout:9/713: link d4/l5d d4/d29/d45/ddb/le0 0 2024-04-15T21:02:55.457 INFO:tasks.workunit.client.0.smithi072.stdout:4/718: dread - d7/d23/d6c/f5f zero size 2024-04-15T21:02:55.457 INFO:tasks.workunit.client.0.smithi072.stdout:8/737: dwrite d3/de/d1b/d3f/f83 [0,4194304] 0 2024-04-15T21:02:55.458 INFO:tasks.workunit.client.0.smithi072.stdout:5/741: readlink d0/d3/d6/d2d/l43 0 2024-04-15T21:02:55.459 INFO:tasks.workunit.client.0.smithi072.stdout:2/738: dread d2/d8/d8e/fa7 [0,4194304] 0 2024-04-15T21:02:55.460 INFO:tasks.workunit.client.0.smithi072.stdout:7/695: unlink d2/d78/lb4 0 2024-04-15T21:02:55.461 INFO:tasks.workunit.client.0.smithi072.stdout:2/739: write d2/d3/f17 [472695,2691] 0 2024-04-15T21:02:55.463 INFO:tasks.workunit.client.0.smithi072.stdout:9/714: rename d4/f13 to d4/d29/d45/ddc/ddd/fe1 0 2024-04-15T21:02:55.465 INFO:tasks.workunit.client.0.smithi072.stdout:3/699: getdents d1/d15/d32/d2f/d1a 0 2024-04-15T21:02:55.466 INFO:tasks.workunit.client.0.smithi072.stdout:2/740: unlink d2/c53 0 2024-04-15T21:02:55.466 INFO:tasks.workunit.client.0.smithi072.stdout:1/693: link d5/c30 d5/d31/d51/cda 0 2024-04-15T21:02:55.468 INFO:tasks.workunit.client.0.smithi072.stdout:3/700: dread - d1/d15/f93 zero size 2024-04-15T21:02:55.468 INFO:tasks.workunit.client.0.smithi072.stdout:9/715: creat d4/d1f/d31/d9b/dca/fe2 x:0 0 0 2024-04-15T21:02:55.471 INFO:tasks.workunit.client.0.smithi072.stdout:7/696: write d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc4 [68438,85210] 0 2024-04-15T21:02:55.471 INFO:tasks.workunit.client.0.smithi072.stdout:8/738: dwrite d3/ff [0,4194304] 0 2024-04-15T21:02:55.473 INFO:tasks.workunit.client.0.smithi072.stdout:4/719: dwrite d7/d10/d41/d44/d7a/d97/fef [0,4194304] 0 2024-04-15T21:02:55.475 INFO:tasks.workunit.client.0.smithi072.stdout:3/701: mknod d1/cdb 0 2024-04-15T21:02:55.478 INFO:tasks.workunit.client.0.smithi072.stdout:9/716: creat d4/d29/d4c/d91/fe3 x:0 0 0 2024-04-15T21:02:55.481 INFO:tasks.workunit.client.0.smithi072.stdout:5/742: dread d0/d3/d7/ff0 [0,4194304] 0 2024-04-15T21:02:55.482 INFO:tasks.workunit.client.0.smithi072.stdout:7/697: chown d2/d7/d25/d2d/d46/l97 745 1 2024-04-15T21:02:55.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/741: dwrite d2/d8/fb1 [0,4194304] 0 2024-04-15T21:02:55.486 INFO:tasks.workunit.client.0.smithi072.stdout:8/739: dread d3/d4/d3b/fb9 [0,4194304] 0 2024-04-15T21:02:55.487 INFO:tasks.workunit.client.0.smithi072.stdout:1/694: dwrite d5/db/d2d/f81 [0,4194304] 0 2024-04-15T21:02:55.488 INFO:tasks.workunit.client.0.smithi072.stdout:1/695: fdatasync d5/db/d2d/f8b 0 2024-04-15T21:02:55.489 INFO:tasks.workunit.client.0.smithi072.stdout:3/702: rmdir d1/d15/d40 39 2024-04-15T21:02:55.491 INFO:tasks.workunit.client.0.smithi072.stdout:4/720: creat d7/d10/d41/d44/d7a/ff1 x:0 0 0 2024-04-15T21:02:55.494 INFO:tasks.workunit.client.0.smithi072.stdout:9/717: mkdir d4/d76/d8f/dbe/de4 0 2024-04-15T21:02:55.498 INFO:tasks.workunit.client.0.smithi072.stdout:5/743: truncate d0/d3/d7/d12/f1a 5364763 0 2024-04-15T21:02:55.499 INFO:tasks.workunit.client.0.smithi072.stdout:5/744: dread - d0/d3/d7/d12/d31/d62/db6/fd2 zero size 2024-04-15T21:02:55.500 INFO:tasks.workunit.client.0.smithi072.stdout:8/740: mkdir d3/de/d1b/d41/dae/dc0/de9 0 2024-04-15T21:02:55.501 INFO:tasks.workunit.client.0.smithi072.stdout:0/727: sync 2024-04-15T21:02:55.502 INFO:tasks.workunit.client.0.smithi072.stdout:1/696: symlink d5/db/d2d/d85/dbf/ldb 0 2024-04-15T21:02:55.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/697: chown d5/db/d2d/d3a/d1f/l46 0 1 2024-04-15T21:02:55.504 INFO:tasks.workunit.client.0.smithi072.stdout:4/721: unlink d7/d10/d41/d44/d7a/fdf 0 2024-04-15T21:02:55.504 INFO:tasks.workunit.client.0.smithi072.stdout:4/722: chown d7/d28/d6d/f92 427325 1 2024-04-15T21:02:55.505 INFO:tasks.workunit.client.0.smithi072.stdout:9/718: rmdir d4/d1f/d9e/db3 39 2024-04-15T21:02:55.507 INFO:tasks.workunit.client.0.smithi072.stdout:5/745: mknod d0/d3/d7/d94/d92/da0/da7/cf8 0 2024-04-15T21:02:55.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/698: mkdir d5/db/d27/d5c/ddc 0 2024-04-15T21:02:55.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/699: chown d5/db/d2d 11 1 2024-04-15T21:02:55.513 INFO:tasks.workunit.client.0.smithi072.stdout:8/741: mknod d3/d4/cea 0 2024-04-15T21:02:55.517 INFO:tasks.workunit.client.0.smithi072.stdout:4/723: mknod d7/d10/d41/d4c/dc9/cf2 0 2024-04-15T21:02:55.519 INFO:tasks.workunit.client.0.smithi072.stdout:3/703: getdents d1/d3f/d7f 0 2024-04-15T21:02:55.520 INFO:tasks.workunit.client.0.smithi072.stdout:7/698: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d [1068053,94964] 0 2024-04-15T21:02:55.521 INFO:tasks.workunit.client.0.smithi072.stdout:8/742: rename d3/d4/f96 to d3/de/d1b/d41/dae/dc0/de9/feb 0 2024-04-15T21:02:55.521 INFO:tasks.workunit.client.0.smithi072.stdout:8/743: stat d3/d4/d3b/lbe 0 2024-04-15T21:02:55.522 INFO:tasks.workunit.client.0.smithi072.stdout:2/742: truncate d2/d64/f87 337091 0 2024-04-15T21:02:55.522 INFO:tasks.workunit.client.0.smithi072.stdout:7/699: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 1329264 0 2024-04-15T21:02:55.523 INFO:tasks.workunit.client.0.smithi072.stdout:2/743: fsync d2/f44 0 2024-04-15T21:02:55.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/724: unlink d7/f54 0 2024-04-15T21:02:55.525 INFO:tasks.workunit.client.0.smithi072.stdout:1/700: symlink d5/db/d2d/d3a/dc3/dd3/ldd 0 2024-04-15T21:02:55.528 INFO:tasks.workunit.client.0.smithi072.stdout:5/746: creat d0/d3/d7/d12/ff9 x:0 0 0 2024-04-15T21:02:55.529 INFO:tasks.workunit.client.0.smithi072.stdout:2/744: dwrite d2/d37/f75 [0,4194304] 0 2024-04-15T21:02:55.530 INFO:tasks.workunit.client.0.smithi072.stdout:8/744: mknod d3/de/d1b/d41/cec 0 2024-04-15T21:02:55.533 INFO:tasks.workunit.client.0.smithi072.stdout:3/704: fsync d1/d15/f4d 0 2024-04-15T21:02:55.534 INFO:tasks.workunit.client.0.smithi072.stdout:9/719: dwrite d4/d1f/d2c/d47/f5f [0,4194304] 0 2024-04-15T21:02:55.534 INFO:tasks.workunit.client.0.smithi072.stdout:0/728: dread d0/d6/fdf [4194304,4194304] 0 2024-04-15T21:02:55.535 INFO:tasks.workunit.client.0.smithi072.stdout:1/701: rename d5/d3d/d5e to d5/db/d2d/d3a/dc3/dd3/dde 0 2024-04-15T21:02:55.539 INFO:tasks.workunit.client.0.smithi072.stdout:5/747: mkdir d0/d3/d7/d12/d31/d62/dfa 0 2024-04-15T21:02:55.539 INFO:tasks.workunit.client.0.smithi072.stdout:5/748: chown d0/d3/d33/d85/fa8 257033443 1 2024-04-15T21:02:55.541 INFO:tasks.workunit.client.0.smithi072.stdout:5/749: stat d0/d3/d7/d94/d5f 0 2024-04-15T21:02:55.544 INFO:tasks.workunit.client.0.smithi072.stdout:1/702: mknod d5/db/d2d/d3a/dc3/dd3/cdf 0 2024-04-15T21:02:55.546 INFO:tasks.workunit.client.0.smithi072.stdout:4/725: creat d7/ff3 x:0 0 0 2024-04-15T21:02:55.546 INFO:tasks.workunit.client.0.smithi072.stdout:7/700: truncate d2/d7/d25/d81/f86 1587766 0 2024-04-15T21:02:55.547 INFO:tasks.workunit.client.0.smithi072.stdout:5/750: read d0/d3/d33/d60/fb3 [3704,24624] 0 2024-04-15T21:02:55.547 INFO:tasks.workunit.client.0.smithi072.stdout:4/726: readlink d7/d23/d6c/l39 0 2024-04-15T21:02:55.550 INFO:tasks.workunit.client.0.smithi072.stdout:8/745: rename d3/de/d1b/d41/dae/dc0/de9/feb to d3/d4/d76/d8f/fed 0 2024-04-15T21:02:55.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/745: dwrite d2/d8/d8e/fa7 [0,4194304] 0 2024-04-15T21:02:55.556 INFO:tasks.workunit.client.1.smithi149.stdout:5/857: sync 2024-04-15T21:02:55.556 INFO:tasks.workunit.client.1.smithi149.stdout:1/818: sync 2024-04-15T21:02:55.559 INFO:tasks.workunit.client.0.smithi072.stdout:8/746: dwrite d3/de/d1b/d41/da4/f8b [4194304,4194304] 0 2024-04-15T21:02:55.560 INFO:tasks.workunit.client.1.smithi149.stdout:7/881: truncate d3/d16/d20/d36/d3d/d56/f5f 1389732 0 2024-04-15T21:02:55.560 INFO:tasks.workunit.client.0.smithi072.stdout:6/693: sync 2024-04-15T21:02:55.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/705: dread d1/d15/d40/f9 [0,4194304] 0 2024-04-15T21:02:55.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/903: write d1/f7c [371307,94868] 0 2024-04-15T21:02:55.566 INFO:tasks.workunit.client.0.smithi072.stdout:4/727: symlink d7/d10/d41/d44/d7a/d86/d76/d8b/dad/lf4 0 2024-04-15T21:02:55.566 INFO:tasks.workunit.client.0.smithi072.stdout:0/729: truncate d0/d6/f41 376707 0 2024-04-15T21:02:55.568 INFO:tasks.workunit.client.0.smithi072.stdout:7/701: mknod d2/d7/cd7 0 2024-04-15T21:02:55.570 INFO:tasks.workunit.client.0.smithi072.stdout:0/730: dread - d0/d19/d96/fd8 zero size 2024-04-15T21:02:55.570 INFO:tasks.workunit.client.0.smithi072.stdout:8/747: dwrite d3/de/d1b/f93 [4194304,4194304] 0 2024-04-15T21:02:55.570 INFO:tasks.workunit.client.1.smithi149.stdout:4/995: mknod dc/d18/dce/dd7/c147 0 2024-04-15T21:02:55.573 INFO:tasks.workunit.client.0.smithi072.stdout:9/720: getdents d4/d29/d4c 0 2024-04-15T21:02:55.575 INFO:tasks.workunit.client.0.smithi072.stdout:4/728: dwrite d7/d10/d41/d44/d7a/d86/d76/fd5 [0,4194304] 0 2024-04-15T21:02:55.576 INFO:tasks.workunit.client.1.smithi149.stdout:9/824: dwrite d23/d46/dcf/deb/d7f/d86/fb7 [0,4194304] 0 2024-04-15T21:02:55.581 INFO:tasks.workunit.client.1.smithi149.stdout:9/825: dread d23/d3c/db5/ffd [0,4194304] 0 2024-04-15T21:02:55.583 INFO:tasks.workunit.client.1.smithi149.stdout:9/826: write d23/d3c/d52/f58 [2722508,40159] 0 2024-04-15T21:02:55.584 INFO:tasks.workunit.client.1.smithi149.stdout:1/819: rename d1/db/dc/fca to d1/db/dc/d11/d3f/d45/dae/ff0 0 2024-04-15T21:02:55.589 INFO:tasks.workunit.client.0.smithi072.stdout:2/746: dread d2/d38/d73/d80/f92 [4194304,4194304] 0 2024-04-15T21:02:55.596 INFO:tasks.workunit.client.1.smithi149.stdout:9/827: dwrite d23/d3c/d52/df8/f10d [0,4194304] 0 2024-04-15T21:02:55.597 INFO:tasks.workunit.client.0.smithi072.stdout:6/694: dread d2/d10/d11/d1f/d60/f61 [0,4194304] 0 2024-04-15T21:02:55.600 INFO:tasks.workunit.client.1.smithi149.stdout:3/904: unlink d1/db/d102/f105 0 2024-04-15T21:02:55.608 INFO:tasks.workunit.client.0.smithi072.stdout:8/748: rename d3/d4/d3b/f55 to d3/de/d1b/d41/dae/dc0/de9/fee 0 2024-04-15T21:02:55.610 INFO:tasks.workunit.client.1.smithi149.stdout:7/882: chown d3/d17/d1f/f8e 56062 1 2024-04-15T21:02:55.612 INFO:tasks.workunit.client.0.smithi072.stdout:4/729: fdatasync d7/d23/f25 0 2024-04-15T21:02:55.613 INFO:tasks.workunit.client.1.smithi149.stdout:6/915: link da/d18/c92 da/d2e/de7/c129 0 2024-04-15T21:02:55.613 INFO:tasks.workunit.client.0.smithi072.stdout:4/730: chown d7/d10/d41/d45/d7c 1 1 2024-04-15T21:02:55.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/820: creat d1/db/dc/d38/d39/d43/daa/d8a/d97/ff1 x:0 0 0 2024-04-15T21:02:55.618 INFO:tasks.workunit.client.0.smithi072.stdout:2/747: rename d2/d38/d73/l9a to d2/d38/d73/lec 0 2024-04-15T21:02:55.623 INFO:tasks.workunit.client.1.smithi149.stdout:3/905: symlink d1/d81/l11d 0 2024-04-15T21:02:55.624 INFO:tasks.workunit.client.1.smithi149.stdout:1/821: dread d1/d17/d36/d6f/fb0 [0,4194304] 0 2024-04-15T21:02:55.624 INFO:tasks.workunit.client.0.smithi072.stdout:7/702: mknod d2/d7/cd8 0 2024-04-15T21:02:55.628 INFO:tasks.workunit.client.1.smithi149.stdout:9/828: mknod d23/d2b/d37/d50/d79/d8d/c10f 0 2024-04-15T21:02:55.630 INFO:tasks.workunit.client.0.smithi072.stdout:0/731: symlink d0/d19/d71/de6/lf9 0 2024-04-15T21:02:55.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/858: creat d0/d9/f10f x:0 0 0 2024-04-15T21:02:55.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/883: chown d3/d16/d32/d90/dad/dc4/cda 326360 1 2024-04-15T21:02:55.638 INFO:tasks.workunit.client.1.smithi149.stdout:7/884: chown d3/d16/d20/d114/fd1 2 1 2024-04-15T21:02:55.641 INFO:tasks.workunit.client.1.smithi149.stdout:9/829: dwrite d23/d46/dcf/deb/d7f/d86/f108 [0,4194304] 0 2024-04-15T21:02:55.642 INFO:tasks.workunit.client.0.smithi072.stdout:5/751: getdents d0/d3/d7/d1f/d4c 0 2024-04-15T21:02:55.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/916: symlink da/l12a 0 2024-04-15T21:02:55.647 INFO:tasks.workunit.client.0.smithi072.stdout:2/748: dread - d2/d8/d8e/d90/fd2 zero size 2024-04-15T21:02:55.647 INFO:tasks.workunit.client.0.smithi072.stdout:2/749: write d2/d3/f5 [5152520,117851] 0 2024-04-15T21:02:55.652 INFO:tasks.workunit.client.1.smithi149.stdout:3/906: dread d1/db/d28/d87/dbd/f6d [0,4194304] 0 2024-04-15T21:02:55.653 INFO:tasks.workunit.client.0.smithi072.stdout:3/706: truncate d1/d15/d32/f24 292306 0 2024-04-15T21:02:55.657 INFO:tasks.workunit.client.0.smithi072.stdout:7/703: unlink d2/d7/d25/d2d/d46/d5a/d5f/d43/ca5 0 2024-04-15T21:02:55.658 INFO:tasks.workunit.client.1.smithi149.stdout:4/996: dwrite fa [0,4194304] 0 2024-04-15T21:02:55.659 INFO:tasks.workunit.client.1.smithi149.stdout:1/822: fsync d1/fdd 0 2024-04-15T21:02:55.661 INFO:tasks.workunit.client.0.smithi072.stdout:6/695: symlink d2/d40/d6e/ld5 0 2024-04-15T21:02:55.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/885: creat d3/d16/d32/d90/dad/f13b x:0 0 0 2024-04-15T21:02:55.664 INFO:tasks.workunit.client.0.smithi072.stdout:0/732: readlink d0/d6/d48/l51 0 2024-04-15T21:02:55.667 INFO:tasks.workunit.client.1.smithi149.stdout:9/830: rename d23/d3c/d52/df8 to d23/d2b/d37/d50/d110 0 2024-04-15T21:02:55.669 INFO:tasks.workunit.client.1.smithi149.stdout:9/831: read f1f [2665781,55975] 0 2024-04-15T21:02:55.676 INFO:tasks.workunit.client.0.smithi072.stdout:9/721: truncate d4/d1f/d31/d4d/f5c 545569 0 2024-04-15T21:02:55.678 INFO:tasks.workunit.client.0.smithi072.stdout:3/707: mknod d1/d5b/dbf/cdc 0 2024-04-15T21:02:55.679 INFO:tasks.workunit.client.0.smithi072.stdout:9/722: read d4/d29/d4c/d74/f7f [1577948,80536] 0 2024-04-15T21:02:55.680 INFO:tasks.workunit.client.1.smithi149.stdout:7/886: chown d3/d16/d20/d9c/lfe 59 1 2024-04-15T21:02:55.682 INFO:tasks.workunit.client.0.smithi072.stdout:5/752: rename d0/d3/d33/d60/d81/le7 to d0/d3/d7/d12/d31/d55/d58/lfb 0 2024-04-15T21:02:55.684 INFO:tasks.workunit.client.0.smithi072.stdout:5/753: read d0/fa [4017435,25692] 0 2024-04-15T21:02:55.684 INFO:tasks.workunit.client.0.smithi072.stdout:7/704: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 [0,4194304] 0 2024-04-15T21:02:55.686 INFO:tasks.workunit.client.0.smithi072.stdout:9/723: dwrite d4/d1f/d2c/fde [0,4194304] 0 2024-04-15T21:02:55.687 INFO:tasks.workunit.client.1.smithi149.stdout:6/917: mknod da/d18/d10/d16/d97/dbf/c12b 0 2024-04-15T21:02:55.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/708: creat d1/d3f/d4f/d73/db3/dc4/fdd x:0 0 0 2024-04-15T21:02:55.695 INFO:tasks.workunit.client.1.smithi149.stdout:3/907: fsync d1/db/d40/da0/f11a 0 2024-04-15T21:02:55.697 INFO:tasks.workunit.client.0.smithi072.stdout:8/749: truncate d3/ff 1308394 0 2024-04-15T21:02:55.699 INFO:tasks.workunit.client.1.smithi149.stdout:6/918: dwrite da/d18/d10/d66/f127 [0,4194304] 0 2024-04-15T21:02:55.699 INFO:tasks.workunit.client.1.smithi149.stdout:4/997: mknod dc/d18/d128/c148 0 2024-04-15T21:02:55.700 INFO:tasks.workunit.client.1.smithi149.stdout:6/919: readlink da/l2a 0 2024-04-15T21:02:55.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/887: creat d3/d16/d11f/f13c x:0 0 0 2024-04-15T21:02:55.710 INFO:tasks.workunit.client.0.smithi072.stdout:5/754: dread - d0/d3/d33/d60/d81/fed zero size 2024-04-15T21:02:55.715 INFO:tasks.workunit.client.1.smithi149.stdout:9/832: dread d23/f5a [0,4194304] 0 2024-04-15T21:02:55.715 INFO:tasks.workunit.client.0.smithi072.stdout:9/724: stat d4/d1f/d2c/l48 0 2024-04-15T21:02:55.717 INFO:tasks.workunit.client.1.smithi149.stdout:1/823: dwrite d1/db/dc/d38/d39/d43/f7b [0,4194304] 0 2024-04-15T21:02:55.718 INFO:tasks.workunit.client.1.smithi149.stdout:1/824: chown d1/d17/d52/cb6 942 1 2024-04-15T21:02:55.720 INFO:tasks.workunit.client.0.smithi072.stdout:2/750: write d2/d8/d8e/fe0 [502510,60159] 0 2024-04-15T21:02:55.720 INFO:tasks.workunit.client.1.smithi149.stdout:1/825: write d1/db/dc/d11/d3f/d45/fc1 [10612,117355] 0 2024-04-15T21:02:55.721 INFO:tasks.workunit.client.0.smithi072.stdout:2/751: truncate d2/d66/fe1 442592 0 2024-04-15T21:02:55.724 INFO:tasks.workunit.client.0.smithi072.stdout:2/752: dread d2/d66/fb0 [0,4194304] 0 2024-04-15T21:02:55.727 INFO:tasks.workunit.client.0.smithi072.stdout:8/750: truncate d3/d4/d4d/f73 2970368 0 2024-04-15T21:02:55.728 INFO:tasks.workunit.client.1.smithi149.stdout:6/920: creat da/d18/d10/d16/d97/dbf/d55/da0/f12c x:0 0 0 2024-04-15T21:02:55.730 INFO:tasks.workunit.client.0.smithi072.stdout:3/709: dread d1/f43 [0,4194304] 0 2024-04-15T21:02:55.734 INFO:tasks.workunit.client.1.smithi149.stdout:1/826: mkdir d1/d17/d36/d6f/df2 0 2024-04-15T21:02:55.735 INFO:tasks.workunit.client.1.smithi149.stdout:1/827: dread - d1/db/dc/d11/d3e/fba zero size 2024-04-15T21:02:55.736 INFO:tasks.workunit.client.0.smithi072.stdout:7/705: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f84 [345402,92067] 0 2024-04-15T21:02:55.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/828: stat d1/d17/d52/d42 0 2024-04-15T21:02:55.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/725: rename d4/d29/fbd to d4/d1f/d31/dcc/fe5 0 2024-04-15T21:02:55.740 INFO:tasks.workunit.client.1.smithi149.stdout:4/998: chown dc/d8f/d91/f133 5142092 1 2024-04-15T21:02:55.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/908: write d1/db/d24/d2b/f50 [3243273,76157] 0 2024-04-15T21:02:55.747 INFO:tasks.workunit.client.1.smithi149.stdout:4/999: fdatasync dc/d2c/d3e/d15/d3f/d117/d6c/d70/dab/f105 0 2024-04-15T21:02:55.750 INFO:tasks.workunit.client.1.smithi149.stdout:9/833: rename d23/d71/cc8 to d23/d3c/d87/d9a/c111 0 2024-04-15T21:02:55.763 INFO:tasks.workunit.client.1.smithi149.stdout:6/921: dwrite da/d18/d10/d66/f57 [0,4194304] 0 2024-04-15T21:02:55.765 INFO:tasks.workunit.client.1.smithi149.stdout:9/834: rmdir d23/d2b/d37 39 2024-04-15T21:02:55.766 INFO:tasks.workunit.client.1.smithi149.stdout:3/909: link d1/c10a d1/db/d24/d39/d79/d97/c11e 0 2024-04-15T21:02:55.769 INFO:tasks.workunit.client.1.smithi149.stdout:6/922: mknod da/d11/dbe/dc1/d106/c12d 0 2024-04-15T21:02:55.774 INFO:tasks.workunit.client.1.smithi149.stdout:7/888: dwrite d3/d16/d20/d36/d3d/f85 [0,4194304] 0 2024-04-15T21:02:55.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/910: mknod d1/db/c11f 0 2024-04-15T21:02:55.785 INFO:tasks.workunit.client.1.smithi149.stdout:9/835: creat d23/f112 x:0 0 0 2024-04-15T21:02:55.785 INFO:tasks.workunit.client.1.smithi149.stdout:1/829: truncate d1/db/dc/d11/d3f/d45/dae/ff0 2202193 0 2024-04-15T21:02:55.788 INFO:tasks.workunit.client.1.smithi149.stdout:7/889: creat d3/d16/d20/d36/d3d/d56/f13d x:0 0 0 2024-04-15T21:02:55.788 INFO:tasks.workunit.client.1.smithi149.stdout:3/911: chown d1/db/d28/d87/fcd 87063 1 2024-04-15T21:02:55.796 INFO:tasks.workunit.client.1.smithi149.stdout:9/836: dread d23/d2b/d44/f63 [0,4194304] 0 2024-04-15T21:02:55.796 INFO:tasks.workunit.client.1.smithi149.stdout:6/923: dwrite da/d18/d10/d16/d97/f10b [0,4194304] 0 2024-04-15T21:02:55.800 INFO:tasks.workunit.client.1.smithi149.stdout:2/958: sync 2024-04-15T21:02:55.817 INFO:tasks.workunit.client.1.smithi149.stdout:3/912: dread d1/db/d40/da0/f11a [4194304,4194304] 0 2024-04-15T21:02:55.818 INFO:tasks.workunit.client.1.smithi149.stdout:3/913: chown d1/db/d24/d39/fb9 4847 1 2024-04-15T21:02:55.831 INFO:tasks.workunit.client.1.smithi149.stdout:7/890: mknod d3/d16/da0/c13e 0 2024-04-15T21:02:55.837 INFO:tasks.workunit.client.0.smithi072.stdout:5/755: fdatasync d0/d3/d33/d85/f89 0 2024-04-15T21:02:55.838 INFO:tasks.workunit.client.1.smithi149.stdout:9/837: symlink d23/d2b/l113 0 2024-04-15T21:02:55.839 INFO:tasks.workunit.client.0.smithi072.stdout:9/726: dwrite d4/d29/d4c/d91/fe3 [0,4194304] 0 2024-04-15T21:02:55.839 INFO:tasks.workunit.client.1.smithi149.stdout:9/838: fsync d23/d2b/fa0 0 2024-04-15T21:02:55.840 INFO:tasks.workunit.client.0.smithi072.stdout:3/710: truncate d1/d15/d40/d9e/fb9 2463382 0 2024-04-15T21:02:55.843 INFO:tasks.workunit.client.0.smithi072.stdout:8/751: dwrite d3/de/d1b/d85/fad [4194304,4194304] 0 2024-04-15T21:02:55.849 INFO:tasks.workunit.client.0.smithi072.stdout:8/752: dwrite d3/f1d [0,4194304] 0 2024-04-15T21:02:55.860 INFO:tasks.workunit.client.1.smithi149.stdout:3/914: symlink d1/db/d40/d56/l120 0 2024-04-15T21:02:55.862 INFO:tasks.workunit.client.0.smithi072.stdout:5/756: mkdir d0/d3/d7/d94/d92/da0/dfc 0 2024-04-15T21:02:55.866 INFO:tasks.workunit.client.1.smithi149.stdout:6/924: creat da/d18/d10/d16/d97/dbf/f12e x:0 0 0 2024-04-15T21:02:55.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/891: symlink d3/d16/d20/d36/d3d/l13f 0 2024-04-15T21:02:55.874 INFO:tasks.workunit.client.1.smithi149.stdout:5/859: sync 2024-04-15T21:02:55.879 INFO:tasks.workunit.client.0.smithi072.stdout:8/753: rename f1 to d3/d4/d4c/fef 0 2024-04-15T21:02:55.879 INFO:tasks.workunit.client.0.smithi072.stdout:5/757: rename d0/d3/d7/d12/d31 to d0/d3/d7/d12/d31/d49/dfd 22 2024-04-15T21:02:55.880 INFO:tasks.workunit.client.1.smithi149.stdout:6/925: chown da/d11/dbe/dc1/d106/c128 210796784 1 2024-04-15T21:02:55.883 INFO:tasks.workunit.client.0.smithi072.stdout:9/727: symlink d4/d29/d45/le6 0 2024-04-15T21:02:55.884 INFO:tasks.workunit.client.0.smithi072.stdout:9/728: write d4/d29/d4c/d74/fc9 [331242,83899] 0 2024-04-15T21:02:55.886 INFO:tasks.workunit.client.0.smithi072.stdout:3/711: truncate d1/d15/d32/f4a 450785 0 2024-04-15T21:02:55.887 INFO:tasks.workunit.client.0.smithi072.stdout:3/712: chown d1/d15/d40/dc2 102 1 2024-04-15T21:02:55.888 INFO:tasks.workunit.client.0.smithi072.stdout:6/696: sync 2024-04-15T21:02:55.888 INFO:tasks.workunit.client.0.smithi072.stdout:1/703: sync 2024-04-15T21:02:55.888 INFO:tasks.workunit.client.0.smithi072.stdout:4/731: sync 2024-04-15T21:02:55.888 INFO:tasks.workunit.client.1.smithi149.stdout:5/860: fsync d0/d6/d82/da1/d12/d2b/f9e 0 2024-04-15T21:02:55.889 INFO:tasks.workunit.client.0.smithi072.stdout:3/713: fdatasync d1/d15/d32/d2f/d1a/f1b 0 2024-04-15T21:02:55.889 INFO:tasks.workunit.client.0.smithi072.stdout:8/754: rmdir d3/d7e/dda 39 2024-04-15T21:02:55.891 INFO:tasks.workunit.client.0.smithi072.stdout:3/714: readlink d1/d15/d32/d2f/d1a/l36 0 2024-04-15T21:02:55.891 INFO:tasks.workunit.client.0.smithi072.stdout:4/732: write d7/d10/d41/d44/d7a/ff1 [512642,35458] 0 2024-04-15T21:02:55.892 INFO:tasks.workunit.client.0.smithi072.stdout:9/729: dwrite d4/d29/d4c/d74/fc9 [0,4194304] 0 2024-04-15T21:02:55.892 INFO:tasks.workunit.client.0.smithi072.stdout:5/758: rename d0/d3/d7/d94/d92/fa4 to d0/d3/d7/d12/d31/d55/d58/ffe 0 2024-04-15T21:02:55.894 INFO:tasks.workunit.client.1.smithi149.stdout:6/926: creat da/d18/d10/d3f/f12f x:0 0 0 2024-04-15T21:02:55.895 INFO:tasks.workunit.client.1.smithi149.stdout:6/927: chown da/d18/l72 1017 1 2024-04-15T21:02:55.902 INFO:tasks.workunit.client.0.smithi072.stdout:6/697: stat d2/d40/dcb/cb4 0 2024-04-15T21:02:55.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/928: dwrite da/d32/d116/f126 [0,4194304] 0 2024-04-15T21:02:55.908 INFO:tasks.workunit.client.0.smithi072.stdout:8/755: creat d3/de/d1b/d41/d74/d98/da5/ff0 x:0 0 0 2024-04-15T21:02:55.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/861: read d0/d6/d82/da1/d12/d16/da9/d1b/f20 [7770253,43235] 0 2024-04-15T21:02:55.914 INFO:tasks.workunit.client.0.smithi072.stdout:3/715: write d1/d15/d32/d78/fa5 [2311732,56809] 0 2024-04-15T21:02:55.920 INFO:tasks.workunit.client.1.smithi149.stdout:1/830: dwrite d1/db/dc/d11/f47 [0,4194304] 0 2024-04-15T21:02:55.921 INFO:tasks.workunit.client.0.smithi072.stdout:3/716: read d1/d15/d32/d2f/f33 [3374783,65029] 0 2024-04-15T21:02:55.922 INFO:tasks.workunit.client.0.smithi072.stdout:0/733: sync 2024-04-15T21:02:55.922 INFO:tasks.workunit.client.1.smithi149.stdout:1/831: readlink d1/l7f 0 2024-04-15T21:02:55.924 INFO:tasks.workunit.client.1.smithi149.stdout:5/862: symlink d0/d9/d3f/l110 0 2024-04-15T21:02:55.924 INFO:tasks.workunit.client.1.smithi149.stdout:2/959: write d4/d7/d46/de4/d21/d5e/f51 [1431811,95837] 0 2024-04-15T21:02:55.931 INFO:tasks.workunit.client.0.smithi072.stdout:7/706: dwrite d2/d7/d25/d2d/d47/f64 [0,4194304] 0 2024-04-15T21:02:55.933 INFO:tasks.workunit.client.0.smithi072.stdout:8/756: stat d3/de/cab 0 2024-04-15T21:02:55.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/832: creat d1/db/dc/d11/d3e/ff3 x:0 0 0 2024-04-15T21:02:55.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/960: fsync d4/d7/d46/de4/db6/fe6 0 2024-04-15T21:02:55.944 INFO:tasks.workunit.client.1.smithi149.stdout:9/839: write d23/d3c/f4e [6125141,6337] 0 2024-04-15T21:02:55.947 INFO:tasks.workunit.client.1.smithi149.stdout:1/833: truncate d1/d17/d4d/f6a 1925279 0 2024-04-15T21:02:55.948 INFO:tasks.workunit.client.1.smithi149.stdout:3/915: dwrite d1/db/d24/d2b/f6c [8388608,4194304] 0 2024-04-15T21:02:55.955 INFO:tasks.workunit.client.1.smithi149.stdout:1/834: fsync d1/db/dc/fa5 0 2024-04-15T21:02:55.957 INFO:tasks.workunit.client.1.smithi149.stdout:7/892: dwrite d3/d16/d20/f41 [0,4194304] 0 2024-04-15T21:02:55.961 INFO:tasks.workunit.client.0.smithi072.stdout:1/704: rename d5/db/d27/d5c/dbd/lc6 to d5/db/d2d/le0 0 2024-04-15T21:02:55.962 INFO:tasks.workunit.client.0.smithi072.stdout:7/707: mknod d2/d7/d25/d2d/d46/d5a/cd9 0 2024-04-15T21:02:55.963 INFO:tasks.workunit.client.0.smithi072.stdout:2/753: sync 2024-04-15T21:02:55.965 INFO:tasks.workunit.client.0.smithi072.stdout:8/757: stat d3/de/d1b/l60 0 2024-04-15T21:02:55.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/840: mkdir d23/d3c/d114 0 2024-04-15T21:02:55.970 INFO:tasks.workunit.client.0.smithi072.stdout:4/733: write d7/d28/f49 [1266073,31638] 0 2024-04-15T21:02:55.970 INFO:tasks.workunit.client.0.smithi072.stdout:3/717: getdents d1/d15/d40/dc2 0 2024-04-15T21:02:55.971 INFO:tasks.workunit.client.0.smithi072.stdout:5/759: write d0/d3/d7/d12/d31/d49/f84 [2485697,24133] 0 2024-04-15T21:02:55.971 INFO:tasks.workunit.client.0.smithi072.stdout:6/698: write d2/d40/d56/f85 [897029,16069] 0 2024-04-15T21:02:55.972 INFO:tasks.workunit.client.0.smithi072.stdout:6/699: chown d2/d42/dad 508 1 2024-04-15T21:02:55.973 INFO:tasks.workunit.client.0.smithi072.stdout:4/734: readlink d7/d28/d42/d8c/ld8 0 2024-04-15T21:02:55.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/929: write da/d18/d10/f42 [853010,128187] 0 2024-04-15T21:02:55.974 INFO:tasks.workunit.client.0.smithi072.stdout:9/730: creat d4/d29/d4c/d74/fe7 x:0 0 0 2024-04-15T21:02:55.975 INFO:tasks.workunit.client.1.smithi149.stdout:1/835: dwrite d1/db/dc/d11/d3e/ff3 [0,4194304] 0 2024-04-15T21:02:55.976 INFO:tasks.workunit.client.0.smithi072.stdout:0/734: write d0/fea [416721,124712] 0 2024-04-15T21:02:55.979 INFO:tasks.workunit.client.1.smithi149.stdout:5/863: getdents d0/d9/d6c/db4/dd1 0 2024-04-15T21:02:55.980 INFO:tasks.workunit.client.1.smithi149.stdout:7/893: dwrite d3/f5 [0,4194304] 0 2024-04-15T21:02:55.983 INFO:tasks.workunit.client.1.smithi149.stdout:9/841: creat d23/d2b/d70/d75/ddb/f115 x:0 0 0 2024-04-15T21:02:55.984 INFO:tasks.workunit.client.0.smithi072.stdout:7/708: fdatasync d2/d78/f95 0 2024-04-15T21:02:55.985 INFO:tasks.workunit.client.1.smithi149.stdout:3/916: symlink d1/db/d24/d4d/d63/l121 0 2024-04-15T21:02:55.986 INFO:tasks.workunit.client.0.smithi072.stdout:2/754: rename d2/d66/d69/l6e to d2/dd7/led 0 2024-04-15T21:02:55.987 INFO:tasks.workunit.client.0.smithi072.stdout:8/758: rmdir d3/d4/d76/d8f 39 2024-04-15T21:02:55.987 INFO:tasks.workunit.client.1.smithi149.stdout:6/930: truncate da/d18/d10/d16/d97/dbf/d55/d82/fbc 416242 0 2024-04-15T21:02:55.988 INFO:tasks.workunit.client.0.smithi072.stdout:8/759: write d3/de/d1b/d3f/fbb [255751,16954] 0 2024-04-15T21:02:55.988 INFO:tasks.workunit.client.1.smithi149.stdout:1/836: creat d1/d17/d52/d78/ff4 x:0 0 0 2024-04-15T21:02:55.990 INFO:tasks.workunit.client.0.smithi072.stdout:3/718: creat d1/d3f/d4f/d73/fde x:0 0 0 2024-04-15T21:02:55.991 INFO:tasks.workunit.client.1.smithi149.stdout:7/894: creat d3/d16/d32/d90/f140 x:0 0 0 2024-04-15T21:02:55.996 INFO:tasks.workunit.client.0.smithi072.stdout:8/760: dwrite d3/fcc [0,4194304] 0 2024-04-15T21:02:55.996 INFO:tasks.workunit.client.1.smithi149.stdout:5/864: rename d0/d6/d82/da1/d12/d16/da9/d9b/fa7 to d0/d6/d82/da1/d12/d16/da9/d9b/db7/dfb/f111 0 2024-04-15T21:02:55.998 INFO:tasks.workunit.client.0.smithi072.stdout:9/731: readlink d4/d29/d45/l56 0 2024-04-15T21:02:55.999 INFO:tasks.workunit.client.0.smithi072.stdout:9/732: truncate d4/d76/d8f/fb0 27223 0 2024-04-15T21:02:56.004 INFO:tasks.workunit.client.1.smithi149.stdout:1/837: creat d1/db/dc/d11/d3f/ff5 x:0 0 0 2024-04-15T21:02:56.005 INFO:tasks.workunit.client.0.smithi072.stdout:4/735: creat d7/d10/d41/d44/d7a/d97/db6/ff5 x:0 0 0 2024-04-15T21:02:56.005 INFO:tasks.workunit.client.0.smithi072.stdout:0/735: mkdir d0/d74/dd5/dfa 0 2024-04-15T21:02:56.006 INFO:tasks.workunit.client.0.smithi072.stdout:4/736: stat d7/d10/d41/d4c/l4e 0 2024-04-15T21:02:56.006 INFO:tasks.workunit.client.0.smithi072.stdout:0/736: truncate d0/d19/fc4 5073759 0 2024-04-15T21:02:56.007 INFO:tasks.workunit.client.0.smithi072.stdout:4/737: readlink d7/d10/d41/d4c/l4e 0 2024-04-15T21:02:56.008 INFO:tasks.workunit.client.0.smithi072.stdout:4/738: readlink d7/d10/d41/d44/d7a/d86/d76/d8b/dad/lf4 0 2024-04-15T21:02:56.009 INFO:tasks.workunit.client.0.smithi072.stdout:4/739: chown d7/d10/d41/d4c 10 1 2024-04-15T21:02:56.010 INFO:tasks.workunit.client.0.smithi072.stdout:1/705: creat d5/d31/dbc/fe1 x:0 0 0 2024-04-15T21:02:56.010 INFO:tasks.workunit.client.1.smithi149.stdout:9/842: mknod d23/d46/dcf/deb/c116 0 2024-04-15T21:02:56.014 INFO:tasks.workunit.client.0.smithi072.stdout:7/709: rename d2/d7/cd7 to d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/cda 0 2024-04-15T21:02:56.018 INFO:tasks.workunit.client.1.smithi149.stdout:1/838: dread - d1/db/d14/d6b/f6d zero size 2024-04-15T21:02:56.018 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:55 smithi072 ceph-mon[29079]: pgmap v12: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 267 MiB/s wr, 513 op/s 2024-04-15T21:02:56.019 INFO:tasks.workunit.client.1.smithi149.stdout:1/839: stat d1/db/dc/d11/d3e 0 2024-04-15T21:02:56.021 INFO:tasks.workunit.client.0.smithi072.stdout:3/719: creat d1/d15/d32/d78/fdf x:0 0 0 2024-04-15T21:02:56.027 INFO:tasks.workunit.client.1.smithi149.stdout:3/917: dread d1/db/d24/d4d/d63/d65/f91 [0,4194304] 0 2024-04-15T21:02:56.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/895: dwrite d3/d16/d32/d90/ff3 [0,4194304] 0 2024-04-15T21:02:56.030 INFO:tasks.workunit.client.0.smithi072.stdout:9/733: mknod d4/d29/d4c/ce8 0 2024-04-15T21:02:56.031 INFO:tasks.workunit.client.1.smithi149.stdout:1/840: chown d1/d17/d36/d6f/da3/cd3 0 1 2024-04-15T21:02:56.031 INFO:tasks.workunit.client.0.smithi072.stdout:9/734: chown d4/f86 354906 1 2024-04-15T21:02:56.033 INFO:tasks.workunit.client.0.smithi072.stdout:2/755: dwrite d2/d3/f4c [0,4194304] 0 2024-04-15T21:02:56.037 INFO:tasks.workunit.client.1.smithi149.stdout:5/865: dwrite d0/d6/d82/da1/d12/d16/f1d [4194304,4194304] 0 2024-04-15T21:02:56.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/896: fdatasync d3/d17/f31 0 2024-04-15T21:02:56.049 INFO:tasks.workunit.client.1.smithi149.stdout:9/843: dread d23/d2b/d37/d50/fa2 [0,4194304] 0 2024-04-15T21:02:56.052 INFO:tasks.workunit.client.1.smithi149.stdout:3/918: mkdir d1/db/d24/d39/dc0/d11b/d122 0 2024-04-15T21:02:56.052 INFO:tasks.workunit.client.1.smithi149.stdout:5/866: symlink d0/d6/d82/l112 0 2024-04-15T21:02:56.054 INFO:tasks.workunit.client.1.smithi149.stdout:5/867: truncate d0/d6/d82/da1/d12/d16/da9/f100 417672 0 2024-04-15T21:02:56.057 INFO:tasks.workunit.client.1.smithi149.stdout:5/868: chown d0/d6/d82/da1/d12/d16/da9/d9b 4134094 1 2024-04-15T21:02:56.058 INFO:tasks.workunit.client.1.smithi149.stdout:7/897: rmdir d3/d16/d32/d110 39 2024-04-15T21:02:56.059 INFO:tasks.workunit.client.1.smithi149.stdout:7/898: chown d3/d16/d20/dab/dd4 231556875 1 2024-04-15T21:02:56.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/844: symlink d23/d2b/d37/d6d/db8/d102/d10e/l117 0 2024-04-15T21:02:56.064 INFO:tasks.workunit.client.1.smithi149.stdout:7/899: unlink d3/d16/d20/d114/cb4 0 2024-04-15T21:02:56.067 INFO:tasks.workunit.client.1.smithi149.stdout:9/845: truncate d23/d46/dcf/deb/d7f/f96 799321 0 2024-04-15T21:02:56.072 INFO:tasks.workunit.client.1.smithi149.stdout:1/841: dread d1/f3 [0,4194304] 0 2024-04-15T21:02:56.075 INFO:tasks.workunit.client.1.smithi149.stdout:1/842: write d1/db/dc/d38/d39/d43/daa/d8a/d97/ff1 [444714,106606] 0 2024-04-15T21:02:56.082 INFO:tasks.workunit.client.1.smithi149.stdout:1/843: rename d1/db/dc/d11/d3f/d45/dae/fd6 to d1/db/d16/d86/de1/ff6 0 2024-04-15T21:02:56.084 INFO:tasks.workunit.client.1.smithi149.stdout:5/869: write d0/d6/f6f [891011,83057] 0 2024-04-15T21:02:56.090 INFO:tasks.workunit.client.1.smithi149.stdout:1/844: mkdir d1/df7 0 2024-04-15T21:02:56.091 INFO:tasks.workunit.client.1.smithi149.stdout:1/845: dread - d1/d17/d52/fd8 zero size 2024-04-15T21:02:56.091 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:55 smithi149 ceph-mon[36029]: pgmap v12: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 267 MiB/s wr, 513 op/s 2024-04-15T21:02:56.095 INFO:tasks.workunit.client.1.smithi149.stdout:9/846: dwrite d23/d2b/d44/fe5 [4194304,4194304] 0 2024-04-15T21:02:56.095 INFO:tasks.workunit.client.0.smithi072.stdout:0/737: unlink d0/d45/d35/d3a/c49 0 2024-04-15T21:02:56.095 INFO:tasks.workunit.client.1.smithi149.stdout:9/847: chown d23/d3c/d52 188711 1 2024-04-15T21:02:56.097 INFO:tasks.workunit.client.0.smithi072.stdout:4/740: symlink d7/d15/d58/d62/d6f/lf6 0 2024-04-15T21:02:56.101 INFO:tasks.workunit.client.1.smithi149.stdout:1/846: creat d1/db/dc/d11/d3f/d45/dae/ff8 x:0 0 0 2024-04-15T21:02:56.101 INFO:tasks.workunit.client.1.smithi149.stdout:9/848: dwrite d23/d2b/fa0 [0,4194304] 0 2024-04-15T21:02:56.105 INFO:tasks.workunit.client.0.smithi072.stdout:7/710: mkdir d2/d7/d25/d72/ddb 0 2024-04-15T21:02:56.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/870: getdents d0/d6/d82 0 2024-04-15T21:02:56.112 INFO:tasks.workunit.client.1.smithi149.stdout:1/847: unlink d1/d17/d52/l25 0 2024-04-15T21:02:56.113 INFO:tasks.workunit.client.0.smithi072.stdout:3/720: read - d1/d5b/f62 zero size 2024-04-15T21:02:56.114 INFO:tasks.workunit.client.1.smithi149.stdout:9/849: dwrite d23/d3c/d87/d9a/dad/fce [0,4194304] 0 2024-04-15T21:02:56.114 INFO:tasks.workunit.client.1.smithi149.stdout:1/848: chown d1/db/dc/d11/d3e/l4f 14038713 1 2024-04-15T21:02:56.115 INFO:tasks.workunit.client.1.smithi149.stdout:1/849: fsync d1/db/dc/d38/d39/fec 0 2024-04-15T21:02:56.117 INFO:tasks.workunit.client.1.smithi149.stdout:5/871: rmdir d0/d9/d71 39 2024-04-15T21:02:56.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/872: stat d0/d6/d82/da1/d12/d2b/f72 0 2024-04-15T21:02:56.118 INFO:tasks.workunit.client.0.smithi072.stdout:5/760: link d0/d3/ld8 d0/d3/d7/d12/d31/d62/lff 0 2024-04-15T21:02:56.121 INFO:tasks.workunit.client.0.smithi072.stdout:8/761: fsync d3/d4/d4d/f73 0 2024-04-15T21:02:56.126 INFO:tasks.workunit.client.1.smithi149.stdout:5/873: dwrite d0/d6/d82/db0/fed [0,4194304] 0 2024-04-15T21:02:56.126 INFO:tasks.workunit.client.1.smithi149.stdout:9/850: symlink d23/d3c/d114/l118 0 2024-04-15T21:02:56.127 INFO:tasks.workunit.client.0.smithi072.stdout:1/706: dwrite d5/db/d2d/d3a/f22 [0,4194304] 0 2024-04-15T21:02:56.133 INFO:tasks.workunit.client.1.smithi149.stdout:1/850: dwrite d1/f3 [4194304,4194304] 0 2024-04-15T21:02:56.140 INFO:tasks.workunit.client.1.smithi149.stdout:5/874: rename d0/d9/l2c to d0/d6/d82/l113 0 2024-04-15T21:02:56.140 INFO:tasks.workunit.client.0.smithi072.stdout:7/711: rmdir d2/d7/d25/d2d/d52/d6d 39 2024-04-15T21:02:56.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/700: getdents d2/d40/d66 0 2024-04-15T21:02:56.151 INFO:tasks.workunit.client.1.smithi149.stdout:5/875: fdatasync d0/d6/d82/da1/f1c 0 2024-04-15T21:02:56.152 INFO:tasks.workunit.client.1.smithi149.stdout:1/851: getdents d1/d17/d52/d42/dac 0 2024-04-15T21:02:56.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/762: creat d3/de/d1b/d41/d74/d98/da5/ff1 x:0 0 0 2024-04-15T21:02:56.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/735: chown d4/d29/d4c/d74/fcd 1847 1 2024-04-15T21:02:56.157 INFO:tasks.workunit.client.0.smithi072.stdout:9/736: chown d4/d1f/d2c/d62/c68 3527 1 2024-04-15T21:02:56.158 INFO:tasks.workunit.client.1.smithi149.stdout:5/876: fdatasync d0/d9/fa2 0 2024-04-15T21:02:56.159 INFO:tasks.workunit.client.0.smithi072.stdout:0/738: link d0/d6/feb d0/d74/dd5/dfa/ffb 0 2024-04-15T21:02:56.161 INFO:tasks.workunit.client.0.smithi072.stdout:7/712: mknod d2/d7/d25/d2d/d46/d5a/cdc 0 2024-04-15T21:02:56.163 INFO:tasks.workunit.client.0.smithi072.stdout:3/721: symlink d1/d3f/d4f/d73/db3/dd5/le0 0 2024-04-15T21:02:56.163 INFO:tasks.workunit.client.0.smithi072.stdout:0/739: dread d0/d6/f4e [0,4194304] 0 2024-04-15T21:02:56.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/761: symlink d0/d3/d7/d94/d92/da0/dfc/l100 0 2024-04-15T21:02:56.165 INFO:tasks.workunit.client.0.smithi072.stdout:0/740: chown d0/d6/d48/d61 146723 1 2024-04-15T21:02:56.166 INFO:tasks.workunit.client.0.smithi072.stdout:4/741: dwrite d7/d23/f29 [0,4194304] 0 2024-04-15T21:02:56.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/756: rmdir d2/db3/dba 0 2024-04-15T21:02:56.169 INFO:tasks.workunit.client.0.smithi072.stdout:2/757: chown d2/d66/fdc 218935 1 2024-04-15T21:02:56.171 INFO:tasks.workunit.client.1.smithi149.stdout:9/851: dwrite d23/d2b/f4a [0,4194304] 0 2024-04-15T21:02:56.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/742: dread d7/d10/d41/d44/d7a/ff1 [0,4194304] 0 2024-04-15T21:02:56.178 INFO:tasks.workunit.client.1.smithi149.stdout:5/877: link d0/d9/d71/ldd d0/d6/d82/da1/d12/d16/da9/d9b/l114 0 2024-04-15T21:02:56.184 INFO:tasks.workunit.client.1.smithi149.stdout:9/852: dwrite d23/d46/dcf/deb/d7f/d86/fb7 [0,4194304] 0 2024-04-15T21:02:56.188 INFO:tasks.workunit.client.1.smithi149.stdout:1/852: dread d1/f79 [0,4194304] 0 2024-04-15T21:02:56.193 INFO:tasks.workunit.client.0.smithi072.stdout:7/713: rename d2/d7/d25/d2d to d2/d7/d25/d2d/d46/d5a/d5f/d1f/ddd 22 2024-04-15T21:02:56.198 INFO:tasks.workunit.client.0.smithi072.stdout:1/707: truncate d5/db/d2d/d3a/f88 34131 0 2024-04-15T21:02:56.200 INFO:tasks.workunit.client.0.smithi072.stdout:0/741: mkdir d0/d19/d96/dfc 0 2024-04-15T21:02:56.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/742: write d0/d97/fbc [3377179,93395] 0 2024-04-15T21:02:56.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/758: readlink d2/d38/l32 0 2024-04-15T21:02:56.202 INFO:tasks.workunit.client.0.smithi072.stdout:9/737: mkdir d4/d1f/d2c/de9 0 2024-04-15T21:02:56.203 INFO:tasks.workunit.client.0.smithi072.stdout:0/743: chown d0/d45/d7a/d70/d59/d8a/d7b 116899 1 2024-04-15T21:02:56.206 INFO:tasks.workunit.client.0.smithi072.stdout:4/743: dwrite d7/d71/db2/fc5 [0,4194304] 0 2024-04-15T21:02:56.220 INFO:tasks.workunit.client.0.smithi072.stdout:6/701: creat d2/d10/d11/fd6 x:0 0 0 2024-04-15T21:02:56.220 INFO:tasks.workunit.client.1.smithi149.stdout:5/878: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d83/fee [0,4194304] 0 2024-04-15T21:02:56.220 INFO:tasks.workunit.client.1.smithi149.stdout:1/853: fdatasync d1/db/f33 0 2024-04-15T21:02:56.221 INFO:tasks.workunit.client.0.smithi072.stdout:7/714: truncate d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc1 800927 0 2024-04-15T21:02:56.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/853: mkdir d23/d2b/d37/d50/df1/d119 0 2024-04-15T21:02:56.224 INFO:tasks.workunit.client.0.smithi072.stdout:5/762: fdatasync d0/d3/d7/d12/d31/d55/d58/f65 0 2024-04-15T21:02:56.226 INFO:tasks.workunit.client.0.smithi072.stdout:5/763: dread - d0/d3/d7/d12/fec zero size 2024-04-15T21:02:56.227 INFO:tasks.workunit.client.0.smithi072.stdout:8/763: creat d3/d4/ff2 x:0 0 0 2024-04-15T21:02:56.231 INFO:tasks.workunit.client.1.smithi149.stdout:9/854: fsync d23/d3c/db5/ffd 0 2024-04-15T21:02:56.233 INFO:tasks.workunit.client.1.smithi149.stdout:9/855: write d23/d46/dcf/deb/d7f/d83/ff6 [698461,22182] 0 2024-04-15T21:02:56.236 INFO:tasks.workunit.client.1.smithi149.stdout:1/854: fdatasync d1/db/dc/d11/f47 0 2024-04-15T21:02:56.239 INFO:tasks.workunit.client.0.smithi072.stdout:0/744: fsync d0/d6/d48/fa2 0 2024-04-15T21:02:56.240 INFO:tasks.workunit.client.0.smithi072.stdout:2/759: dwrite d2/dd7/fe9 [0,4194304] 0 2024-04-15T21:02:56.241 INFO:tasks.workunit.client.0.smithi072.stdout:0/745: chown d0/d74/d94/lab 82977196 1 2024-04-15T21:02:56.241 INFO:tasks.workunit.client.0.smithi072.stdout:4/744: readlink d7/d10/lcd 0 2024-04-15T21:02:56.242 INFO:tasks.workunit.client.1.smithi149.stdout:1/855: dwrite d1/f3 [4194304,4194304] 0 2024-04-15T21:02:56.244 INFO:tasks.workunit.client.1.smithi149.stdout:9/856: rename d23/d2b/d37/d50/d79/d8d/la7 to d23/d2b/d37/d50/l11a 0 2024-04-15T21:02:56.248 INFO:tasks.workunit.client.0.smithi072.stdout:6/702: unlink d2/d10/d11/d15/c5b 0 2024-04-15T21:02:56.254 INFO:tasks.workunit.client.1.smithi149.stdout:9/857: creat d23/d3c/d7a/f11b x:0 0 0 2024-04-15T21:02:56.254 INFO:tasks.workunit.client.1.smithi149.stdout:5/879: dwrite d0/d6/d82/da1/fb2 [0,4194304] 0 2024-04-15T21:02:56.255 INFO:tasks.workunit.client.0.smithi072.stdout:5/764: mkdir d0/d3/d7/d12/d31/d62/d8e/d101 0 2024-04-15T21:02:56.255 INFO:tasks.workunit.client.1.smithi149.stdout:5/880: chown d0/d9/c92 184774 1 2024-04-15T21:02:56.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/856: creat d1/d17/d5e/de0/ff9 x:0 0 0 2024-04-15T21:02:56.265 INFO:tasks.workunit.client.0.smithi072.stdout:9/738: link d4/d1f/d31/dcc/fe5 d4/d29/fea 0 2024-04-15T21:02:56.265 INFO:tasks.workunit.client.0.smithi072.stdout:9/739: readlink d4/d1f/d2c/d47/la3 0 2024-04-15T21:02:56.270 INFO:tasks.workunit.client.0.smithi072.stdout:2/760: rmdir d2/d66/d96 39 2024-04-15T21:02:56.271 INFO:tasks.workunit.client.0.smithi072.stdout:8/764: write d3/de/d1b/d3f/f67 [2285466,104337] 0 2024-04-15T21:02:56.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/857: dread d1/db/f37 [0,4194304] 0 2024-04-15T21:02:56.273 INFO:tasks.workunit.client.0.smithi072.stdout:1/708: dwrite d5/f8f [0,4194304] 0 2024-04-15T21:02:56.274 INFO:tasks.workunit.client.0.smithi072.stdout:2/761: dread d2/d66/fe1 [0,4194304] 0 2024-04-15T21:02:56.276 INFO:tasks.workunit.client.0.smithi072.stdout:4/745: rename d7/d10/d41/d44/d7a/d86 to d7/d15/ddd/df7 0 2024-04-15T21:02:56.276 INFO:tasks.workunit.client.0.smithi072.stdout:2/762: write d2/d3/d5f/fe3 [283107,61729] 0 2024-04-15T21:02:56.277 INFO:tasks.workunit.client.0.smithi072.stdout:3/722: getdents d1/d5b 0 2024-04-15T21:02:56.282 INFO:tasks.workunit.client.1.smithi149.stdout:5/881: dread d0/d6/d82/da1/d12/d16/da9/f40 [0,4194304] 0 2024-04-15T21:02:56.287 INFO:tasks.workunit.client.1.smithi149.stdout:9/858: dread d23/d46/f73 [0,4194304] 0 2024-04-15T21:02:56.289 INFO:tasks.workunit.client.1.smithi149.stdout:1/858: getdents d1/db/dc/d38/d39/d43/daa/d8a 0 2024-04-15T21:02:56.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/746: dwrite d0/d45/d7a/f2a [4194304,4194304] 0 2024-04-15T21:02:56.290 INFO:tasks.workunit.client.0.smithi072.stdout:0/747: chown d0/d19/d2b/fee 87282584 1 2024-04-15T21:02:56.291 INFO:tasks.workunit.client.0.smithi072.stdout:8/765: dread - d3/de/fb6 zero size 2024-04-15T21:02:56.293 INFO:tasks.workunit.client.1.smithi149.stdout:5/882: rename d0/d6/d82/da1/d12/d16/da9/d9b/db7 to d0/d9/d115 0 2024-04-15T21:02:56.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/883: symlink d0/d6/d9f/l116 0 2024-04-15T21:02:56.297 INFO:tasks.workunit.client.0.smithi072.stdout:5/765: unlink d0/d3/d33/d60/d81/lf6 0 2024-04-15T21:02:56.299 INFO:tasks.workunit.client.0.smithi072.stdout:9/740: truncate d4/d1f/d31/f7e 1134235 0 2024-04-15T21:02:56.300 INFO:tasks.workunit.client.1.smithi149.stdout:5/884: fdatasync d0/f5 0 2024-04-15T21:02:56.301 INFO:tasks.workunit.client.1.smithi149.stdout:5/885: write d0/f4f [3924057,44120] 0 2024-04-15T21:02:56.303 INFO:tasks.workunit.client.1.smithi149.stdout:5/886: write d0/d6/d82/da1/fe3 [1127793,11143] 0 2024-04-15T21:02:56.304 INFO:tasks.workunit.client.0.smithi072.stdout:0/748: readlink d0/d45/d7a/d70/lae 0 2024-04-15T21:02:56.304 INFO:tasks.workunit.client.1.smithi149.stdout:9/859: write d23/d2b/d37/d50/db3/fd9 [931707,117192] 0 2024-04-15T21:02:56.308 INFO:tasks.workunit.client.0.smithi072.stdout:1/709: write d5/d3d/fb7 [625970,79186] 0 2024-04-15T21:02:56.309 INFO:tasks.workunit.client.1.smithi149.stdout:9/860: creat d23/d71/f11c x:0 0 0 2024-04-15T21:02:56.311 INFO:tasks.workunit.client.1.smithi149.stdout:9/861: write d23/d3c/d87/d9a/dad/fce [4035823,76607] 0 2024-04-15T21:02:56.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/746: dread d7/d15/d58/f7b [0,4194304] 0 2024-04-15T21:02:56.315 INFO:tasks.workunit.client.0.smithi072.stdout:1/710: dwrite d5/d3d/f75 [0,4194304] 0 2024-04-15T21:02:56.317 INFO:tasks.workunit.client.0.smithi072.stdout:8/766: dread d3/f3c [0,4194304] 0 2024-04-15T21:02:56.318 INFO:tasks.workunit.client.0.smithi072.stdout:0/749: rename d0/d6/f39 to d0/d45/d7a/d70/d59/d8a/d7b/ffd 0 2024-04-15T21:02:56.318 INFO:tasks.workunit.client.1.smithi149.stdout:1/859: dread d1/db/f33 [4194304,4194304] 0 2024-04-15T21:02:56.320 INFO:tasks.workunit.client.1.smithi149.stdout:9/862: fdatasync d23/d2b/d44/f5c 0 2024-04-15T21:02:56.321 INFO:tasks.workunit.client.1.smithi149.stdout:5/887: getdents d0/d6/d82/da1/d12/d16/da9/d1b/d61 0 2024-04-15T21:02:56.322 INFO:tasks.workunit.client.1.smithi149.stdout:5/888: stat d0/d6/d82/da1/l88 0 2024-04-15T21:02:56.323 INFO:tasks.workunit.client.1.smithi149.stdout:1/860: mknod d1/d17/d36/d6f/da3/cfa 0 2024-04-15T21:02:56.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/723: link d1/d3f/f67 d1/d15/d32/d2f/fe1 0 2024-04-15T21:02:56.328 INFO:tasks.workunit.client.1.smithi149.stdout:5/889: mkdir d0/d9/d115/dfb/d117 0 2024-04-15T21:02:56.329 INFO:tasks.workunit.client.0.smithi072.stdout:5/766: mkdir d0/d3/d7/d12/d1d/d102 0 2024-04-15T21:02:56.330 INFO:tasks.workunit.client.0.smithi072.stdout:9/741: mknod d4/d29/d4c/d91/ceb 0 2024-04-15T21:02:56.331 INFO:tasks.workunit.client.0.smithi072.stdout:9/742: stat d4/d29/d4c/d91/d93/caf 0 2024-04-15T21:02:56.332 INFO:tasks.workunit.client.1.smithi149.stdout:1/861: creat d1/db/d14/dd5/ffb x:0 0 0 2024-04-15T21:02:56.333 INFO:tasks.workunit.client.1.smithi149.stdout:5/890: dwrite d0/f8 [0,4194304] 0 2024-04-15T21:02:56.334 INFO:tasks.workunit.client.0.smithi072.stdout:8/767: unlink d3/de/d1b/d41/da4/f4a 0 2024-04-15T21:02:56.338 INFO:tasks.workunit.client.0.smithi072.stdout:2/763: getdents d2/d3 0 2024-04-15T21:02:56.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/862: truncate d1/db/dc/fa5 500026 0 2024-04-15T21:02:56.341 INFO:tasks.workunit.client.0.smithi072.stdout:3/724: readlink d1/d15/d32/l88 0 2024-04-15T21:02:56.342 INFO:tasks.workunit.client.0.smithi072.stdout:3/725: write d1/d3f/d4f/d73/fc5 [6748971,86399] 0 2024-04-15T21:02:56.344 INFO:tasks.workunit.client.0.smithi072.stdout:4/747: dread d7/d10/d41/d44/f48 [0,4194304] 0 2024-04-15T21:02:56.345 INFO:tasks.workunit.client.0.smithi072.stdout:4/748: chown d7/d10/d41/d4c/dc9 3300873 1 2024-04-15T21:02:56.346 INFO:tasks.workunit.client.1.smithi149.stdout:1/863: dwrite d1/f3 [4194304,4194304] 0 2024-04-15T21:02:56.349 INFO:tasks.workunit.client.1.smithi149.stdout:9/863: write d23/d2b/d37/d50/d110/fd8 [4145423,119427] 0 2024-04-15T21:02:56.355 INFO:tasks.workunit.client.0.smithi072.stdout:3/726: creat d1/d3f/d4f/da3/fe2 x:0 0 0 2024-04-15T21:02:56.357 INFO:tasks.workunit.client.0.smithi072.stdout:5/767: symlink d0/d3/l103 0 2024-04-15T21:02:56.359 INFO:tasks.workunit.client.1.smithi149.stdout:9/864: rename c13 to d23/d2b/d44/d7e/c11d 0 2024-04-15T21:02:56.362 INFO:tasks.workunit.client.1.smithi149.stdout:1/864: dwrite d1/db/dc/d11/fad [0,4194304] 0 2024-04-15T21:02:56.362 INFO:tasks.workunit.client.0.smithi072.stdout:2/764: dwrite d2/d3/d5f/f7c [4194304,4194304] 0 2024-04-15T21:02:56.362 INFO:tasks.workunit.client.0.smithi072.stdout:2/765: stat d2/d64/l83 0 2024-04-15T21:02:56.363 INFO:tasks.workunit.client.0.smithi072.stdout:0/750: write d0/d45/fc0 [338559,105394] 0 2024-04-15T21:02:56.368 INFO:tasks.workunit.client.0.smithi072.stdout:3/727: creat d1/d5b/fe3 x:0 0 0 2024-04-15T21:02:56.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/891: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d83/f97 [4194304,4194304] 0 2024-04-15T21:02:56.372 INFO:tasks.workunit.client.0.smithi072.stdout:2/766: mknod d2/d66/d69/cee 0 2024-04-15T21:02:56.373 INFO:tasks.workunit.client.0.smithi072.stdout:1/711: getdents d5/db/d27/d9c 0 2024-04-15T21:02:56.374 INFO:tasks.workunit.client.0.smithi072.stdout:8/768: creat d3/d7e/ff3 x:0 0 0 2024-04-15T21:02:56.374 INFO:tasks.workunit.client.0.smithi072.stdout:0/751: creat d0/d6/d48/d61/ffe x:0 0 0 2024-04-15T21:02:56.376 INFO:tasks.workunit.client.0.smithi072.stdout:2/767: creat d2/d8/fef x:0 0 0 2024-04-15T21:02:56.378 INFO:tasks.workunit.client.1.smithi149.stdout:5/892: getdents d0/d6 0 2024-04-15T21:02:56.381 INFO:tasks.workunit.client.0.smithi072.stdout:0/752: getdents d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2 0 2024-04-15T21:02:56.381 INFO:tasks.workunit.client.1.smithi149.stdout:5/893: truncate d0/d6/d82/da1/f38 7570955 0 2024-04-15T21:02:56.382 INFO:tasks.workunit.client.0.smithi072.stdout:1/712: link d5/db/d27/f47 d5/dcb/fe2 0 2024-04-15T21:02:56.384 INFO:tasks.workunit.client.0.smithi072.stdout:0/753: fdatasync d0/fb3 0 2024-04-15T21:02:56.384 INFO:tasks.workunit.client.1.smithi149.stdout:5/894: creat d0/d9/db6/f118 x:0 0 0 2024-04-15T21:02:56.384 INFO:tasks.workunit.client.0.smithi072.stdout:2/768: dwrite d2/d8/daa/fa6 [0,4194304] 0 2024-04-15T21:02:56.385 INFO:tasks.workunit.client.1.smithi149.stdout:5/895: read - d0/d6/d82/fa6 zero size 2024-04-15T21:02:56.385 INFO:tasks.workunit.client.0.smithi072.stdout:1/713: mknod d5/db/d2d/d56/ce3 0 2024-04-15T21:02:56.387 INFO:tasks.workunit.client.0.smithi072.stdout:9/743: dread d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:56.389 INFO:tasks.workunit.client.0.smithi072.stdout:9/744: write d4/d1f/fc3 [2402405,28381] 0 2024-04-15T21:02:56.389 INFO:tasks.workunit.client.0.smithi072.stdout:1/714: symlink d5/db/d27/d5c/le4 0 2024-04-15T21:02:56.390 INFO:tasks.workunit.client.0.smithi072.stdout:9/745: readlink d4/d1f/l2a 0 2024-04-15T21:02:56.391 INFO:tasks.workunit.client.0.smithi072.stdout:0/754: fsync d0/d45/fc0 0 2024-04-15T21:02:56.392 INFO:tasks.workunit.client.0.smithi072.stdout:2/769: mknod d2/d64/cf0 0 2024-04-15T21:02:56.393 INFO:tasks.workunit.client.1.smithi149.stdout:5/896: getdents d0/d9/d3f/dc7 0 2024-04-15T21:02:56.393 INFO:tasks.workunit.client.1.smithi149.stdout:9/865: write d23/d2b/d44/d7e/fb6 [652759,40575] 0 2024-04-15T21:02:56.401 INFO:tasks.workunit.client.1.smithi149.stdout:9/866: link d23/d2b/d37/d50/fa2 d23/d3c/d87/f11e 0 2024-04-15T21:02:56.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/867: rename d23/d3c/d52/l61 to d23/d2b/d37/d6d/db8/l11f 0 2024-04-15T21:02:56.408 INFO:tasks.workunit.client.1.smithi149.stdout:9/868: creat d23/d46/dcf/deb/d7f/d86/f120 x:0 0 0 2024-04-15T21:02:56.412 INFO:tasks.workunit.client.0.smithi072.stdout:1/715: read - d5/d31/d51/d82/fc0 zero size 2024-04-15T21:02:56.412 INFO:tasks.workunit.client.0.smithi072.stdout:0/755: rmdir d0/d45 39 2024-04-15T21:02:56.412 INFO:tasks.workunit.client.1.smithi149.stdout:9/869: dread d23/d3c/d87/d9a/dad/fce [0,4194304] 0 2024-04-15T21:02:56.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/746: fsync d4/d1f/d2c/f57 0 2024-04-15T21:02:56.413 INFO:tasks.workunit.client.0.smithi072.stdout:4/749: dwrite d7/d10/d41/d44/d7a/ff1 [0,4194304] 0 2024-04-15T21:02:56.413 INFO:tasks.workunit.client.0.smithi072.stdout:2/770: mkdir d2/d3/df1 0 2024-04-15T21:02:56.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/870: symlink d23/d3c/d114/l121 0 2024-04-15T21:02:56.416 INFO:tasks.workunit.client.1.smithi149.stdout:5/897: dread d0/d6/d82/da1/d12/f27 [0,4194304] 0 2024-04-15T21:02:56.418 INFO:tasks.workunit.client.0.smithi072.stdout:4/750: write d7/d10/d41/d4c/f82 [4255914,30973] 0 2024-04-15T21:02:56.418 INFO:tasks.workunit.client.0.smithi072.stdout:0/756: creat d0/d19/d2b/fff x:0 0 0 2024-04-15T21:02:56.419 INFO:tasks.workunit.client.1.smithi149.stdout:5/898: creat d0/d6/d82/da1/d12/d2b/f119 x:0 0 0 2024-04-15T21:02:56.421 INFO:tasks.workunit.client.0.smithi072.stdout:9/747: creat d4/d1f/d31/dcc/fec x:0 0 0 2024-04-15T21:02:56.421 INFO:tasks.workunit.client.0.smithi072.stdout:1/716: read d5/db/d27/f34 [3782859,8835] 0 2024-04-15T21:02:56.421 INFO:tasks.workunit.client.0.smithi072.stdout:4/751: chown d7/fc 2835 1 2024-04-15T21:02:56.423 INFO:tasks.workunit.client.0.smithi072.stdout:5/768: dwrite d0/d3/d6/ff [4194304,4194304] 0 2024-04-15T21:02:56.423 INFO:tasks.workunit.client.0.smithi072.stdout:2/771: mkdir d2/d66/df2 0 2024-04-15T21:02:56.425 INFO:tasks.workunit.client.1.smithi149.stdout:5/899: creat d0/d6/f11a x:0 0 0 2024-04-15T21:02:56.427 INFO:tasks.workunit.client.0.smithi072.stdout:3/728: dwrite d1/f64 [4194304,4194304] 0 2024-04-15T21:02:56.427 INFO:tasks.workunit.client.1.smithi149.stdout:9/871: creat d23/d2b/d44/f122 x:0 0 0 2024-04-15T21:02:56.429 INFO:tasks.workunit.client.0.smithi072.stdout:9/748: truncate d4/d1f/d9e/fd9 400574 0 2024-04-15T21:02:56.430 INFO:tasks.workunit.client.0.smithi072.stdout:1/717: dread - d5/db/d2d/d3a/d1f/d63/fd2 zero size 2024-04-15T21:02:56.430 INFO:tasks.workunit.client.1.smithi149.stdout:9/872: symlink d23/d2b/d37/d6d/de3/l123 0 2024-04-15T21:02:56.431 INFO:tasks.workunit.client.0.smithi072.stdout:2/772: chown d2/d8/d8e/d90/fa5 1 1 2024-04-15T21:02:56.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/769: rename d0/d3/d33/cb1 to d0/c104 0 2024-04-15T21:02:56.434 INFO:tasks.workunit.client.1.smithi149.stdout:9/873: chown d23/d3c/d7a/da5/ca9 3465 1 2024-04-15T21:02:56.436 INFO:tasks.workunit.client.0.smithi072.stdout:2/773: mkdir d2/d8/df3 0 2024-04-15T21:02:56.437 INFO:tasks.workunit.client.0.smithi072.stdout:4/752: dwrite d7/d10/f85 [0,4194304] 0 2024-04-15T21:02:56.438 INFO:tasks.workunit.client.0.smithi072.stdout:1/718: rename d5/fd4 to d5/db/d27/d5c/dbd/fe5 0 2024-04-15T21:02:56.439 INFO:tasks.workunit.client.1.smithi149.stdout:9/874: dread d23/d2b/d37/d50/db3/fd9 [0,4194304] 0 2024-04-15T21:02:56.443 INFO:tasks.workunit.client.0.smithi072.stdout:2/774: creat d2/d38/d91/ff4 x:0 0 0 2024-04-15T21:02:56.445 INFO:tasks.workunit.client.0.smithi072.stdout:2/775: chown d2/d8/d41/c93 515987194 1 2024-04-15T21:02:56.445 INFO:tasks.workunit.client.0.smithi072.stdout:5/770: dwrite d0/d3/d7/f8a [4194304,4194304] 0 2024-04-15T21:02:56.447 INFO:tasks.workunit.client.0.smithi072.stdout:2/776: chown d2/d8/l25 12 1 2024-04-15T21:02:56.452 INFO:tasks.workunit.client.0.smithi072.stdout:4/753: rename d7/d28/d42/d8c/da9/l94 to d7/d10/lf8 0 2024-04-15T21:02:56.452 INFO:tasks.workunit.client.0.smithi072.stdout:0/757: write d0/d6/f4e [716777,115171] 0 2024-04-15T21:02:56.453 INFO:tasks.workunit.client.0.smithi072.stdout:2/777: fdatasync d2/d66/f68 0 2024-04-15T21:02:56.454 INFO:tasks.workunit.client.0.smithi072.stdout:9/749: dread d4/f1b [0,4194304] 0 2024-04-15T21:02:56.457 INFO:tasks.workunit.client.0.smithi072.stdout:4/754: rename d7/d15/f66 to d7/d10/d41/d44/d7a/ff9 0 2024-04-15T21:02:56.459 INFO:tasks.workunit.client.1.smithi149.stdout:5/900: symlink d0/d6/d82/da1/d12/d16/da9/d1b/d9c/l11b 0 2024-04-15T21:02:56.461 INFO:tasks.workunit.client.1.smithi149.stdout:5/901: creat d0/d9/d3f/f11c x:0 0 0 2024-04-15T21:02:56.463 INFO:tasks.workunit.client.0.smithi072.stdout:9/750: rename d4/d76/d8f/fb0 to d4/fed 0 2024-04-15T21:02:56.465 INFO:tasks.workunit.client.1.smithi149.stdout:5/902: creat d0/d6/f11d x:0 0 0 2024-04-15T21:02:56.466 INFO:tasks.workunit.client.1.smithi149.stdout:9/875: dread d23/d3c/d7a/da5/dbd/f106 [0,4194304] 0 2024-04-15T21:02:56.467 INFO:tasks.workunit.client.0.smithi072.stdout:2/778: rename d2/d3/d5f/dc8/lca to d2/d8/df3/lf5 0 2024-04-15T21:02:56.469 INFO:tasks.workunit.client.1.smithi149.stdout:9/876: mkdir d23/d46/d124 0 2024-04-15T21:02:56.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/877: stat d23/d71/fea 0 2024-04-15T21:02:56.470 INFO:tasks.workunit.client.0.smithi072.stdout:2/779: unlink d2/d66/cc6 0 2024-04-15T21:02:56.474 INFO:tasks.workunit.client.1.smithi149.stdout:9/878: symlink d23/d3c/l125 0 2024-04-15T21:02:56.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/903: dwrite d0/d6/d82/da1/d12/d2b/f119 [0,4194304] 0 2024-04-15T21:02:56.483 INFO:tasks.workunit.client.0.smithi072.stdout:5/771: dread d0/d3/d6/f8 [4194304,4194304] 0 2024-04-15T21:02:56.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/904: creat d0/d9/f11e x:0 0 0 2024-04-15T21:02:56.484 INFO:tasks.workunit.client.0.smithi072.stdout:5/772: dread - d0/d3/d7/d12/ff9 zero size 2024-04-15T21:02:56.485 INFO:tasks.workunit.client.1.smithi149.stdout:9/879: dwrite d23/d3c/f6b [0,4194304] 0 2024-04-15T21:02:56.487 INFO:tasks.workunit.client.0.smithi072.stdout:5/773: creat d0/d3/d33/d60/d81/f105 x:0 0 0 2024-04-15T21:02:56.492 INFO:tasks.workunit.client.1.smithi149.stdout:5/905: rmdir d0/d6/d82/da1/d12/d16/da9 39 2024-04-15T21:02:56.493 INFO:tasks.workunit.client.1.smithi149.stdout:9/880: fdatasync d23/fd7 0 2024-04-15T21:02:56.498 INFO:tasks.workunit.client.0.smithi072.stdout:4/755: dwrite d7/d28/d6d/f92 [0,4194304] 0 2024-04-15T21:02:56.500 INFO:tasks.workunit.client.1.smithi149.stdout:5/906: creat d0/d6/d82/da1/d12/d16/f11f x:0 0 0 2024-04-15T21:02:56.503 INFO:tasks.workunit.client.0.smithi072.stdout:4/756: mkdir d7/d10/d41/d44/d7a/d97/db6/dfa 0 2024-04-15T21:02:56.505 INFO:tasks.workunit.client.0.smithi072.stdout:2/780: truncate d2/d8/fbc 1463770 0 2024-04-15T21:02:56.505 INFO:tasks.workunit.client.1.smithi149.stdout:9/881: dread d23/f33 [0,4194304] 0 2024-04-15T21:02:56.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/781: write d2/d38/f56 [8837069,71347] 0 2024-04-15T21:02:56.510 INFO:tasks.workunit.client.0.smithi072.stdout:9/751: dwrite d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:02:56.512 INFO:tasks.workunit.client.0.smithi072.stdout:1/719: dwrite d5/d31/f87 [0,4194304] 0 2024-04-15T21:02:56.514 INFO:tasks.workunit.client.1.smithi149.stdout:9/882: link d23/d2b/d37/d50/l11a d23/d71/l126 0 2024-04-15T21:02:56.516 INFO:tasks.workunit.client.1.smithi149.stdout:9/883: mkdir d23/d2b/d37/d50/d69/d127 0 2024-04-15T21:02:56.518 INFO:tasks.workunit.client.1.smithi149.stdout:9/884: symlink d23/d2b/d37/d50/d69/l128 0 2024-04-15T21:02:56.521 INFO:tasks.workunit.client.0.smithi072.stdout:9/752: dwrite d4/d1f/d2c/fde [0,4194304] 0 2024-04-15T21:02:56.524 INFO:tasks.workunit.client.0.smithi072.stdout:5/774: dread d0/d3/d7/f3c [0,4194304] 0 2024-04-15T21:02:56.524 INFO:tasks.workunit.client.0.smithi072.stdout:1/720: mkdir d5/db/d27/d5c/ddc/de6 0 2024-04-15T21:02:56.526 INFO:tasks.workunit.client.0.smithi072.stdout:9/753: creat d4/d1f/d31/d9b/fee x:0 0 0 2024-04-15T21:02:56.528 INFO:tasks.workunit.client.0.smithi072.stdout:9/754: read - d4/d29/d4c/d74/d84/f8d zero size 2024-04-15T21:02:56.530 INFO:tasks.workunit.client.0.smithi072.stdout:9/755: write d4/d1f/d2c/d47/f5f [3145169,101567] 0 2024-04-15T21:02:56.530 INFO:tasks.workunit.client.0.smithi072.stdout:5/775: dwrite d0/d3/d33/d85/fd4 [0,4194304] 0 2024-04-15T21:02:56.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/907: dread d0/d6/d82/da1/d12/d2b/f72 [0,4194304] 0 2024-04-15T21:02:56.533 INFO:tasks.workunit.client.0.smithi072.stdout:5/776: fdatasync d0/f7c 0 2024-04-15T21:02:56.538 INFO:tasks.workunit.client.1.smithi149.stdout:5/908: symlink d0/d6/d82/da1/d12/d16/da9/d1b/d61/l120 0 2024-04-15T21:02:56.541 INFO:tasks.workunit.client.0.smithi072.stdout:9/756: dwrite d4/d1f/d9e/fd9 [0,4194304] 0 2024-04-15T21:02:56.543 INFO:tasks.workunit.client.1.smithi149.stdout:9/885: write d23/fd7 [175282,16904] 0 2024-04-15T21:02:56.545 INFO:tasks.workunit.client.0.smithi072.stdout:9/757: dread d4/d1f/d2c/d47/f5f [0,4194304] 0 2024-04-15T21:02:56.545 INFO:tasks.workunit.client.1.smithi149.stdout:5/909: creat d0/d6/dc8/d103/f121 x:0 0 0 2024-04-15T21:02:56.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/961: sync 2024-04-15T21:02:56.550 INFO:tasks.workunit.client.0.smithi072.stdout:5/777: rename d0/d3/d7/d12/d31/f3d to d0/d3/d7/d12/d31/d62/dfa/f106 0 2024-04-15T21:02:56.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/886: symlink d23/d3c/d7a/da5/dbd/l129 0 2024-04-15T21:02:56.553 INFO:tasks.workunit.client.1.smithi149.stdout:5/910: rename d0/d9/d71/cb9 to d0/d9/db6/c122 0 2024-04-15T21:02:56.561 INFO:tasks.workunit.client.1.smithi149.stdout:2/962: fdatasync d4/df6/f14a 0 2024-04-15T21:02:56.562 INFO:tasks.workunit.client.1.smithi149.stdout:2/963: fdatasync d4/d7/d46/de4/d21/d3b/d10a/d15c/f88 0 2024-04-15T21:02:56.565 INFO:tasks.workunit.client.0.smithi072.stdout:5/778: getdents d0/d3/d7/d12/d1d 0 2024-04-15T21:02:56.572 INFO:tasks.workunit.client.1.smithi149.stdout:2/964: rename d4/df6/f140 to d4/d7/d46/de4/d21/d3b/d10a/d15c/dee/f15e 0 2024-04-15T21:02:56.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/887: dread d23/d2b/d70/d75/f95 [0,4194304] 0 2024-04-15T21:02:56.575 INFO:tasks.workunit.client.1.smithi149.stdout:5/911: link d0/d6/d82/da1/d12/d16/da9/d1b/d83/f90 d0/f123 0 2024-04-15T21:02:56.576 INFO:tasks.workunit.client.0.smithi072.stdout:9/758: dwrite d4/d1f/d2c/f2d [0,4194304] 0 2024-04-15T21:02:56.576 INFO:tasks.workunit.client.1.smithi149.stdout:2/965: mknod d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/c15f 0 2024-04-15T21:02:56.579 INFO:tasks.workunit.client.1.smithi149.stdout:9/888: dread d23/d2b/d37/d50/db3/fd9 [0,4194304] 0 2024-04-15T21:02:56.580 INFO:tasks.workunit.client.0.smithi072.stdout:9/759: symlink d4/d29/d4c/d91/d93/lef 0 2024-04-15T21:02:56.580 INFO:tasks.workunit.client.1.smithi149.stdout:2/966: readlink d4/d7/d46/de4/l8a 0 2024-04-15T21:02:56.581 INFO:tasks.workunit.client.1.smithi149.stdout:9/889: dread - d23/d3c/d7a/f11b zero size 2024-04-15T21:02:56.581 INFO:tasks.workunit.client.0.smithi072.stdout:9/760: creat d4/d1f/d31/d4d/ff0 x:0 0 0 2024-04-15T21:02:56.582 INFO:tasks.workunit.client.0.smithi072.stdout:5/779: dread d0/d3/d33/d60/f8f [0,4194304] 0 2024-04-15T21:02:56.584 INFO:tasks.workunit.client.1.smithi149.stdout:2/967: fdatasync d4/d7/d10/d36/f107 0 2024-04-15T21:02:56.584 INFO:tasks.workunit.client.1.smithi149.stdout:6/931: sync 2024-04-15T21:02:56.584 INFO:tasks.workunit.client.1.smithi149.stdout:1/865: sync 2024-04-15T21:02:56.584 INFO:tasks.workunit.client.1.smithi149.stdout:7/900: sync 2024-04-15T21:02:56.584 INFO:tasks.workunit.client.1.smithi149.stdout:3/919: sync 2024-04-15T21:02:56.585 INFO:tasks.workunit.client.1.smithi149.stdout:9/890: fsync f22 0 2024-04-15T21:02:56.587 INFO:tasks.workunit.client.0.smithi072.stdout:5/780: symlink d0/d3/d7/d94/d92/l107 0 2024-04-15T21:02:56.588 INFO:tasks.workunit.client.0.smithi072.stdout:9/761: mknod d4/d1f/d2c/d47/dda/cf1 0 2024-04-15T21:02:56.592 INFO:tasks.workunit.client.0.smithi072.stdout:9/762: mkdir d4/d29/d4c/d74/d84/df2 0 2024-04-15T21:02:56.593 INFO:tasks.workunit.client.0.smithi072.stdout:5/781: dwrite d0/d3/d33/d60/fe0 [0,4194304] 0 2024-04-15T21:02:56.593 INFO:tasks.workunit.client.1.smithi149.stdout:9/891: chown d23/d71/l9e 8190 1 2024-04-15T21:02:56.596 INFO:tasks.workunit.client.1.smithi149.stdout:3/920: creat d1/db/d24/d2b/da9/f123 x:0 0 0 2024-04-15T21:02:56.598 INFO:tasks.workunit.client.1.smithi149.stdout:7/901: mknod d3/d16/d20/d36/d3d/da4/c141 0 2024-04-15T21:02:56.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/921: chown d1/db/d24/f4b 57805 1 2024-04-15T21:02:56.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/912: dread d0/d9/f22 [0,4194304] 0 2024-04-15T21:02:56.603 INFO:tasks.workunit.client.1.smithi149.stdout:2/968: creat d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/d11f/f160 x:0 0 0 2024-04-15T21:02:56.603 INFO:tasks.workunit.client.1.smithi149.stdout:5/913: dread - d0/d6/dc8/d103/f121 zero size 2024-04-15T21:02:56.604 INFO:tasks.workunit.client.0.smithi072.stdout:9/763: unlink d4/d1f/d31/d9b/dca/fce 0 2024-04-15T21:02:56.605 INFO:tasks.workunit.client.1.smithi149.stdout:6/932: mkdir da/d18/d10/d16/d97/dbf/d130 0 2024-04-15T21:02:56.606 INFO:tasks.workunit.client.1.smithi149.stdout:1/866: mkdir d1/df7/dfc 0 2024-04-15T21:02:56.611 INFO:tasks.workunit.client.0.smithi072.stdout:5/782: write d0/d3/d6/f8 [6372396,87364] 0 2024-04-15T21:02:56.613 INFO:tasks.workunit.client.1.smithi149.stdout:2/969: creat d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/d11f/f161 x:0 0 0 2024-04-15T21:02:56.617 INFO:tasks.workunit.client.1.smithi149.stdout:1/867: truncate d1/fc9 881 0 2024-04-15T21:02:56.618 INFO:tasks.workunit.client.1.smithi149.stdout:9/892: creat d23/d2b/d37/d50/d103/f12a x:0 0 0 2024-04-15T21:02:56.619 INFO:tasks.workunit.client.0.smithi072.stdout:9/764: write d4/d1f/d2c/d62/f81 [1524935,49393] 0 2024-04-15T21:02:56.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/868: truncate d1/d17/fdc 890384 0 2024-04-15T21:02:56.620 INFO:tasks.workunit.client.1.smithi149.stdout:2/970: dwrite d4/d7/d46/de4/d21/d55/ffb [0,4194304] 0 2024-04-15T21:02:56.622 INFO:tasks.workunit.client.1.smithi149.stdout:7/902: rename d3/d17/f33 to d3/d16/d32/d90/dad/dc4/dd6/f142 0 2024-04-15T21:02:56.623 INFO:tasks.workunit.client.0.smithi072.stdout:9/765: creat d4/d29/d4c/d74/d84/ff3 x:0 0 0 2024-04-15T21:02:56.624 INFO:tasks.workunit.client.0.smithi072.stdout:5/783: write d0/d3/d7/d94/f69 [244386,45352] 0 2024-04-15T21:02:56.625 INFO:tasks.workunit.client.1.smithi149.stdout:7/903: stat d3/d16/d11f/d92/l12c 0 2024-04-15T21:02:56.628 INFO:tasks.workunit.client.1.smithi149.stdout:5/914: write d0/d6/d82/da1/d12/d16/da9/fc5 [1252895,42033] 0 2024-04-15T21:02:56.628 INFO:tasks.workunit.client.1.smithi149.stdout:6/933: fdatasync da/d18/d10/d3f/f41 0 2024-04-15T21:02:56.632 INFO:tasks.workunit.client.1.smithi149.stdout:7/904: read d3/d16/d20/f24 [2285545,54750] 0 2024-04-15T21:02:56.633 INFO:tasks.workunit.client.1.smithi149.stdout:2/971: read d4/d7/d46/de4/d21/d2c/fbc [2472245,41807] 0 2024-04-15T21:02:56.633 INFO:tasks.workunit.client.1.smithi149.stdout:5/915: chown d0/f5 272164 1 2024-04-15T21:02:56.633 INFO:tasks.workunit.client.1.smithi149.stdout:7/905: chown d3/d16/d20/fdd 911 1 2024-04-15T21:02:56.634 INFO:tasks.workunit.client.1.smithi149.stdout:3/922: dwrite d1/db/d28/fbf [0,4194304] 0 2024-04-15T21:02:56.634 INFO:tasks.workunit.client.1.smithi149.stdout:6/934: write da/d18/d10/d16/f9a [2419780,128409] 0 2024-04-15T21:02:56.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/923: chown d1/d81/fef 57 1 2024-04-15T21:02:56.639 INFO:tasks.workunit.client.1.smithi149.stdout:5/916: creat d0/d9/d3f/f124 x:0 0 0 2024-04-15T21:02:56.640 INFO:tasks.workunit.client.1.smithi149.stdout:7/906: creat d3/d16/d20/d36/d3d/da4/d138/f143 x:0 0 0 2024-04-15T21:02:56.642 INFO:tasks.workunit.client.1.smithi149.stdout:5/917: read d0/d6/d82/da1/d12/d16/da9/fc5 [182577,18710] 0 2024-04-15T21:02:56.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/972: rename d4/d7/d46/de4/d21/d3b/d10a/dfd/d112/d155 to d4/d7/d29/dff/d162 0 2024-04-15T21:02:56.645 INFO:tasks.workunit.client.0.smithi072.stdout:5/784: dread d0/d3/d7/d1f/d4c/fbf [0,4194304] 0 2024-04-15T21:02:56.648 INFO:tasks.workunit.client.1.smithi149.stdout:3/924: creat d1/db/d40/d56/d84/d10d/f124 x:0 0 0 2024-04-15T21:02:56.655 INFO:tasks.workunit.client.0.smithi072.stdout:5/785: creat d0/d3/d7/f108 x:0 0 0 2024-04-15T21:02:56.656 INFO:tasks.workunit.client.1.smithi149.stdout:7/907: dread d3/d16/d32/d90/fb0 [0,4194304] 0 2024-04-15T21:02:56.656 INFO:tasks.workunit.client.0.smithi072.stdout:5/786: stat d0/d3/d7/d12/d31/def 0 2024-04-15T21:02:56.658 INFO:tasks.workunit.client.1.smithi149.stdout:2/973: read d4/d7/d46/f69 [1832544,40951] 0 2024-04-15T21:02:56.658 INFO:tasks.workunit.client.1.smithi149.stdout:6/935: creat da/d18/d10/d16/d97/dbf/f131 x:0 0 0 2024-04-15T21:02:56.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/869: dwrite d1/db/d16/f24 [8388608,4194304] 0 2024-04-15T21:02:56.661 INFO:tasks.workunit.client.0.smithi072.stdout:5/787: creat d0/d3/d7/d12/d31/d55/d93/f109 x:0 0 0 2024-04-15T21:02:56.664 INFO:tasks.workunit.client.1.smithi149.stdout:5/918: truncate d0/d6/d9f/fba 477552 0 2024-04-15T21:02:56.666 INFO:tasks.workunit.client.0.smithi072.stdout:5/788: truncate d0/d3/d7/f3c 52621 0 2024-04-15T21:02:56.670 INFO:tasks.workunit.client.0.smithi072.stdout:5/789: mknod d0/c10a 0 2024-04-15T21:02:56.671 INFO:tasks.workunit.client.1.smithi149.stdout:5/919: chown d0/d6/d82/da1/d12/d16/da9/d9b 768 1 2024-04-15T21:02:56.671 INFO:tasks.workunit.client.1.smithi149.stdout:9/893: dread d23/d46/f49 [0,4194304] 0 2024-04-15T21:02:56.672 INFO:tasks.workunit.client.1.smithi149.stdout:1/870: mkdir d1/d17/d52/d6c/dfd 0 2024-04-15T21:02:56.673 INFO:tasks.workunit.client.1.smithi149.stdout:3/925: write d1/db/d24/d39/dc0/fdd [753080,86913] 0 2024-04-15T21:02:56.674 INFO:tasks.workunit.client.0.smithi072.stdout:5/790: symlink d0/d3/d7/d94/de1/l10b 0 2024-04-15T21:02:56.678 INFO:tasks.workunit.client.1.smithi149.stdout:9/894: mkdir d23/d46/d12b 0 2024-04-15T21:02:56.683 INFO:tasks.workunit.client.0.smithi072.stdout:5/791: fdatasync d0/d3/d7/d1f/f40 0 2024-04-15T21:02:56.684 INFO:tasks.workunit.client.1.smithi149.stdout:1/871: fdatasync d1/db/dc/d38/d39/d43/f67 0 2024-04-15T21:02:56.687 INFO:tasks.workunit.client.1.smithi149.stdout:7/908: dread d3/d16/d20/d36/f2f [0,4194304] 0 2024-04-15T21:02:56.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/895: unlink d23/d3c/d87/d9a/dad/fce 0 2024-04-15T21:02:56.692 INFO:tasks.workunit.client.0.smithi072.stdout:5/792: dread d0/d3/d7/d12/f1a [4194304,4194304] 0 2024-04-15T21:02:56.692 INFO:tasks.workunit.client.1.smithi149.stdout:6/936: rename da/d11/d90/ld6 to da/d11/l132 0 2024-04-15T21:02:56.693 INFO:tasks.workunit.client.1.smithi149.stdout:2/974: link d4/d7/d46/de4/d21/d3b/d10a/f110 d4/d7/d93/dc3/f163 0 2024-04-15T21:02:56.693 INFO:tasks.workunit.client.1.smithi149.stdout:6/937: stat da/d18/d7d/cf4 0 2024-04-15T21:02:56.694 INFO:tasks.workunit.client.1.smithi149.stdout:5/920: dwrite d0/f5 [4194304,4194304] 0 2024-04-15T21:02:56.698 INFO:tasks.workunit.client.1.smithi149.stdout:3/926: write d1/db/d24/d4d/d63/d65/f67 [1484617,50099] 0 2024-04-15T21:02:56.699 INFO:tasks.workunit.client.1.smithi149.stdout:3/927: chown d1/db/d24/f8b 35949442 1 2024-04-15T21:02:56.700 INFO:tasks.workunit.client.0.smithi072.stdout:5/793: symlink d0/d3/d33/d85/l10c 0 2024-04-15T21:02:56.702 INFO:tasks.workunit.client.1.smithi149.stdout:5/921: rmdir d0/d6/d82/da1/d12/d16 39 2024-04-15T21:02:56.703 INFO:tasks.workunit.client.1.smithi149.stdout:2/975: symlink d4/d7/d46/de4/d21/d55/l164 0 2024-04-15T21:02:56.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/794: mkdir d0/d3/d7/d94/d86/d10d 0 2024-04-15T21:02:56.705 INFO:tasks.workunit.client.1.smithi149.stdout:7/909: fsync d3/f10 0 2024-04-15T21:02:56.712 INFO:tasks.workunit.client.1.smithi149.stdout:5/922: mkdir d0/d9/d3f/dc7/d125 0 2024-04-15T21:02:56.714 INFO:tasks.workunit.client.1.smithi149.stdout:2/976: creat d4/d7/d46/de4/d21/d3b/d10a/d15c/dee/f165 x:0 0 0 2024-04-15T21:02:56.715 INFO:tasks.workunit.client.0.smithi072.stdout:5/795: write d0/d3/d33/d60/d81/fed [704134,119795] 0 2024-04-15T21:02:56.721 INFO:tasks.workunit.client.0.smithi072.stdout:5/796: write d0/d3/d7/d12/d1d/f74 [547919,77787] 0 2024-04-15T21:02:56.721 INFO:tasks.workunit.client.1.smithi149.stdout:7/910: write d3/d129/fed [935178,40823] 0 2024-04-15T21:02:56.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/923: dwrite d0/d6/d82/da1/d12/ff7 [0,4194304] 0 2024-04-15T21:02:56.724 INFO:tasks.workunit.client.1.smithi149.stdout:9/896: getdents d23/d3c/d7a 0 2024-04-15T21:02:56.724 INFO:tasks.workunit.client.1.smithi149.stdout:1/872: dread d1/db/d16/d35/f96 [0,4194304] 0 2024-04-15T21:02:56.725 INFO:tasks.workunit.client.1.smithi149.stdout:6/938: getdents da/d18/d33 0 2024-04-15T21:02:56.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/928: dwrite d1/db/d24/d2b/fd5 [0,4194304] 0 2024-04-15T21:02:56.734 INFO:tasks.workunit.client.1.smithi149.stdout:7/911: creat d3/d129/f144 x:0 0 0 2024-04-15T21:02:56.735 INFO:tasks.workunit.client.1.smithi149.stdout:5/924: mkdir d0/d9/d6c/db4/dd1/d126 0 2024-04-15T21:02:56.735 INFO:tasks.workunit.client.1.smithi149.stdout:7/912: dread - d3/d16/d6e/f12e zero size 2024-04-15T21:02:56.736 INFO:tasks.workunit.client.1.smithi149.stdout:6/939: mkdir da/d11/d90/d133 0 2024-04-15T21:02:56.736 INFO:tasks.workunit.client.0.smithi072.stdout:5/797: dread d0/d3/d7/d12/f51 [0,4194304] 0 2024-04-15T21:02:56.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/873: truncate d1/d17/d52/f84 4665411 0 2024-04-15T21:02:56.737 INFO:tasks.workunit.client.0.smithi072.stdout:5/798: read - d0/d3/d7/f108 zero size 2024-04-15T21:02:56.737 INFO:tasks.workunit.client.1.smithi149.stdout:7/913: chown d3/d16/d20/d60/f7e 5399601 1 2024-04-15T21:02:56.738 INFO:tasks.workunit.client.1.smithi149.stdout:9/897: write d23/d71/fea [5131861,73840] 0 2024-04-15T21:02:56.741 INFO:tasks.workunit.client.1.smithi149.stdout:3/929: mkdir d1/db/d24/d39/d79/d97/daf/d106/d125 0 2024-04-15T21:02:56.743 INFO:tasks.workunit.client.1.smithi149.stdout:6/940: mknod da/c134 0 2024-04-15T21:02:56.746 INFO:tasks.workunit.client.1.smithi149.stdout:6/941: write da/d18/d10/d66/f57 [4660043,96207] 0 2024-04-15T21:02:56.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/977: dread d4/d7/d10/d36/f47 [0,4194304] 0 2024-04-15T21:02:56.746 INFO:tasks.workunit.client.0.smithi072.stdout:5/799: getdents d0/d3/d7/d12/d31/d62/db6 0 2024-04-15T21:02:56.747 INFO:tasks.workunit.client.0.smithi072.stdout:5/800: chown d0/d3/d7/d94/le3 12367 1 2024-04-15T21:02:56.749 INFO:tasks.workunit.client.1.smithi149.stdout:7/914: mkdir d3/d145 0 2024-04-15T21:02:56.749 INFO:tasks.workunit.client.1.smithi149.stdout:6/942: dread - da/d18/d10/d16/d97/dbf/d55/da0/fff zero size 2024-04-15T21:02:56.751 INFO:tasks.workunit.client.1.smithi149.stdout:9/898: dread d23/d46/dcf/deb/d7f/d86/fb7 [0,4194304] 0 2024-04-15T21:02:56.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/930: creat d1/db/d102/f126 x:0 0 0 2024-04-15T21:02:56.753 INFO:tasks.workunit.client.1.smithi149.stdout:9/899: chown d23/d46/dcf/deb/d7f/d83/ff6 711725 1 2024-04-15T21:02:56.754 INFO:tasks.workunit.client.1.smithi149.stdout:9/900: read f9 [8190348,33607] 0 2024-04-15T21:02:56.759 INFO:tasks.workunit.client.0.smithi072.stdout:5/801: dwrite d0/f59 [0,4194304] 0 2024-04-15T21:02:56.763 INFO:tasks.workunit.client.1.smithi149.stdout:2/978: read d4/d7/d46/f54 [4054253,3105] 0 2024-04-15T21:02:56.766 INFO:tasks.workunit.client.1.smithi149.stdout:6/943: mknod da/d11/dbe/dc1/c135 0 2024-04-15T21:02:56.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/874: truncate d1/db/d16/f24 4918429 0 2024-04-15T21:02:56.771 INFO:tasks.workunit.client.0.smithi072.stdout:5/802: write d0/d3/f4 [4320665,103178] 0 2024-04-15T21:02:56.771 INFO:tasks.workunit.client.1.smithi149.stdout:5/925: dread d0/d6/d82/da1/d12/d16/f58 [0,4194304] 0 2024-04-15T21:02:56.773 INFO:tasks.workunit.client.1.smithi149.stdout:2/979: creat d4/d7/d29/dff/f166 x:0 0 0 2024-04-15T21:02:56.776 INFO:tasks.workunit.client.1.smithi149.stdout:9/901: symlink d23/d46/d124/l12c 0 2024-04-15T21:02:56.777 INFO:tasks.workunit.client.1.smithi149.stdout:9/902: chown d23/d46/dcf/deb/fb1 85 1 2024-04-15T21:02:56.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/915: mkdir d3/d16/d20/d36/d146 0 2024-04-15T21:02:56.779 INFO:tasks.workunit.client.0.smithi072.stdout:5/803: link d0/d3/d6/cd3 d0/d3/d33/d60/c10e 0 2024-04-15T21:02:56.780 INFO:tasks.workunit.client.0.smithi072.stdout:5/804: dread d0/d3/d7/d12/fda [0,4194304] 0 2024-04-15T21:02:56.780 INFO:tasks.workunit.client.0.smithi072.stdout:5/805: readlink d0/d3/d7/d94/de1/l10b 0 2024-04-15T21:02:56.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/875: unlink d1/db/dc/d38/d39/d43/daa/c9f 0 2024-04-15T21:02:56.783 INFO:tasks.workunit.client.0.smithi072.stdout:7/715: sync 2024-04-15T21:02:56.784 INFO:tasks.workunit.client.0.smithi072.stdout:5/806: creat d0/d3/d7/d12/d31/d62/db6/f10f x:0 0 0 2024-04-15T21:02:56.792 INFO:tasks.workunit.client.1.smithi149.stdout:9/903: rename d23/d2b/c34 to d23/d2b/d37/d50/c12d 0 2024-04-15T21:02:56.792 INFO:tasks.workunit.client.1.smithi149.stdout:3/931: truncate d1/db/d24/d2b/f1b 2763582 0 2024-04-15T21:02:56.793 INFO:tasks.workunit.client.1.smithi149.stdout:2/980: fsync d4/d7/d46/de4/d21/d5e/fb9 0 2024-04-15T21:02:56.794 INFO:tasks.workunit.client.0.smithi072.stdout:7/716: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f2a [4194304,4194304] 0 2024-04-15T21:02:56.795 INFO:tasks.workunit.client.1.smithi149.stdout:1/876: fsync d1/d17/d52/f40 0 2024-04-15T21:02:56.796 INFO:tasks.workunit.client.1.smithi149.stdout:1/877: fsync d1/d17/d52/fd8 0 2024-04-15T21:02:56.797 INFO:tasks.workunit.client.1.smithi149.stdout:1/878: dread - d1/d17/d52/fe3 zero size 2024-04-15T21:02:56.798 INFO:tasks.workunit.client.1.smithi149.stdout:6/944: write da/f75 [962166,68081] 0 2024-04-15T21:02:56.808 INFO:tasks.workunit.client.0.smithi072.stdout:7/717: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f60 [0,4194304] 0 2024-04-15T21:02:56.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/926: dwrite d0/f123 [0,4194304] 0 2024-04-15T21:02:56.824 INFO:tasks.workunit.client.0.smithi072.stdout:7/718: creat d2/d7/d25/d2d/d46/d5a/d5f/fde x:0 0 0 2024-04-15T21:02:56.847 INFO:tasks.workunit.client.1.smithi149.stdout:7/916: mknod d3/d16/d20/d114/d11b/c147 0 2024-04-15T21:02:56.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/904: truncate d23/d71/fdf 493611 0 2024-04-15T21:02:56.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/981: symlink d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/d11f/l167 0 2024-04-15T21:02:56.854 INFO:tasks.workunit.client.1.smithi149.stdout:9/905: dread d23/d46/dcf/deb/d7f/d83/ff6 [0,4194304] 0 2024-04-15T21:02:56.854 INFO:tasks.workunit.client.1.smithi149.stdout:9/906: readlink d23/d2b/l5e 0 2024-04-15T21:02:56.860 INFO:tasks.workunit.client.1.smithi149.stdout:3/932: creat d1/f127 x:0 0 0 2024-04-15T21:02:56.867 INFO:tasks.workunit.client.1.smithi149.stdout:6/945: rename da/d18/d10/d16/d97 to da/d32/d136 0 2024-04-15T21:02:56.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/946: dread - da/d18/d10/d3f/ded/f11a zero size 2024-04-15T21:02:56.871 INFO:tasks.workunit.client.1.smithi149.stdout:3/933: creat d1/db/d40/d56/d84/f128 x:0 0 0 2024-04-15T21:02:56.873 INFO:tasks.workunit.client.1.smithi149.stdout:2/982: dread d4/d7/da/fe [0,4194304] 0 2024-04-15T21:02:56.873 INFO:tasks.workunit.client.1.smithi149.stdout:9/907: rename d23/d2b/d70/d75/cfb to d23/d2b/d37/d50/d103/c12e 0 2024-04-15T21:02:56.874 INFO:tasks.workunit.client.1.smithi149.stdout:1/879: link d1/db/dc/d11/c59 d1/d17/d36/d6f/d70/cfe 0 2024-04-15T21:02:56.875 INFO:tasks.workunit.client.1.smithi149.stdout:2/983: write d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/d11f/f161 [1038075,87048] 0 2024-04-15T21:02:56.876 INFO:tasks.workunit.client.1.smithi149.stdout:6/947: unlink da/d18/d10/d66/f57 0 2024-04-15T21:02:56.878 INFO:tasks.workunit.client.1.smithi149.stdout:3/934: rename d1/db/d24/d2b/l12 to d1/db/d24/d2b/l129 0 2024-04-15T21:02:56.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/935: read d1/db/d24/d39/dc0/fdd [585855,3136] 0 2024-04-15T21:02:56.880 INFO:tasks.workunit.client.1.smithi149.stdout:9/908: rmdir d23/d46 39 2024-04-15T21:02:56.880 INFO:tasks.workunit.client.1.smithi149.stdout:3/936: chown d1/db/d24/f8b 2 1 2024-04-15T21:02:56.883 INFO:tasks.workunit.client.0.smithi072.stdout:7/719: unlink d2/d7/d25/d2d/d46/lb3 0 2024-04-15T21:02:56.885 INFO:tasks.workunit.client.1.smithi149.stdout:1/880: creat d1/d17/d36/d6f/d70/fff x:0 0 0 2024-04-15T21:02:56.887 INFO:tasks.workunit.client.1.smithi149.stdout:2/984: chown d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/ce5 65 1 2024-04-15T21:02:56.892 INFO:tasks.workunit.client.0.smithi072.stdout:7/720: link d2/d7/d25/d2d/d47/f5c d2/d7/d25/d2d/d46/d5a/d5f/dbc/fdf 0 2024-04-15T21:02:56.894 INFO:tasks.workunit.client.1.smithi149.stdout:2/985: creat d4/dc7/f168 x:0 0 0 2024-04-15T21:02:56.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/909: unlink d23/d46/d124/l12c 0 2024-04-15T21:02:56.901 INFO:tasks.workunit.client.1.smithi149.stdout:9/910: fsync d23/d3c/db5/ffa 0 2024-04-15T21:02:56.903 INFO:tasks.workunit.client.1.smithi149.stdout:9/911: read d23/d2b/d44/f63 [1051382,79132] 0 2024-04-15T21:02:56.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/986: rmdir d4/d7/d46/de4/d21/d3b 39 2024-04-15T21:02:56.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/987: rmdir d4/d7/d29/dff/d162 0 2024-04-15T21:02:56.919 INFO:tasks.workunit.client.0.smithi072.stdout:6/703: sync 2024-04-15T21:02:56.920 INFO:tasks.workunit.client.1.smithi149.stdout:5/927: dwrite d0/d6/d82/da1/d12/d16/da9/d1b/d61/fe9 [0,4194304] 0 2024-04-15T21:02:56.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/917: dwrite d3/d16/d20/d9c/f8f [0,4194304] 0 2024-04-15T21:02:56.927 INFO:tasks.workunit.client.1.smithi149.stdout:9/912: dread d23/d71/fef [0,4194304] 0 2024-04-15T21:02:56.927 INFO:tasks.workunit.client.1.smithi149.stdout:6/948: write da/d32/d136/dbf/d55/fd2 [744134,108678] 0 2024-04-15T21:02:56.929 INFO:tasks.workunit.client.1.smithi149.stdout:9/913: chown d23/d3c/d7a/da5/l10c 31399 1 2024-04-15T21:02:56.930 INFO:tasks.workunit.client.1.smithi149.stdout:6/949: write da/d32/d136/dbf/d55/fa7 [1348170,116031] 0 2024-04-15T21:02:56.931 INFO:tasks.workunit.client.0.smithi072.stdout:6/704: dwrite d2/d10/f3c [0,4194304] 0 2024-04-15T21:02:56.932 INFO:tasks.workunit.client.0.smithi072.stdout:6/705: stat d2/d40/d56/d6a/f88 0 2024-04-15T21:02:56.933 INFO:tasks.workunit.client.0.smithi072.stdout:6/706: dread - d2/d40/dcb/d49/f65 zero size 2024-04-15T21:02:56.934 INFO:tasks.workunit.client.1.smithi149.stdout:9/914: truncate d23/d2b/d70/d75/ddb/f115 288747 0 2024-04-15T21:02:56.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/928: symlink d0/d9/d115/dfb/d117/l127 0 2024-04-15T21:02:56.949 INFO:tasks.workunit.client.0.smithi072.stdout:6/707: rename d2/d40/d66/d7f/ca7 to d2/cd7 0 2024-04-15T21:02:56.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/721: dwrite d2/d7/f4e [0,4194304] 0 2024-04-15T21:02:56.954 INFO:tasks.workunit.client.1.smithi149.stdout:9/915: dwrite d23/fd7 [0,4194304] 0 2024-04-15T21:02:56.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/929: creat d0/d6/d82/f128 x:0 0 0 2024-04-15T21:02:56.957 INFO:tasks.workunit.client.1.smithi149.stdout:9/916: fdatasync d23/d2b/f4a 0 2024-04-15T21:02:56.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/917: write d23/d2b/d37/d6d/de3/f104 [225160,65793] 0 2024-04-15T21:02:56.958 INFO:tasks.workunit.client.0.smithi072.stdout:6/708: fdatasync d2/d10/d11/d1f/f30 0 2024-04-15T21:02:56.959 INFO:tasks.workunit.client.0.smithi072.stdout:7/722: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/le0 0 2024-04-15T21:02:56.963 INFO:tasks.workunit.client.1.smithi149.stdout:1/881: dwrite d1/db/dc/d38/d39/d43/f8f [4194304,4194304] 0 2024-04-15T21:02:56.964 INFO:tasks.workunit.client.1.smithi149.stdout:3/937: write d1/db/d24/d2b/f2e [2140520,102659] 0 2024-04-15T21:02:56.965 INFO:tasks.workunit.client.0.smithi072.stdout:7/723: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 [0,4194304] 0 2024-04-15T21:02:56.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/882: write d1/db/d14/f9d [861806,62102] 0 2024-04-15T21:02:56.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/938: fdatasync d1/db/d24/d4d/d63/d65/fc5 0 2024-04-15T21:02:56.973 INFO:tasks.workunit.client.1.smithi149.stdout:2/988: write d4/d7/d46/de4/d21/d5e/dbe/da7/d6c/f8f [2679333,8431] 0 2024-04-15T21:02:56.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/883: chown d1/db/dc/d11/d3e/c51 0 1 2024-04-15T21:02:56.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/939: dwrite d1/db/d24/d39/d79/f119 [0,4194304] 0 2024-04-15T21:02:56.997 INFO:tasks.workunit.client.1.smithi149.stdout:9/918: link d23/d2b/d44/d7e/f9b d23/d2b/d70/d75/ddb/f12f 0 2024-04-15T21:02:57.000 INFO:tasks.workunit.client.0.smithi072.stdout:6/709: truncate d2/d1a/f55 39160 0 2024-04-15T21:02:57.001 INFO:tasks.workunit.client.0.smithi072.stdout:3/729: sync 2024-04-15T21:02:57.001 INFO:tasks.workunit.client.0.smithi072.stdout:8/769: sync 2024-04-15T21:02:57.003 INFO:tasks.workunit.client.1.smithi149.stdout:3/940: truncate d1/db/fd4 645349 0 2024-04-15T21:02:57.004 INFO:tasks.workunit.client.0.smithi072.stdout:6/710: creat d2/d10/d11/d15/fd8 x:0 0 0 2024-04-15T21:02:57.006 INFO:tasks.workunit.client.1.smithi149.stdout:1/884: creat d1/db/d14/f100 x:0 0 0 2024-04-15T21:02:57.007 INFO:tasks.workunit.client.1.smithi149.stdout:6/950: dread da/d18/d10/d16/f9a [0,4194304] 0 2024-04-15T21:02:57.009 INFO:tasks.workunit.client.1.smithi149.stdout:3/941: fsync d1/db/d24/f4b 0 2024-04-15T21:02:57.011 INFO:tasks.workunit.client.0.smithi072.stdout:7/724: write d2/d7/d25/d2d/d46/d5a/d5f/fb2 [1176090,15132] 0 2024-04-15T21:02:57.011 INFO:tasks.workunit.client.1.smithi149.stdout:7/918: dread d3/d16/d20/d114/f6d [4194304,4194304] 0 2024-04-15T21:02:57.011 INFO:tasks.workunit.client.1.smithi149.stdout:1/885: mkdir d1/db/d16/d86/de1/d101 0 2024-04-15T21:02:57.012 INFO:tasks.workunit.client.0.smithi072.stdout:7/725: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 [2657469,6562] 0 2024-04-15T21:02:57.014 INFO:tasks.workunit.client.1.smithi149.stdout:7/919: chown d3/d16/d6e/f131 14 1 2024-04-15T21:02:57.015 INFO:tasks.workunit.client.1.smithi149.stdout:6/951: rename da/d18/d7d to da/d11/dbe/dc1/d106/d137 0 2024-04-15T21:02:57.017 INFO:tasks.workunit.client.0.smithi072.stdout:7/726: dwrite d2/d7/d25/d2d/d46/d5a/d5f/fb2 [0,4194304] 0 2024-04-15T21:02:57.018 INFO:tasks.workunit.client.1.smithi149.stdout:2/989: dwrite d4/d7/d46/de4/d21/d2c/d32/fef [0,4194304] 0 2024-04-15T21:02:57.025 INFO:tasks.workunit.client.1.smithi149.stdout:6/952: mkdir da/d11/dbe/d138 0 2024-04-15T21:02:57.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/919: getdents d23/d2b/d37 0 2024-04-15T21:02:57.028 INFO:tasks.workunit.client.1.smithi149.stdout:9/920: read d23/d2b/d37/d50/db3/fd9 [27056,29763] 0 2024-04-15T21:02:57.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/953: dwrite da/d11/dbe/dc1/d106/d137/fe9 [0,4194304] 0 2024-04-15T21:02:57.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/990: read d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/fdc [2409163,83411] 0 2024-04-15T21:02:57.036 INFO:tasks.workunit.client.1.smithi149.stdout:6/954: readlink da/d18/d10/d3f/lb9 0 2024-04-15T21:02:57.046 INFO:tasks.workunit.client.1.smithi149.stdout:6/955: creat da/d60/f139 x:0 0 0 2024-04-15T21:02:57.052 INFO:tasks.workunit.client.1.smithi149.stdout:1/886: dwrite d1/db/dc/d38/d39/d43/f67 [0,4194304] 0 2024-04-15T21:02:57.052 INFO:tasks.workunit.client.1.smithi149.stdout:1/887: dread - d1/fc2 zero size 2024-04-15T21:02:57.053 INFO:tasks.workunit.client.1.smithi149.stdout:1/888: dread - d1/db/dc/d11/d3e/fed zero size 2024-04-15T21:02:57.054 INFO:tasks.workunit.client.1.smithi149.stdout:7/920: getdents d3/d96 0 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:2/782: sync 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:4/757: sync 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:5/807: sync 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/758: sync 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:9/766: sync 2024-04-15T21:02:57.055 INFO:tasks.workunit.client.0.smithi072.stdout:1/721: sync 2024-04-15T21:02:57.056 INFO:tasks.workunit.client.1.smithi149.stdout:1/889: chown d1/db/dc/d38/d39/d43/f8f 787321 1 2024-04-15T21:02:57.057 INFO:tasks.workunit.client.0.smithi072.stdout:4/758: fsync d7/d15/f33 0 2024-04-15T21:02:57.057 INFO:tasks.workunit.client.0.smithi072.stdout:2/783: fdatasync d2/d8/f72 0 2024-04-15T21:02:57.057 INFO:tasks.workunit.client.0.smithi072.stdout:4/759: stat d7/f4f 0 2024-04-15T21:02:57.058 INFO:tasks.workunit.client.1.smithi149.stdout:6/956: creat da/d18/d10/d3f/ded/f13a x:0 0 0 2024-04-15T21:02:57.059 INFO:tasks.workunit.client.1.smithi149.stdout:6/957: dread - da/d11/d90/f114 zero size 2024-04-15T21:02:57.060 INFO:tasks.workunit.client.1.smithi149.stdout:6/958: chown da/d11/d90/d133 2978951 1 2024-04-15T21:02:57.060 INFO:tasks.workunit.client.1.smithi149.stdout:9/921: creat d23/d2b/d70/d75/f130 x:0 0 0 2024-04-15T21:02:57.061 INFO:tasks.workunit.client.1.smithi149.stdout:6/959: chown da/d18/d10/d3f/ded/f13a 703181 1 2024-04-15T21:02:57.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/960: write da/d32/d136/dbf/d55/fa7 [1469425,48195] 0 2024-04-15T21:02:57.063 INFO:tasks.workunit.client.0.smithi072.stdout:9/767: dwrite d4/d1f/d31/d4d/ff0 [0,4194304] 0 2024-04-15T21:02:57.063 INFO:tasks.workunit.client.1.smithi149.stdout:6/961: fsync da/d11/d90/f102 0 2024-04-15T21:02:57.065 INFO:tasks.workunit.client.1.smithi149.stdout:1/890: rename d1/db/dc/d11/fad to d1/db/dc/d38/d39/d43/daa/d8a/dc3/f102 0 2024-04-15T21:02:57.075 INFO:tasks.workunit.client.1.smithi149.stdout:6/962: mknod da/d18/d33/c13b 0 2024-04-15T21:02:57.076 INFO:tasks.workunit.client.1.smithi149.stdout:6/963: write da/d32/d136/dbf/d55/fa7 [341827,130762] 0 2024-04-15T21:02:57.077 INFO:tasks.workunit.client.0.smithi072.stdout:8/770: mknod d3/ddb/cf4 0 2024-04-15T21:02:57.081 INFO:tasks.workunit.client.1.smithi149.stdout:1/891: creat d1/db/dc/d11/d3f/d45/f103 x:0 0 0 2024-04-15T21:02:57.082 INFO:tasks.workunit.client.1.smithi149.stdout:2/991: write d4/d7/d46/de4/d21/d55/f59 [3486708,127529] 0 2024-04-15T21:02:57.083 INFO:tasks.workunit.client.1.smithi149.stdout:1/892: chown d1/db/d14/f100 690519 1 2024-04-15T21:02:57.086 INFO:tasks.workunit.client.1.smithi149.stdout:1/893: write d1/db/dc/d38/d39/d43/f1f [3317703,99605] 0 2024-04-15T21:02:57.088 INFO:tasks.workunit.client.1.smithi149.stdout:1/894: dread - d1/d17/d52/fd8 zero size 2024-04-15T21:02:57.088 INFO:tasks.workunit.client.0.smithi072.stdout:7/727: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3d [4716946,116274] 0 2024-04-15T21:02:57.090 INFO:tasks.workunit.client.0.smithi072.stdout:7/728: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab [769668,65449] 0 2024-04-15T21:02:57.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/992: dwrite d4/d7/da/f4e [4194304,4194304] 0 2024-04-15T21:02:57.094 INFO:tasks.workunit.client.1.smithi149.stdout:6/964: dread da/d18/d33/fa8 [0,4194304] 0 2024-04-15T21:02:57.096 INFO:tasks.workunit.client.1.smithi149.stdout:1/895: stat d1/db/f33 0 2024-04-15T21:02:57.098 INFO:tasks.workunit.client.1.smithi149.stdout:2/993: dread - d4/d7/d46/de4/d21/d2c/d32/f12b zero size 2024-04-15T21:02:57.100 INFO:tasks.workunit.client.0.smithi072.stdout:0/759: mkdir d0/d6/d55/d100 0 2024-04-15T21:02:57.103 INFO:tasks.workunit.client.0.smithi072.stdout:1/722: creat d5/db/d27/d5c/dbd/fe7 x:0 0 0 2024-04-15T21:02:57.103 INFO:tasks.workunit.client.1.smithi149.stdout:9/922: dwrite f16 [0,4194304] 0 2024-04-15T21:02:57.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/784: mknod d2/da8/cf6 0 2024-04-15T21:02:57.107 INFO:tasks.workunit.client.1.smithi149.stdout:6/965: symlink da/d11/dbe/dc1/d125/l13c 0 2024-04-15T21:02:57.115 INFO:tasks.workunit.client.1.smithi149.stdout:9/923: dwrite d23/d71/fea [0,4194304] 0 2024-04-15T21:02:57.119 INFO:tasks.workunit.client.0.smithi072.stdout:3/730: dwrite d1/d15/d32/f24 [0,4194304] 0 2024-04-15T21:02:57.125 INFO:tasks.workunit.client.1.smithi149.stdout:1/896: creat d1/d17/f104 x:0 0 0 2024-04-15T21:02:57.133 INFO:tasks.workunit.client.0.smithi072.stdout:5/808: symlink d0/d3/d7/d12/l110 0 2024-04-15T21:02:57.133 INFO:tasks.workunit.client.1.smithi149.stdout:1/897: fsync d1/f79 0 2024-04-15T21:02:57.135 INFO:tasks.workunit.client.0.smithi072.stdout:1/723: mkdir d5/db/daa/de8 0 2024-04-15T21:02:57.138 INFO:tasks.workunit.client.0.smithi072.stdout:2/785: rename d2/db3/ce5 to d2/d38/d91/cf7 0 2024-04-15T21:02:57.139 INFO:tasks.workunit.client.1.smithi149.stdout:2/994: dwrite d4/d7/d46/de4/db6/f109 [0,4194304] 0 2024-04-15T21:02:57.140 INFO:tasks.workunit.client.0.smithi072.stdout:9/768: mkdir d4/d29/d4c/d74/d84/df2/df4 0 2024-04-15T21:02:57.142 INFO:tasks.workunit.client.1.smithi149.stdout:1/898: creat d1/d17/d36/d6f/f105 x:0 0 0 2024-04-15T21:02:57.143 INFO:tasks.workunit.client.0.smithi072.stdout:8/771: creat d3/d7e/dc6/ff5 x:0 0 0 2024-04-15T21:02:57.143 INFO:tasks.workunit.client.1.smithi149.stdout:1/899: write d1/db/dc/d38/d39/fec [294595,8451] 0 2024-04-15T21:02:57.144 INFO:tasks.workunit.client.0.smithi072.stdout:8/772: chown d3/d4/d76/fe2 86 1 2024-04-15T21:02:57.144 INFO:tasks.workunit.client.1.smithi149.stdout:1/900: stat d1/d17/d52/d92 0 2024-04-15T21:02:57.146 INFO:tasks.workunit.client.1.smithi149.stdout:1/901: truncate d1/d17/d5e/feb 601826 0 2024-04-15T21:02:57.146 INFO:tasks.workunit.client.0.smithi072.stdout:7/729: write d2/d7/d25/d2d/d46/d5a/d5f/f3c [1684995,109443] 0 2024-04-15T21:02:57.147 INFO:tasks.workunit.client.1.smithi149.stdout:6/966: getdents da/d11 0 2024-04-15T21:02:57.149 INFO:tasks.workunit.client.1.smithi149.stdout:2/995: fdatasync d4/d7/d46/de4/d21/d3b/f113 0 2024-04-15T21:02:57.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/924: truncate f16 3759267 0 2024-04-15T21:02:57.153 INFO:tasks.workunit.client.1.smithi149.stdout:1/902: rmdir d1/db/dc/d38/d39/d43/daa 39 2024-04-15T21:02:57.155 INFO:tasks.workunit.client.0.smithi072.stdout:0/760: truncate d0/d45/d35/d3a/f47 1033200 0 2024-04-15T21:02:57.156 INFO:tasks.workunit.client.1.smithi149.stdout:6/967: truncate da/d32/d136/dbf/f8d 169398 0 2024-04-15T21:02:57.157 INFO:tasks.workunit.client.0.smithi072.stdout:0/761: read d0/d45/d7a/f15 [36287,122051] 0 2024-04-15T21:02:57.157 INFO:tasks.workunit.client.1.smithi149.stdout:6/968: chown da/d18/d10/d66/leb 3256742 1 2024-04-15T21:02:57.157 INFO:tasks.workunit.client.0.smithi072.stdout:1/724: truncate d5/d31/d51/d82/fae 3668229 0 2024-04-15T21:02:57.161 INFO:tasks.workunit.client.0.smithi072.stdout:9/769: unlink d4/d1f/d9e/la6 0 2024-04-15T21:02:57.162 INFO:tasks.workunit.client.0.smithi072.stdout:3/731: dwrite d1/d3f/d4f/fb5 [0,4194304] 0 2024-04-15T21:02:57.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/903: stat d1/d17/d52/f2a 0 2024-04-15T21:02:57.164 INFO:tasks.workunit.client.0.smithi072.stdout:8/773: symlink d3/de/d1b/d41/dae/dc0/de9/lf6 0 2024-04-15T21:02:57.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/786: write d2/d66/f68 [2679093,29964] 0 2024-04-15T21:02:57.170 INFO:tasks.workunit.client.0.smithi072.stdout:6/711: getdents d2/d40/d66 0 2024-04-15T21:02:57.171 INFO:tasks.workunit.client.0.smithi072.stdout:2/787: fdatasync d2/d8/d8e/fe0 0 2024-04-15T21:02:57.171 INFO:tasks.workunit.client.0.smithi072.stdout:9/770: dwrite d4/d1f/d31/d4d/dbf/dd2/fd7 [0,4194304] 0 2024-04-15T21:02:57.172 INFO:tasks.workunit.client.0.smithi072.stdout:2/788: fdatasync d2/d64/fac 0 2024-04-15T21:02:57.173 INFO:tasks.workunit.client.0.smithi072.stdout:8/774: read d3/de/d1b/d44/f78 [744155,127258] 0 2024-04-15T21:02:57.173 INFO:tasks.workunit.client.0.smithi072.stdout:8/775: chown d3/d4/d4d 11160 1 2024-04-15T21:02:57.175 INFO:tasks.workunit.client.1.smithi149.stdout:1/904: mknod d1/d17/d36/d6f/df2/c106 0 2024-04-15T21:02:57.178 INFO:tasks.workunit.client.1.smithi149.stdout:2/996: getdents d4/d7/d46/de4/d21/d55/dfe/d106 0 2024-04-15T21:02:57.182 INFO:tasks.workunit.client.0.smithi072.stdout:7/730: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f19 [1516126,27013] 0 2024-04-15T21:02:57.185 INFO:tasks.workunit.client.1.smithi149.stdout:9/925: link d23/d3c/d7a/da5/ld2 d23/d46/dcf/deb/d7f/l131 0 2024-04-15T21:02:57.187 INFO:tasks.workunit.client.1.smithi149.stdout:1/905: rename d1/db/dc/fa5 to d1/df7/f107 0 2024-04-15T21:02:57.194 INFO:tasks.workunit.client.1.smithi149.stdout:9/926: mknod d23/d2b/d70/c132 0 2024-04-15T21:02:57.198 INFO:tasks.workunit.client.1.smithi149.stdout:9/927: creat d23/d2b/d37/d50/df1/f133 x:0 0 0 2024-04-15T21:02:57.198 INFO:tasks.workunit.client.0.smithi072.stdout:6/712: write d2/d40/dcb/d49/f91 [147779,74170] 0 2024-04-15T21:02:57.199 INFO:tasks.workunit.client.0.smithi072.stdout:0/762: creat d0/d45/d7a/d70/dce/f101 x:0 0 0 2024-04-15T21:02:57.199 INFO:tasks.workunit.client.1.smithi149.stdout:9/928: write d23/d46/dcf/deb/d7f/d86/f120 [313017,69887] 0 2024-04-15T21:02:57.200 INFO:tasks.workunit.client.1.smithi149.stdout:1/906: creat d1/d17/f108 x:0 0 0 2024-04-15T21:02:57.201 INFO:tasks.workunit.client.0.smithi072.stdout:8/776: creat d3/d4/d4c/ff7 x:0 0 0 2024-04-15T21:02:57.205 INFO:tasks.workunit.client.0.smithi072.stdout:9/771: dwrite d4/d29/d4c/d74/d84/f8d [0,4194304] 0 2024-04-15T21:02:57.206 INFO:tasks.workunit.client.1.smithi149.stdout:1/907: symlink d1/l109 0 2024-04-15T21:02:57.207 INFO:tasks.workunit.client.0.smithi072.stdout:9/772: chown d4/d1f/d31/d9b 1 1 2024-04-15T21:02:57.209 INFO:tasks.workunit.client.0.smithi072.stdout:1/725: truncate d5/db/d2d/d3a/d1f/f79 924223 0 2024-04-15T21:02:57.210 INFO:tasks.workunit.client.0.smithi072.stdout:8/777: dwrite d3/de/d1b/d41/dae/dc0/fce [0,4194304] 0 2024-04-15T21:02:57.211 INFO:tasks.workunit.client.1.smithi149.stdout:1/908: mknod d1/d17/c10a 0 2024-04-15T21:02:57.215 INFO:tasks.workunit.client.1.smithi149.stdout:9/929: dwrite d23/d46/dcf/deb/d7f/d83/ff6 [0,4194304] 0 2024-04-15T21:02:57.215 INFO:tasks.workunit.client.0.smithi072.stdout:6/713: rename d2/d1a to d2/d40/d66/d7f/dd9 0 2024-04-15T21:02:57.215 INFO:tasks.workunit.client.0.smithi072.stdout:0/763: mkdir d0/d6/d6d/d102 0 2024-04-15T21:02:57.216 INFO:tasks.workunit.client.1.smithi149.stdout:1/909: creat d1/db/d14/d6b/f10b x:0 0 0 2024-04-15T21:02:57.219 INFO:tasks.workunit.client.0.smithi072.stdout:3/732: dwrite d1/d15/f31 [0,4194304] 0 2024-04-15T21:02:57.220 INFO:tasks.workunit.client.0.smithi072.stdout:3/733: chown d1/d3f/d4f/d73/db3/dd5/le0 16 1 2024-04-15T21:02:57.220 INFO:tasks.workunit.client.0.smithi072.stdout:7/731: symlink d2/da7/le1 0 2024-04-15T21:02:57.221 INFO:tasks.workunit.client.1.smithi149.stdout:9/930: dread d23/d2b/d70/d75/f95 [0,4194304] 0 2024-04-15T21:02:57.223 INFO:tasks.workunit.client.1.smithi149.stdout:1/910: fsync d1/db/dc/d38/fbe 0 2024-04-15T21:02:57.224 INFO:tasks.workunit.client.0.smithi072.stdout:9/773: symlink d4/d29/d4c/d91/lf5 0 2024-04-15T21:02:57.225 INFO:tasks.workunit.client.0.smithi072.stdout:2/789: truncate d2/d8/f36 4969672 0 2024-04-15T21:02:57.227 INFO:tasks.workunit.client.0.smithi072.stdout:1/726: write d5/f70 [420137,43666] 0 2024-04-15T21:02:57.228 INFO:tasks.workunit.client.1.smithi149.stdout:1/911: creat d1/d17/d36/d6f/f10c x:0 0 0 2024-04-15T21:02:57.229 INFO:tasks.workunit.client.0.smithi072.stdout:4/760: sync 2024-04-15T21:02:57.230 INFO:tasks.workunit.client.1.smithi149.stdout:1/912: write d1/db/dc/d11/d3f/d45/f103 [1042318,96218] 0 2024-04-15T21:02:57.230 INFO:tasks.workunit.client.0.smithi072.stdout:6/714: symlink d2/d40/d66/lda 0 2024-04-15T21:02:57.234 INFO:tasks.workunit.client.1.smithi149.stdout:1/913: dread d1/fdd [0,4194304] 0 2024-04-15T21:02:57.235 INFO:tasks.workunit.client.1.smithi149.stdout:1/914: dread - d1/db/dc/d38/fe6 zero size 2024-04-15T21:02:57.241 INFO:tasks.workunit.client.1.smithi149.stdout:1/915: chown d1/db/dc/d11/c22 6 1 2024-04-15T21:02:57.243 INFO:tasks.workunit.client.0.smithi072.stdout:7/732: mkdir d2/d7/d25/d72/d98/de2 0 2024-04-15T21:02:57.244 INFO:tasks.workunit.client.1.smithi149.stdout:1/916: creat d1/db/dc/d11/d3e/f10d x:0 0 0 2024-04-15T21:02:57.248 INFO:tasks.workunit.client.1.smithi149.stdout:1/917: mknod d1/d17/d52/d92/c10e 0 2024-04-15T21:02:57.249 INFO:tasks.workunit.client.0.smithi072.stdout:9/774: dread d4/d1f/d2c/d62/f81 [0,4194304] 0 2024-04-15T21:02:57.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/918: link d1/db/dc/d38/d39/d43/daa/d8a/d97/ff1 d1/db/dc/d11/d3f/d45/dae/f10f 0 2024-04-15T21:02:57.259 INFO:tasks.workunit.client.1.smithi149.stdout:9/931: dread d23/f24 [0,4194304] 0 2024-04-15T21:02:57.260 INFO:tasks.workunit.client.1.smithi149.stdout:9/932: read d23/d46/f73 [2309969,99964] 0 2024-04-15T21:02:57.261 INFO:tasks.workunit.client.1.smithi149.stdout:1/919: symlink d1/db/dc/d11/d3f/d45/l110 0 2024-04-15T21:02:57.262 INFO:tasks.workunit.client.1.smithi149.stdout:9/933: mkdir d23/d2b/d37/d134 0 2024-04-15T21:02:57.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/920: dread d1/f3 [4194304,4194304] 0 2024-04-15T21:02:57.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/921: write d1/db/d16/d35/f96 [2527540,89078] 0 2024-04-15T21:02:57.275 INFO:tasks.workunit.client.1.smithi149.stdout:1/922: stat d1/db/dc/d11/d3f/d45/dae/f10f 0 2024-04-15T21:02:57.276 INFO:tasks.workunit.client.0.smithi072.stdout:2/790: dwrite d2/d3/f5 [0,4194304] 0 2024-04-15T21:02:57.276 INFO:tasks.workunit.client.0.smithi072.stdout:8/778: truncate d3/de/d1b/d85/fad 408435 0 2024-04-15T21:02:57.277 INFO:tasks.workunit.client.0.smithi072.stdout:4/761: truncate d7/d10/f85 422821 0 2024-04-15T21:02:57.277 INFO:tasks.workunit.client.0.smithi072.stdout:3/734: write d1/d15/d40/f22 [3798880,130253] 0 2024-04-15T21:02:57.277 INFO:tasks.workunit.client.1.smithi149.stdout:9/934: dwrite d23/d2b/d37/d6d/f6e [4194304,4194304] 0 2024-04-15T21:02:57.287 INFO:tasks.workunit.client.1.smithi149.stdout:1/923: dwrite d1/db/d14/f100 [0,4194304] 0 2024-04-15T21:02:57.305 INFO:tasks.workunit.client.1.smithi149.stdout:1/924: dwrite d1/d17/d52/f34 [0,4194304] 0 2024-04-15T21:02:57.313 INFO:tasks.workunit.client.1.smithi149.stdout:9/935: dread d23/d2b/d44/f64 [0,4194304] 0 2024-04-15T21:02:57.314 INFO:tasks.workunit.client.1.smithi149.stdout:9/936: stat d23/d3c/d7a/da5/l10c 0 2024-04-15T21:02:57.332 INFO:tasks.workunit.client.1.smithi149.stdout:9/937: dread f4 [4194304,4194304] 0 2024-04-15T21:02:57.339 INFO:tasks.workunit.client.0.smithi072.stdout:5/809: sync 2024-04-15T21:02:57.340 INFO:tasks.workunit.client.0.smithi072.stdout:3/735: chown d1/f8f 89052 1 2024-04-15T21:02:57.343 INFO:tasks.workunit.client.0.smithi072.stdout:0/764: dwrite d0/d6/f80 [0,4194304] 0 2024-04-15T21:02:57.418 INFO:tasks.workunit.client.0.smithi072.stdout:1/727: sync 2024-04-15T21:02:57.418 INFO:tasks.workunit.client.0.smithi072.stdout:6/715: sync 2024-04-15T21:02:57.424 INFO:tasks.workunit.client.0.smithi072.stdout:6/716: dwrite d2/da1/fb5 [0,4194304] 0 2024-04-15T21:02:57.435 INFO:tasks.workunit.client.0.smithi072.stdout:8/779: rename d3/de/d1b/d41/d74/d98/da5/le8 to d3/d4/d76/dde/lf8 0 2024-04-15T21:02:57.440 INFO:tasks.workunit.client.0.smithi072.stdout:0/765: fsync d0/d19/d96/dad/dc8/fa4 0 2024-04-15T21:02:57.444 INFO:tasks.workunit.client.0.smithi072.stdout:2/791: mknod d2/d8/d8e/cf8 0 2024-04-15T21:02:57.445 INFO:tasks.workunit.client.0.smithi072.stdout:2/792: write d2/d8/f72 [1806931,111665] 0 2024-04-15T21:02:57.447 INFO:tasks.workunit.client.0.smithi072.stdout:9/775: getdents d4/d76 0 2024-04-15T21:02:57.448 INFO:tasks.workunit.client.0.smithi072.stdout:9/776: read d4/d1f/d2c/d47/f5f [2223602,2164] 0 2024-04-15T21:02:57.450 INFO:tasks.workunit.client.0.smithi072.stdout:8/780: chown d3/de/d1b/c68 454 1 2024-04-15T21:02:57.453 INFO:tasks.workunit.client.0.smithi072.stdout:3/736: link d1/d15/d40/f22 d1/d15/d32/d78/fe4 0 2024-04-15T21:02:57.462 INFO:tasks.workunit.client.0.smithi072.stdout:6/717: rename d2/cd7 to d2/da1/cdb 0 2024-04-15T21:02:57.462 INFO:tasks.workunit.client.0.smithi072.stdout:7/733: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f76 [0,4194304] 0 2024-04-15T21:02:57.462 INFO:tasks.workunit.client.0.smithi072.stdout:6/718: chown d2/d10/d11/l59 1273832 1 2024-04-15T21:02:57.463 INFO:tasks.workunit.client.0.smithi072.stdout:7/734: stat d2/d7/d25/d2d/d46/d5a/f8f 0 2024-04-15T21:02:57.463 INFO:tasks.workunit.client.0.smithi072.stdout:6/719: stat d2/d40/d66 0 2024-04-15T21:02:57.464 INFO:tasks.workunit.client.0.smithi072.stdout:3/737: truncate d1/d15/d40/f1c 3085731 0 2024-04-15T21:02:57.464 INFO:tasks.workunit.client.0.smithi072.stdout:6/720: chown d2/d10/d18/l7e 9647 1 2024-04-15T21:02:57.467 INFO:tasks.workunit.client.0.smithi072.stdout:3/738: read d1/d15/d40/d9e/dc7/fb4 [777009,79016] 0 2024-04-15T21:02:57.469 INFO:tasks.workunit.client.0.smithi072.stdout:3/739: fsync d1/d3f/da2/fb8 0 2024-04-15T21:02:57.470 INFO:tasks.workunit.client.0.smithi072.stdout:6/721: dwrite d2/d40/f86 [0,4194304] 0 2024-04-15T21:02:57.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/938: rename d23/d46/dcf/deb/d7f/d86 to d23/d2b/d37/d50/df1/d119/d135 0 2024-04-15T21:02:57.474 INFO:tasks.workunit.client.0.smithi072.stdout:3/740: dread d1/d15/f31 [0,4194304] 0 2024-04-15T21:02:57.477 INFO:tasks.workunit.client.0.smithi072.stdout:3/741: symlink d1/d3f/d4f/da3/le5 0 2024-04-15T21:02:57.479 INFO:tasks.workunit.client.0.smithi072.stdout:3/742: fsync d1/d15/d40/fb 0 2024-04-15T21:02:57.481 INFO:tasks.workunit.client.0.smithi072.stdout:3/743: creat d1/d15/d32/d2f/fe6 x:0 0 0 2024-04-15T21:02:57.482 INFO:tasks.workunit.client.0.smithi072.stdout:3/744: chown d1/d3f/fc1 25380159 1 2024-04-15T21:02:57.485 INFO:tasks.workunit.client.1.smithi149.stdout:9/939: dread d23/d46/dcf/deb/fb1 [0,4194304] 0 2024-04-15T21:02:57.485 INFO:tasks.workunit.client.0.smithi072.stdout:3/745: dread d1/d3f/d4f/d73/f85 [0,4194304] 0 2024-04-15T21:02:57.490 INFO:tasks.workunit.client.1.smithi149.stdout:9/940: rename d23/d3c/d52/ld0 to d23/d46/dcf/deb/l136 0 2024-04-15T21:02:57.492 INFO:tasks.workunit.client.1.smithi149.stdout:9/941: mkdir d23/d3c/d87/d9a/d109/d137 0 2024-04-15T21:02:57.495 INFO:tasks.workunit.client.1.smithi149.stdout:9/942: creat d23/d2b/d37/d50/d69/f138 x:0 0 0 2024-04-15T21:02:57.497 INFO:tasks.workunit.client.1.smithi149.stdout:9/943: mknod d23/d2b/d37/d6d/db8/d102/d10e/c139 0 2024-04-15T21:02:57.499 INFO:tasks.workunit.client.1.smithi149.stdout:9/944: read f16 [1914926,75130] 0 2024-04-15T21:02:57.515 INFO:tasks.workunit.client.0.smithi072.stdout:1/728: creat d5/db/d27/d5c/fe9 x:0 0 0 2024-04-15T21:02:57.516 INFO:tasks.workunit.client.0.smithi072.stdout:1/729: chown d5/d31/d51 11745520 1 2024-04-15T21:02:57.517 INFO:tasks.workunit.client.0.smithi072.stdout:1/730: write d5/db/d27/d5c/f84 [2172652,123546] 0 2024-04-15T21:02:57.578 INFO:tasks.workunit.client.0.smithi072.stdout:5/810: write d0/d3/d7/d1f/d50/fcf [943491,94668] 0 2024-04-15T21:02:57.581 INFO:tasks.workunit.client.0.smithi072.stdout:5/811: mkdir d0/d3/d7/d94/d92/da0/dfc/d111 0 2024-04-15T21:02:57.582 INFO:tasks.workunit.client.0.smithi072.stdout:5/812: stat d0/d3/d6/d2d/d79/ccb 0 2024-04-15T21:02:57.590 INFO:tasks.workunit.client.0.smithi072.stdout:4/762: dwrite d7/d10/d41/d45/fba [0,4194304] 0 2024-04-15T21:02:57.591 INFO:tasks.workunit.client.0.smithi072.stdout:2/793: write d2/da1/fc0 [227622,46680] 0 2024-04-15T21:02:57.591 INFO:tasks.workunit.client.0.smithi072.stdout:9/777: write d4/d1f/f8a [248716,36047] 0 2024-04-15T21:02:57.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/778: write d4/d1f/d31/dcc/fec [692592,10921] 0 2024-04-15T21:02:57.597 INFO:tasks.workunit.client.0.smithi072.stdout:8/781: write d3/d4/f1e [4741383,12684] 0 2024-04-15T21:02:57.597 INFO:tasks.workunit.client.0.smithi072.stdout:9/779: chown d4/d1f/d2c/dd8 343 1 2024-04-15T21:02:57.600 INFO:tasks.workunit.client.0.smithi072.stdout:8/782: truncate d3/de/f99 4792588 0 2024-04-15T21:02:57.601 INFO:tasks.workunit.client.0.smithi072.stdout:2/794: mknod d2/d3/cf9 0 2024-04-15T21:02:57.601 INFO:tasks.workunit.client.0.smithi072.stdout:0/766: dread d0/f13 [0,4194304] 0 2024-04-15T21:02:57.602 INFO:tasks.workunit.client.0.smithi072.stdout:8/783: dread - d3/fe6 zero size 2024-04-15T21:02:57.603 INFO:tasks.workunit.client.0.smithi072.stdout:4/763: dwrite d7/d10/d41/d44/d7a/ff1 [0,4194304] 0 2024-04-15T21:02:57.605 INFO:tasks.workunit.client.0.smithi072.stdout:2/795: dread - d2/da1/fcc zero size 2024-04-15T21:02:57.609 INFO:tasks.workunit.client.0.smithi072.stdout:6/722: write d2/d40/d66/d7f/dd9/f75 [1467588,6043] 0 2024-04-15T21:02:57.610 INFO:tasks.workunit.client.0.smithi072.stdout:4/764: write d7/d10/f11 [1640640,60647] 0 2024-04-15T21:02:57.613 INFO:tasks.workunit.client.0.smithi072.stdout:2/796: rmdir d2/d8/df3 39 2024-04-15T21:02:57.615 INFO:tasks.workunit.client.0.smithi072.stdout:7/735: rmdir d2/d7/d25/d2d/d46/d5a/d5f 39 2024-04-15T21:02:57.619 INFO:tasks.workunit.client.0.smithi072.stdout:2/797: mkdir d2/da8/dfa 0 2024-04-15T21:02:57.620 INFO:tasks.workunit.client.0.smithi072.stdout:8/784: dwrite d3/d4/f91 [0,4194304] 0 2024-04-15T21:02:57.621 INFO:tasks.workunit.client.0.smithi072.stdout:0/767: dwrite d0/d45/fc0 [0,4194304] 0 2024-04-15T21:02:57.627 INFO:tasks.workunit.client.0.smithi072.stdout:2/798: write d2/d38/f48 [2338084,64092] 0 2024-04-15T21:02:57.631 INFO:tasks.workunit.client.0.smithi072.stdout:0/768: link d0/d19/d2b/f4d d0/d74/d94/f103 0 2024-04-15T21:02:57.634 INFO:tasks.workunit.client.0.smithi072.stdout:3/746: dwrite d1/d26/f47 [0,4194304] 0 2024-04-15T21:02:57.636 INFO:tasks.workunit.client.0.smithi072.stdout:0/769: creat d0/d19/d71/d9e/f104 x:0 0 0 2024-04-15T21:02:57.637 INFO:tasks.workunit.client.0.smithi072.stdout:2/799: creat d2/ffb x:0 0 0 2024-04-15T21:02:57.645 INFO:tasks.workunit.client.0.smithi072.stdout:8/785: dread d3/de/d1b/d85/fad [0,4194304] 0 2024-04-15T21:02:57.646 INFO:tasks.workunit.client.0.smithi072.stdout:1/731: write d5/db/d2d/d3a/d1f/f98 [150705,110340] 0 2024-04-15T21:02:57.646 INFO:tasks.workunit.client.0.smithi072.stdout:6/723: dread d2/d40/d56/d6a/f9d [0,4194304] 0 2024-04-15T21:02:57.647 INFO:tasks.workunit.client.0.smithi072.stdout:2/800: truncate d2/d8/fbc 757093 0 2024-04-15T21:02:57.650 INFO:tasks.workunit.client.0.smithi072.stdout:5/813: write d0/f4a [49610,57605] 0 2024-04-15T21:02:57.651 INFO:tasks.workunit.client.0.smithi072.stdout:8/786: fdatasync d3/de/d1b/d41/dae/dc0/fce 0 2024-04-15T21:02:57.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/787: dread - d3/d4/d4c/ff7 zero size 2024-04-15T21:02:57.653 INFO:tasks.workunit.client.0.smithi072.stdout:0/770: dread d0/d6/f4c [4194304,4194304] 0 2024-04-15T21:02:57.653 INFO:tasks.workunit.client.0.smithi072.stdout:3/747: dwrite d1/f43 [0,4194304] 0 2024-04-15T21:02:57.656 INFO:tasks.workunit.client.0.smithi072.stdout:7/736: dread d2/d7/f8 [0,4194304] 0 2024-04-15T21:02:57.658 INFO:tasks.workunit.client.0.smithi072.stdout:6/724: creat d2/d10/d11/d1f/fdc x:0 0 0 2024-04-15T21:02:57.668 INFO:tasks.workunit.client.0.smithi072.stdout:0/771: truncate d0/d45/d7a/d70/d59/d8a/d7b/f91 531322 0 2024-04-15T21:02:57.670 INFO:tasks.workunit.client.0.smithi072.stdout:3/748: symlink d1/d15/d40/dc2/le7 0 2024-04-15T21:02:57.672 INFO:tasks.workunit.client.0.smithi072.stdout:4/765: dwrite d7/f12 [4194304,4194304] 0 2024-04-15T21:02:57.673 INFO:tasks.workunit.client.0.smithi072.stdout:9/780: dwrite d4/d76/fa9 [0,4194304] 0 2024-04-15T21:02:57.673 INFO:tasks.workunit.client.0.smithi072.stdout:7/737: unlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/f3e 0 2024-04-15T21:02:57.674 INFO:tasks.workunit.client.0.smithi072.stdout:3/749: read - d1/d3f/fc1 zero size 2024-04-15T21:02:57.680 INFO:tasks.workunit.client.0.smithi072.stdout:8/788: write d3/ff [1167420,35730] 0 2024-04-15T21:02:57.681 INFO:tasks.workunit.client.0.smithi072.stdout:7/738: chown d2/d7/ca1 50121 1 2024-04-15T21:02:57.684 INFO:tasks.workunit.client.0.smithi072.stdout:0/772: write d0/d19/d96/dad/dc8/fa4 [190251,4520] 0 2024-04-15T21:02:57.686 INFO:tasks.workunit.client.0.smithi072.stdout:3/750: fsync d1/d26/f59 0 2024-04-15T21:02:57.686 INFO:tasks.workunit.client.0.smithi072.stdout:8/789: rename d3/d4/ld2 to d3/de/d1b/d44/lf9 0 2024-04-15T21:02:57.689 INFO:tasks.workunit.client.0.smithi072.stdout:2/801: dread d2/d64/fac [0,4194304] 0 2024-04-15T21:02:57.694 INFO:tasks.workunit.client.0.smithi072.stdout:4/766: dread d7/d28/d42/da1/da2/fa5 [0,4194304] 0 2024-04-15T21:02:57.697 INFO:tasks.workunit.client.0.smithi072.stdout:0/773: symlink d0/d74/l105 0 2024-04-15T21:02:57.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/790: symlink d3/de/d1b/d85/lfa 0 2024-04-15T21:02:57.698 INFO:tasks.workunit.client.0.smithi072.stdout:7/739: mknod d2/d7/d25/d2d/d46/d5a/d5f/ce3 0 2024-04-15T21:02:57.699 INFO:tasks.workunit.client.0.smithi072.stdout:9/781: truncate d4/d1f/d2c/f35 2567472 0 2024-04-15T21:02:57.700 INFO:tasks.workunit.client.0.smithi072.stdout:2/802: symlink d2/da8/lfc 0 2024-04-15T21:02:57.701 INFO:tasks.workunit.client.0.smithi072.stdout:8/791: readlink d3/d4/d4c/l18 0 2024-04-15T21:02:57.703 INFO:tasks.workunit.client.0.smithi072.stdout:1/732: dread d5/db/f52 [0,4194304] 0 2024-04-15T21:02:57.703 INFO:tasks.workunit.client.0.smithi072.stdout:7/740: mkdir d2/d7/d25/d72/d98/de2/de4 0 2024-04-15T21:02:57.704 INFO:tasks.workunit.client.0.smithi072.stdout:6/725: dread d2/d40/d66/d7f/dd9/f1b [0,4194304] 0 2024-04-15T21:02:57.707 INFO:tasks.workunit.client.0.smithi072.stdout:1/733: chown d5/db/d2d/d3a/d1f/d63/cd1 3 1 2024-04-15T21:02:57.709 INFO:tasks.workunit.client.0.smithi072.stdout:2/803: truncate d2/d3/f4c 4876105 0 2024-04-15T21:02:57.709 INFO:tasks.workunit.client.0.smithi072.stdout:9/782: rename d4/d29/d45/c6f to d4/d1f/d31/d4d/dbf/dd2/cf6 0 2024-04-15T21:02:57.710 INFO:tasks.workunit.client.0.smithi072.stdout:7/741: fsync d2/d7/f55 0 2024-04-15T21:02:57.714 INFO:tasks.workunit.client.0.smithi072.stdout:1/734: fsync d5/d3d/f94 0 2024-04-15T21:02:57.715 INFO:tasks.workunit.client.0.smithi072.stdout:3/751: dwrite d1/d15/d40/fb [0,4194304] 0 2024-04-15T21:02:57.717 INFO:tasks.workunit.client.0.smithi072.stdout:7/742: creat d2/d7/d25/d4c/fe5 x:0 0 0 2024-04-15T21:02:57.718 INFO:tasks.workunit.client.0.smithi072.stdout:2/804: rename d2/d8/fef to d2/ffd 0 2024-04-15T21:02:57.721 INFO:tasks.workunit.client.0.smithi072.stdout:3/752: stat d1/d15/d32/c2a 0 2024-04-15T21:02:57.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/743: write d2/d7/d25/d72/f85 [4786591,41269] 0 2024-04-15T21:02:57.721 INFO:tasks.workunit.client.0.smithi072.stdout:0/774: write d0/d45/d7a/d70/d59/d8a/d8b/db8/f34 [4613241,20066] 0 2024-04-15T21:02:57.728 INFO:tasks.workunit.client.0.smithi072.stdout:8/792: truncate d3/de/d1b/d3f/fbb 8328 0 2024-04-15T21:02:57.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/783: dwrite d4/d29/d4c/d74/fe7 [0,4194304] 0 2024-04-15T21:02:57.737 INFO:tasks.workunit.client.0.smithi072.stdout:4/767: dwrite d7/d28/d42/f70 [0,4194304] 0 2024-04-15T21:02:57.737 INFO:tasks.workunit.client.0.smithi072.stdout:3/753: creat d1/d15/d32/d2f/fe8 x:0 0 0 2024-04-15T21:02:57.737 INFO:tasks.workunit.client.0.smithi072.stdout:9/784: rmdir d4/d1f/d2c/d62 39 2024-04-15T21:02:57.740 INFO:tasks.workunit.client.0.smithi072.stdout:0/775: fsync d0/d45/d7a/d70/d59/d8a/d7b/f91 0 2024-04-15T21:02:57.743 INFO:tasks.workunit.client.0.smithi072.stdout:9/785: chown d4/d1f/d31/f3f 13 1 2024-04-15T21:02:57.743 INFO:tasks.workunit.client.0.smithi072.stdout:6/726: dwrite d2/d40/d66/d7f/dd9/f5f [0,4194304] 0 2024-04-15T21:02:57.749 INFO:tasks.workunit.client.0.smithi072.stdout:0/776: chown d0/d45/d7a/d70/d59/d8a/d8b/db8/f34 5797687 1 2024-04-15T21:02:57.750 INFO:tasks.workunit.client.0.smithi072.stdout:7/744: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc/fe6 x:0 0 0 2024-04-15T21:02:57.751 INFO:tasks.workunit.client.0.smithi072.stdout:7/745: readlink d2/l15 0 2024-04-15T21:02:57.751 INFO:tasks.workunit.client.0.smithi072.stdout:3/754: mknod d1/d3f/d4f/d73/db3/dc4/ce9 0 2024-04-15T21:02:57.752 INFO:tasks.workunit.client.0.smithi072.stdout:6/727: truncate d2/d40/dcb/d49/f65 819096 0 2024-04-15T21:02:57.753 INFO:tasks.workunit.client.0.smithi072.stdout:3/755: stat d1/d5b 0 2024-04-15T21:02:57.754 INFO:tasks.workunit.client.0.smithi072.stdout:0/777: readlink d0/d6/l1a 0 2024-04-15T21:02:57.757 INFO:tasks.workunit.client.0.smithi072.stdout:7/746: mknod d2/d7/d25/d2d/d52/d6d/ce7 0 2024-04-15T21:02:57.758 INFO:tasks.workunit.client.0.smithi072.stdout:8/793: truncate d3/f1d 1568077 0 2024-04-15T21:02:57.760 INFO:tasks.workunit.client.0.smithi072.stdout:4/768: dwrite d7/d15/ddd/df7/d76/d8b/fe2 [0,4194304] 0 2024-04-15T21:02:57.761 INFO:tasks.workunit.client.0.smithi072.stdout:0/778: truncate d0/d19/d2b/d63/fe9 159046 0 2024-04-15T21:02:57.762 INFO:tasks.workunit.client.0.smithi072.stdout:0/779: chown d0/d19/d2b/d63 88634 1 2024-04-15T21:02:57.762 INFO:tasks.workunit.client.0.smithi072.stdout:4/769: stat d7/d28/d6d/faa 0 2024-04-15T21:02:57.764 INFO:tasks.workunit.client.0.smithi072.stdout:1/735: dwrite d5/dcb/fe2 [8388608,4194304] 0 2024-04-15T21:02:57.765 INFO:tasks.workunit.client.0.smithi072.stdout:1/736: write d5/db/d2d/f81 [387654,38715] 0 2024-04-15T21:02:57.772 INFO:tasks.workunit.client.0.smithi072.stdout:6/728: mknod d2/d40/d66/da8/cdd 0 2024-04-15T21:02:57.776 INFO:tasks.workunit.client.0.smithi072.stdout:8/794: mkdir d3/de/d1b/d3f/dfb 0 2024-04-15T21:02:57.777 INFO:tasks.workunit.client.0.smithi072.stdout:9/786: write d4/d1f/d2c/d47/f79 [254828,44495] 0 2024-04-15T21:02:57.778 INFO:tasks.workunit.client.0.smithi072.stdout:0/780: creat d0/d19/d58/f106 x:0 0 0 2024-04-15T21:02:57.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/787: chown d4/d1f/f8a 1018 1 2024-04-15T21:02:57.779 INFO:tasks.workunit.client.0.smithi072.stdout:4/770: creat d7/d10/d41/dcf/ffb x:0 0 0 2024-04-15T21:02:57.781 INFO:tasks.workunit.client.0.smithi072.stdout:1/737: mknod d5/db/d27/d5c/dbd/cea 0 2024-04-15T21:02:57.781 INFO:tasks.workunit.client.0.smithi072.stdout:6/729: readlink d2/d10/d11/d1f/la6 0 2024-04-15T21:02:57.782 INFO:tasks.workunit.client.0.smithi072.stdout:8/795: symlink d3/de/d1b/d41/dae/lfc 0 2024-04-15T21:02:57.783 INFO:tasks.workunit.client.0.smithi072.stdout:9/788: mkdir d4/d1f/d31/d4d/df7 0 2024-04-15T21:02:57.784 INFO:tasks.workunit.client.0.smithi072.stdout:7/747: creat d2/d7/fe8 x:0 0 0 2024-04-15T21:02:57.789 INFO:tasks.workunit.client.0.smithi072.stdout:8/796: rmdir d3/d4/d76/d8f 39 2024-04-15T21:02:57.789 INFO:tasks.workunit.client.0.smithi072.stdout:1/738: dwrite d5/db/d27/d5c/f84 [0,4194304] 0 2024-04-15T21:02:57.790 INFO:tasks.workunit.client.0.smithi072.stdout:8/797: stat d3/de/d1b/d41/da4/d2e/c79 0 2024-04-15T21:02:57.794 INFO:tasks.workunit.client.0.smithi072.stdout:0/781: link d0/d6/d6d/dcc/ccf d0/c107 0 2024-04-15T21:02:57.795 INFO:tasks.workunit.client.0.smithi072.stdout:0/782: readlink d0/d6/d48/l51 0 2024-04-15T21:02:57.798 INFO:tasks.workunit.client.0.smithi072.stdout:1/739: creat d5/d31/dbc/feb x:0 0 0 2024-04-15T21:02:57.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/798: fsync d3/de/d1b/d85/fad 0 2024-04-15T21:02:57.803 INFO:tasks.workunit.client.0.smithi072.stdout:4/771: truncate d7/d23/f29 2927144 0 2024-04-15T21:02:57.805 INFO:tasks.workunit.client.0.smithi072.stdout:6/730: getdents d2/d40/d66 0 2024-04-15T21:02:57.806 INFO:tasks.workunit.client.0.smithi072.stdout:9/789: write d4/d1f/d2c/f35 [1406395,16472] 0 2024-04-15T21:02:57.808 INFO:tasks.workunit.client.0.smithi072.stdout:7/748: truncate d2/f1c 8511767 0 2024-04-15T21:02:57.811 INFO:tasks.workunit.client.0.smithi072.stdout:1/740: dread d5/fb8 [0,4194304] 0 2024-04-15T21:02:57.811 INFO:tasks.workunit.client.0.smithi072.stdout:8/799: rmdir d3/de/d1b/d41/da4/d2e 39 2024-04-15T21:02:57.814 INFO:tasks.workunit.client.0.smithi072.stdout:4/772: write d7/d28/d42/da1/da2/fa5 [3884906,112040] 0 2024-04-15T21:02:57.815 INFO:tasks.workunit.client.0.smithi072.stdout:4/773: read - d7/d10/d41/dcf/fd9 zero size 2024-04-15T21:02:57.818 INFO:tasks.workunit.client.0.smithi072.stdout:7/749: dread - d2/d78/fbb zero size 2024-04-15T21:02:57.819 INFO:tasks.workunit.client.0.smithi072.stdout:1/741: creat d5/d31/d51/d82/fec x:0 0 0 2024-04-15T21:02:57.820 INFO:tasks.workunit.client.0.smithi072.stdout:8/800: truncate d3/d4/d3b/f88 775070 0 2024-04-15T21:02:57.897 INFO:tasks.workunit.client.0.smithi072.stdout:6/731: getdents d2/d40/dcb/d49 0 2024-04-15T21:02:57.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/783: rename d0/d74/dd5/dfa to d0/d45/d7a/d70/d59/d8a/d108 0 2024-04-15T21:02:57.902 INFO:tasks.workunit.client.1.smithi149.stdout:3/942: sync 2024-04-15T21:02:57.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/997: sync 2024-04-15T21:02:57.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/969: sync 2024-04-15T21:02:57.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/925: sync 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.1.smithi149.stdout:5/930: sync 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.1.smithi149.stdout:9/945: sync 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.1.smithi149.stdout:7/921: sync 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.0.smithi072.stdout:4/774: dread d7/d10/d41/d44/d7a/fda [0,4194304] 0 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.0.smithi072.stdout:4/775: chown d7/d10/d41/d4c/f82 32 1 2024-04-15T21:02:57.903 INFO:tasks.workunit.client.0.smithi072.stdout:7/750: rename d2/c45 to d2/d78/ce9 0 2024-04-15T21:02:57.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/776: write d7/f38 [3268833,9684] 0 2024-04-15T21:02:57.904 INFO:tasks.workunit.client.0.smithi072.stdout:7/751: chown d2/d7/d25/d4c/l66 2516494 1 2024-04-15T21:02:57.905 INFO:tasks.workunit.client.0.smithi072.stdout:7/752: fdatasync d2/fcb 0 2024-04-15T21:02:57.905 INFO:tasks.workunit.client.1.smithi149.stdout:1/926: write d1/db/dc/d38/d39/d43/f8f [64355,1178] 0 2024-04-15T21:02:57.906 INFO:tasks.workunit.client.1.smithi149.stdout:6/970: write da/d18/d10/d3f/f12f [212059,97884] 0 2024-04-15T21:02:57.907 INFO:tasks.workunit.client.1.smithi149.stdout:3/943: chown d1/db/d24/d39/d79/f119 3826 1 2024-04-15T21:02:57.908 INFO:tasks.workunit.client.1.smithi149.stdout:7/922: chown d3/d16/d20/d36/d3d/f85 1 1 2024-04-15T21:02:57.909 INFO:tasks.workunit.client.1.smithi149.stdout:5/931: rmdir d0/d9/d3f 39 2024-04-15T21:02:57.910 INFO:tasks.workunit.client.1.smithi149.stdout:6/971: dread - da/d18/d10/d3f/ded/f13a zero size 2024-04-15T21:02:57.911 INFO:tasks.workunit.client.1.smithi149.stdout:9/946: creat d23/d3c/d87/d9a/dad/f13a x:0 0 0 2024-04-15T21:02:57.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/932: fdatasync d0/d9/db6/f62 0 2024-04-15T21:02:57.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:57 smithi072 ceph-mon[29079]: pgmap v13: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 197 MiB/s wr, 392 op/s 2024-04-15T21:02:57.913 INFO:tasks.workunit.client.0.smithi072.stdout:9/790: dread d4/d76/d8f/faa [0,4194304] 0 2024-04-15T21:02:57.913 INFO:tasks.workunit.client.0.smithi072.stdout:0/784: dwrite d0/d45/d7a/d70/d59/d8a/d7b/ffd [0,4194304] 0 2024-04-15T21:02:57.916 INFO:tasks.workunit.client.1.smithi149.stdout:3/944: fsync d1/db/d40/d56/fe1 0 2024-04-15T21:02:57.919 INFO:tasks.workunit.client.0.smithi072.stdout:7/753: fdatasync d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 0 2024-04-15T21:02:57.924 INFO:tasks.workunit.client.1.smithi149.stdout:9/947: creat d23/d46/d124/f13b x:0 0 0 2024-04-15T21:02:57.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/933: mknod d0/d9/d71/c129 0 2024-04-15T21:02:57.926 INFO:tasks.workunit.client.0.smithi072.stdout:7/754: rmdir d2/d7/d25/d2d/d52/d6d 39 2024-04-15T21:02:57.926 INFO:tasks.workunit.client.1.smithi149.stdout:5/934: write d0/f3a [1531029,7135] 0 2024-04-15T21:02:57.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/801: dread d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:02:57.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/923: dread d3/d17/d1f/f25 [0,4194304] 0 2024-04-15T21:02:57.934 INFO:tasks.workunit.client.0.smithi072.stdout:1/742: write d5/db/f12 [4283393,53237] 0 2024-04-15T21:02:57.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/802: read d3/de/d1b/d41/da4/fc3 [24104,75263] 0 2024-04-15T21:02:57.935 INFO:tasks.workunit.client.0.smithi072.stdout:9/791: getdents d4/d1f 0 2024-04-15T21:02:57.938 INFO:tasks.workunit.client.0.smithi072.stdout:1/743: fdatasync d5/db/f28 0 2024-04-15T21:02:57.940 INFO:tasks.workunit.client.0.smithi072.stdout:9/792: creat d4/d29/d4c/d74/d84/dc0/ff8 x:0 0 0 2024-04-15T21:02:57.941 INFO:tasks.workunit.client.1.smithi149.stdout:7/924: unlink d3/d16/d20/d36/d3d/f9d 0 2024-04-15T21:02:57.942 INFO:tasks.workunit.client.0.smithi072.stdout:4/777: dread d7/d24/f1e [0,4194304] 0 2024-04-15T21:02:57.942 INFO:tasks.workunit.client.0.smithi072.stdout:8/803: dwrite d3/d4/d76/fe2 [0,4194304] 0 2024-04-15T21:02:57.946 INFO:tasks.workunit.client.1.smithi149.stdout:1/927: creat d1/db/d16/f111 x:0 0 0 2024-04-15T21:02:57.950 INFO:tasks.workunit.client.1.smithi149.stdout:9/948: unlink d23/c76 0 2024-04-15T21:02:57.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/925: dwrite d3/d16/d11f/f13c [0,4194304] 0 2024-04-15T21:02:57.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/935: symlink d0/d9/l12a 0 2024-04-15T21:02:57.958 INFO:tasks.workunit.client.1.smithi149.stdout:1/928: rmdir d1/db 39 2024-04-15T21:02:57.958 INFO:tasks.workunit.client.0.smithi072.stdout:6/732: write d2/d42/f73 [1009428,94394] 0 2024-04-15T21:02:57.961 INFO:tasks.workunit.client.0.smithi072.stdout:7/755: link d2/d7/d25/d72/f9f d2/d7/d25/d2d/d47/fea 0 2024-04-15T21:02:57.964 INFO:tasks.workunit.client.1.smithi149.stdout:2/998: write d4/d7/d46/de4/d21/d3b/d10a/d15c/dbd/ff2 [359660,46928] 0 2024-04-15T21:02:57.964 INFO:tasks.workunit.client.0.smithi072.stdout:8/804: symlink d3/dd9/lfd 0 2024-04-15T21:02:57.965 INFO:tasks.workunit.client.1.smithi149.stdout:7/926: creat d3/d16/d20/d60/f148 x:0 0 0 2024-04-15T21:02:57.969 INFO:tasks.workunit.client.0.smithi072.stdout:6/733: unlink d2/d10/faf 0 2024-04-15T21:02:57.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/929: write d1/db/d16/f111 [875046,43729] 0 2024-04-15T21:02:57.973 INFO:tasks.workunit.client.0.smithi072.stdout:7/756: read d2/d7/d25/d2d/d46/d5a/d5f/f82 [1611383,2336] 0 2024-04-15T21:02:57.973 INFO:tasks.workunit.client.1.smithi149.stdout:3/945: getdents d1/db/d24/d8a 0 2024-04-15T21:02:57.974 INFO:tasks.workunit.client.0.smithi072.stdout:9/793: link d4/d1f/d31/d42/cd0 d4/d1f/d31/d9b/dca/cf9 0 2024-04-15T21:02:57.976 INFO:tasks.workunit.client.1.smithi149.stdout:2/999: mknod d4/d7/d46/de4/d21/d55/d94/c169 0 2024-04-15T21:02:57.976 INFO:tasks.workunit.client.1.smithi149.stdout:6/972: dwrite da/d18/d10/d16/f3c [8388608,4194304] 0 2024-04-15T21:02:57.978 INFO:tasks.workunit.client.1.smithi149.stdout:7/927: chown d3/d17/f19 61647 1 2024-04-15T21:02:57.986 INFO:tasks.workunit.client.0.smithi072.stdout:8/805: unlink d3/de/cd1 0 2024-04-15T21:02:57.988 INFO:tasks.workunit.client.1.smithi149.stdout:3/946: fsync d1/db/d40/da0/dd1/ff1 0 2024-04-15T21:02:57.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/947: write d1/db/d24/d4d/f111 [97838,11109] 0 2024-04-15T21:02:57.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/973: symlink da/d11/dbe/dc1/d106/l13d 0 2024-04-15T21:02:57.992 INFO:tasks.workunit.client.0.smithi072.stdout:1/744: write d5/db/d2d/d3a/d1f/f78 [1650834,120851] 0 2024-04-15T21:02:57.993 INFO:tasks.workunit.client.1.smithi149.stdout:9/949: write d23/d46/f73 [2066159,13596] 0 2024-04-15T21:02:57.997 INFO:tasks.workunit.client.1.smithi149.stdout:5/936: creat d0/d6/d82/da1/d12/f12b x:0 0 0 2024-04-15T21:02:58.001 INFO:tasks.workunit.client.1.smithi149.stdout:1/930: mknod d1/d17/d52/d6c/dfd/c112 0 2024-04-15T21:02:58.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/931: chown d1/db/dc/d11/d3e/c51 215430 1 2024-04-15T21:02:58.003 INFO:tasks.workunit.client.1.smithi149.stdout:1/932: chown d1/db/dc/d11/d3f/d45/dae/lbc 105765 1 2024-04-15T21:02:58.003 INFO:tasks.workunit.client.0.smithi072.stdout:1/745: symlink d5/db/daa/led 0 2024-04-15T21:02:58.004 INFO:tasks.workunit.client.0.smithi072.stdout:6/734: write d2/d40/dcb/f44 [2091582,101769] 0 2024-04-15T21:02:58.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/928: dread d3/f78 [0,4194304] 0 2024-04-15T21:02:58.007 INFO:tasks.workunit.client.1.smithi149.stdout:9/950: dread d23/f5a [0,4194304] 0 2024-04-15T21:02:58.008 INFO:tasks.workunit.client.0.smithi072.stdout:7/757: link d2/d7/d25/d2d/d46/d5a/d5f/l4d d2/leb 0 2024-04-15T21:02:58.010 INFO:tasks.workunit.client.1.smithi149.stdout:9/951: dread f16 [0,4194304] 0 2024-04-15T21:02:58.012 INFO:tasks.workunit.client.0.smithi072.stdout:8/806: dread d3/ff [0,4194304] 0 2024-04-15T21:02:58.012 INFO:tasks.workunit.client.0.smithi072.stdout:9/794: rename d4/d29/d4c/d91/d93 to d4/d1f/d2c/dfa 0 2024-04-15T21:02:58.013 INFO:tasks.workunit.client.0.smithi072.stdout:1/746: dwrite d5/f70 [0,4194304] 0 2024-04-15T21:02:58.014 INFO:tasks.workunit.client.0.smithi072.stdout:8/807: readlink d3/d4/d76/l87 0 2024-04-15T21:02:58.016 INFO:tasks.workunit.client.1.smithi149.stdout:1/933: mknod d1/d17/d52/d42/c113 0 2024-04-15T21:02:58.018 INFO:tasks.workunit.client.1.smithi149.stdout:3/948: write d1/db/d28/d87/dbd/f86 [2428633,71079] 0 2024-04-15T21:02:58.021 INFO:tasks.workunit.client.0.smithi072.stdout:8/808: dwrite d3/d7e/ff3 [0,4194304] 0 2024-04-15T21:02:58.025 INFO:tasks.workunit.client.1.smithi149.stdout:6/974: dwrite da/d18/d10/d16/f6d [4194304,4194304] 0 2024-04-15T21:02:58.030 INFO:tasks.workunit.client.1.smithi149.stdout:1/934: creat d1/db/d16/d35/f114 x:0 0 0 2024-04-15T21:02:58.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/949: creat d1/db/d23/f12a x:0 0 0 2024-04-15T21:02:58.034 INFO:tasks.workunit.client.1.smithi149.stdout:3/950: chown d1/db/d40/d56/d84/la2 1715061 1 2024-04-15T21:02:58.038 INFO:tasks.workunit.client.1.smithi149.stdout:6/975: symlink da/d18/d33/l13e 0 2024-04-15T21:02:58.039 INFO:tasks.workunit.client.1.smithi149.stdout:9/952: creat d23/d3c/f13c x:0 0 0 2024-04-15T21:02:58.040 INFO:tasks.workunit.client.1.smithi149.stdout:1/935: creat d1/d17/d52/d78/f115 x:0 0 0 2024-04-15T21:02:58.041 INFO:tasks.workunit.client.1.smithi149.stdout:1/936: dread - d1/db/d16/d35/f114 zero size 2024-04-15T21:02:58.044 INFO:tasks.workunit.client.1.smithi149.stdout:5/937: getdents d0/d9/d3f/dc7 0 2024-04-15T21:02:58.048 INFO:tasks.workunit.client.1.smithi149.stdout:1/937: readlink d1/db/d16/l49 0 2024-04-15T21:02:58.050 INFO:tasks.workunit.client.1.smithi149.stdout:1/938: fdatasync d1/db/dc/fa4 0 2024-04-15T21:02:58.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/938: dwrite d0/d9/d3f/dc7/f10e [0,4194304] 0 2024-04-15T21:02:58.053 INFO:tasks.workunit.client.0.smithi072.stdout:7/758: rmdir d2/d7/d25/d4c 39 2024-04-15T21:02:58.055 INFO:tasks.workunit.client.0.smithi072.stdout:1/747: truncate d5/d31/f4c 306939 0 2024-04-15T21:02:58.056 INFO:tasks.workunit.client.1.smithi149.stdout:7/929: write d3/d16/d20/f117 [226967,116922] 0 2024-04-15T21:02:58.057 INFO:tasks.workunit.client.1.smithi149.stdout:7/930: readlink d3/d16/d20/d114/l3c 0 2024-04-15T21:02:58.059 INFO:tasks.workunit.client.0.smithi072.stdout:6/735: truncate d2/d10/d11/d15/fbe 267285 0 2024-04-15T21:02:58.060 INFO:tasks.workunit.client.0.smithi072.stdout:6/736: write d2/d10/f3c [2550461,23156] 0 2024-04-15T21:02:58.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/939: creat d0/d6/d82/da1/d12/d16/da9/d1b/d83/f12c x:0 0 0 2024-04-15T21:02:58.064 INFO:tasks.workunit.client.0.smithi072.stdout:7/759: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fec x:0 0 0 2024-04-15T21:02:58.066 INFO:tasks.workunit.client.1.smithi149.stdout:1/939: mkdir d1/d17/d52/d116 0 2024-04-15T21:02:58.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/814: sync 2024-04-15T21:02:58.070 INFO:tasks.workunit.client.1.smithi149.stdout:9/953: rename d23/d3c/d87/d9a/c111 to d23/d3c/d87/d9a/c13d 0 2024-04-15T21:02:58.071 INFO:tasks.workunit.client.0.smithi072.stdout:6/737: rmdir d2/d10/d18/d47/d6d 39 2024-04-15T21:02:58.074 INFO:tasks.workunit.client.1.smithi149.stdout:1/940: mkdir d1/df7/d117 0 2024-04-15T21:02:58.076 INFO:tasks.workunit.client.1.smithi149.stdout:1/941: write d1/d17/d36/d6f/da3/fd4 [863304,82084] 0 2024-04-15T21:02:58.077 INFO:tasks.workunit.client.1.smithi149.stdout:7/931: rename d3/d16/d20/d60/c69 to d3/d129/dfb/c149 0 2024-04-15T21:02:58.078 INFO:tasks.workunit.client.1.smithi149.stdout:5/940: dread d0/d6/f6f [0,4194304] 0 2024-04-15T21:02:58.079 INFO:tasks.workunit.client.1.smithi149.stdout:9/954: read d23/d3c/d87/f8a [561459,16126] 0 2024-04-15T21:02:58.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/955: dread - d23/d2b/d37/d50/d103/f12a zero size 2024-04-15T21:02:58.082 INFO:tasks.workunit.client.1.smithi149.stdout:1/942: mknod d1/d17/d52/d6c/dfd/c118 0 2024-04-15T21:02:58.085 INFO:tasks.workunit.client.1.smithi149.stdout:3/951: dwrite d1/db/d24/d4d/d63/d65/f9c [0,4194304] 0 2024-04-15T21:02:58.085 INFO:tasks.workunit.client.1.smithi149.stdout:7/932: chown d3/d16/d20/d36/fcf 5268688 1 2024-04-15T21:02:58.086 INFO:tasks.workunit.client.0.smithi072.stdout:1/748: creat d5/db/d2d/d56/d93/fee x:0 0 0 2024-04-15T21:02:58.087 INFO:tasks.workunit.client.1.smithi149.stdout:5/941: dread d0/f123 [0,4194304] 0 2024-04-15T21:02:58.090 INFO:tasks.workunit.client.0.smithi072.stdout:5/815: fsync d0/d3/d7/f3c 0 2024-04-15T21:02:58.095 INFO:tasks.workunit.client.1.smithi149.stdout:6/976: dwrite da/d18/d10/d3f/ded/f10c [0,4194304] 0 2024-04-15T21:02:58.095 INFO:tasks.workunit.client.0.smithi072.stdout:6/738: mknod d2/d10/d11/d1f/d60/d63/dd4/cde 0 2024-04-15T21:02:58.099 INFO:tasks.workunit.client.0.smithi072.stdout:8/809: dread d3/d7e/dda/fd7 [0,4194304] 0 2024-04-15T21:02:58.099 INFO:tasks.workunit.client.1.smithi149.stdout:6/977: fdatasync da/d11/dbe/dc1/d106/d137/ffd 0 2024-04-15T21:02:58.100 INFO:tasks.workunit.client.0.smithi072.stdout:7/760: creat d2/d7/d25/fed x:0 0 0 2024-04-15T21:02:58.101 INFO:tasks.workunit.client.1.smithi149.stdout:5/942: dwrite d0/d6/d82/da1/f2e [4194304,4194304] 0 2024-04-15T21:02:58.103 INFO:tasks.workunit.client.1.smithi149.stdout:9/956: mkdir d23/d2b/d37/d50/d79/d13e 0 2024-04-15T21:02:58.103 INFO:tasks.workunit.client.1.smithi149.stdout:5/943: write d0/d9/db6/f7e [373927,42938] 0 2024-04-15T21:02:58.104 INFO:tasks.workunit.client.0.smithi072.stdout:1/749: fsync d5/db/d27/f33 0 2024-04-15T21:02:58.106 INFO:tasks.workunit.client.1.smithi149.stdout:6/978: dread da/d18/d10/d3f/f12f [0,4194304] 0 2024-04-15T21:02:58.110 INFO:tasks.workunit.client.1.smithi149.stdout:7/933: creat d3/d16/d11f/f14a x:0 0 0 2024-04-15T21:02:58.111 INFO:tasks.workunit.client.0.smithi072.stdout:8/810: dwrite d3/d4/ff2 [0,4194304] 0 2024-04-15T21:02:58.111 INFO:tasks.workunit.client.0.smithi072.stdout:9/795: dwrite d4/f11 [0,4194304] 0 2024-04-15T21:02:58.114 INFO:tasks.workunit.client.1.smithi149.stdout:3/952: mkdir d1/db/d24/d8a/d12b 0 2024-04-15T21:02:58.117 INFO:tasks.workunit.client.1.smithi149.stdout:7/934: dwrite d3/d129/dfb/ffd [0,4194304] 0 2024-04-15T21:02:58.121 INFO:tasks.workunit.client.0.smithi072.stdout:6/739: dread d2/d40/dcb/f44 [0,4194304] 0 2024-04-15T21:02:58.123 INFO:tasks.workunit.client.0.smithi072.stdout:1/750: mknod d5/db/d27/d5c/dbd/cef 0 2024-04-15T21:02:58.124 INFO:tasks.workunit.client.0.smithi072.stdout:5/816: mknod d0/d3/d7/c112 0 2024-04-15T21:02:58.126 INFO:tasks.workunit.client.1.smithi149.stdout:5/944: symlink d0/d9/d6c/db4/l12d 0 2024-04-15T21:02:58.129 INFO:tasks.workunit.client.0.smithi072.stdout:8/811: creat d3/de/d1b/d44/ffe x:0 0 0 2024-04-15T21:02:58.132 INFO:tasks.workunit.client.0.smithi072.stdout:6/740: dwrite d2/d10/d11/fd6 [0,4194304] 0 2024-04-15T21:02:58.138 INFO:tasks.workunit.client.1.smithi149.stdout:5/945: dwrite d0/d6/d82/da1/d12/d16/f1d [8388608,4194304] 0 2024-04-15T21:02:58.139 INFO:tasks.workunit.client.0.smithi072.stdout:6/741: dwrite d2/d10/d11/d1f/d60/d63/fc4 [0,4194304] 0 2024-04-15T21:02:58.140 INFO:tasks.workunit.client.0.smithi072.stdout:1/751: rename d5/d31/d51 to d5/db/d2d/d56/df0 0 2024-04-15T21:02:58.140 INFO:tasks.workunit.client.0.smithi072.stdout:5/817: mknod d0/d3/d33/d85/c113 0 2024-04-15T21:02:58.154 INFO:tasks.workunit.client.0.smithi072.stdout:1/752: rename d5/db to d5/db/d27/df1 22 2024-04-15T21:02:58.155 INFO:tasks.workunit.client.1.smithi149.stdout:5/946: write d0/d6/d82/da1/d12/d16/f11f [247747,95538] 0 2024-04-15T21:02:58.159 INFO:tasks.workunit.client.1.smithi149.stdout:1/943: link d1/d17/d5e/le5 d1/db/dc/d38/d39/d43/l119 0 2024-04-15T21:02:58.159 INFO:tasks.workunit.client.1.smithi149.stdout:3/953: getdents d1/db/d40/d56/d84 0 2024-04-15T21:02:58.160 INFO:tasks.workunit.client.0.smithi072.stdout:6/742: read d2/d10/d11/d1f/f32 [6510002,88104] 0 2024-04-15T21:02:58.164 INFO:tasks.workunit.client.1.smithi149.stdout:1/944: mkdir d1/db/dc/d38/d11a 0 2024-04-15T21:02:58.165 INFO:tasks.workunit.client.0.smithi072.stdout:6/743: creat d2/d40/d56/d95/fdf x:0 0 0 2024-04-15T21:02:58.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/744: stat d2/d10/d18/fa5 0 2024-04-15T21:02:58.167 INFO:tasks.workunit.client.0.smithi072.stdout:6/745: write d2/d10/d11/d1f/d60/f61 [261746,109166] 0 2024-04-15T21:02:58.169 INFO:tasks.workunit.client.0.smithi072.stdout:6/746: write d2/d10/d11/d15/f53 [1232673,60323] 0 2024-04-15T21:02:58.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/947: dwrite d0/d6/d82/da1/d12/d16/da9/f40 [4194304,4194304] 0 2024-04-15T21:02:58.174 INFO:tasks.workunit.client.0.smithi072.stdout:6/747: creat d2/d10/d11/d1f/fe0 x:0 0 0 2024-04-15T21:02:58.175 INFO:tasks.workunit.client.1.smithi149.stdout:5/948: creat d0/d9/d115/f12e x:0 0 0 2024-04-15T21:02:58.181 INFO:tasks.workunit.client.1.smithi149.stdout:5/949: unlink d0/d9/d3f/dc7/f10e 0 2024-04-15T21:02:58.182 INFO:tasks.workunit.client.0.smithi072.stdout:7/761: write d2/d78/fbb [94437,108283] 0 2024-04-15T21:02:58.183 INFO:tasks.workunit.client.0.smithi072.stdout:7/762: chown d2/d7/d25/d72/d98/dc0 656 1 2024-04-15T21:02:58.186 INFO:tasks.workunit.client.1.smithi149.stdout:5/950: rename d0/d6/d82/da1/d12/d16/da9/f104 to d0/d9/db6/f12f 0 2024-04-15T21:02:58.190 INFO:tasks.workunit.client.1.smithi149.stdout:5/951: unlink d0/f4f 0 2024-04-15T21:02:58.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:57 smithi149 ceph-mon[36029]: pgmap v13: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 197 MiB/s wr, 392 op/s 2024-04-15T21:02:58.193 INFO:tasks.workunit.client.0.smithi072.stdout:7/763: rename d2/d7/d25/d2d/d47/d7e/fa3 to d2/d7/d25/fee 0 2024-04-15T21:02:58.195 INFO:tasks.workunit.client.0.smithi072.stdout:7/764: chown d2/d7/d25/d2d/d46/d5a/f88 1263 1 2024-04-15T21:02:58.199 INFO:tasks.workunit.client.0.smithi072.stdout:7/765: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 [0,4194304] 0 2024-04-15T21:02:58.202 INFO:tasks.workunit.client.0.smithi072.stdout:7/766: dread d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc4 [0,4194304] 0 2024-04-15T21:02:58.206 INFO:tasks.workunit.client.1.smithi149.stdout:5/952: dread d0/d6/d79/f9d [0,4194304] 0 2024-04-15T21:02:58.208 INFO:tasks.workunit.client.0.smithi072.stdout:7/767: rename d2/l30 to d2/d7/lef 0 2024-04-15T21:02:58.210 INFO:tasks.workunit.client.1.smithi149.stdout:5/953: creat d0/d6/d2d/f130 x:0 0 0 2024-04-15T21:02:58.211 INFO:tasks.workunit.client.0.smithi072.stdout:7/768: truncate d2/d7/d25/d2d/d47/d7e/f91 3351653 0 2024-04-15T21:02:58.212 INFO:tasks.workunit.client.0.smithi072.stdout:6/748: dread d2/d40/d56/d6a/fd0 [0,4194304] 0 2024-04-15T21:02:58.214 INFO:tasks.workunit.client.1.smithi149.stdout:5/954: rename d0/d6/d82/da1/d12/ff7 to d0/d6/d82/db0/f131 0 2024-04-15T21:02:58.215 INFO:tasks.workunit.client.1.smithi149.stdout:9/957: write d23/d2b/d37/d50/df1/d119/d135/dc5/fc9 [3584370,27635] 0 2024-04-15T21:02:58.219 INFO:tasks.workunit.client.1.smithi149.stdout:6/979: write da/d2e/f50 [2471628,86182] 0 2024-04-15T21:02:58.222 INFO:tasks.workunit.client.0.smithi072.stdout:6/749: unlink d2/d40/f68 0 2024-04-15T21:02:58.223 INFO:tasks.workunit.client.1.smithi149.stdout:9/958: dwrite f1f [0,4194304] 0 2024-04-15T21:02:58.223 INFO:tasks.workunit.client.0.smithi072.stdout:7/769: creat d2/d7/d25/d2d/d46/d5a/d5f/d43/db8/ff0 x:0 0 0 2024-04-15T21:02:58.234 INFO:tasks.workunit.client.1.smithi149.stdout:7/935: dwrite d3/d16/da0/f133 [0,4194304] 0 2024-04-15T21:02:58.235 INFO:tasks.workunit.client.1.smithi149.stdout:6/980: getdents da/d11/d104 0 2024-04-15T21:02:58.235 INFO:tasks.workunit.client.0.smithi072.stdout:9/796: truncate d4/d1f/d2c/d47/f5f 92282 0 2024-04-15T21:02:58.238 INFO:tasks.workunit.client.0.smithi072.stdout:7/770: dread d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 [0,4194304] 0 2024-04-15T21:02:58.241 INFO:tasks.workunit.client.1.smithi149.stdout:6/981: dread da/d18/d10/d16/f3c [8388608,4194304] 0 2024-04-15T21:02:58.242 INFO:tasks.workunit.client.1.smithi149.stdout:7/936: creat d3/d16/d11f/f14b x:0 0 0 2024-04-15T21:02:58.242 INFO:tasks.workunit.client.1.smithi149.stdout:6/982: read - da/d11/d90/f102 zero size 2024-04-15T21:02:58.243 INFO:tasks.workunit.client.0.smithi072.stdout:8/812: truncate d3/d4/f1e 2112714 0 2024-04-15T21:02:58.246 INFO:tasks.workunit.client.1.smithi149.stdout:3/954: write d1/db/d24/d39/fb9 [612833,11261] 0 2024-04-15T21:02:58.247 INFO:tasks.workunit.client.0.smithi072.stdout:9/797: dwrite d4/f6a [0,4194304] 0 2024-04-15T21:02:58.247 INFO:tasks.workunit.client.0.smithi072.stdout:7/771: truncate d2/d7/d25/d72/fc2 708636 0 2024-04-15T21:02:58.247 INFO:tasks.workunit.client.1.smithi149.stdout:7/937: mkdir d3/d16/d32/d90/dad/d14c 0 2024-04-15T21:02:58.253 INFO:tasks.workunit.client.1.smithi149.stdout:1/945: dwrite d1/d17/fc0 [0,4194304] 0 2024-04-15T21:02:58.254 INFO:tasks.workunit.client.0.smithi072.stdout:7/772: creat d2/da7/ff1 x:0 0 0 2024-04-15T21:02:58.254 INFO:tasks.workunit.client.1.smithi149.stdout:1/946: stat d1/f79 0 2024-04-15T21:02:58.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/773: stat d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 0 2024-04-15T21:02:58.256 INFO:tasks.workunit.client.0.smithi072.stdout:8/813: dwrite d3/de/d1b/d41/da4/f8e [4194304,4194304] 0 2024-04-15T21:02:58.256 INFO:tasks.workunit.client.1.smithi149.stdout:3/955: unlink d1/db/d24/d39/dc0/fdd 0 2024-04-15T21:02:58.257 INFO:tasks.workunit.client.0.smithi072.stdout:8/814: chown d3/de/d1b/d41/cec 1 1 2024-04-15T21:02:58.269 INFO:tasks.workunit.client.1.smithi149.stdout:7/938: mknod d3/d16/d20/d36/d3d/da4/d138/c14d 0 2024-04-15T21:02:58.271 INFO:tasks.workunit.client.0.smithi072.stdout:7/774: rename d2/d7/d25/d2d/d46/d5a/d5f/fde to d2/d7/d25/d81/dce/ff2 0 2024-04-15T21:02:58.272 INFO:tasks.workunit.client.1.smithi149.stdout:1/947: dread d1/d17/d52/d6c/f7a [0,4194304] 0 2024-04-15T21:02:58.272 INFO:tasks.workunit.client.0.smithi072.stdout:2/805: sync 2024-04-15T21:02:58.275 INFO:tasks.workunit.client.0.smithi072.stdout:9/798: creat d4/d29/d4c/d74/d84/df2/df4/ffb x:0 0 0 2024-04-15T21:02:58.276 INFO:tasks.workunit.client.0.smithi072.stdout:9/799: truncate d4/d29/fea 844758 0 2024-04-15T21:02:58.281 INFO:tasks.workunit.client.1.smithi149.stdout:5/955: write d0/d9/d6c/ff5 [161289,74371] 0 2024-04-15T21:02:58.283 INFO:tasks.workunit.client.1.smithi149.stdout:1/948: creat d1/db/dc/d38/d39/d43/daa/d8a/d97/f11b x:0 0 0 2024-04-15T21:02:58.285 INFO:tasks.workunit.client.0.smithi072.stdout:6/750: write d2/d42/f93 [820718,10459] 0 2024-04-15T21:02:58.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/983: getdents da/d18/d10/d3f/ded/d11b 0 2024-04-15T21:02:58.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/956: mknod d0/d6/d2d/c132 0 2024-04-15T21:02:58.291 INFO:tasks.workunit.client.0.smithi072.stdout:7/775: creat d2/d7/d25/d72/d98/de2/de4/ff3 x:0 0 0 2024-04-15T21:02:58.292 INFO:tasks.workunit.client.1.smithi149.stdout:6/984: read - da/d18/d10/d3f/fe2 zero size 2024-04-15T21:02:58.294 INFO:tasks.workunit.client.0.smithi072.stdout:8/815: dread d3/fcc [0,4194304] 0 2024-04-15T21:02:58.294 INFO:tasks.workunit.client.0.smithi072.stdout:7/776: truncate d2/d7/d25/d2d/d46/d5a/d5f/f3c 4950889 0 2024-04-15T21:02:58.295 INFO:tasks.workunit.client.1.smithi149.stdout:1/949: symlink d1/db/d16/d86/de1/d101/l11c 0 2024-04-15T21:02:58.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/959: dwrite d23/d2b/d44/d7e/f9b [0,4194304] 0 2024-04-15T21:02:58.295 INFO:tasks.workunit.client.0.smithi072.stdout:9/800: mkdir d4/d1f/d2c/de9/dfc 0 2024-04-15T21:02:58.298 INFO:tasks.workunit.client.0.smithi072.stdout:2/806: rmdir d2/d3/df1 0 2024-04-15T21:02:58.303 INFO:tasks.workunit.client.1.smithi149.stdout:9/960: dread d23/f33 [0,4194304] 0 2024-04-15T21:02:58.303 INFO:tasks.workunit.client.0.smithi072.stdout:8/816: truncate d3/de/d1b/d41/f95 835632 0 2024-04-15T21:02:58.304 INFO:tasks.workunit.client.1.smithi149.stdout:1/950: dwrite d1/db/dc/d38/fe6 [0,4194304] 0 2024-04-15T21:02:58.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/801: truncate d4/d1f/f54 3890996 0 2024-04-15T21:02:58.309 INFO:tasks.workunit.client.1.smithi149.stdout:6/985: symlink da/l13f 0 2024-04-15T21:02:58.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/802: read d4/d1f/d31/f3f [2659219,12632] 0 2024-04-15T21:02:58.318 INFO:tasks.workunit.client.1.smithi149.stdout:1/951: dwrite d1/d17/d52/d78/f115 [0,4194304] 0 2024-04-15T21:02:58.325 INFO:tasks.workunit.client.1.smithi149.stdout:6/986: mkdir da/d11/d90/d140 0 2024-04-15T21:02:58.330 INFO:tasks.workunit.client.0.smithi072.stdout:2/807: mknod d2/d66/df2/cfe 0 2024-04-15T21:02:58.330 INFO:tasks.workunit.client.0.smithi072.stdout:2/808: write d2/dd7/fe2 [103530,37836] 0 2024-04-15T21:02:58.332 INFO:tasks.workunit.client.1.smithi149.stdout:5/957: getdents d0/d6/d82/da1/d12/d16/da9/d1b/d83 0 2024-04-15T21:02:58.333 INFO:tasks.workunit.client.1.smithi149.stdout:7/939: truncate d3/d16/d32/f10b 1019293 0 2024-04-15T21:02:58.334 INFO:tasks.workunit.client.1.smithi149.stdout:6/987: read da/d18/d10/d16/f6d [2173938,107491] 0 2024-04-15T21:02:58.335 INFO:tasks.workunit.client.0.smithi072.stdout:6/751: write d2/d40/d66/d7f/dd9/f41 [3454692,9294] 0 2024-04-15T21:02:58.336 INFO:tasks.workunit.client.1.smithi149.stdout:3/956: dwrite d1/db/d40/fe8 [0,4194304] 0 2024-04-15T21:02:58.336 INFO:tasks.workunit.client.1.smithi149.stdout:1/952: chown d1/db/dc/d11/d3f/d45/cc8 336626 1 2024-04-15T21:02:58.337 INFO:tasks.workunit.client.1.smithi149.stdout:9/961: getdents d23/d2b/d37/d50/d79/d13e 0 2024-04-15T21:02:58.343 INFO:tasks.workunit.client.1.smithi149.stdout:9/962: fdatasync d23/d46/dcf/deb/d7f/d83/ff6 0 2024-04-15T21:02:58.345 INFO:tasks.workunit.client.0.smithi072.stdout:3/756: sync 2024-04-15T21:02:58.345 INFO:tasks.workunit.client.0.smithi072.stdout:0/785: sync 2024-04-15T21:02:58.347 INFO:tasks.workunit.client.0.smithi072.stdout:7/777: write d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 [767063,59215] 0 2024-04-15T21:02:58.349 INFO:tasks.workunit.client.0.smithi072.stdout:6/752: creat d2/d42/db9/fe1 x:0 0 0 2024-04-15T21:02:58.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/988: creat da/d60/d9b/f141 x:0 0 0 2024-04-15T21:02:58.351 INFO:tasks.workunit.client.1.smithi149.stdout:5/958: dwrite d0/d6/f11d [0,4194304] 0 2024-04-15T21:02:58.353 INFO:tasks.workunit.client.1.smithi149.stdout:5/959: write d0/d6/d82/da1/d12/d16/da9/f107 [492953,26939] 0 2024-04-15T21:02:58.353 INFO:tasks.workunit.client.1.smithi149.stdout:5/960: readlink d0/d6/d2d/le8 0 2024-04-15T21:02:58.353 INFO:tasks.workunit.client.0.smithi072.stdout:6/753: dread d2/d40/d66/d7f/dd9/f1b [0,4194304] 0 2024-04-15T21:02:58.364 INFO:tasks.workunit.client.0.smithi072.stdout:8/817: dwrite d3/f30 [0,4194304] 0 2024-04-15T21:02:58.364 INFO:tasks.workunit.client.0.smithi072.stdout:9/803: write d4/f1c [1722735,103159] 0 2024-04-15T21:02:58.364 INFO:tasks.workunit.client.0.smithi072.stdout:8/818: stat d3/de/d1b/l59 0 2024-04-15T21:02:58.365 INFO:tasks.workunit.client.0.smithi072.stdout:7/778: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4 0 2024-04-15T21:02:58.367 INFO:tasks.workunit.client.1.smithi149.stdout:3/957: creat d1/db/d24/d4d/d63/d65/dc3/f12c x:0 0 0 2024-04-15T21:02:58.368 INFO:tasks.workunit.client.0.smithi072.stdout:8/819: chown d3/de/d1b/d41/dae/dc0/de9 84605210 1 2024-04-15T21:02:58.371 INFO:tasks.workunit.client.0.smithi072.stdout:7/779: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc/fe6 [799076,61466] 0 2024-04-15T21:02:58.375 INFO:tasks.workunit.client.0.smithi072.stdout:9/804: dwrite d4/d29/f71 [4194304,4194304] 0 2024-04-15T21:02:58.376 INFO:tasks.workunit.client.0.smithi072.stdout:2/809: creat d2/d8/d8e/fff x:0 0 0 2024-04-15T21:02:58.377 INFO:tasks.workunit.client.0.smithi072.stdout:2/810: fsync d2/d3/d5f/f7c 0 2024-04-15T21:02:58.377 INFO:tasks.workunit.client.1.smithi149.stdout:5/961: creat d0/d6/d82/da1/d12/d2b/f133 x:0 0 0 2024-04-15T21:02:58.385 INFO:tasks.workunit.client.0.smithi072.stdout:6/754: dread d2/d40/d6e/f36 [0,4194304] 0 2024-04-15T21:02:58.385 INFO:tasks.workunit.client.0.smithi072.stdout:3/757: write d1/f8e [1558601,104664] 0 2024-04-15T21:02:58.386 INFO:tasks.workunit.client.1.smithi149.stdout:1/953: dwrite d1/d17/d52/f2a [0,4194304] 0 2024-04-15T21:02:58.387 INFO:tasks.workunit.client.1.smithi149.stdout:7/940: write d3/d16/d20/d60/f77 [1316979,15031] 0 2024-04-15T21:02:58.389 INFO:tasks.workunit.client.0.smithi072.stdout:2/811: rmdir d2/da8 39 2024-04-15T21:02:58.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/820: symlink d3/d4/d76/d8f/lff 0 2024-04-15T21:02:58.394 INFO:tasks.workunit.client.1.smithi149.stdout:1/954: creat d1/d17/d36/d6f/f11d x:0 0 0 2024-04-15T21:02:58.396 INFO:tasks.workunit.client.1.smithi149.stdout:7/941: creat d3/d17/d1f/d93/f14e x:0 0 0 2024-04-15T21:02:58.397 INFO:tasks.workunit.client.0.smithi072.stdout:3/758: mkdir d1/d3f/d4f/d73/db3/dd5/dea 0 2024-04-15T21:02:58.399 INFO:tasks.workunit.client.0.smithi072.stdout:6/755: truncate d2/d10/d18/f94 3529989 0 2024-04-15T21:02:58.401 INFO:tasks.workunit.client.1.smithi149.stdout:9/963: creat d23/d2b/d37/d6d/f13f x:0 0 0 2024-04-15T21:02:58.401 INFO:tasks.workunit.client.1.smithi149.stdout:6/989: write da/d60/f9c [1817767,42657] 0 2024-04-15T21:02:58.402 INFO:tasks.workunit.client.1.smithi149.stdout:6/990: readlink da/d18/d10/d3f/lac 0 2024-04-15T21:02:58.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/753: sync 2024-04-15T21:02:58.403 INFO:tasks.workunit.client.0.smithi072.stdout:4/778: sync 2024-04-15T21:02:58.403 INFO:tasks.workunit.client.0.smithi072.stdout:5/818: sync 2024-04-15T21:02:58.404 INFO:tasks.workunit.client.0.smithi072.stdout:6/756: dread d2/d42/f73 [0,4194304] 0 2024-04-15T21:02:58.404 INFO:tasks.workunit.client.0.smithi072.stdout:2/812: rename d2/d38/l32 to d2/dd7/l100 0 2024-04-15T21:02:58.404 INFO:tasks.workunit.client.0.smithi072.stdout:0/786: dwrite d0/d6/fa8 [0,4194304] 0 2024-04-15T21:02:58.406 INFO:tasks.workunit.client.0.smithi072.stdout:2/813: chown d2/d38/f48 0 1 2024-04-15T21:02:58.407 INFO:tasks.workunit.client.0.smithi072.stdout:0/787: fdatasync d0/d19/d2b/d63/fe9 0 2024-04-15T21:02:58.407 INFO:tasks.workunit.client.1.smithi149.stdout:7/942: dread d3/d17/fc6 [0,4194304] 0 2024-04-15T21:02:58.408 INFO:tasks.workunit.client.0.smithi072.stdout:5/819: chown d0/d3/d7/d12/d31/d62/d8e/f9e 1696 1 2024-04-15T21:02:58.408 INFO:tasks.workunit.client.0.smithi072.stdout:8/821: unlink d3/fcc 0 2024-04-15T21:02:58.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/991: dread da/d18/d33/fad [0,4194304] 0 2024-04-15T21:02:58.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/962: creat d0/d6/d82/da1/d12/f134 x:0 0 0 2024-04-15T21:02:58.411 INFO:tasks.workunit.client.1.smithi149.stdout:1/955: symlink d1/db/dc/d38/d39/d43/l11e 0 2024-04-15T21:02:58.415 INFO:tasks.workunit.client.0.smithi072.stdout:9/805: dwrite d4/d1f/d31/d9b/fa5 [0,4194304] 0 2024-04-15T21:02:58.417 INFO:tasks.workunit.client.0.smithi072.stdout:9/806: readlink d4/l41 0 2024-04-15T21:02:58.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/964: creat d23/d2b/d37/f140 x:0 0 0 2024-04-15T21:02:58.418 INFO:tasks.workunit.client.1.smithi149.stdout:1/956: chown d1/db/dc/d11/d3e/cc5 1 1 2024-04-15T21:02:58.420 INFO:tasks.workunit.client.1.smithi149.stdout:3/958: dwrite d1/db/d28/ffa [0,4194304] 0 2024-04-15T21:02:58.422 INFO:tasks.workunit.client.1.smithi149.stdout:1/957: write d1/db/dc/d11/f47 [3354215,10388] 0 2024-04-15T21:02:58.423 INFO:tasks.workunit.client.0.smithi072.stdout:6/757: creat d2/d40/dc3/fe2 x:0 0 0 2024-04-15T21:02:58.424 INFO:tasks.workunit.client.1.smithi149.stdout:6/992: dread da/d11/ff0 [0,4194304] 0 2024-04-15T21:02:58.426 INFO:tasks.workunit.client.1.smithi149.stdout:6/993: read da/d18/d10/d3f/fd9 [3835080,118949] 0 2024-04-15T21:02:58.430 INFO:tasks.workunit.client.0.smithi072.stdout:1/754: read d5/db/d2d/d56/df0/f83 [1632573,73199] 0 2024-04-15T21:02:58.430 INFO:tasks.workunit.client.0.smithi072.stdout:6/758: dwrite d2/d40/d66/d7f/dd9/f75 [4194304,4194304] 0 2024-04-15T21:02:58.431 INFO:tasks.workunit.client.0.smithi072.stdout:6/759: readlink d2/d10/d11/d1f/la6 0 2024-04-15T21:02:58.434 INFO:tasks.workunit.client.0.smithi072.stdout:1/755: dread d5/dcb/fe2 [8388608,4194304] 0 2024-04-15T21:02:58.437 INFO:tasks.workunit.client.0.smithi072.stdout:2/814: rmdir d2/dd7 39 2024-04-15T21:02:58.439 INFO:tasks.workunit.client.0.smithi072.stdout:2/815: write d2/d8/d8e/fe0 [820012,51920] 0 2024-04-15T21:02:58.440 INFO:tasks.workunit.client.0.smithi072.stdout:1/756: dread d5/db/d2d/d3a/d1f/d63/fa9 [0,4194304] 0 2024-04-15T21:02:58.442 INFO:tasks.workunit.client.0.smithi072.stdout:0/788: rmdir d0/d45/d35 39 2024-04-15T21:02:58.444 INFO:tasks.workunit.client.0.smithi072.stdout:0/789: chown d0/d45/d7a/d70/d59/d8a/d108 387488 1 2024-04-15T21:02:58.444 INFO:tasks.workunit.client.0.smithi072.stdout:0/790: dread - d0/d6/d55/fe7 zero size 2024-04-15T21:02:58.445 INFO:tasks.workunit.client.1.smithi149.stdout:5/963: dwrite d0/d6/d82/da1/d12/d16/f58 [0,4194304] 0 2024-04-15T21:02:58.448 INFO:tasks.workunit.client.0.smithi072.stdout:8/822: creat d3/d4/d3b/f100 x:0 0 0 2024-04-15T21:02:58.448 INFO:tasks.workunit.client.0.smithi072.stdout:8/823: chown d3/d4/d3b/c58 655990371 1 2024-04-15T21:02:58.449 INFO:tasks.workunit.client.0.smithi072.stdout:8/824: chown d3/de/d1b/d41/da4/f8e 54808720 1 2024-04-15T21:02:58.451 INFO:tasks.workunit.client.1.smithi149.stdout:7/943: symlink d3/d16/d32/d90/dad/d14c/l14f 0 2024-04-15T21:02:58.452 INFO:tasks.workunit.client.1.smithi149.stdout:5/964: fsync d0/d6/d82/da1/d12/f6e 0 2024-04-15T21:02:58.454 INFO:tasks.workunit.client.1.smithi149.stdout:5/965: write d0/d9/d115/f12e [371972,65444] 0 2024-04-15T21:02:58.456 INFO:tasks.workunit.client.0.smithi072.stdout:5/820: read d0/d3/d6/d14/f5b [3997387,44472] 0 2024-04-15T21:02:58.456 INFO:tasks.workunit.client.0.smithi072.stdout:5/821: chown d0/d3/d7/d1f/d4c/fbf 0 1 2024-04-15T21:02:58.458 INFO:tasks.workunit.client.0.smithi072.stdout:7/780: getdents d2/d7/d25 0 2024-04-15T21:02:58.459 INFO:tasks.workunit.client.0.smithi072.stdout:3/759: getdents d1/d3f/d7f 0 2024-04-15T21:02:58.461 INFO:tasks.workunit.client.0.smithi072.stdout:3/760: write d1/d5b/fe3 [828363,53499] 0 2024-04-15T21:02:58.463 INFO:tasks.workunit.client.0.smithi072.stdout:9/807: chown d4/d1f/d2c/f46 108 1 2024-04-15T21:02:58.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/944: unlink d3/d16/d20/d60/c10c 0 2024-04-15T21:02:58.464 INFO:tasks.workunit.client.1.smithi149.stdout:6/994: dwrite da/d18/d10/d66/f80 [8388608,4194304] 0 2024-04-15T21:02:58.465 INFO:tasks.workunit.client.0.smithi072.stdout:7/781: dread d2/d7/d25/d2d/d46/d5a/d5f/dbc/fc4 [0,4194304] 0 2024-04-15T21:02:58.466 INFO:tasks.workunit.client.1.smithi149.stdout:6/995: readlink da/d32/d136/dbf/l4a 0 2024-04-15T21:02:58.466 INFO:tasks.workunit.client.0.smithi072.stdout:4/779: dread d7/fc [4194304,4194304] 0 2024-04-15T21:02:58.467 INFO:tasks.workunit.client.1.smithi149.stdout:6/996: chown da/d18/d33/c13b 7 1 2024-04-15T21:02:58.469 INFO:tasks.workunit.client.0.smithi072.stdout:5/822: dwrite d0/d3/d7/d12/ff9 [0,4194304] 0 2024-04-15T21:02:58.472 INFO:tasks.workunit.client.1.smithi149.stdout:1/958: write d1/db/dc/d38/d39/d43/daa/d8a/d97/ff1 [468553,123745] 0 2024-04-15T21:02:58.475 INFO:tasks.workunit.client.1.smithi149.stdout:9/965: readlink d23/d2b/d37/d6d/db8/l11f 0 2024-04-15T21:02:58.476 INFO:tasks.workunit.client.1.smithi149.stdout:3/959: creat d1/f12d x:0 0 0 2024-04-15T21:02:58.476 INFO:tasks.workunit.client.0.smithi072.stdout:3/761: read d1/d15/d32/d2f/f5c [965364,131070] 0 2024-04-15T21:02:58.479 INFO:tasks.workunit.client.0.smithi072.stdout:6/760: chown d2/d10/d18/d47/d6d 200387228 1 2024-04-15T21:02:58.480 INFO:tasks.workunit.client.0.smithi072.stdout:2/816: mknod d2/d8/da2/c101 0 2024-04-15T21:02:58.482 INFO:tasks.workunit.client.1.smithi149.stdout:1/959: creat d1/db/d16/d35/f11f x:0 0 0 2024-04-15T21:02:58.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/960: chown d1/db/dc/d11/f47 369 1 2024-04-15T21:02:58.486 INFO:tasks.workunit.client.0.smithi072.stdout:0/791: fdatasync d0/d19/f98 0 2024-04-15T21:02:58.488 INFO:tasks.workunit.client.0.smithi072.stdout:0/792: chown d0/d74/l105 173 1 2024-04-15T21:02:58.488 INFO:tasks.workunit.client.0.smithi072.stdout:8/825: dread - d3/de/d1b/d41/da4/f90 zero size 2024-04-15T21:02:58.488 INFO:tasks.workunit.client.1.smithi149.stdout:5/966: dread d0/d9/f39 [0,4194304] 0 2024-04-15T21:02:58.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/826: write d3/de/d1b/d41/da4/f8b [1640022,12083] 0 2024-04-15T21:02:58.490 INFO:tasks.workunit.client.1.smithi149.stdout:9/966: creat d23/d46/dcf/deb/d7f/d83/ded/f141 x:0 0 0 2024-04-15T21:02:58.492 INFO:tasks.workunit.client.1.smithi149.stdout:1/961: dread d1/d17/fdc [0,4194304] 0 2024-04-15T21:02:58.499 INFO:tasks.workunit.client.0.smithi072.stdout:4/780: rename d7/d28/d42/da1/da2 to d7/d10/d41/d45/d93/de0/dfc 0 2024-04-15T21:02:58.499 INFO:tasks.workunit.client.1.smithi149.stdout:6/997: dread da/d18/d10/d3f/fde [0,4194304] 0 2024-04-15T21:02:58.500 INFO:tasks.workunit.client.1.smithi149.stdout:6/998: dread - da/d11/d90/f114 zero size 2024-04-15T21:02:58.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/962: creat d1/db/d16/d86/de1/d101/f120 x:0 0 0 2024-04-15T21:02:58.504 INFO:tasks.workunit.client.1.smithi149.stdout:3/960: write d1/d81/fcb [1542947,28369] 0 2024-04-15T21:02:58.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/963: chown d1/db/dc/fa4 801659 1 2024-04-15T21:02:58.506 INFO:tasks.workunit.client.1.smithi149.stdout:7/945: write d3/ff [6858715,99592] 0 2024-04-15T21:02:58.507 INFO:tasks.workunit.client.0.smithi072.stdout:2/817: symlink d2/db3/l102 0 2024-04-15T21:02:58.507 INFO:tasks.workunit.client.1.smithi149.stdout:7/946: dread - d3/d129/f122 zero size 2024-04-15T21:02:58.507 INFO:tasks.workunit.client.0.smithi072.stdout:9/808: write d4/f1b [1832321,59611] 0 2024-04-15T21:02:58.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/757: fdatasync d5/db/d2d/d56/df0/d82/fae 0 2024-04-15T21:02:58.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/967: getdents d23/d46/d12b 0 2024-04-15T21:02:58.513 INFO:tasks.workunit.client.0.smithi072.stdout:7/782: write d2/d7/d25/d2d/d47/fa0 [129926,6265] 0 2024-04-15T21:02:58.514 INFO:tasks.workunit.client.0.smithi072.stdout:0/793: fsync d0/d45/d7a/d70/d59/d8a/d8b/db8/fa 0 2024-04-15T21:02:58.515 INFO:tasks.workunit.client.0.smithi072.stdout:0/794: fsync d0/fea 0 2024-04-15T21:02:58.515 INFO:tasks.workunit.client.0.smithi072.stdout:7/783: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc 481890 1 2024-04-15T21:02:58.518 INFO:tasks.workunit.client.0.smithi072.stdout:6/761: dread d2/d10/d18/f94 [0,4194304] 0 2024-04-15T21:02:58.519 INFO:tasks.workunit.client.1.smithi149.stdout:1/964: rmdir d1/d17/d52/d92 39 2024-04-15T21:02:58.525 INFO:tasks.workunit.client.1.smithi149.stdout:5/967: rmdir d0/d6/d82/da1/d12/d2b/de0 0 2024-04-15T21:02:58.525 INFO:tasks.workunit.client.1.smithi149.stdout:6/999: dwrite da/d18/f87 [0,4194304] 0 2024-04-15T21:02:58.526 INFO:tasks.workunit.client.0.smithi072.stdout:5/823: mknod d0/d3/c114 0 2024-04-15T21:02:58.529 INFO:tasks.workunit.client.1.smithi149.stdout:7/947: rmdir d3/d16/d6e 39 2024-04-15T21:02:58.535 INFO:tasks.workunit.client.0.smithi072.stdout:2/818: creat d2/d8/d41/f103 x:0 0 0 2024-04-15T21:02:58.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/968: unlink d23/d2b/d37/f140 0 2024-04-15T21:02:58.539 INFO:tasks.workunit.client.1.smithi149.stdout:3/961: mkdir d1/db/d12e 0 2024-04-15T21:02:58.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/965: readlink d1/db/dc/d11/d3e/la1 0 2024-04-15T21:02:58.541 INFO:tasks.workunit.client.1.smithi149.stdout:1/966: write d1/d17/d36/d6f/f11d [403653,34007] 0 2024-04-15T21:02:58.542 INFO:tasks.workunit.client.0.smithi072.stdout:1/758: fdatasync d5/db/d27/d9c/fa7 0 2024-04-15T21:02:58.543 INFO:tasks.workunit.client.0.smithi072.stdout:1/759: readlink d5/db/d2d/d3a/l2c 0 2024-04-15T21:02:58.543 INFO:tasks.workunit.client.1.smithi149.stdout:7/948: fsync d3/d16/d20/d36/fbd 0 2024-04-15T21:02:58.547 INFO:tasks.workunit.client.0.smithi072.stdout:7/784: stat d2/d7/d25/d4c/f59 0 2024-04-15T21:02:58.550 INFO:tasks.workunit.client.0.smithi072.stdout:0/795: mkdir d0/d19/d96/dad/d109 0 2024-04-15T21:02:58.554 INFO:tasks.workunit.client.0.smithi072.stdout:6/762: creat d2/d40/d56/d95/fe3 x:0 0 0 2024-04-15T21:02:58.555 INFO:tasks.workunit.client.1.smithi149.stdout:7/949: unlink d3/d16/d20/d60/ff5 0 2024-04-15T21:02:58.556 INFO:tasks.workunit.client.0.smithi072.stdout:4/781: dread d7/d15/d58/f77 [0,4194304] 0 2024-04-15T21:02:58.556 INFO:tasks.workunit.client.1.smithi149.stdout:7/950: stat d3/d16/d32/d90/de5 0 2024-04-15T21:02:58.557 INFO:tasks.workunit.client.0.smithi072.stdout:9/809: dread d4/d29/d4c/d74/f9c [0,4194304] 0 2024-04-15T21:02:58.558 INFO:tasks.workunit.client.1.smithi149.stdout:7/951: read d3/d17/d1f/f8e [657713,119584] 0 2024-04-15T21:02:58.559 INFO:tasks.workunit.client.0.smithi072.stdout:5/824: rename d0/d3/d33/d60/fb3 to d0/d3/d7/d12/d31/d55/d93/f115 0 2024-04-15T21:02:58.559 INFO:tasks.workunit.client.0.smithi072.stdout:3/762: creat d1/d15/feb x:0 0 0 2024-04-15T21:02:58.561 INFO:tasks.workunit.client.1.smithi149.stdout:9/969: creat d23/d46/dcf/deb/f142 x:0 0 0 2024-04-15T21:02:58.563 INFO:tasks.workunit.client.1.smithi149.stdout:1/967: rmdir d1/db/dc/d11/d3f/d45/dea 0 2024-04-15T21:02:58.564 INFO:tasks.workunit.client.1.smithi149.stdout:1/968: truncate d1/d17/d5e/feb 1600261 0 2024-04-15T21:02:58.565 INFO:tasks.workunit.client.1.smithi149.stdout:3/962: getdents d1/db/d40/d56/d84/d85 0 2024-04-15T21:02:58.566 INFO:tasks.workunit.client.1.smithi149.stdout:9/970: symlink d23/d3c/d87/l143 0 2024-04-15T21:02:58.567 INFO:tasks.workunit.client.0.smithi072.stdout:0/796: creat d0/d6/d6d/dcc/f10a x:0 0 0 2024-04-15T21:02:58.568 INFO:tasks.workunit.client.0.smithi072.stdout:0/797: readlink d0/d19/d71/de6/lf9 0 2024-04-15T21:02:58.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/969: unlink d1/db/dc/d38/fe6 0 2024-04-15T21:02:58.570 INFO:tasks.workunit.client.1.smithi149.stdout:3/963: fdatasync d1/db/d24/d4d/f9d 0 2024-04-15T21:02:58.570 INFO:tasks.workunit.client.0.smithi072.stdout:7/785: dread d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:02:58.571 INFO:tasks.workunit.client.1.smithi149.stdout:3/964: chown d1/db/d40/d56 4656474 1 2024-04-15T21:02:58.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/971: creat d23/d2b/d37/d50/df1/d119/d135/dc5/f144 x:0 0 0 2024-04-15T21:02:58.574 INFO:tasks.workunit.client.1.smithi149.stdout:1/970: unlink d1/db/dc/d11/d3f/d45/c60 0 2024-04-15T21:02:58.576 INFO:tasks.workunit.client.0.smithi072.stdout:9/810: chown d4/d29/d45/ddc/ddd/fe1 127876036 1 2024-04-15T21:02:58.576 INFO:tasks.workunit.client.0.smithi072.stdout:7/786: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 [0,4194304] 0 2024-04-15T21:02:58.577 INFO:tasks.workunit.client.0.smithi072.stdout:7/787: chown d2/d7/d25/d72/d98/de2 214 1 2024-04-15T21:02:58.580 INFO:tasks.workunit.client.1.smithi149.stdout:3/965: unlink d1/db/d24/d2b/f2e 0 2024-04-15T21:02:58.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/972: dwrite d23/d46/dcf/deb/f142 [0,4194304] 0 2024-04-15T21:02:58.582 INFO:tasks.workunit.client.0.smithi072.stdout:3/763: creat d1/d15/d32/d2f/fec x:0 0 0 2024-04-15T21:02:58.594 INFO:tasks.workunit.client.0.smithi072.stdout:1/760: unlink d5/db/d2d/d3a/f13 0 2024-04-15T21:02:58.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/763: mknod d2/d40/ce4 0 2024-04-15T21:02:58.596 INFO:tasks.workunit.client.0.smithi072.stdout:1/761: truncate d5/db/d2d/d56/fd9 161560 0 2024-04-15T21:02:58.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/966: dwrite d1/f12d [0,4194304] 0 2024-04-15T21:02:58.600 INFO:tasks.workunit.client.0.smithi072.stdout:0/798: rename d0/d45/d7a/d70/caf to d0/d45/d7a/d70/d59/c10b 0 2024-04-15T21:02:58.604 INFO:tasks.workunit.client.0.smithi072.stdout:8/827: getdents d3/d4/d76 0 2024-04-15T21:02:58.610 INFO:tasks.workunit.client.0.smithi072.stdout:9/811: dread d4/d1f/d2c/d47/f79 [0,4194304] 0 2024-04-15T21:02:58.613 INFO:tasks.workunit.client.1.smithi149.stdout:3/967: mkdir d1/db/d24/d39/d79/d97/daf/d106/d12f 0 2024-04-15T21:02:58.614 INFO:tasks.workunit.client.0.smithi072.stdout:4/782: creat d7/d28/db1/ffd x:0 0 0 2024-04-15T21:02:58.618 INFO:tasks.workunit.client.1.smithi149.stdout:1/971: rename d1/db/dc/d11/c22 to d1/db/d14/c121 0 2024-04-15T21:02:58.625 INFO:tasks.workunit.client.0.smithi072.stdout:3/764: mkdir d1/d15/d32/d78/ded 0 2024-04-15T21:02:58.629 INFO:tasks.workunit.client.1.smithi149.stdout:1/972: dread d1/db/dc/d38/d39/d43/f1f [0,4194304] 0 2024-04-15T21:02:58.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/973: write d23/d2b/d70/fae [27529,101845] 0 2024-04-15T21:02:58.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/974: read - d23/d3c/d7a/f11b zero size 2024-04-15T21:02:58.634 INFO:tasks.workunit.client.0.smithi072.stdout:9/812: rename d4/d29/d4c/d91/ceb to d4/d76/d8f/cfd 0 2024-04-15T21:02:58.635 INFO:tasks.workunit.client.0.smithi072.stdout:4/783: symlink d7/d28/d42/da1/lfe 0 2024-04-15T21:02:58.635 INFO:tasks.workunit.client.1.smithi149.stdout:1/973: dread d1/db/dc/d38/d39/d43/f1f [0,4194304] 0 2024-04-15T21:02:58.636 INFO:tasks.workunit.client.1.smithi149.stdout:1/974: readlink d1/d17/d36/d6f/d70/l93 0 2024-04-15T21:02:58.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/975: stat d1/f5 0 2024-04-15T21:02:58.637 INFO:tasks.workunit.client.0.smithi072.stdout:2/819: link d2/d66/d69/c81 d2/d8/daa/c104 0 2024-04-15T21:02:58.639 INFO:tasks.workunit.client.0.smithi072.stdout:9/813: dwrite d4/f6a [0,4194304] 0 2024-04-15T21:02:58.639 INFO:tasks.workunit.client.0.smithi072.stdout:7/788: getdents d2/d7/d25/d2d/d46/d5a/d5f/d26 0 2024-04-15T21:02:58.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/968: write d1/db/d28/d87/dbd/f6d [4853404,23963] 0 2024-04-15T21:02:58.646 INFO:tasks.workunit.client.0.smithi072.stdout:8/828: write d3/de/d1b/d44/f78 [1151146,106422] 0 2024-04-15T21:02:58.646 INFO:tasks.workunit.client.1.smithi149.stdout:3/969: fdatasync d1/db/d24/d4d/d63/fd3 0 2024-04-15T21:02:58.647 INFO:tasks.workunit.client.1.smithi149.stdout:1/976: creat d1/db/dc/d38/d39/d43/f122 x:0 0 0 2024-04-15T21:02:58.649 INFO:tasks.workunit.client.1.smithi149.stdout:1/977: write d1/d17/d36/d6f/f11d [927057,106068] 0 2024-04-15T21:02:58.650 INFO:tasks.workunit.client.0.smithi072.stdout:0/799: dwrite d0/d6/feb [0,4194304] 0 2024-04-15T21:02:58.651 INFO:tasks.workunit.client.0.smithi072.stdout:4/784: symlink d7/d10/lff 0 2024-04-15T21:02:58.652 INFO:tasks.workunit.client.0.smithi072.stdout:4/785: truncate d7/d28/f40 4966456 0 2024-04-15T21:02:58.654 INFO:tasks.workunit.client.0.smithi072.stdout:7/789: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/lf5 0 2024-04-15T21:02:58.659 INFO:tasks.workunit.client.1.smithi149.stdout:3/970: mkdir d1/db/d24/d4d/d63/d130 0 2024-04-15T21:02:58.661 INFO:tasks.workunit.client.0.smithi072.stdout:6/764: creat d2/d10/fe5 x:0 0 0 2024-04-15T21:02:58.662 INFO:tasks.workunit.client.1.smithi149.stdout:1/978: mknod d1/df7/d117/c123 0 2024-04-15T21:02:58.663 INFO:tasks.workunit.client.1.smithi149.stdout:9/975: truncate f1b 1033938 0 2024-04-15T21:02:58.665 INFO:tasks.workunit.client.0.smithi072.stdout:3/765: rename d1/f28 to d1/d3f/d4f/d73/fee 0 2024-04-15T21:02:58.666 INFO:tasks.workunit.client.0.smithi072.stdout:3/766: fsync d1/d26/fab 0 2024-04-15T21:02:58.666 INFO:tasks.workunit.client.1.smithi149.stdout:3/971: fsync d1/db/d28/de7/ffb 0 2024-04-15T21:02:58.667 INFO:tasks.workunit.client.0.smithi072.stdout:8/829: mkdir d3/de/d1b/d85/d101 0 2024-04-15T21:02:58.668 INFO:tasks.workunit.client.1.smithi149.stdout:3/972: write d1/db/d28/d87/dbd/f6d [186955,110675] 0 2024-04-15T21:02:58.668 INFO:tasks.workunit.client.1.smithi149.stdout:1/979: symlink d1/db/d16/d86/de1/d101/l124 0 2024-04-15T21:02:58.670 INFO:tasks.workunit.client.0.smithi072.stdout:0/800: fdatasync d0/d45/f26 0 2024-04-15T21:02:58.670 INFO:tasks.workunit.client.1.smithi149.stdout:3/973: write d1/db/d24/f7d [2327144,87840] 0 2024-04-15T21:02:58.671 INFO:tasks.workunit.client.1.smithi149.stdout:3/974: readlink d1/db/d24/d4d/d63/d65/l104 0 2024-04-15T21:02:58.671 INFO:tasks.workunit.client.0.smithi072.stdout:9/814: mknod d4/d76/d8f/dbe/de4/cfe 0 2024-04-15T21:02:58.675 INFO:tasks.workunit.client.0.smithi072.stdout:6/765: creat d2/d10/d11/d1f/fe6 x:0 0 0 2024-04-15T21:02:58.681 INFO:tasks.workunit.client.1.smithi149.stdout:3/975: rmdir d1/db/d24/d39/dc0/d11b 39 2024-04-15T21:02:58.683 INFO:tasks.workunit.client.0.smithi072.stdout:8/830: unlink d3/de/d1b/d41/dae/dc0/de9/fee 0 2024-04-15T21:02:58.686 INFO:tasks.workunit.client.1.smithi149.stdout:3/976: creat d1/db/d24/d39/d79/d97/f131 x:0 0 0 2024-04-15T21:02:58.687 INFO:tasks.workunit.client.0.smithi072.stdout:2/820: dread d2/d66/fb0 [0,4194304] 0 2024-04-15T21:02:58.688 INFO:tasks.workunit.client.1.smithi149.stdout:9/976: dread d23/d2b/d37/d50/d110/f10d [0,4194304] 0 2024-04-15T21:02:58.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/977: write d23/d2b/d37/d50/d110/fd8 [5021987,6600] 0 2024-04-15T21:02:58.691 INFO:tasks.workunit.client.0.smithi072.stdout:0/801: creat d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f10c x:0 0 0 2024-04-15T21:02:58.692 INFO:tasks.workunit.client.0.smithi072.stdout:0/802: write d0/d19/d2b/d63/fe2 [791628,96177] 0 2024-04-15T21:02:58.692 INFO:tasks.workunit.client.0.smithi072.stdout:0/803: chown d0/d19/d96 522333 1 2024-04-15T21:02:58.696 INFO:tasks.workunit.client.1.smithi149.stdout:9/978: creat d23/d2b/d37/d50/df1/d119/d135/dc5/f145 x:0 0 0 2024-04-15T21:02:58.696 INFO:tasks.workunit.client.1.smithi149.stdout:9/979: chown f1d 84905172 1 2024-04-15T21:02:58.697 INFO:tasks.workunit.client.0.smithi072.stdout:8/831: unlink d3/l84 0 2024-04-15T21:02:58.698 INFO:tasks.workunit.client.0.smithi072.stdout:3/767: dread d1/d15/f98 [0,4194304] 0 2024-04-15T21:02:58.698 INFO:tasks.workunit.client.0.smithi072.stdout:7/790: write d2/d7/d25/f42 [918525,62574] 0 2024-04-15T21:02:58.698 INFO:tasks.workunit.client.0.smithi072.stdout:3/768: chown d1/cdb 13826987 1 2024-04-15T21:02:58.700 INFO:tasks.workunit.client.0.smithi072.stdout:3/769: chown d1/d15/d40/d9e/fba 5032 1 2024-04-15T21:02:58.701 INFO:tasks.workunit.client.1.smithi149.stdout:3/977: link d1/db/d23/f12a d1/db/d28/f132 0 2024-04-15T21:02:58.702 INFO:tasks.workunit.client.0.smithi072.stdout:9/815: creat d4/d1f/d31/d4d/df7/fff x:0 0 0 2024-04-15T21:02:58.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/980: dwrite d1/db/f65 [0,4194304] 0 2024-04-15T21:02:58.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/980: mkdir d23/d46/dcf/deb/d7f/d146 0 2024-04-15T21:02:58.709 INFO:tasks.workunit.client.0.smithi072.stdout:4/786: truncate d7/d24/f1e 1483800 0 2024-04-15T21:02:58.714 INFO:tasks.workunit.client.1.smithi149.stdout:9/981: read d23/d2b/d44/d7e/fcc [236905,121496] 0 2024-04-15T21:02:58.717 INFO:tasks.workunit.client.1.smithi149.stdout:1/981: fsync d1/d17/d52/f84 0 2024-04-15T21:02:58.718 INFO:tasks.workunit.client.1.smithi149.stdout:1/982: chown d1/l80 22607 1 2024-04-15T21:02:58.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/982: dwrite d23/d3c/d7a/f11b [0,4194304] 0 2024-04-15T21:02:58.729 INFO:tasks.workunit.client.1.smithi149.stdout:1/983: dwrite d1/d17/d52/f2a [4194304,4194304] 0 2024-04-15T21:02:58.733 INFO:tasks.workunit.client.1.smithi149.stdout:3/978: dwrite d1/db/d24/d39/f70 [0,4194304] 0 2024-04-15T21:02:58.739 INFO:tasks.workunit.client.0.smithi072.stdout:4/787: dread - d7/d10/d41/dcf/ffb zero size 2024-04-15T21:02:58.739 INFO:tasks.workunit.client.0.smithi072.stdout:6/766: symlink d2/d10/le7 0 2024-04-15T21:02:58.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/816: creat d4/d1f/db7/f100 x:0 0 0 2024-04-15T21:02:58.741 INFO:tasks.workunit.client.0.smithi072.stdout:0/804: dread d0/d45/d35/d3a/f47 [0,4194304] 0 2024-04-15T21:02:58.745 INFO:tasks.workunit.client.0.smithi072.stdout:4/788: dwrite d7/d10/d41/d44/d7a/ff1 [4194304,4194304] 0 2024-04-15T21:02:58.747 INFO:tasks.workunit.client.0.smithi072.stdout:7/791: getdents d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4 0 2024-04-15T21:02:58.748 INFO:tasks.workunit.client.1.smithi149.stdout:1/984: dwrite d1/db/d16/d35/f114 [0,4194304] 0 2024-04-15T21:02:58.749 INFO:tasks.workunit.client.1.smithi149.stdout:9/983: chown d23/d2b/d37/d6d/de3/l123 400204541 1 2024-04-15T21:02:58.754 INFO:tasks.workunit.client.0.smithi072.stdout:4/789: dwrite d7/d10/d41/d45/d93/de0/dfc/fa5 [0,4194304] 0 2024-04-15T21:02:58.760 INFO:tasks.workunit.client.0.smithi072.stdout:6/767: mknod d2/d40/d66/d7f/dd9/ce8 0 2024-04-15T21:02:58.764 INFO:tasks.workunit.client.0.smithi072.stdout:2/821: link d2/d37/l4e d2/d66/d69/l105 0 2024-04-15T21:02:58.765 INFO:tasks.workunit.client.1.smithi149.stdout:1/985: truncate d1/db/d14/d6b/f6d 1007620 0 2024-04-15T21:02:58.766 INFO:tasks.workunit.client.0.smithi072.stdout:0/805: symlink d0/d45/d7a/d70/dce/l10d 0 2024-04-15T21:02:58.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/984: rename d23/d46 to d23/d46/dcf/deb/d7f/d147 22 2024-04-15T21:02:58.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/986: unlink d1/db/dc/d11/d3e/la1 0 2024-04-15T21:02:58.771 INFO:tasks.workunit.client.0.smithi072.stdout:7/792: creat d2/d78/ff6 x:0 0 0 2024-04-15T21:02:58.772 INFO:tasks.workunit.client.0.smithi072.stdout:4/790: dread - d7/d15/ddd/df7/d76/d8b/fd7 zero size 2024-04-15T21:02:58.776 INFO:tasks.workunit.client.1.smithi149.stdout:1/987: rename d1/d17/d36/d6f/da3/cd3 to d1/db/dc/d38/d39/c125 0 2024-04-15T21:02:58.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/768: creat d2/d40/d66/d7f/dd9/fe9 x:0 0 0 2024-04-15T21:02:58.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/769: write d2/d10/d11/d15/fd8 [254933,37092] 0 2024-04-15T21:02:58.779 INFO:tasks.workunit.client.0.smithi072.stdout:9/817: mknod d4/d29/d45/c101 0 2024-04-15T21:02:58.780 INFO:tasks.workunit.client.1.smithi149.stdout:1/988: creat d1/d17/d36/d6f/f126 x:0 0 0 2024-04-15T21:02:58.782 INFO:tasks.workunit.client.0.smithi072.stdout:2/822: mknod d2/da1/c106 0 2024-04-15T21:02:58.783 INFO:tasks.workunit.client.0.smithi072.stdout:0/806: creat d0/d45/d35/f10e x:0 0 0 2024-04-15T21:02:58.784 INFO:tasks.workunit.client.0.smithi072.stdout:3/770: truncate d1/d15/f31 2437664 0 2024-04-15T21:02:58.786 INFO:tasks.workunit.client.0.smithi072.stdout:7/793: symlink d2/d7/d25/d2d/d46/d5a/d5f/d43/lf7 0 2024-04-15T21:02:58.786 INFO:tasks.workunit.client.0.smithi072.stdout:7/794: stat d2/d7/d25/d81 0 2024-04-15T21:02:58.787 INFO:tasks.workunit.client.0.smithi072.stdout:6/770: rmdir d2/d40/d66/d7f 39 2024-04-15T21:02:58.787 INFO:tasks.workunit.client.0.smithi072.stdout:7/795: fsync d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab 0 2024-04-15T21:02:58.789 INFO:tasks.workunit.client.1.smithi149.stdout:1/989: getdents d1/d17/d36/d6f/d70 0 2024-04-15T21:02:58.790 INFO:tasks.workunit.client.1.smithi149.stdout:1/990: write d1/d17/d36/d6f/d70/fff [871425,101234] 0 2024-04-15T21:02:58.792 INFO:tasks.workunit.client.0.smithi072.stdout:3/771: symlink d1/d15/d40/d9e/dc7/lef 0 2024-04-15T21:02:58.792 INFO:tasks.workunit.client.0.smithi072.stdout:4/791: truncate d7/d23/f29 388904 0 2024-04-15T21:02:58.793 INFO:tasks.workunit.client.0.smithi072.stdout:4/792: chown d7/f12 91873 1 2024-04-15T21:02:58.798 INFO:tasks.workunit.client.0.smithi072.stdout:2/823: symlink d2/d8/df3/l107 0 2024-04-15T21:02:58.800 INFO:tasks.workunit.client.1.smithi149.stdout:3/979: truncate d1/db/d24/d4d/f111 98700 0 2024-04-15T21:02:58.802 INFO:tasks.workunit.client.1.smithi149.stdout:3/980: write d1/db/d24/d2b/f50 [1888327,110419] 0 2024-04-15T21:02:58.802 INFO:tasks.workunit.client.1.smithi149.stdout:9/985: write d23/f47 [2843401,52636] 0 2024-04-15T21:02:58.808 INFO:tasks.workunit.client.0.smithi072.stdout:4/793: dwrite d7/f4f [0,4194304] 0 2024-04-15T21:02:58.808 INFO:tasks.workunit.client.0.smithi072.stdout:4/794: stat d7/d28/d42/cbb 0 2024-04-15T21:02:58.810 INFO:tasks.workunit.client.0.smithi072.stdout:2/824: creat d2/d64/dce/f108 x:0 0 0 2024-04-15T21:02:58.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/825: sync 2024-04-15T21:02:58.815 INFO:tasks.workunit.client.0.smithi072.stdout:1/762: sync 2024-04-15T21:02:58.815 INFO:tasks.workunit.client.0.smithi072.stdout:7/796: rename d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/cda to d2/d7/d25/d72/d98/de2/de4/cf8 0 2024-04-15T21:02:58.819 INFO:tasks.workunit.client.0.smithi072.stdout:0/807: write d0/d45/f1d [4303602,89994] 0 2024-04-15T21:02:58.821 INFO:tasks.workunit.client.0.smithi072.stdout:9/818: dwrite d4/d29/d4c/d74/f7f [0,4194304] 0 2024-04-15T21:02:58.824 INFO:tasks.workunit.client.0.smithi072.stdout:0/808: dread d0/d6/d6d/f83 [0,4194304] 0 2024-04-15T21:02:58.825 INFO:tasks.workunit.client.0.smithi072.stdout:0/809: readlink d0/d6/lcb 0 2024-04-15T21:02:58.825 INFO:tasks.workunit.client.0.smithi072.stdout:0/810: chown d0/d45 5 1 2024-04-15T21:02:58.827 INFO:tasks.workunit.client.1.smithi149.stdout:1/991: write d1/fb3 [2299619,37869] 0 2024-04-15T21:02:58.840 INFO:tasks.workunit.client.0.smithi072.stdout:1/763: symlink d5/db/d27/d9c/lf2 0 2024-04-15T21:02:58.842 INFO:tasks.workunit.client.0.smithi072.stdout:5/826: dread d0/d3/d7/d1f/f29 [0,4194304] 0 2024-04-15T21:02:58.844 INFO:tasks.workunit.client.0.smithi072.stdout:7/797: unlink d2/d7/d25/d2d/d46/fc5 0 2024-04-15T21:02:58.849 INFO:tasks.workunit.client.0.smithi072.stdout:9/819: mkdir d4/d1f/db7/d102 0 2024-04-15T21:02:58.851 INFO:tasks.workunit.client.0.smithi072.stdout:3/772: truncate d1/d15/d32/d78/fa5 1957421 0 2024-04-15T21:02:58.852 INFO:tasks.workunit.client.0.smithi072.stdout:3/773: dread - d1/d3f/d4f/da3/fe2 zero size 2024-04-15T21:02:58.860 INFO:tasks.workunit.client.0.smithi072.stdout:3/774: dwrite d1/d26/f47 [0,4194304] 0 2024-04-15T21:02:58.861 INFO:tasks.workunit.client.0.smithi072.stdout:1/764: truncate d5/db/d2d/d56/df0/d82/fae 603059 0 2024-04-15T21:02:58.865 INFO:tasks.workunit.client.0.smithi072.stdout:7/798: fsync d2/d7/d25/d2d/d46/d5a/d5f/f11 0 2024-04-15T21:02:58.867 INFO:tasks.workunit.client.0.smithi072.stdout:6/771: dwrite d2/d40/d66/d7f/dd9/f55 [0,4194304] 0 2024-04-15T21:02:58.868 INFO:tasks.workunit.client.0.smithi072.stdout:5/827: dread d0/d3/d7/d1f/f40 [0,4194304] 0 2024-04-15T21:02:58.873 INFO:tasks.workunit.client.0.smithi072.stdout:3/775: dwrite d1/fce [0,4194304] 0 2024-04-15T21:02:58.878 INFO:tasks.workunit.client.0.smithi072.stdout:0/811: dread d0/d19/d2b/f2e [0,4194304] 0 2024-04-15T21:02:58.890 INFO:tasks.workunit.client.0.smithi072.stdout:5/828: creat d0/d3/d7/d94/f116 x:0 0 0 2024-04-15T21:02:58.890 INFO:tasks.workunit.client.0.smithi072.stdout:4/795: write d7/d10/d41/d44/d7a/ff9 [1692906,61819] 0 2024-04-15T21:02:58.891 INFO:tasks.workunit.client.0.smithi072.stdout:5/829: chown d0/d3/d7/d12/f51 462297 1 2024-04-15T21:02:58.891 INFO:tasks.workunit.client.0.smithi072.stdout:5/830: chown d0/d3 454517 1 2024-04-15T21:02:58.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/772: rmdir d2/d40/dcb/d49 39 2024-04-15T21:02:58.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/773: readlink d2/d10/d18/l7e 0 2024-04-15T21:02:58.898 INFO:tasks.workunit.client.0.smithi072.stdout:5/831: dwrite d0/d3/d7/d12/d31/d62/db6/fd2 [0,4194304] 0 2024-04-15T21:02:58.900 INFO:tasks.workunit.client.0.smithi072.stdout:2/825: rename d2/d8/d8e/cd0 to d2/c109 0 2024-04-15T21:02:58.902 INFO:tasks.workunit.client.0.smithi072.stdout:0/812: creat d0/d45/d7a/d70/d59/d8a/d108/f10f x:0 0 0 2024-04-15T21:02:58.904 INFO:tasks.workunit.client.0.smithi072.stdout:1/765: symlink d5/db/d27/lf3 0 2024-04-15T21:02:58.905 INFO:tasks.workunit.client.0.smithi072.stdout:1/766: chown d5/db/d2d/d3a/d1f/d63/f68 403 1 2024-04-15T21:02:58.909 INFO:tasks.workunit.client.0.smithi072.stdout:7/799: mkdir d2/d7/d25/d2d/d46/df9 0 2024-04-15T21:02:58.910 INFO:tasks.workunit.client.0.smithi072.stdout:7/800: chown d2/d7/d25/d2d/d46/fc8 6214964 1 2024-04-15T21:02:58.912 INFO:tasks.workunit.client.0.smithi072.stdout:4/796: creat d7/d28/d42/d8c/f100 x:0 0 0 2024-04-15T21:02:58.921 INFO:tasks.workunit.client.0.smithi072.stdout:2/826: creat d2/d66/d69/f10a x:0 0 0 2024-04-15T21:02:58.921 INFO:tasks.workunit.client.0.smithi072.stdout:2/827: dread - d2/ffb zero size 2024-04-15T21:02:58.926 INFO:tasks.workunit.client.0.smithi072.stdout:1/767: creat d5/db/d2d/d56/df0/d82/ff4 x:0 0 0 2024-04-15T21:02:58.927 INFO:tasks.workunit.client.0.smithi072.stdout:1/768: chown d5/db/d2d/d3a/dc3/dd3 245477 1 2024-04-15T21:02:58.929 INFO:tasks.workunit.client.0.smithi072.stdout:7/801: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa 0 2024-04-15T21:02:58.931 INFO:tasks.workunit.client.0.smithi072.stdout:4/797: fdatasync d7/d10/f11 0 2024-04-15T21:02:58.932 INFO:tasks.workunit.client.1.smithi149.stdout:9/986: symlink d23/d2b/d37/d50/l148 0 2024-04-15T21:02:58.935 INFO:tasks.workunit.client.1.smithi149.stdout:3/981: truncate d1/db/d40/d56/fdc 996030 0 2024-04-15T21:02:58.936 INFO:tasks.workunit.client.0.smithi072.stdout:5/832: fdatasync d0/d3/d7/d12/d31/d55/d93/f115 0 2024-04-15T21:02:58.938 INFO:tasks.workunit.client.1.smithi149.stdout:1/992: unlink d1/db/dc/d11/d3f/d45/dae/f10f 0 2024-04-15T21:02:58.941 INFO:tasks.workunit.client.0.smithi072.stdout:2/828: creat d2/d38/d73/f10b x:0 0 0 2024-04-15T21:02:58.941 INFO:tasks.workunit.client.0.smithi072.stdout:2/829: write d2/f44 [3412373,72016] 0 2024-04-15T21:02:58.945 INFO:tasks.workunit.client.1.smithi149.stdout:3/982: truncate d1/db/d40/da0/dd1/ff1 48882 0 2024-04-15T21:02:58.947 INFO:tasks.workunit.client.0.smithi072.stdout:8/832: sync 2024-04-15T21:02:58.949 INFO:tasks.workunit.client.1.smithi149.stdout:1/993: creat d1/d17/d36/f127 x:0 0 0 2024-04-15T21:02:58.951 INFO:tasks.workunit.client.1.smithi149.stdout:9/987: mkdir d23/d2b/d149 0 2024-04-15T21:02:58.957 INFO:tasks.workunit.client.1.smithi149.stdout:9/988: dwrite d23/d2b/d37/d50/df1/d119/d135/dc5/fc9 [0,4194304] 0 2024-04-15T21:02:58.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/989: dread - d23/d2b/d37/d50/d103/f12a zero size 2024-04-15T21:02:59.024 INFO:tasks.workunit.client.0.smithi072.stdout:9/820: sync 2024-04-15T21:02:59.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/776: getdents d1/d15/d32/d2f 0 2024-04-15T21:02:59.050 INFO:tasks.workunit.client.1.smithi149.stdout:1/994: rename d1/db/d16/d86/lab to d1/db/dc/d38/d39/d88/l128 0 2024-04-15T21:02:59.051 INFO:tasks.workunit.client.0.smithi072.stdout:5/833: mkdir d0/d117 0 2024-04-15T21:02:59.061 INFO:tasks.workunit.client.0.smithi072.stdout:3/777: dread d1/d5b/f97 [0,4194304] 0 2024-04-15T21:02:59.062 INFO:tasks.workunit.client.0.smithi072.stdout:3/778: write d1/d15/d32/d2f/f3a [1004936,37778] 0 2024-04-15T21:02:59.066 INFO:tasks.workunit.client.0.smithi072.stdout:6/774: sync 2024-04-15T21:02:59.067 INFO:tasks.workunit.client.0.smithi072.stdout:3/779: dwrite d1/d3f/d4f/d73/fd9 [0,4194304] 0 2024-04-15T21:02:59.121 INFO:tasks.workunit.client.0.smithi072.stdout:0/813: link d0/d45/d35/d3a/fc3 d0/d74/f110 0 2024-04-15T21:02:59.122 INFO:tasks.workunit.client.0.smithi072.stdout:1/769: mkdir d5/df5 0 2024-04-15T21:02:59.124 INFO:tasks.workunit.client.1.smithi149.stdout:1/995: symlink d1/df7/dfc/l129 0 2024-04-15T21:02:59.126 INFO:tasks.workunit.client.0.smithi072.stdout:8/833: truncate d3/de/d1b/f62 4249851 0 2024-04-15T21:02:59.126 INFO:tasks.workunit.client.1.smithi149.stdout:1/996: symlink d1/d17/d5e/l12a 0 2024-04-15T21:02:59.127 INFO:tasks.workunit.client.1.smithi149.stdout:1/997: chown d1/d17/d36/d6f/fb0 2216943 1 2024-04-15T21:02:59.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/798: dwrite d7/d15/d58/f7b [0,4194304] 0 2024-04-15T21:02:59.138 INFO:tasks.workunit.client.1.smithi149.stdout:1/998: link d1/db/dc/d38/d39/d43/daa/d8a/d97/ff1 d1/d17/d52/f12b 0 2024-04-15T21:02:59.143 INFO:tasks.workunit.client.1.smithi149.stdout:1/999: symlink d1/d17/d52/d78/l12c 0 2024-04-15T21:02:59.157 INFO:tasks.workunit.client.0.smithi072.stdout:5/834: creat d0/d3/d7/d12/d31/d62/f118 x:0 0 0 2024-04-15T21:02:59.167 INFO:tasks.workunit.client.0.smithi072.stdout:4/799: mknod d7/d10/d41/d45/d93/de0/c101 0 2024-04-15T21:02:59.168 INFO:tasks.workunit.client.0.smithi072.stdout:4/800: truncate d7/d10/d41/d45/d93/de0/dfc/fa5 4957084 0 2024-04-15T21:02:59.171 INFO:tasks.workunit.client.0.smithi072.stdout:2/830: creat d2/d8/f10c x:0 0 0 2024-04-15T21:02:59.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/802: getdents d2/da7 0 2024-04-15T21:02:59.175 INFO:tasks.workunit.client.0.smithi072.stdout:4/801: rmdir d7/d10/d41/d45/d7c 39 2024-04-15T21:02:59.178 INFO:tasks.workunit.client.0.smithi072.stdout:3/780: creat d1/ff0 x:0 0 0 2024-04-15T21:02:59.178 INFO:tasks.workunit.client.0.smithi072.stdout:3/781: chown d1/f14 32576 1 2024-04-15T21:02:59.179 INFO:tasks.workunit.client.0.smithi072.stdout:2/831: fdatasync d2/da1/fcc 0 2024-04-15T21:02:59.180 INFO:tasks.workunit.client.0.smithi072.stdout:4/802: dread d7/d10/d41/d45/d93/de0/dfc/fa5 [0,4194304] 0 2024-04-15T21:02:59.180 INFO:tasks.workunit.client.0.smithi072.stdout:2/832: chown d2/d66 4 1 2024-04-15T21:02:59.181 INFO:tasks.workunit.client.0.smithi072.stdout:7/803: read - d2/d78/fa4 zero size 2024-04-15T21:02:59.185 INFO:tasks.workunit.client.0.smithi072.stdout:2/833: symlink d2/da1/l10d 0 2024-04-15T21:02:59.189 INFO:tasks.workunit.client.0.smithi072.stdout:7/804: rename d2/d7/d25/d2d/c6f to d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dd5/cfb 0 2024-04-15T21:02:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:58 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:58 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:58 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:58 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.191 INFO:tasks.workunit.client.0.smithi072.stdout:2/834: dwrite d2/d8/daa/f84 [4194304,4194304] 0 2024-04-15T21:02:59.192 INFO:tasks.workunit.client.0.smithi072.stdout:7/805: mknod d2/d7/d25/d81/cfc 0 2024-04-15T21:02:59.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/782: dread d1/d26/fab [0,4194304] 0 2024-04-15T21:02:59.197 INFO:tasks.workunit.client.0.smithi072.stdout:9/821: write d4/d29/d4c/d74/f9c [4721083,31875] 0 2024-04-15T21:02:59.198 INFO:tasks.workunit.client.0.smithi072.stdout:3/783: read d1/d3f/f8a [1456949,76314] 0 2024-04-15T21:02:59.200 INFO:tasks.workunit.client.0.smithi072.stdout:8/834: write d3/de/d1b/d41/d74/d98/da5/fc2 [226651,129873] 0 2024-04-15T21:02:59.200 INFO:tasks.workunit.client.0.smithi072.stdout:0/814: write d0/d45/d7a/fe1 [118836,95832] 0 2024-04-15T21:02:59.200 INFO:tasks.workunit.client.0.smithi072.stdout:2/835: dwrite d2/d3/f4c [0,4194304] 0 2024-04-15T21:02:59.207 INFO:tasks.workunit.client.0.smithi072.stdout:9/822: creat d4/d1f/d31/d9b/dca/f103 x:0 0 0 2024-04-15T21:02:59.213 INFO:tasks.workunit.client.0.smithi072.stdout:9/823: unlink d4/l95 0 2024-04-15T21:02:59.218 INFO:tasks.workunit.client.0.smithi072.stdout:5/835: dwrite d0/d3/d6/f2b [4194304,4194304] 0 2024-04-15T21:02:59.218 INFO:tasks.workunit.client.0.smithi072.stdout:6/775: dwrite d2/d10/d11/f4b [0,4194304] 0 2024-04-15T21:02:59.219 INFO:tasks.workunit.client.0.smithi072.stdout:2/836: rename d2/d3/d5f/dc8/fe8 to d2/d8/d41/dde/f10e 0 2024-04-15T21:02:59.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/835: truncate d3/de/d1b/d41/dae/dc0/fce 5194231 0 2024-04-15T21:02:59.222 INFO:tasks.workunit.client.0.smithi072.stdout:1/770: dwrite d5/db/d27/f34 [0,4194304] 0 2024-04-15T21:02:59.230 INFO:tasks.workunit.client.0.smithi072.stdout:4/803: dwrite d7/d15/d58/d62/f90 [0,4194304] 0 2024-04-15T21:02:59.230 INFO:tasks.workunit.client.0.smithi072.stdout:2/837: mkdir d2/d64/d10f 0 2024-04-15T21:02:59.230 INFO:tasks.workunit.client.0.smithi072.stdout:0/815: dwrite d0/d6/d55/f5f [8388608,4194304] 0 2024-04-15T21:02:59.230 INFO:tasks.workunit.client.0.smithi072.stdout:4/804: chown d7/d10/d41/d44 7 1 2024-04-15T21:02:59.230 INFO:tasks.workunit.client.0.smithi072.stdout:3/784: dread d1/d26/f59 [0,4194304] 0 2024-04-15T21:02:59.234 INFO:tasks.workunit.client.0.smithi072.stdout:8/836: mkdir d3/de/d1b/d44/d102 0 2024-04-15T21:02:59.235 INFO:tasks.workunit.client.0.smithi072.stdout:9/824: dwrite d4/d1f/d2c/dfa/fac [0,4194304] 0 2024-04-15T21:02:59.239 INFO:tasks.workunit.client.0.smithi072.stdout:6/776: dread d2/d10/d18/f94 [0,4194304] 0 2024-04-15T21:02:59.241 INFO:tasks.workunit.client.0.smithi072.stdout:6/777: chown d2/d42/f45 46442786 1 2024-04-15T21:02:59.241 INFO:tasks.workunit.client.0.smithi072.stdout:1/771: symlink d5/db/d27/d9c/lf6 0 2024-04-15T21:02:59.242 INFO:tasks.workunit.client.0.smithi072.stdout:4/805: creat d7/d15/dac/f102 x:0 0 0 2024-04-15T21:02:59.243 INFO:tasks.workunit.client.0.smithi072.stdout:3/785: dread - d1/d3f/f9c zero size 2024-04-15T21:02:59.245 INFO:tasks.workunit.client.0.smithi072.stdout:2/838: mkdir d2/d64/dbd/d110 0 2024-04-15T21:02:59.246 INFO:tasks.workunit.client.0.smithi072.stdout:9/825: dwrite d4/d29/d4c/d91/fe3 [0,4194304] 0 2024-04-15T21:02:59.252 INFO:tasks.workunit.client.0.smithi072.stdout:3/786: rmdir d1/d5b/dbf 39 2024-04-15T21:02:59.256 INFO:tasks.workunit.client.1.smithi149.stdout:7/952: sync 2024-04-15T21:02:59.256 INFO:tasks.workunit.client.1.smithi149.stdout:5/968: sync 2024-04-15T21:02:59.258 INFO:tasks.workunit.client.1.smithi149.stdout:5/969: write d0/d6/d82/f10a [594239,16944] 0 2024-04-15T21:02:59.259 INFO:tasks.workunit.client.0.smithi072.stdout:2/839: chown d2/d66/c88 169224 1 2024-04-15T21:02:59.260 INFO:tasks.workunit.client.0.smithi072.stdout:1/772: mknod d5/db/d2d/d85/dbf/cf7 0 2024-04-15T21:02:59.260 INFO:tasks.workunit.client.0.smithi072.stdout:2/840: write d2/d8/daa/fa6 [4635139,103781] 0 2024-04-15T21:02:59.263 INFO:tasks.workunit.client.0.smithi072.stdout:1/773: truncate d5/db/d2d/d56/df0/d82/ff4 994616 0 2024-04-15T21:02:59.264 INFO:tasks.workunit.client.1.smithi149.stdout:7/953: rmdir d3/d16/d32/d90/dad 39 2024-04-15T21:02:59.266 INFO:tasks.workunit.client.0.smithi072.stdout:0/816: link d0/d45/d35/f4f d0/d45/f111 0 2024-04-15T21:02:59.269 INFO:tasks.workunit.client.0.smithi072.stdout:3/787: unlink d1/d15/d32/d2f/lc3 0 2024-04-15T21:02:59.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/954: fsync d3/d16/d20/d60/fcd 0 2024-04-15T21:02:59.275 INFO:tasks.workunit.client.1.smithi149.stdout:9/990: sync 2024-04-15T21:02:59.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/983: sync 2024-04-15T21:02:59.276 INFO:tasks.workunit.client.0.smithi072.stdout:1/774: mkdir d5/db/d2d/d56/df0/d82/df8 0 2024-04-15T21:02:59.277 INFO:tasks.workunit.client.0.smithi072.stdout:9/826: creat d4/d1f/db7/d102/f104 x:0 0 0 2024-04-15T21:02:59.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/775: write d5/db/d27/d5c/fe9 [119414,33861] 0 2024-04-15T21:02:59.278 INFO:tasks.workunit.client.0.smithi072.stdout:2/841: dread d2/d38/d73/f7d [0,4194304] 0 2024-04-15T21:02:59.279 INFO:tasks.workunit.client.1.smithi149.stdout:5/970: dread d0/f89 [0,4194304] 0 2024-04-15T21:02:59.279 INFO:tasks.workunit.client.0.smithi072.stdout:2/842: write d2/da1/fc0 [1076657,76078] 0 2024-04-15T21:02:59.280 INFO:tasks.workunit.client.0.smithi072.stdout:3/788: creat d1/d15/d32/d2f/ff1 x:0 0 0 2024-04-15T21:02:59.281 INFO:tasks.workunit.client.0.smithi072.stdout:3/789: stat d1/d5b/c76 0 2024-04-15T21:02:59.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/817: symlink d0/d19/d96/dfc/l112 0 2024-04-15T21:02:59.282 INFO:tasks.workunit.client.0.smithi072.stdout:0/818: chown d0/d6/f80 3131 1 2024-04-15T21:02:59.283 INFO:tasks.workunit.client.0.smithi072.stdout:9/827: rmdir d4/d1f/d9e 39 2024-04-15T21:02:59.285 INFO:tasks.workunit.client.1.smithi149.stdout:5/971: rmdir d0/d6/d82/db0/ddc 39 2024-04-15T21:02:59.287 INFO:tasks.workunit.client.0.smithi072.stdout:5/836: truncate d0/d3/d6/d14/fb2 692466 0 2024-04-15T21:02:59.287 INFO:tasks.workunit.client.0.smithi072.stdout:8/837: dwrite d3/de/d81/f86 [0,4194304] 0 2024-04-15T21:02:59.289 INFO:tasks.workunit.client.1.smithi149.stdout:3/984: mkdir d1/db/d24/d39/d133 0 2024-04-15T21:02:59.290 INFO:tasks.workunit.client.0.smithi072.stdout:9/828: dread d4/d29/d4c/d74/f9c [0,4194304] 0 2024-04-15T21:02:59.291 INFO:tasks.workunit.client.0.smithi072.stdout:4/806: write d7/d15/d58/d62/d6f/f9e [5631284,13230] 0 2024-04-15T21:02:59.292 INFO:tasks.workunit.client.0.smithi072.stdout:2/843: symlink d2/d8/d41/l111 0 2024-04-15T21:02:59.294 INFO:tasks.workunit.client.0.smithi072.stdout:2/844: dread d2/d8/fbc [0,4194304] 0 2024-04-15T21:02:59.295 INFO:tasks.workunit.client.0.smithi072.stdout:2/845: chown d2/d37/l51 11813472 1 2024-04-15T21:02:59.299 INFO:tasks.workunit.client.0.smithi072.stdout:6/778: truncate d2/d10/d11/d1f/d60/d63/fc4 1883032 0 2024-04-15T21:02:59.302 INFO:tasks.workunit.client.1.smithi149.stdout:5/972: mknod d0/d6/d82/da1/d12/d16/da9/d1b/c135 0 2024-04-15T21:02:59.304 INFO:tasks.workunit.client.1.smithi149.stdout:5/973: chown d0/l66 0 1 2024-04-15T21:02:59.306 INFO:tasks.workunit.client.1.smithi149.stdout:9/991: getdents d23/d2b/d37/d50/d110 0 2024-04-15T21:02:59.307 INFO:tasks.workunit.client.1.smithi149.stdout:7/955: dwrite d3/d17/d1f/d93/f128 [0,4194304] 0 2024-04-15T21:02:59.311 INFO:tasks.workunit.client.1.smithi149.stdout:3/985: dread d1/db/d40/d56/d84/f9f [0,4194304] 0 2024-04-15T21:02:59.313 INFO:tasks.workunit.client.0.smithi072.stdout:5/837: mknod d0/d3/d7/d1f/d50/c119 0 2024-04-15T21:02:59.314 INFO:tasks.workunit.client.1.smithi149.stdout:5/974: rmdir d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8 39 2024-04-15T21:02:59.327 INFO:tasks.workunit.client.0.smithi072.stdout:6/779: rename d2/d10/d11/d1f/f32 to d2/d40/d56/d95/fea 0 2024-04-15T21:02:59.328 INFO:tasks.workunit.client.0.smithi072.stdout:1/776: rmdir d5/db/daa/de8 0 2024-04-15T21:02:59.330 INFO:tasks.workunit.client.1.smithi149.stdout:7/956: mkdir d3/d16/d6e/d150 0 2024-04-15T21:02:59.332 INFO:tasks.workunit.client.1.smithi149.stdout:3/986: write d1/db/d40/da0/fe9 [590861,32888] 0 2024-04-15T21:02:59.334 INFO:tasks.workunit.client.1.smithi149.stdout:3/987: read - d1/db/d24/d4d/d63/fb3 zero size 2024-04-15T21:02:59.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/992: dread d23/d3c/d52/ff7 [0,4194304] 0 2024-04-15T21:02:59.334 INFO:tasks.workunit.client.1.smithi149.stdout:5/975: unlink d0/d9/db6/ld0 0 2024-04-15T21:02:59.335 INFO:tasks.workunit.client.0.smithi072.stdout:0/819: creat d0/d45/d7a/d70/d59/d8a/d8b/db8/f113 x:0 0 0 2024-04-15T21:02:59.337 INFO:tasks.workunit.client.1.smithi149.stdout:7/957: rename d3/d17/d1f/d93/f100 to d3/d16/d20/d36/d3d/da4/d138/f151 0 2024-04-15T21:02:59.341 INFO:tasks.workunit.client.0.smithi072.stdout:5/838: write d0/d3/d7/d12/d31/d55/d93/f115 [749816,40302] 0 2024-04-15T21:02:59.343 INFO:tasks.workunit.client.0.smithi072.stdout:8/838: rename d3/de/d1b/d41/da4/d2e/f9d to d3/de/d1b/d85/f103 0 2024-04-15T21:02:59.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/958: rename d3/d16/d20/fdd to d3/d16/d20/d114/d11b/f152 0 2024-04-15T21:02:59.347 INFO:tasks.workunit.client.0.smithi072.stdout:1/777: unlink d5/db/d2d/d56/df0/f83 0 2024-04-15T21:02:59.348 INFO:tasks.workunit.client.1.smithi149.stdout:3/988: getdents d1/db/d12e 0 2024-04-15T21:02:59.348 INFO:tasks.workunit.client.0.smithi072.stdout:5/839: dwrite d0/d3/d7/d12/d31/d55/d93/f109 [0,4194304] 0 2024-04-15T21:02:59.352 INFO:tasks.workunit.client.0.smithi072.stdout:9/829: rmdir d4/d1f/db7/d102 39 2024-04-15T21:02:59.356 INFO:tasks.workunit.client.0.smithi072.stdout:0/820: mknod d0/d74/dd5/c114 0 2024-04-15T21:02:59.359 INFO:tasks.workunit.client.1.smithi149.stdout:9/993: write d23/f3a [141138,56741] 0 2024-04-15T21:02:59.360 INFO:tasks.workunit.client.1.smithi149.stdout:3/989: dwrite d1/db/d40/d56/d84/d10d/f124 [0,4194304] 0 2024-04-15T21:02:59.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/976: creat d0/d6/f136 x:0 0 0 2024-04-15T21:02:59.362 INFO:tasks.workunit.client.1.smithi149.stdout:5/977: read - d0/d6/f11a zero size 2024-04-15T21:02:59.363 INFO:tasks.workunit.client.1.smithi149.stdout:9/994: write d23/d2b/d44/f122 [350316,4187] 0 2024-04-15T21:02:59.365 INFO:tasks.workunit.client.1.smithi149.stdout:9/995: chown d23/d2b/d70 56885 1 2024-04-15T21:02:59.366 INFO:tasks.workunit.client.1.smithi149.stdout:7/959: creat d3/d16/d11f/d92/d123/d135/f153 x:0 0 0 2024-04-15T21:02:59.367 INFO:tasks.workunit.client.0.smithi072.stdout:6/780: mkdir d2/d10/d18/d47/deb 0 2024-04-15T21:02:59.367 INFO:tasks.workunit.client.1.smithi149.stdout:7/960: dread - d3/d16/d20/fd9 zero size 2024-04-15T21:02:59.372 INFO:tasks.workunit.client.0.smithi072.stdout:1/778: creat d5/db/d2d/d56/ff9 x:0 0 0 2024-04-15T21:02:59.373 INFO:tasks.workunit.client.0.smithi072.stdout:1/779: readlink d5/db/d2d/d56/df0/d82/l9f 0 2024-04-15T21:02:59.374 INFO:tasks.workunit.client.0.smithi072.stdout:1/780: read - d5/db/d2d/d56/df0/d82/fc0 zero size 2024-04-15T21:02:59.376 INFO:tasks.workunit.client.0.smithi072.stdout:8/839: dread d3/d4/d76/fe2 [0,4194304] 0 2024-04-15T21:02:59.378 INFO:tasks.workunit.client.0.smithi072.stdout:6/781: creat d2/d10/d11/d1f/d60/d63/dd4/fec x:0 0 0 2024-04-15T21:02:59.379 INFO:tasks.workunit.client.1.smithi149.stdout:3/990: mkdir d1/db/d24/d39/d79/d97/daf/d106/d12f/d134 0 2024-04-15T21:02:59.381 INFO:tasks.workunit.client.1.smithi149.stdout:3/991: chown d1/db/d28/f51 884 1 2024-04-15T21:02:59.381 INFO:tasks.workunit.client.0.smithi072.stdout:9/830: unlink d4/d1f/d31/d42/f66 0 2024-04-15T21:02:59.382 INFO:tasks.workunit.client.0.smithi072.stdout:8/840: dwrite d3/d4/d3b/f100 [0,4194304] 0 2024-04-15T21:02:59.384 INFO:tasks.workunit.client.0.smithi072.stdout:0/821: mkdir d0/d19/d96/dad/d109/d115 0 2024-04-15T21:02:59.385 INFO:tasks.workunit.client.0.smithi072.stdout:0/822: chown d0/d45/d7a/d70/d59/d8a/d8b/db8/l86 145985 1 2024-04-15T21:02:59.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/961: creat d3/d17/d1f/f154 x:0 0 0 2024-04-15T21:02:59.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/962: chown d3/d129/dfb/ffd 28999787 1 2024-04-15T21:02:59.393 INFO:tasks.workunit.client.0.smithi072.stdout:2/846: link d2/l35 d2/da8/l112 0 2024-04-15T21:02:59.394 INFO:tasks.workunit.client.0.smithi072.stdout:1/781: dread - d5/d3d/fc1 zero size 2024-04-15T21:02:59.394 INFO:tasks.workunit.client.0.smithi072.stdout:6/782: write d2/d40/d56/d6a/fd0 [3599961,87201] 0 2024-04-15T21:02:59.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/963: truncate d3/d16/d11f/f14a 493148 0 2024-04-15T21:02:59.396 INFO:tasks.workunit.client.1.smithi149.stdout:9/996: dread d23/d46/fec [0,4194304] 0 2024-04-15T21:02:59.396 INFO:tasks.workunit.client.0.smithi072.stdout:2/847: fdatasync d2/d8/d41/dde/f10e 0 2024-04-15T21:02:59.397 INFO:tasks.workunit.client.1.smithi149.stdout:5/978: dread d0/d6/d82/da1/d12/d2b/f119 [0,4194304] 0 2024-04-15T21:02:59.398 INFO:tasks.workunit.client.0.smithi072.stdout:1/782: mknod d5/db/d2d/d3a/dc3/dd3/cfa 0 2024-04-15T21:02:59.399 INFO:tasks.workunit.client.0.smithi072.stdout:1/783: readlink d5/db/d2d/d56/lc8 0 2024-04-15T21:02:59.403 INFO:tasks.workunit.client.0.smithi072.stdout:9/831: dread d4/d29/d4c/d91/fc2 [0,4194304] 0 2024-04-15T21:02:59.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/979: truncate d0/d6/d9f/fba 472175 0 2024-04-15T21:02:59.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/980: stat d0/d6/d82/da1/d12/d2b/lf0 0 2024-04-15T21:02:59.410 INFO:tasks.workunit.client.1.smithi149.stdout:3/992: dread d1/db/d24/d39/f47 [0,4194304] 0 2024-04-15T21:02:59.410 INFO:tasks.workunit.client.0.smithi072.stdout:2/848: rename d2/c85 to d2/d3/c113 0 2024-04-15T21:02:59.411 INFO:tasks.workunit.client.0.smithi072.stdout:0/823: dread d0/d6/fdf [0,4194304] 0 2024-04-15T21:02:59.412 INFO:tasks.workunit.client.0.smithi072.stdout:9/832: unlink d4/d1f/d9e/fd9 0 2024-04-15T21:02:59.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:58 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:58 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:58 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:58 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:02:59.414 INFO:tasks.workunit.client.0.smithi072.stdout:0/824: symlink d0/d45/d7a/d70/l116 0 2024-04-15T21:02:59.415 INFO:tasks.workunit.client.0.smithi072.stdout:0/825: chown d0/d19/d71/d9e/fb9 3093516 1 2024-04-15T21:02:59.416 INFO:tasks.workunit.client.0.smithi072.stdout:1/784: dread d5/db/d2d/d3a/f2e [0,4194304] 0 2024-04-15T21:02:59.416 INFO:tasks.workunit.client.1.smithi149.stdout:9/997: rename d23/l25 to d23/d46/dcf/deb/l14a 0 2024-04-15T21:02:59.418 INFO:tasks.workunit.client.0.smithi072.stdout:9/833: symlink d4/d29/d45/ddc/ddd/l105 0 2024-04-15T21:02:59.418 INFO:tasks.workunit.client.1.smithi149.stdout:7/964: getdents d3/d16/da0 0 2024-04-15T21:02:59.418 INFO:tasks.workunit.client.1.smithi149.stdout:7/965: chown d3/d16/d20/d114/f6d 214428 1 2024-04-15T21:02:59.419 INFO:tasks.workunit.client.0.smithi072.stdout:0/826: fsync d0/d19/d2b/f37 0 2024-04-15T21:02:59.420 INFO:tasks.workunit.client.0.smithi072.stdout:0/827: stat d0/d45/d7a/d70/l116 0 2024-04-15T21:02:59.421 INFO:tasks.workunit.client.1.smithi149.stdout:5/981: rename d0/d6/d82/da1/d12/d16/da9/d1b/d9c/lab to d0/d6/d2d/l137 0 2024-04-15T21:02:59.425 INFO:tasks.workunit.client.1.smithi149.stdout:3/993: creat d1/f135 x:0 0 0 2024-04-15T21:02:59.426 INFO:tasks.workunit.client.0.smithi072.stdout:1/785: dwrite d5/db/d27/d5c/dbd/fe5 [0,4194304] 0 2024-04-15T21:02:59.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/849: link d2/d8/f28 d2/d66/f114 0 2024-04-15T21:02:59.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/850: stat d2/d8/d8e 0 2024-04-15T21:02:59.433 INFO:tasks.workunit.client.1.smithi149.stdout:5/982: creat d0/d9/d115/dfb/f138 x:0 0 0 2024-04-15T21:02:59.437 INFO:tasks.workunit.client.1.smithi149.stdout:5/983: dread - d0/d6/d82/da1/d12/d2b/f133 zero size 2024-04-15T21:02:59.437 INFO:tasks.workunit.client.1.smithi149.stdout:3/994: truncate d1/db/d28/f32 1515050 0 2024-04-15T21:02:59.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/786: dread - d5/db/d2d/d3a/dc3/dd3/dde/fac zero size 2024-04-15T21:02:59.442 INFO:tasks.workunit.client.1.smithi149.stdout:9/998: getdents d23/d3c/d7a/da5/dbd 0 2024-04-15T21:02:59.443 INFO:tasks.workunit.client.0.smithi072.stdout:1/787: write d5/db/d27/d5c/dbd/fe5 [565187,117126] 0 2024-04-15T21:02:59.444 INFO:tasks.workunit.client.0.smithi072.stdout:2/851: mknod d2/d8/d41/c115 0 2024-04-15T21:02:59.445 INFO:tasks.workunit.client.0.smithi072.stdout:2/852: write d2/d8/fb1 [5112837,123694] 0 2024-04-15T21:02:59.447 INFO:tasks.workunit.client.0.smithi072.stdout:0/828: write d0/f1 [214287,27287] 0 2024-04-15T21:02:59.448 INFO:tasks.workunit.client.1.smithi149.stdout:3/995: mkdir d1/db/d24/d39/d79/d136 0 2024-04-15T21:02:59.449 INFO:tasks.workunit.client.0.smithi072.stdout:9/834: symlink d4/d1f/d2c/l106 0 2024-04-15T21:02:59.449 INFO:tasks.workunit.client.0.smithi072.stdout:9/835: chown d4/d76 16543572 1 2024-04-15T21:02:59.455 INFO:tasks.workunit.client.1.smithi149.stdout:5/984: dread d0/d6/d82/da1/d12/d16/da9/d1b/d61/db8/fe4 [0,4194304] 0 2024-04-15T21:02:59.456 INFO:tasks.workunit.client.1.smithi149.stdout:5/985: chown d0/d9/d3f/fc1 3183334 1 2024-04-15T21:02:59.457 INFO:tasks.workunit.client.1.smithi149.stdout:5/986: chown d0/fc4 3 1 2024-04-15T21:02:59.458 INFO:tasks.workunit.client.0.smithi072.stdout:2/853: rename d2/d66/cad to d2/d64/dce/c116 0 2024-04-15T21:02:59.459 INFO:tasks.workunit.client.0.smithi072.stdout:2/854: truncate d2/da1/fc0 2043099 0 2024-04-15T21:02:59.459 INFO:tasks.workunit.client.0.smithi072.stdout:0/829: fdatasync d0/d6/f4c 0 2024-04-15T21:02:59.460 INFO:tasks.workunit.client.0.smithi072.stdout:2/855: read d2/d8/d8e/fe0 [346871,87846] 0 2024-04-15T21:02:59.460 INFO:tasks.workunit.client.0.smithi072.stdout:0/830: readlink d0/d6/d48/l6e 0 2024-04-15T21:02:59.461 INFO:tasks.workunit.client.0.smithi072.stdout:7/806: sync 2024-04-15T21:02:59.464 INFO:tasks.workunit.client.1.smithi149.stdout:5/987: rmdir d0/d6/d82/da1/d12/d16/da9 39 2024-04-15T21:02:59.464 INFO:tasks.workunit.client.0.smithi072.stdout:2/856: dread d2/d8/daa/fa6 [4194304,4194304] 0 2024-04-15T21:02:59.465 INFO:tasks.workunit.client.0.smithi072.stdout:2/857: dread - d2/d8/d8e/d90/fd2 zero size 2024-04-15T21:02:59.469 INFO:tasks.workunit.client.1.smithi149.stdout:9/999: rename d23/d2b/d37 to d23/d2b/d70/d14b 0 2024-04-15T21:02:59.470 INFO:tasks.workunit.client.0.smithi072.stdout:0/831: mkdir d0/d6/d6d/d117 0 2024-04-15T21:02:59.471 INFO:tasks.workunit.client.1.smithi149.stdout:5/988: dwrite d0/d6/d82/db0/fd9 [0,4194304] 0 2024-04-15T21:02:59.473 INFO:tasks.workunit.client.1.smithi149.stdout:3/996: creat d1/db/d24/d4d/f137 x:0 0 0 2024-04-15T21:02:59.474 INFO:tasks.workunit.client.0.smithi072.stdout:9/836: rename d4/l8e to d4/d1f/d31/d42/l107 0 2024-04-15T21:02:59.478 INFO:tasks.workunit.client.1.smithi149.stdout:5/989: mknod d0/d9/d3f/d47/c139 0 2024-04-15T21:02:59.481 INFO:tasks.workunit.client.0.smithi072.stdout:0/832: truncate d0/d97/fbf 704653 0 2024-04-15T21:02:59.483 INFO:tasks.workunit.client.1.smithi149.stdout:3/997: mknod d1/c138 0 2024-04-15T21:02:59.487 INFO:tasks.workunit.client.0.smithi072.stdout:0/833: dwrite d0/d6/d55/ff1 [0,4194304] 0 2024-04-15T21:02:59.488 INFO:tasks.workunit.client.0.smithi072.stdout:9/837: creat d4/d76/d8f/f108 x:0 0 0 2024-04-15T21:02:59.489 INFO:tasks.workunit.client.0.smithi072.stdout:7/807: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 [577727,100636] 0 2024-04-15T21:02:59.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/990: rmdir d0/d6/d82/da1/d12/d16/da9/d1b 39 2024-04-15T21:02:59.498 INFO:tasks.workunit.client.1.smithi149.stdout:3/998: creat d1/f139 x:0 0 0 2024-04-15T21:02:59.498 INFO:tasks.workunit.client.0.smithi072.stdout:2/858: dread d2/dd7/fe9 [0,4194304] 0 2024-04-15T21:02:59.499 INFO:tasks.workunit.client.0.smithi072.stdout:2/859: fsync d2/dd7/fe2 0 2024-04-15T21:02:59.499 INFO:tasks.workunit.client.0.smithi072.stdout:9/838: symlink d4/d29/d4c/d74/d84/dc0/l109 0 2024-04-15T21:02:59.503 INFO:tasks.workunit.client.1.smithi149.stdout:3/999: fsync d1/db/d24/fd6 0 2024-04-15T21:02:59.505 INFO:tasks.workunit.client.0.smithi072.stdout:0/834: write d0/d45/d7a/f60 [530629,23271] 0 2024-04-15T21:02:59.506 INFO:tasks.workunit.client.0.smithi072.stdout:2/860: fsync d2/dd7/fe9 0 2024-04-15T21:02:59.506 INFO:tasks.workunit.client.0.smithi072.stdout:7/808: write d2/f16 [550067,92322] 0 2024-04-15T21:02:59.507 INFO:tasks.workunit.client.0.smithi072.stdout:0/835: readlink d0/d45/d7a/d70/d59/d8a/d8b/db8/l95 0 2024-04-15T21:02:59.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/861: creat d2/db3/f117 x:0 0 0 2024-04-15T21:02:59.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/836: write d0/d45/d7a/f60 [1038438,46768] 0 2024-04-15T21:02:59.509 INFO:tasks.workunit.client.0.smithi072.stdout:7/809: creat d2/d7/d25/d4c/ffd x:0 0 0 2024-04-15T21:02:59.510 INFO:tasks.workunit.client.0.smithi072.stdout:9/839: getdents d4/d29/d45/ddc 0 2024-04-15T21:02:59.511 INFO:tasks.workunit.client.0.smithi072.stdout:2/862: mknod d2/d38/d91/dbb/c118 0 2024-04-15T21:02:59.513 INFO:tasks.workunit.client.0.smithi072.stdout:0/837: creat d0/d45/d7a/d70/dce/f118 x:0 0 0 2024-04-15T21:02:59.514 INFO:tasks.workunit.client.0.smithi072.stdout:0/838: write d0/d19/f4a [533284,106074] 0 2024-04-15T21:02:59.515 INFO:tasks.workunit.client.0.smithi072.stdout:2/863: rmdir d2/d8/d41/dde 39 2024-04-15T21:02:59.518 INFO:tasks.workunit.client.0.smithi072.stdout:9/840: rename d4/d1f/d2c/f4f to d4/d29/d45/ddb/f10a 0 2024-04-15T21:02:59.518 INFO:tasks.workunit.client.1.smithi149.stdout:5/991: dread d0/d6/d82/da1/d12/d16/da9/d1b/d60/fa8 [4194304,4194304] 0 2024-04-15T21:02:59.519 INFO:tasks.workunit.client.0.smithi072.stdout:9/841: chown d4/d29/d45/ddc 8245838 1 2024-04-15T21:02:59.519 INFO:tasks.workunit.client.0.smithi072.stdout:2/864: chown d2/d37/l3d 253 1 2024-04-15T21:02:59.520 INFO:tasks.workunit.client.0.smithi072.stdout:2/865: read - d2/d8/d8e/d90/fd2 zero size 2024-04-15T21:02:59.524 INFO:tasks.workunit.client.0.smithi072.stdout:9/842: truncate d4/d1f/d31/f44 1811627 0 2024-04-15T21:02:59.524 INFO:tasks.workunit.client.0.smithi072.stdout:7/810: write d2/f5 [339027,63771] 0 2024-04-15T21:02:59.525 INFO:tasks.workunit.client.1.smithi149.stdout:5/992: dread d0/d6/d82/da1/fb2 [4194304,4194304] 0 2024-04-15T21:02:59.528 INFO:tasks.workunit.client.0.smithi072.stdout:7/811: chown d2/d7/f9a 2520 1 2024-04-15T21:02:59.528 INFO:tasks.workunit.client.1.smithi149.stdout:5/993: mknod d0/d6/d2d/c13a 0 2024-04-15T21:02:59.529 INFO:tasks.workunit.client.0.smithi072.stdout:2/866: unlink d2/d3/c113 0 2024-04-15T21:02:59.530 INFO:tasks.workunit.client.1.smithi149.stdout:5/994: symlink d0/d9/d71/l13b 0 2024-04-15T21:02:59.530 INFO:tasks.workunit.client.0.smithi072.stdout:0/839: dwrite d0/d45/d7a/d70/d59/d8a/d8b/db8/fa [0,4194304] 0 2024-04-15T21:02:59.531 INFO:tasks.workunit.client.0.smithi072.stdout:2/867: chown d2/ffb 0 1 2024-04-15T21:02:59.531 INFO:tasks.workunit.client.0.smithi072.stdout:7/812: creat d2/d7/d25/d2d/d46/d5a/d5f/d43/db8/ffe x:0 0 0 2024-04-15T21:02:59.532 INFO:tasks.workunit.client.0.smithi072.stdout:7/813: chown d2/d7/d25/d2d/d46/fc8 1020 1 2024-04-15T21:02:59.533 INFO:tasks.workunit.client.0.smithi072.stdout:2/868: rmdir d2/d66/d69 39 2024-04-15T21:02:59.536 INFO:tasks.workunit.client.0.smithi072.stdout:0/840: link d0/d19/d2b/fee d0/d45/d7a/d70/d59/f119 0 2024-04-15T21:02:59.538 INFO:tasks.workunit.client.0.smithi072.stdout:2/869: fdatasync d2/d3/f7f 0 2024-04-15T21:02:59.540 INFO:tasks.workunit.client.0.smithi072.stdout:0/841: dread - d0/d45/d7a/d70/d59/d8a/d7b/f9a zero size 2024-04-15T21:02:59.542 INFO:tasks.workunit.client.0.smithi072.stdout:7/814: dwrite d2/d7/d25/d72/d98/de2/de4/ff3 [0,4194304] 0 2024-04-15T21:02:59.547 INFO:tasks.workunit.client.0.smithi072.stdout:7/815: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/cff 0 2024-04-15T21:02:59.548 INFO:tasks.workunit.client.0.smithi072.stdout:2/870: dwrite d2/dd7/fe9 [0,4194304] 0 2024-04-15T21:02:59.549 INFO:tasks.workunit.client.0.smithi072.stdout:2/871: readlink d2/dd7/lc4 0 2024-04-15T21:02:59.549 INFO:tasks.workunit.client.0.smithi072.stdout:9/843: dread d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:59.551 INFO:tasks.workunit.client.0.smithi072.stdout:2/872: chown d2/d8/daa/l9b 24517 1 2024-04-15T21:02:59.552 INFO:tasks.workunit.client.0.smithi072.stdout:0/842: truncate d0/d6/d55/f5f 8242447 0 2024-04-15T21:02:59.553 INFO:tasks.workunit.client.0.smithi072.stdout:7/816: creat d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa/f100 x:0 0 0 2024-04-15T21:02:59.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/873: chown d2/d3/cf9 4 1 2024-04-15T21:02:59.554 INFO:tasks.workunit.client.0.smithi072.stdout:9/844: rename d4/d1f/d2c/l106 to d4/d76/d8f/dbe/l10b 0 2024-04-15T21:02:59.555 INFO:tasks.workunit.client.0.smithi072.stdout:0/843: fdatasync d0/d45/d7a/d70/d59/d8a/d8b/db8/fa 0 2024-04-15T21:02:59.556 INFO:tasks.workunit.client.0.smithi072.stdout:2/874: symlink d2/d66/d69/l119 0 2024-04-15T21:02:59.559 INFO:tasks.workunit.client.0.smithi072.stdout:2/875: creat d2/d64/dbd/d110/f11a x:0 0 0 2024-04-15T21:02:59.559 INFO:tasks.workunit.client.0.smithi072.stdout:2/876: readlink d2/d37/l59 0 2024-04-15T21:02:59.576 INFO:tasks.workunit.client.0.smithi072.stdout:9/845: write d4/d1f/d31/d42/fab [819708,1259] 0 2024-04-15T21:02:59.577 INFO:tasks.workunit.client.0.smithi072.stdout:9/846: write d4/f6a [4361471,17724] 0 2024-04-15T21:02:59.579 INFO:tasks.workunit.client.0.smithi072.stdout:9/847: mknod d4/d76/d8f/dbe/c10c 0 2024-04-15T21:02:59.580 INFO:tasks.workunit.client.0.smithi072.stdout:0/844: dwrite d0/d45/d35/d3a/f47 [0,4194304] 0 2024-04-15T21:02:59.584 INFO:tasks.workunit.client.0.smithi072.stdout:3/790: sync 2024-04-15T21:02:59.584 INFO:tasks.workunit.client.0.smithi072.stdout:0/845: rmdir d0/d6/d48/d61 39 2024-04-15T21:02:59.585 INFO:tasks.workunit.client.0.smithi072.stdout:0/846: fdatasync d0/d97/fbc 0 2024-04-15T21:02:59.586 INFO:tasks.workunit.client.0.smithi072.stdout:3/791: stat d1/d15/d32/f4a 0 2024-04-15T21:02:59.591 INFO:tasks.workunit.client.0.smithi072.stdout:9/848: getdents d4/d1f/d31/d4d/dbf 0 2024-04-15T21:02:59.591 INFO:tasks.workunit.client.0.smithi072.stdout:0/847: dread d0/d6/f25 [0,4194304] 0 2024-04-15T21:02:59.592 INFO:tasks.workunit.client.0.smithi072.stdout:3/792: dwrite d1/d15/feb [0,4194304] 0 2024-04-15T21:02:59.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/849: chown d4/d1f/f54 15 1 2024-04-15T21:02:59.600 INFO:tasks.workunit.client.0.smithi072.stdout:0/848: write d0/f13 [4185945,12555] 0 2024-04-15T21:02:59.602 INFO:tasks.workunit.client.0.smithi072.stdout:0/849: chown d0/d6/d55/d100 103 1 2024-04-15T21:02:59.602 INFO:tasks.workunit.client.0.smithi072.stdout:9/850: dwrite d4/d29/d4c/d74/d84/ff3 [0,4194304] 0 2024-04-15T21:02:59.603 INFO:tasks.workunit.client.0.smithi072.stdout:0/850: chown d0/d19/d96/dfc 1082944452 1 2024-04-15T21:02:59.609 INFO:tasks.workunit.client.0.smithi072.stdout:0/851: rename d0/d45/d35/f4f to d0/d45/d7a/d70/f11a 0 2024-04-15T21:02:59.616 INFO:tasks.workunit.client.0.smithi072.stdout:3/793: dread d1/f6 [0,4194304] 0 2024-04-15T21:02:59.617 INFO:tasks.workunit.client.0.smithi072.stdout:3/794: creat d1/d15/d32/d2f/d1a/ff2 x:0 0 0 2024-04-15T21:02:59.619 INFO:tasks.workunit.client.0.smithi072.stdout:3/795: fsync d1/d15/d32/f81 0 2024-04-15T21:02:59.622 INFO:tasks.workunit.client.0.smithi072.stdout:3/796: mknod d1/d5b/cf3 0 2024-04-15T21:02:59.623 INFO:tasks.workunit.client.0.smithi072.stdout:3/797: chown d1/d3f/d4f/d73 3 1 2024-04-15T21:02:59.625 INFO:tasks.workunit.client.0.smithi072.stdout:3/798: unlink d1/d5b/ld3 0 2024-04-15T21:02:59.626 INFO:tasks.workunit.client.0.smithi072.stdout:9/851: dwrite d4/d29/d4c/d74/f9c [0,4194304] 0 2024-04-15T21:02:59.626 INFO:tasks.workunit.client.0.smithi072.stdout:3/799: dread - d1/d15/d32/d2f/d1a/ff2 zero size 2024-04-15T21:02:59.627 INFO:tasks.workunit.client.0.smithi072.stdout:9/852: fsync d4/d1f/d2c/f8c 0 2024-04-15T21:02:59.627 INFO:tasks.workunit.client.0.smithi072.stdout:3/800: stat d1/d15/d40/f22 0 2024-04-15T21:02:59.631 INFO:tasks.workunit.client.0.smithi072.stdout:3/801: rmdir d1/d15 39 2024-04-15T21:02:59.631 INFO:tasks.workunit.client.0.smithi072.stdout:3/802: chown d1/d3f/d4f/d73/f87 6217 1 2024-04-15T21:02:59.632 INFO:tasks.workunit.client.0.smithi072.stdout:9/853: mknod d4/d29/d4c/d74/d84/c10d 0 2024-04-15T21:02:59.638 INFO:tasks.workunit.client.0.smithi072.stdout:3/803: mkdir d1/d15/d32/d2f/df4 0 2024-04-15T21:02:59.640 INFO:tasks.workunit.client.0.smithi072.stdout:9/854: mkdir d4/d29/d4c/d74/d10e 0 2024-04-15T21:02:59.643 INFO:tasks.workunit.client.0.smithi072.stdout:3/804: creat d1/d5b/ff5 x:0 0 0 2024-04-15T21:02:59.646 INFO:tasks.workunit.client.0.smithi072.stdout:9/855: dread d4/d1f/d2c/d62/f75 [0,4194304] 0 2024-04-15T21:02:59.655 INFO:tasks.workunit.client.0.smithi072.stdout:3/805: write d1/d15/d32/d78/fe4 [2521486,24877] 0 2024-04-15T21:02:59.656 INFO:tasks.workunit.client.0.smithi072.stdout:3/806: chown d1/d5b/f84 55 1 2024-04-15T21:02:59.657 INFO:tasks.workunit.client.0.smithi072.stdout:3/807: fdatasync d1/d15/d32/d2f/f3a 0 2024-04-15T21:02:59.658 INFO:tasks.workunit.client.0.smithi072.stdout:9/856: dwrite d4/d1f/d2c/f46 [0,4194304] 0 2024-04-15T21:02:59.658 INFO:tasks.workunit.client.0.smithi072.stdout:3/808: write d1/d5b/fd7 [325547,39542] 0 2024-04-15T21:02:59.659 INFO:tasks.workunit.client.0.smithi072.stdout:3/809: stat d1/d26/f47 0 2024-04-15T21:02:59.660 INFO:tasks.workunit.client.0.smithi072.stdout:3/810: dread - d1/d3f/d4f/d73/db3/dc4/dd0/fd4 zero size 2024-04-15T21:02:59.661 INFO:tasks.workunit.client.0.smithi072.stdout:9/857: symlink d4/d29/d45/ddc/l10f 0 2024-04-15T21:02:59.663 INFO:tasks.workunit.client.0.smithi072.stdout:9/858: chown d4/d29/d4c/ca8 845 1 2024-04-15T21:02:59.666 INFO:tasks.workunit.client.0.smithi072.stdout:3/811: dwrite d1/d3f/d4f/d73/db3/dc4/fdd [0,4194304] 0 2024-04-15T21:02:59.674 INFO:tasks.workunit.client.0.smithi072.stdout:3/812: rename d1/d15/d32/fa8 to d1/d3f/d4f/ff6 0 2024-04-15T21:02:59.674 INFO:tasks.workunit.client.0.smithi072.stdout:9/859: getdents d4/d76/d8f/dbe 0 2024-04-15T21:02:59.675 INFO:tasks.workunit.client.1.smithi149.stdout:7/966: sync 2024-04-15T21:02:59.675 INFO:tasks.workunit.client.0.smithi072.stdout:3/813: fdatasync d1/d15/d32/d2f/d1a/ff2 0 2024-04-15T21:02:59.677 INFO:tasks.workunit.client.0.smithi072.stdout:9/860: creat d4/d76/d8f/f110 x:0 0 0 2024-04-15T21:02:59.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/967: truncate d3/f2d 1317782 0 2024-04-15T21:02:59.684 INFO:tasks.workunit.client.1.smithi149.stdout:7/968: mknod d3/d16/d11f/d92/d123/c155 0 2024-04-15T21:02:59.685 INFO:tasks.workunit.client.0.smithi072.stdout:3/814: getdents d1/d15/d32/d2f 0 2024-04-15T21:02:59.686 INFO:tasks.workunit.client.1.smithi149.stdout:7/969: unlink d3/d16/d20/f24 0 2024-04-15T21:02:59.687 INFO:tasks.workunit.client.1.smithi149.stdout:7/970: chown d3/d16/d20/l82 22 1 2024-04-15T21:02:59.689 INFO:tasks.workunit.client.0.smithi072.stdout:3/815: rename d1/d15/d32/c39 to d1/d3f/cf7 0 2024-04-15T21:02:59.690 INFO:tasks.workunit.client.0.smithi072.stdout:3/816: truncate d1/ff0 213688 0 2024-04-15T21:02:59.693 INFO:tasks.workunit.client.1.smithi149.stdout:7/971: link d3/d16/d20/db5/l115 d3/d16/d32/d90/dad/l156 0 2024-04-15T21:02:59.694 INFO:tasks.workunit.client.0.smithi072.stdout:9/861: dwrite d4/d29/d45/f88 [0,4194304] 0 2024-04-15T21:02:59.696 INFO:tasks.workunit.client.1.smithi149.stdout:7/972: mkdir d3/d16/d32/d90/dad/d14c/d157 0 2024-04-15T21:02:59.698 INFO:tasks.workunit.client.0.smithi072.stdout:3/817: dwrite d1/d15/d40/d9e/fc6 [0,4194304] 0 2024-04-15T21:02:59.701 INFO:tasks.workunit.client.0.smithi072.stdout:9/862: dwrite d4/d76/fa9 [4194304,4194304] 0 2024-04-15T21:02:59.702 INFO:tasks.workunit.client.0.smithi072.stdout:3/818: read d1/f8e [2752919,126333] 0 2024-04-15T21:02:59.703 INFO:tasks.workunit.client.0.smithi072.stdout:3/819: chown d1/d3f/fc1 44 1 2024-04-15T21:02:59.704 INFO:tasks.workunit.client.0.smithi072.stdout:3/820: write d1/d15/d32/d2f/fe6 [708474,69169] 0 2024-04-15T21:02:59.705 INFO:tasks.workunit.client.0.smithi072.stdout:3/821: write d1/d15/d32/f24 [1709232,13125] 0 2024-04-15T21:02:59.716 INFO:tasks.workunit.client.1.smithi149.stdout:7/973: write d3/d16/d20/d114/fa2 [4479028,78229] 0 2024-04-15T21:02:59.721 INFO:tasks.workunit.client.0.smithi072.stdout:3/822: rename d1/d3f/d4f/d73/fc5 to d1/d15/d40/dc2/ff8 0 2024-04-15T21:02:59.722 INFO:tasks.workunit.client.0.smithi072.stdout:9/863: mknod d4/d1f/d31/d4d/dae/c111 0 2024-04-15T21:02:59.727 INFO:tasks.workunit.client.1.smithi149.stdout:7/974: unlink d3/d16/d20/d36/d3d/da4/d138/cd5 0 2024-04-15T21:02:59.729 INFO:tasks.workunit.client.0.smithi072.stdout:9/864: mknod d4/d1f/d2c/dd8/c112 0 2024-04-15T21:02:59.732 INFO:tasks.workunit.client.0.smithi072.stdout:8/841: sync 2024-04-15T21:02:59.732 INFO:tasks.workunit.client.0.smithi072.stdout:5/840: sync 2024-04-15T21:02:59.732 INFO:tasks.workunit.client.0.smithi072.stdout:1/788: sync 2024-04-15T21:02:59.732 INFO:tasks.workunit.client.0.smithi072.stdout:6/783: sync 2024-04-15T21:02:59.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/807: sync 2024-04-15T21:02:59.734 INFO:tasks.workunit.client.1.smithi149.stdout:7/975: dwrite d3/d17/d1f/d93/f14e [0,4194304] 0 2024-04-15T21:02:59.736 INFO:tasks.workunit.client.0.smithi072.stdout:9/865: dwrite d4/d1f/d31/d4d/fbb [0,4194304] 0 2024-04-15T21:02:59.738 INFO:tasks.workunit.client.0.smithi072.stdout:5/841: stat d0/d3/d6/cd3 0 2024-04-15T21:02:59.745 INFO:tasks.workunit.client.0.smithi072.stdout:3/823: dread d1/d3f/d4f/fb5 [0,4194304] 0 2024-04-15T21:02:59.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/995: sync 2024-04-15T21:02:59.752 INFO:tasks.workunit.client.0.smithi072.stdout:4/808: rename d7/d15/d58/d62 to d7/d10/d41/dc4/de8/d103 0 2024-04-15T21:02:59.752 INFO:tasks.workunit.client.0.smithi072.stdout:4/809: chown d7/d71/db2/fcc 39732 1 2024-04-15T21:02:59.755 INFO:tasks.workunit.client.1.smithi149.stdout:5/996: mkdir d0/d9/d6c/db4/d13c 0 2024-04-15T21:02:59.756 INFO:tasks.workunit.client.1.smithi149.stdout:7/976: write d3/d17/f125 [194455,108806] 0 2024-04-15T21:02:59.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/997: write d0/d9/db6/f7e [1479042,37739] 0 2024-04-15T21:02:59.757 INFO:tasks.workunit.client.0.smithi072.stdout:8/842: symlink d3/de/d1b/d85/d101/l104 0 2024-04-15T21:02:59.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/998: write d0/f8 [2493182,109519] 0 2024-04-15T21:02:59.759 INFO:tasks.workunit.client.0.smithi072.stdout:9/866: symlink d4/d1f/d2c/de9/dfc/l113 0 2024-04-15T21:02:59.761 INFO:tasks.workunit.client.1.smithi149.stdout:7/977: readlink d3/d16/lbb 0 2024-04-15T21:02:59.761 INFO:tasks.workunit.client.0.smithi072.stdout:1/789: dwrite d5/db/d27/d5c/dbd/fce [0,4194304] 0 2024-04-15T21:02:59.762 INFO:tasks.workunit.client.1.smithi149.stdout:7/978: fdatasync d3/d16/d20/f41 0 2024-04-15T21:02:59.763 INFO:tasks.workunit.client.0.smithi072.stdout:5/842: symlink d0/d3/d7/d94/d92/da0/dfc/d111/l11a 0 2024-04-15T21:02:59.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/824: fdatasync d1/d5b/dbf/fa6 0 2024-04-15T21:02:59.766 INFO:tasks.workunit.client.0.smithi072.stdout:6/784: dread d2/da1/fb5 [0,4194304] 0 2024-04-15T21:02:59.766 INFO:tasks.workunit.client.1.smithi149.stdout:5/999: mkdir d0/d9/d6c/db4/dd1/d126/d13d 0 2024-04-15T21:02:59.775 INFO:tasks.workunit.client.0.smithi072.stdout:9/867: unlink d4/d76/d8f/dbe/de4/cfe 0 2024-04-15T21:02:59.776 INFO:tasks.workunit.client.0.smithi072.stdout:9/868: fsync d4/d29/d45/f88 0 2024-04-15T21:02:59.777 INFO:tasks.workunit.client.0.smithi072.stdout:1/790: readlink d5/db/d2d/le0 0 2024-04-15T21:02:59.777 INFO:tasks.workunit.client.0.smithi072.stdout:8/843: dread d3/d4/ff2 [0,4194304] 0 2024-04-15T21:02:59.777 INFO:tasks.workunit.client.0.smithi072.stdout:1/791: write d5/d3d/f75 [4156905,38352] 0 2024-04-15T21:02:59.778 INFO:tasks.workunit.client.0.smithi072.stdout:8/844: chown d3/d4/d76/la6 1788 1 2024-04-15T21:02:59.779 INFO:tasks.workunit.client.0.smithi072.stdout:5/843: truncate d0/d3/d7/d12/fdf 261172 0 2024-04-15T21:02:59.783 INFO:tasks.workunit.client.0.smithi072.stdout:9/869: stat d4/d1f/fc3 0 2024-04-15T21:02:59.784 INFO:tasks.workunit.client.0.smithi072.stdout:4/810: write d7/d24/f1e [2032050,58817] 0 2024-04-15T21:02:59.785 INFO:tasks.workunit.client.0.smithi072.stdout:8/845: creat d3/d4/d4c/f105 x:0 0 0 2024-04-15T21:02:59.786 INFO:tasks.workunit.client.0.smithi072.stdout:8/846: read d3/de/d81/f86 [4147465,29733] 0 2024-04-15T21:02:59.787 INFO:tasks.workunit.client.1.smithi149.stdout:7/979: dwrite d3/d16/f86 [0,4194304] 0 2024-04-15T21:02:59.788 INFO:tasks.workunit.client.0.smithi072.stdout:5/844: creat d0/d3/d7/d12/d1d/d8c/f11b x:0 0 0 2024-04-15T21:02:59.789 INFO:tasks.workunit.client.0.smithi072.stdout:8/847: dread d3/d4/d76/fe2 [0,4194304] 0 2024-04-15T21:02:59.792 INFO:tasks.workunit.client.0.smithi072.stdout:9/870: truncate d4/d29/d4c/fcf 494237 0 2024-04-15T21:02:59.797 INFO:tasks.workunit.client.0.smithi072.stdout:4/811: rename d7/d28/d42/d8c/f100 to d7/d15/ddd/f104 0 2024-04-15T21:02:59.799 INFO:tasks.workunit.client.0.smithi072.stdout:6/785: write d2/d10/d11/d1f/d60/d63/fc4 [1438217,75753] 0 2024-04-15T21:02:59.800 INFO:tasks.workunit.client.0.smithi072.stdout:1/792: truncate d5/db/d27/d5c/dbd/fe5 205379 0 2024-04-15T21:02:59.804 INFO:tasks.workunit.client.1.smithi149.stdout:7/980: getdents d3/d129 0 2024-04-15T21:02:59.808 INFO:tasks.workunit.client.0.smithi072.stdout:5/845: symlink d0/d3/d7/d12/d31/l11c 0 2024-04-15T21:02:59.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/848: mkdir d3/de/d1b/d106 0 2024-04-15T21:02:59.810 INFO:tasks.workunit.client.0.smithi072.stdout:5/846: read d0/d3/d7/d12/d1d/f74 [171977,46956] 0 2024-04-15T21:02:59.810 INFO:tasks.workunit.client.0.smithi072.stdout:5/847: chown d0/fa 2 1 2024-04-15T21:02:59.812 INFO:tasks.workunit.client.0.smithi072.stdout:1/793: stat d5/d31 0 2024-04-15T21:02:59.812 INFO:tasks.workunit.client.0.smithi072.stdout:9/871: dwrite d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:02:59.813 INFO:tasks.workunit.client.0.smithi072.stdout:5/848: fdatasync d0/d3/d7/d12/d31/d55/d58/f63 0 2024-04-15T21:02:59.813 INFO:tasks.workunit.client.0.smithi072.stdout:6/786: read d2/d40/dcb/d49/f91 [41827,128029] 0 2024-04-15T21:02:59.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/849: write d0/d3/d33/d60/d81/f105 [687323,40256] 0 2024-04-15T21:02:59.830 INFO:tasks.workunit.client.0.smithi072.stdout:1/794: mknod d5/db/d27/d5c/ddc/cfb 0 2024-04-15T21:02:59.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/812: dwrite d7/d28/d42/f75 [0,4194304] 0 2024-04-15T21:02:59.838 INFO:tasks.workunit.client.0.smithi072.stdout:4/813: truncate d7/f38 6373392 0 2024-04-15T21:02:59.841 INFO:tasks.workunit.client.0.smithi072.stdout:1/795: creat d5/db/d2d/d3a/ffc x:0 0 0 2024-04-15T21:02:59.844 INFO:tasks.workunit.client.0.smithi072.stdout:5/850: symlink d0/d117/l11d 0 2024-04-15T21:02:59.847 INFO:tasks.workunit.client.0.smithi072.stdout:7/817: sync 2024-04-15T21:02:59.850 INFO:tasks.workunit.client.0.smithi072.stdout:4/814: mkdir d7/d15/d58/d105 0 2024-04-15T21:02:59.850 INFO:tasks.workunit.client.0.smithi072.stdout:7/818: dread d2/d7/d25/d2d/d46/d5a/d5f/d43/f51 [0,4194304] 0 2024-04-15T21:02:59.860 INFO:tasks.workunit.client.0.smithi072.stdout:4/815: dread - d7/d10/d41/d44/f8e zero size 2024-04-15T21:02:59.861 INFO:tasks.workunit.client.0.smithi072.stdout:4/816: fsync d7/d10/d41/dcf/fd9 0 2024-04-15T21:02:59.864 INFO:tasks.workunit.client.0.smithi072.stdout:8/849: link d3/de/d1b/c28 d3/de/d1b/d41/d74/c107 0 2024-04-15T21:02:59.869 INFO:tasks.workunit.client.0.smithi072.stdout:9/872: rename d4/d29/d4c/lb8 to d4/d1f/d9e/l114 0 2024-04-15T21:02:59.870 INFO:tasks.workunit.client.0.smithi072.stdout:9/873: dread - d4/d29/d4c/d74/d84/df2/df4/ffb zero size 2024-04-15T21:02:59.870 INFO:tasks.workunit.client.0.smithi072.stdout:6/787: getdents d2/d40/d66/dbc 0 2024-04-15T21:02:59.870 INFO:tasks.workunit.client.0.smithi072.stdout:6/788: chown d2/da1 4 1 2024-04-15T21:02:59.871 INFO:tasks.workunit.client.0.smithi072.stdout:5/851: mknod d0/d3/d7/d12/d1d/d102/c11e 0 2024-04-15T21:02:59.871 INFO:tasks.workunit.client.0.smithi072.stdout:9/874: write d4/d1f/d31/d9b/dca/fe2 [104038,98055] 0 2024-04-15T21:02:59.871 INFO:tasks.workunit.client.1.smithi149.stdout:7/981: mknod d3/d16/d32/d110/c158 0 2024-04-15T21:02:59.872 INFO:tasks.workunit.client.0.smithi072.stdout:9/875: readlink d4/d29/l61 0 2024-04-15T21:02:59.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/817: readlink d7/d28/d42/lbf 0 2024-04-15T21:02:59.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/982: mkdir d3/d16/d20/d36/d3d/da4/d138/d159 0 2024-04-15T21:02:59.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/983: chown d3/d16/d11f/d92/f107 10830 1 2024-04-15T21:02:59.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/877: sync 2024-04-15T21:02:59.878 INFO:tasks.workunit.client.0.smithi072.stdout:0/852: sync 2024-04-15T21:02:59.880 INFO:tasks.workunit.client.0.smithi072.stdout:0/853: chown d0/d45/d7a/d70/d59/d8a/d7b/daa/fe3 780 1 2024-04-15T21:02:59.882 INFO:tasks.workunit.client.0.smithi072.stdout:5/852: rename d0/d3/d7/d94/de1/feb to d0/f11f 0 2024-04-15T21:02:59.884 INFO:tasks.workunit.client.0.smithi072.stdout:4/818: dread d7/d24/f59 [4194304,4194304] 0 2024-04-15T21:02:59.884 INFO:tasks.workunit.client.0.smithi072.stdout:7/819: rmdir d2/d7/d25/d72/d98/dc0 0 2024-04-15T21:02:59.886 INFO:tasks.workunit.client.0.smithi072.stdout:4/819: readlink d7/d15/ddd/df7/d76/d8b/dad/lf4 0 2024-04-15T21:02:59.886 INFO:tasks.workunit.client.0.smithi072.stdout:9/876: dread d4/f4e [0,4194304] 0 2024-04-15T21:02:59.888 INFO:tasks.workunit.client.0.smithi072.stdout:0/854: mknod d0/d45/d7a/d70/d59/d8a/d7b/daa/c11b 0 2024-04-15T21:02:59.891 INFO:tasks.workunit.client.0.smithi072.stdout:4/820: creat d7/d15/ddd/df7/d76/f106 x:0 0 0 2024-04-15T21:02:59.892 INFO:tasks.workunit.client.0.smithi072.stdout:4/821: chown d7/d10/d41/d4c/dc9 5 1 2024-04-15T21:02:59.893 INFO:tasks.workunit.client.0.smithi072.stdout:0/855: mkdir d0/d19/d96/dad/dc8/d11c 0 2024-04-15T21:02:59.895 INFO:tasks.workunit.client.0.smithi072.stdout:2/878: creat d2/d8/d8e/f11b x:0 0 0 2024-04-15T21:02:59.896 INFO:tasks.workunit.client.0.smithi072.stdout:4/822: mknod d7/d15/d58/c107 0 2024-04-15T21:02:59.896 INFO:tasks.workunit.client.0.smithi072.stdout:4/823: dread - d7/ff3 zero size 2024-04-15T21:02:59.897 INFO:tasks.workunit.client.0.smithi072.stdout:7/820: creat d2/d7/d25/d2d/d46/f101 x:0 0 0 2024-04-15T21:02:59.898 INFO:tasks.workunit.client.0.smithi072.stdout:7/821: write d2/d7/d25/d2d/d46/d5a/d5f/f3c [3209281,112228] 0 2024-04-15T21:02:59.899 INFO:tasks.workunit.client.0.smithi072.stdout:9/877: rename d4/d29/d4c/d74/d84/l87 to d4/d1f/d31/l115 0 2024-04-15T21:02:59.900 INFO:tasks.workunit.client.0.smithi072.stdout:4/824: creat d7/d15/ddd/df7/d76/f108 x:0 0 0 2024-04-15T21:02:59.903 INFO:tasks.workunit.client.0.smithi072.stdout:0/856: rename d0/d45/d7a/d70/d59/d8a/d8b/db8/f34 to d0/d19/d58/f11d 0 2024-04-15T21:02:59.904 INFO:tasks.workunit.client.0.smithi072.stdout:2/879: mknod d2/d66/c11c 0 2024-04-15T21:02:59.908 INFO:tasks.workunit.client.0.smithi072.stdout:4/825: unlink d7/d28/d42/l47 0 2024-04-15T21:02:59.910 INFO:tasks.workunit.client.0.smithi072.stdout:0/857: symlink d0/d19/d2b/d63/ddb/l11e 0 2024-04-15T21:02:59.911 INFO:tasks.workunit.client.0.smithi072.stdout:0/858: dread - d0/d45/d7a/d70/d59/d8a/d8b/db8/f113 zero size 2024-04-15T21:02:59.912 INFO:tasks.workunit.client.0.smithi072.stdout:1/796: write d5/f32 [4148854,96117] 0 2024-04-15T21:02:59.913 INFO:tasks.workunit.client.0.smithi072.stdout:0/859: chown d0/d45/d7a/d70/d59/d8a/d8b/db8/l95 495 1 2024-04-15T21:02:59.916 INFO:tasks.workunit.client.0.smithi072.stdout:6/789: write d2/d10/d11/d1f/f28 [741756,76346] 0 2024-04-15T21:02:59.917 INFO:tasks.workunit.client.0.smithi072.stdout:0/860: write d0/d6/d48/d61/ffe [22531,75133] 0 2024-04-15T21:02:59.919 INFO:tasks.workunit.client.0.smithi072.stdout:3/825: sync 2024-04-15T21:02:59.921 INFO:tasks.workunit.client.0.smithi072.stdout:1/797: dwrite d5/f32 [0,4194304] 0 2024-04-15T21:02:59.922 INFO:tasks.workunit.client.1.smithi149.stdout:7/984: dwrite d3/d17/f8a [0,4194304] 0 2024-04-15T21:02:59.922 INFO:tasks.workunit.client.0.smithi072.stdout:0/861: creat d0/d74/f11f x:0 0 0 2024-04-15T21:02:59.926 INFO:tasks.workunit.client.1.smithi149.stdout:7/985: rmdir d3/d16/d20/d36 39 2024-04-15T21:02:59.928 INFO:tasks.workunit.client.1.smithi149.stdout:7/986: mknod d3/d16/d11f/d92/d123/d135/c15a 0 2024-04-15T21:02:59.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/987: creat d3/d16/d20/dab/f15b x:0 0 0 2024-04-15T21:02:59.934 INFO:tasks.workunit.client.1.smithi149.stdout:7/988: creat d3/d16/d11f/d92/d123/f15c x:0 0 0 2024-04-15T21:02:59.936 INFO:tasks.workunit.client.1.smithi149.stdout:7/989: chown d3/d17/d11e 5 1 2024-04-15T21:02:59.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/990: unlink d3/d129/c10f 0 2024-04-15T21:02:59.939 INFO:tasks.workunit.client.0.smithi072.stdout:8/850: dwrite d3/d4/d76/fb8 [0,4194304] 0 2024-04-15T21:02:59.941 INFO:tasks.workunit.client.0.smithi072.stdout:4/826: dread d7/d10/f34 [0,4194304] 0 2024-04-15T21:02:59.943 INFO:tasks.workunit.client.0.smithi072.stdout:5/853: dwrite d0/d3/d7/d12/d31/d55/d58/f66 [0,4194304] 0 2024-04-15T21:02:59.943 INFO:tasks.workunit.client.0.smithi072.stdout:3/826: rename d1/d15/d40/dc2/le7 to d1/d15/d40/dc2/lf9 0 2024-04-15T21:02:59.944 INFO:tasks.workunit.client.0.smithi072.stdout:1/798: rename d5/db/d2d/d56/df0/la6 to d5/db/d27/d5c/lfd 0 2024-04-15T21:02:59.947 INFO:tasks.workunit.client.1.smithi149.stdout:7/991: creat d3/d16/d32/d90/dad/dc4/f15d x:0 0 0 2024-04-15T21:02:59.948 INFO:tasks.workunit.client.0.smithi072.stdout:8/851: truncate d3/d4/fe7 283744 0 2024-04-15T21:02:59.950 INFO:tasks.workunit.client.0.smithi072.stdout:3/827: stat d1/d3f/da2/lcb 0 2024-04-15T21:02:59.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/822: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/faa [0,4194304] 0 2024-04-15T21:02:59.952 INFO:tasks.workunit.client.0.smithi072.stdout:9/878: dwrite d4/d1f/d2c/d62/f78 [0,4194304] 0 2024-04-15T21:02:59.952 INFO:tasks.workunit.client.0.smithi072.stdout:2/880: dread d2/d3/f5d [0,4194304] 0 2024-04-15T21:02:59.952 INFO:tasks.workunit.client.1.smithi149.stdout:7/992: creat d3/d16/d32/d90/dad/d14c/d157/f15e x:0 0 0 2024-04-15T21:02:59.960 INFO:tasks.workunit.client.0.smithi072.stdout:1/799: truncate d5/db/d27/d5c/faf 1046578 0 2024-04-15T21:02:59.960 INFO:tasks.workunit.client.0.smithi072.stdout:3/828: read d1/d15/d40/dc2/ff8 [3062946,40651] 0 2024-04-15T21:02:59.965 INFO:tasks.workunit.client.0.smithi072.stdout:0/862: write d0/d6/d55/f8f [1107268,52740] 0 2024-04-15T21:02:59.968 INFO:tasks.workunit.client.0.smithi072.stdout:9/879: mkdir d4/d29/d4c/d74/d10e/d116 0 2024-04-15T21:02:59.968 INFO:tasks.workunit.client.0.smithi072.stdout:8/852: dwrite d3/de/d1b/d44/ffe [0,4194304] 0 2024-04-15T21:02:59.970 INFO:tasks.workunit.client.0.smithi072.stdout:4/827: dwrite d7/d15/ddd/df7/d76/f108 [0,4194304] 0 2024-04-15T21:02:59.971 INFO:tasks.workunit.client.0.smithi072.stdout:1/800: unlink d5/db/d2d/d3a/d1f/f78 0 2024-04-15T21:02:59.973 INFO:tasks.workunit.client.0.smithi072.stdout:1/801: chown d5/db/d2d/d3a/dc3/dd3/cdf 37835 1 2024-04-15T21:02:59.974 INFO:tasks.workunit.client.0.smithi072.stdout:0/863: mknod d0/d45/d35/c120 0 2024-04-15T21:02:59.977 INFO:tasks.workunit.client.0.smithi072.stdout:3/829: mknod d1/d15/d32/d2f/df4/cfa 0 2024-04-15T21:02:59.978 INFO:tasks.workunit.client.0.smithi072.stdout:1/802: truncate d5/db/f59 5104012 0 2024-04-15T21:02:59.979 INFO:tasks.workunit.client.0.smithi072.stdout:0/864: mknod d0/d45/d35/c121 0 2024-04-15T21:02:59.987 INFO:tasks.workunit.client.0.smithi072.stdout:9/880: unlink d4/d1f/db7/d102/f104 0 2024-04-15T21:02:59.988 INFO:tasks.workunit.client.0.smithi072.stdout:7/823: rename d2/d7/d25/d2d/d47/fd2 to d2/d7/d25/d2d/d47/f102 0 2024-04-15T21:02:59.988 INFO:tasks.workunit.client.0.smithi072.stdout:5/854: write d0/d3/d6/d2d/f96 [216378,55494] 0 2024-04-15T21:02:59.989 INFO:tasks.workunit.client.0.smithi072.stdout:3/830: fdatasync d1/d3f/d4f/ff6 0 2024-04-15T21:02:59.991 INFO:tasks.workunit.client.0.smithi072.stdout:7/824: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 10806 1 2024-04-15T21:02:59.991 INFO:tasks.workunit.client.0.smithi072.stdout:5/855: chown d0/d3/d7/d12/d31/d62/db6/lc6 361595 1 2024-04-15T21:02:59.994 INFO:tasks.workunit.client.0.smithi072.stdout:4/828: creat d7/d28/d42/d8c/da9/f109 x:0 0 0 2024-04-15T21:02:59.995 INFO:tasks.workunit.client.0.smithi072.stdout:2/881: dwrite d2/d66/fdc [0,4194304] 0 2024-04-15T21:02:59.997 INFO:tasks.workunit.client.0.smithi072.stdout:8/853: write d3/de/d1b/d41/da4/fc3 [90760,130799] 0 2024-04-15T21:03:00.000 INFO:tasks.workunit.client.0.smithi072.stdout:7/825: mknod d2/d7/d25/c103 0 2024-04-15T21:03:00.004 INFO:tasks.workunit.client.0.smithi072.stdout:2/882: chown d2/d8/d8e/ldd 167501180 1 2024-04-15T21:03:00.005 INFO:tasks.workunit.client.0.smithi072.stdout:1/803: dread d5/db/d2d/f81 [0,4194304] 0 2024-04-15T21:03:00.005 INFO:tasks.workunit.client.0.smithi072.stdout:4/829: dwrite d7/d10/d41/dcf/ffb [0,4194304] 0 2024-04-15T21:03:00.020 INFO:tasks.workunit.client.0.smithi072.stdout:2/883: unlink d2/d64/f87 0 2024-04-15T21:03:00.022 INFO:tasks.workunit.client.0.smithi072.stdout:5/856: dread d0/d3/f16 [0,4194304] 0 2024-04-15T21:03:00.022 INFO:tasks.workunit.client.0.smithi072.stdout:0/865: dwrite d0/d45/f26 [4194304,4194304] 0 2024-04-15T21:03:00.025 INFO:tasks.workunit.client.0.smithi072.stdout:7/826: chown d2/d7/d25/c6e 11649 1 2024-04-15T21:03:00.026 INFO:tasks.workunit.client.0.smithi072.stdout:9/881: truncate d4/d29/d4c/f82 1330238 0 2024-04-15T21:03:00.026 INFO:tasks.workunit.client.0.smithi072.stdout:3/831: dwrite d1/f8f [0,4194304] 0 2024-04-15T21:03:00.030 INFO:tasks.workunit.client.0.smithi072.stdout:2/884: dread d2/d3/d5f/fe3 [0,4194304] 0 2024-04-15T21:03:00.030 INFO:tasks.workunit.client.0.smithi072.stdout:6/790: sync 2024-04-15T21:03:00.030 INFO:tasks.workunit.client.0.smithi072.stdout:1/804: write d5/db/d2d/d3a/f88 [558797,56683] 0 2024-04-15T21:03:00.032 INFO:tasks.workunit.client.0.smithi072.stdout:4/830: dread d7/f55 [0,4194304] 0 2024-04-15T21:03:00.035 INFO:tasks.workunit.client.0.smithi072.stdout:4/831: chown d7/d10/d41/d45/d93/de0/fe4 58447 1 2024-04-15T21:03:00.037 INFO:tasks.workunit.client.0.smithi072.stdout:4/832: stat d7/d15/d58/f7b 0 2024-04-15T21:03:00.038 INFO:tasks.workunit.client.0.smithi072.stdout:6/791: dwrite d2/d10/fe5 [0,4194304] 0 2024-04-15T21:03:00.039 INFO:tasks.workunit.client.0.smithi072.stdout:1/805: dwrite d5/d31/dbc/feb [0,4194304] 0 2024-04-15T21:03:00.039 INFO:tasks.workunit.client.0.smithi072.stdout:8/854: getdents d3/de/d1b/d41/dae/dc0 0 2024-04-15T21:03:00.041 INFO:tasks.workunit.client.0.smithi072.stdout:0/866: creat d0/d45/d35/f122 x:0 0 0 2024-04-15T21:03:00.056 INFO:tasks.workunit.client.0.smithi072.stdout:6/792: fdatasync d2/d40/d66/dbc/fca 0 2024-04-15T21:03:00.057 INFO:tasks.workunit.client.0.smithi072.stdout:6/793: write d2/d10/d11/d1f/d60/f61 [2745907,14099] 0 2024-04-15T21:03:00.062 INFO:tasks.workunit.client.0.smithi072.stdout:3/832: mknod d1/d15/d32/d78/ded/cfb 0 2024-04-15T21:03:00.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/833: chown d1/d3f/d4f 3645 1 2024-04-15T21:03:00.064 INFO:tasks.workunit.client.0.smithi072.stdout:3/834: write d1/d3f/d4f/da3/fe2 [423993,23831] 0 2024-04-15T21:03:00.069 INFO:tasks.workunit.client.0.smithi072.stdout:6/794: rename d2/l9 to d2/d40/d66/da8/led 0 2024-04-15T21:03:00.072 INFO:tasks.workunit.client.0.smithi072.stdout:2/885: creat d2/d8/d8e/f11d x:0 0 0 2024-04-15T21:03:00.076 INFO:tasks.workunit.client.0.smithi072.stdout:6/795: dread - d2/d42/f8b zero size 2024-04-15T21:03:00.077 INFO:tasks.workunit.client.0.smithi072.stdout:7/827: link d2/d78/fbb d2/d7/d25/d2d/d46/d5a/d5f/d1f/f104 0 2024-04-15T21:03:00.078 INFO:tasks.workunit.client.0.smithi072.stdout:2/886: symlink d2/d64/dce/l11e 0 2024-04-15T21:03:00.078 INFO:tasks.workunit.client.0.smithi072.stdout:5/857: write d0/d3/d7/d12/d31/d49/fad [1695983,113142] 0 2024-04-15T21:03:00.079 INFO:tasks.workunit.client.0.smithi072.stdout:9/882: write d4/f5 [3591720,26352] 0 2024-04-15T21:03:00.081 INFO:tasks.workunit.client.0.smithi072.stdout:4/833: getdents d7/d28/d42 0 2024-04-15T21:03:00.081 INFO:tasks.workunit.client.0.smithi072.stdout:7/828: chown d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 487382 1 2024-04-15T21:03:00.083 INFO:tasks.workunit.client.0.smithi072.stdout:2/887: unlink d2/d8/l25 0 2024-04-15T21:03:00.083 INFO:tasks.workunit.client.0.smithi072.stdout:0/867: write d0/d6/f2c [315607,57375] 0 2024-04-15T21:03:00.085 INFO:tasks.workunit.client.0.smithi072.stdout:5/858: mknod d0/d3/d33/d60/c120 0 2024-04-15T21:03:00.086 INFO:tasks.workunit.client.0.smithi072.stdout:6/796: fdatasync d2/d40/dcb/d49/f65 0 2024-04-15T21:03:00.087 INFO:tasks.workunit.client.0.smithi072.stdout:4/834: rmdir d7/d10/d41 39 2024-04-15T21:03:00.087 INFO:tasks.workunit.client.0.smithi072.stdout:8/855: write d3/de/d1b/f62 [4523422,74972] 0 2024-04-15T21:03:00.089 INFO:tasks.workunit.client.0.smithi072.stdout:7/829: stat d2/d7/d25/d72/d98/de2/de4/ff3 0 2024-04-15T21:03:00.090 INFO:tasks.workunit.client.0.smithi072.stdout:6/797: dread d2/d10/d11/d15/fd8 [0,4194304] 0 2024-04-15T21:03:00.090 INFO:tasks.workunit.client.0.smithi072.stdout:1/806: truncate d5/db/d2d/f81 2077183 0 2024-04-15T21:03:00.092 INFO:tasks.workunit.client.0.smithi072.stdout:5/859: fsync d0/d3/d7/d94/d86/fb9 0 2024-04-15T21:03:00.093 INFO:tasks.workunit.client.0.smithi072.stdout:9/883: dread d4/d1f/d31/f7e [0,4194304] 0 2024-04-15T21:03:00.094 INFO:tasks.workunit.client.0.smithi072.stdout:5/860: write d0/d3/d7/d12/d31/d62/db6/f10f [594983,2448] 0 2024-04-15T21:03:00.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/835: write d1/d15/d32/d78/fa5 [2785611,123926] 0 2024-04-15T21:03:00.099 INFO:tasks.workunit.client.0.smithi072.stdout:0/868: mknod d0/d19/d96/dad/dc8/df6/c123 0 2024-04-15T21:03:00.102 INFO:tasks.workunit.client.0.smithi072.stdout:7/830: symlink d2/d7/d25/d2d/d46/d5a/d5f/dbc/l105 0 2024-04-15T21:03:00.102 INFO:tasks.workunit.client.0.smithi072.stdout:5/861: dread d0/d3/d7/d1f/d4c/fea [0,4194304] 0 2024-04-15T21:03:00.107 INFO:tasks.workunit.client.0.smithi072.stdout:9/884: read d4/d29/d45/fa1 [1048774,42400] 0 2024-04-15T21:03:00.107 INFO:tasks.workunit.client.0.smithi072.stdout:2/888: creat d2/d8/d8e/f11f x:0 0 0 2024-04-15T21:03:00.109 INFO:tasks.workunit.client.0.smithi072.stdout:3/836: dwrite d1/d15/d32/d2f/d1a/ff2 [0,4194304] 0 2024-04-15T21:03:00.109 INFO:tasks.workunit.client.0.smithi072.stdout:1/807: dread d5/db/f52 [0,4194304] 0 2024-04-15T21:03:00.110 INFO:tasks.workunit.client.0.smithi072.stdout:4/835: dread d7/d71/db2/fc5 [0,4194304] 0 2024-04-15T21:03:00.111 INFO:tasks.workunit.client.0.smithi072.stdout:0/869: rename d0/d19/d71/d9e/fe4 to d0/d6/d6d/d117/f124 0 2024-04-15T21:03:00.112 INFO:tasks.workunit.client.0.smithi072.stdout:7/831: mknod d2/d78/c106 0 2024-04-15T21:03:00.115 INFO:tasks.workunit.client.0.smithi072.stdout:3/837: truncate d1/d15/d32/d78/fdf 697731 0 2024-04-15T21:03:00.115 INFO:tasks.workunit.client.0.smithi072.stdout:5/862: mknod d0/d3/d6/d2d/d79/c121 0 2024-04-15T21:03:00.116 INFO:tasks.workunit.client.0.smithi072.stdout:8/856: dread d3/f30 [0,4194304] 0 2024-04-15T21:03:00.123 INFO:tasks.workunit.client.0.smithi072.stdout:0/870: mknod d0/d19/d2b/c125 0 2024-04-15T21:03:00.126 INFO:tasks.workunit.client.0.smithi072.stdout:6/798: link d2/d10/f1d d2/d40/fee 0 2024-04-15T21:03:00.128 INFO:tasks.workunit.client.0.smithi072.stdout:5/863: creat d0/d3/d33/d60/d81/f122 x:0 0 0 2024-04-15T21:03:00.129 INFO:tasks.workunit.client.0.smithi072.stdout:2/889: dread d2/f44 [0,4194304] 0 2024-04-15T21:03:00.130 INFO:tasks.workunit.client.0.smithi072.stdout:9/885: creat d4/d29/d4c/d74/d10e/d116/f117 x:0 0 0 2024-04-15T21:03:00.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/864: dread - d0/d3/d7/d12/d1d/d8c/f11b zero size 2024-04-15T21:03:00.131 INFO:tasks.workunit.client.0.smithi072.stdout:7/832: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/d107 0 2024-04-15T21:03:00.133 INFO:tasks.workunit.client.0.smithi072.stdout:6/799: creat d2/da1/fef x:0 0 0 2024-04-15T21:03:00.134 INFO:tasks.workunit.client.0.smithi072.stdout:0/871: creat d0/d19/d2b/d63/ddb/de0/f126 x:0 0 0 2024-04-15T21:03:00.135 INFO:tasks.workunit.client.0.smithi072.stdout:1/808: dread d5/db/d2d/d3a/f50 [0,4194304] 0 2024-04-15T21:03:00.135 INFO:tasks.workunit.client.0.smithi072.stdout:3/838: dread d1/d15/f31 [0,4194304] 0 2024-04-15T21:03:00.135 INFO:tasks.workunit.client.0.smithi072.stdout:0/872: chown d0/d6/cca 7724742 1 2024-04-15T21:03:00.136 INFO:tasks.workunit.client.0.smithi072.stdout:9/886: chown d4/f1c 6 1 2024-04-15T21:03:00.136 INFO:tasks.workunit.client.0.smithi072.stdout:7/833: rmdir d2/d7/d25 39 2024-04-15T21:03:00.138 INFO:tasks.workunit.client.0.smithi072.stdout:8/857: rename d3/de/d1b/d85/d101/l104 to d3/de/l108 0 2024-04-15T21:03:00.139 INFO:tasks.workunit.client.0.smithi072.stdout:8/858: write d3/d7e/ff3 [5193683,37379] 0 2024-04-15T21:03:00.145 INFO:tasks.workunit.client.0.smithi072.stdout:9/887: symlink d4/d1f/d31/d9b/l118 0 2024-04-15T21:03:00.146 INFO:tasks.workunit.client.0.smithi072.stdout:8/859: dwrite d3/de/d1b/d44/ffe [0,4194304] 0 2024-04-15T21:03:00.148 INFO:tasks.workunit.client.0.smithi072.stdout:4/836: rename d7/d10/d41/d4c/l5d to d7/d15/df0/l10a 0 2024-04-15T21:03:00.148 INFO:tasks.workunit.client.0.smithi072.stdout:1/809: dread d5/db/d2d/d56/df0/d82/f92 [0,4194304] 0 2024-04-15T21:03:00.151 INFO:tasks.workunit.client.0.smithi072.stdout:2/890: creat d2/d8/d41/f120 x:0 0 0 2024-04-15T21:03:00.154 INFO:tasks.workunit.client.0.smithi072.stdout:0/873: symlink d0/d6/d48/l127 0 2024-04-15T21:03:00.157 INFO:tasks.workunit.client.0.smithi072.stdout:8/860: symlink d3/de/d1b/d41/dae/dc0/l109 0 2024-04-15T21:03:00.159 INFO:tasks.workunit.client.0.smithi072.stdout:0/874: dwrite d0/d19/d58/f106 [0,4194304] 0 2024-04-15T21:03:00.160 INFO:tasks.workunit.client.0.smithi072.stdout:9/888: rename d4/d1f/d31/d9b/dca/fe2 to d4/d1f/d2c/d47/f119 0 2024-04-15T21:03:00.161 INFO:tasks.workunit.client.0.smithi072.stdout:4/837: creat d7/d10/d41/d44/d7a/f10b x:0 0 0 2024-04-15T21:03:00.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/834: truncate d2/d7/d25/f34 3254453 0 2024-04-15T21:03:00.165 INFO:tasks.workunit.client.0.smithi072.stdout:2/891: dread - d2/d8/d41/dde/f10e zero size 2024-04-15T21:03:00.169 INFO:tasks.workunit.client.0.smithi072.stdout:6/800: dwrite d2/d40/dcb/f38 [0,4194304] 0 2024-04-15T21:03:00.170 INFO:tasks.workunit.client.0.smithi072.stdout:2/892: truncate d2/d8/d8e/f11b 805181 0 2024-04-15T21:03:00.171 INFO:tasks.workunit.client.0.smithi072.stdout:9/889: dread d4/d1f/d31/d4d/dae/fb5 [0,4194304] 0 2024-04-15T21:03:00.171 INFO:tasks.workunit.client.0.smithi072.stdout:3/839: dwrite d1/d26/f58 [4194304,4194304] 0 2024-04-15T21:03:00.172 INFO:tasks.workunit.client.0.smithi072.stdout:4/838: mknod d7/d15/ddd/df7/d76/d8b/c10c 0 2024-04-15T21:03:00.173 INFO:tasks.workunit.client.0.smithi072.stdout:9/890: stat d4/d29/d45 0 2024-04-15T21:03:00.173 INFO:tasks.workunit.client.1.smithi149.stdout:7/993: sync 2024-04-15T21:03:00.175 INFO:tasks.workunit.client.0.smithi072.stdout:7/835: mkdir d2/d7/d25/d72/d98/d108 0 2024-04-15T21:03:00.176 INFO:tasks.workunit.client.0.smithi072.stdout:8/861: mkdir d3/de/d1b/d44/d102/d10a 0 2024-04-15T21:03:00.177 INFO:tasks.workunit.client.1.smithi149.stdout:7/994: mkdir d3/d17/d1f/d93/d15f 0 2024-04-15T21:03:00.180 INFO:tasks.workunit.client.0.smithi072.stdout:0/875: symlink d0/d45/l128 0 2024-04-15T21:03:00.183 INFO:tasks.workunit.client.0.smithi072.stdout:8/862: dwrite d3/d4/d4c/ff7 [0,4194304] 0 2024-04-15T21:03:00.184 INFO:tasks.workunit.client.1.smithi149.stdout:7/995: dread d3/d17/d1f/d93/fdf [0,4194304] 0 2024-04-15T21:03:00.187 INFO:tasks.workunit.client.0.smithi072.stdout:1/810: dwrite d5/db/d2d/d3a/d1f/d63/fa9 [0,4194304] 0 2024-04-15T21:03:00.187 INFO:tasks.workunit.client.0.smithi072.stdout:4/839: fsync d7/d10/d41/f51 0 2024-04-15T21:03:00.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/840: rmdir d1/d3f/d4f/d73/db3/dc4/dd0 39 2024-04-15T21:03:00.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/841: chown d1/c70 68495941 1 2024-04-15T21:03:00.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/996: mkdir d3/d16/d32/d110/d160 0 2024-04-15T21:03:00.196 INFO:tasks.workunit.client.0.smithi072.stdout:3/842: dwrite d1/d26/f58 [4194304,4194304] 0 2024-04-15T21:03:00.201 INFO:tasks.workunit.client.0.smithi072.stdout:6/801: rename d2/d10/d11/d15/l2f to d2/d10/d18/d47/d6d/lf0 0 2024-04-15T21:03:00.203 INFO:tasks.workunit.client.0.smithi072.stdout:6/802: readlink d2/d40/dc3/lce 0 2024-04-15T21:03:00.207 INFO:tasks.workunit.client.0.smithi072.stdout:1/811: readlink d5/lca 0 2024-04-15T21:03:00.211 INFO:tasks.workunit.client.0.smithi072.stdout:4/840: chown d7/d23/d6c/c3f 3477541 1 2024-04-15T21:03:00.212 INFO:tasks.workunit.client.1.smithi149.stdout:7/997: dwrite d3/d16/d20/d114/fa2 [0,4194304] 0 2024-04-15T21:03:00.216 INFO:tasks.workunit.client.0.smithi072.stdout:8/863: dread d3/de/d1b/f43 [0,4194304] 0 2024-04-15T21:03:00.216 INFO:tasks.workunit.client.0.smithi072.stdout:0/876: rename d0/d19/d96 to d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129 0 2024-04-15T21:03:00.217 INFO:tasks.workunit.client.0.smithi072.stdout:8/864: chown d3/d4/d4c/l18 42 1 2024-04-15T21:03:00.218 INFO:tasks.workunit.client.1.smithi149.stdout:7/998: mkdir d3/d16/d20/dab/d161 0 2024-04-15T21:03:00.221 INFO:tasks.workunit.client.0.smithi072.stdout:2/893: write d2/d66/fe1 [1126894,120148] 0 2024-04-15T21:03:00.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/999: rename d3/d16/d32/d90/dad/d14c/d157 to d3/d16/d32/d90/dad/dc4/dd6/d162 0 2024-04-15T21:03:00.231 INFO:tasks.workunit.client.1.smithi149.stderr:+ rm -rf -- ./tmp.DUo23Qyueu 2024-04-15T21:03:00.233 INFO:tasks.workunit.client.0.smithi072.stdout:7/836: creat d2/d7/f109 x:0 0 0 2024-04-15T21:03:00.234 INFO:tasks.workunit.client.0.smithi072.stdout:4/841: symlink d7/d23/l10d 0 2024-04-15T21:03:00.234 INFO:tasks.workunit.client.0.smithi072.stdout:9/891: write d4/d1f/d2c/d47/f5f [635753,128741] 0 2024-04-15T21:03:00.235 INFO:tasks.workunit.client.0.smithi072.stdout:6/803: dread d2/d10/d11/f4b [0,4194304] 0 2024-04-15T21:03:00.240 INFO:tasks.workunit.client.0.smithi072.stdout:3/843: write d1/d15/f34 [828643,87134] 0 2024-04-15T21:03:00.240 INFO:tasks.workunit.client.0.smithi072.stdout:8/865: write d3/d7e/f8d [588926,74878] 0 2024-04-15T21:03:00.243 INFO:tasks.workunit.client.0.smithi072.stdout:8/866: fsync d3/de/d1b/d3f/f83 0 2024-04-15T21:03:00.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/812: dwrite d5/db/d27/d9c/fb4 [0,4194304] 0 2024-04-15T21:03:00.244 INFO:tasks.workunit.client.0.smithi072.stdout:2/894: write d2/d8/f13 [5185426,18644] 0 2024-04-15T21:03:00.245 INFO:tasks.workunit.client.0.smithi072.stdout:9/892: fdatasync d4/d1f/d2c/d47/f79 0 2024-04-15T21:03:00.246 INFO:tasks.workunit.client.0.smithi072.stdout:2/895: write d2/d8/d41/f103 [560532,110047] 0 2024-04-15T21:03:00.247 INFO:tasks.workunit.client.0.smithi072.stdout:6/804: mkdir d2/d10/d11/d1f/d60/df1 0 2024-04-15T21:03:00.247 INFO:tasks.workunit.client.0.smithi072.stdout:3/844: readlink d1/d15/l46 0 2024-04-15T21:03:00.248 INFO:tasks.workunit.client.0.smithi072.stdout:9/893: write d4/d1f/d31/d9b/dca/f103 [488749,127694] 0 2024-04-15T21:03:00.249 INFO:tasks.workunit.client.0.smithi072.stdout:2/896: read d2/dd7/fe9 [1544950,106236] 0 2024-04-15T21:03:00.249 INFO:tasks.workunit.client.0.smithi072.stdout:9/894: chown d4/d1f/d31 65665 1 2024-04-15T21:03:00.250 INFO:tasks.workunit.client.0.smithi072.stdout:0/877: rename d0/d45/d7a/d70/d59/d8a/d7b/ffd to d0/d6/d48/f12a 0 2024-04-15T21:03:00.254 INFO:tasks.workunit.client.0.smithi072.stdout:7/837: unlink d2/d7/d25/d4c/f59 0 2024-04-15T21:03:00.255 INFO:tasks.workunit.client.0.smithi072.stdout:4/842: mknod d7/d10/c10e 0 2024-04-15T21:03:00.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/895: dwrite d4/d29/d4c/d74/d84/ff3 [0,4194304] 0 2024-04-15T21:03:00.262 INFO:tasks.workunit.client.0.smithi072.stdout:9/896: dwrite d4/d29/d4c/d74/d84/ff3 [0,4194304] 0 2024-04-15T21:03:00.303 INFO:tasks.workunit.client.0.smithi072.stdout:2/897: unlink d2/d3/f5 0 2024-04-15T21:03:00.303 INFO:tasks.workunit.client.0.smithi072.stdout:6/805: rename d2/d42/cc6 to d2/d10/d11/d1f/d60/df1/cf2 0 2024-04-15T21:03:00.304 INFO:tasks.workunit.client.0.smithi072.stdout:0/878: symlink d0/d19/d2b/l12b 0 2024-04-15T21:03:00.304 INFO:tasks.workunit.client.0.smithi072.stdout:8/867: mkdir d3/d4/d10b 0 2024-04-15T21:03:00.305 INFO:tasks.workunit.client.0.smithi072.stdout:1/813: dread d5/db/d2d/d56/df0/d82/fae [0,4194304] 0 2024-04-15T21:03:00.306 INFO:tasks.workunit.client.0.smithi072.stdout:6/806: chown d2/d10/d18/d47/cb0 15971359 1 2024-04-15T21:03:00.306 INFO:tasks.workunit.client.0.smithi072.stdout:9/897: dread d4/d1f/d2c/d62/f96 [0,4194304] 0 2024-04-15T21:03:00.311 INFO:tasks.workunit.client.0.smithi072.stdout:8/868: chown d3/de/l108 768930 1 2024-04-15T21:03:00.313 INFO:tasks.workunit.client.0.smithi072.stdout:2/898: truncate d2/d8/f28 4577937 0 2024-04-15T21:03:00.317 INFO:tasks.workunit.client.0.smithi072.stdout:3/845: dread d1/d5b/f60 [0,4194304] 0 2024-04-15T21:03:00.319 INFO:tasks.workunit.client.0.smithi072.stdout:8/869: dwrite d3/de/d1b/d41/d74/d98/da5/ff1 [0,4194304] 0 2024-04-15T21:03:00.321 INFO:tasks.workunit.client.0.smithi072.stdout:8/870: write d3/de/d1b/d44/f78 [233134,43120] 0 2024-04-15T21:03:00.328 INFO:tasks.workunit.client.0.smithi072.stdout:6/807: dwrite d2/d42/f45 [0,4194304] 0 2024-04-15T21:03:00.336 INFO:tasks.workunit.client.0.smithi072.stdout:9/898: symlink d4/d1f/d31/l11a 0 2024-04-15T21:03:00.344 INFO:tasks.workunit.client.0.smithi072.stdout:8/871: creat d3/de/d1b/d44/d102/f10c x:0 0 0 2024-04-15T21:03:00.348 INFO:tasks.workunit.client.0.smithi072.stdout:6/808: truncate d2/d40/d56/d6a/f72 1212468 0 2024-04-15T21:03:00.349 INFO:tasks.workunit.client.0.smithi072.stdout:1/814: dwrite d5/db/d2d/d56/d93/fa2 [0,4194304] 0 2024-04-15T21:03:00.351 INFO:tasks.workunit.client.0.smithi072.stdout:6/809: fdatasync d2/d40/d66/d7f/dd9/f55 0 2024-04-15T21:03:00.352 INFO:tasks.workunit.client.0.smithi072.stdout:8/872: dwrite d3/d4/f91 [0,4194304] 0 2024-04-15T21:03:00.352 INFO:tasks.workunit.client.0.smithi072.stdout:5/865: sync 2024-04-15T21:03:00.358 INFO:tasks.workunit.client.0.smithi072.stdout:0/879: getdents d0/d45/d7a/d70/d59/d8a/d108 0 2024-04-15T21:03:00.359 INFO:tasks.workunit.client.0.smithi072.stdout:2/899: dread d2/d38/f56 [4194304,4194304] 0 2024-04-15T21:03:00.361 INFO:tasks.workunit.client.0.smithi072.stdout:0/880: write d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f10c [374759,18754] 0 2024-04-15T21:03:00.362 INFO:tasks.workunit.client.0.smithi072.stdout:0/881: write d0/d6/f4e [1547758,84886] 0 2024-04-15T21:03:00.365 INFO:tasks.workunit.client.0.smithi072.stdout:1/815: mknod d5/d31/dbc/cfe 0 2024-04-15T21:03:00.368 INFO:tasks.workunit.client.0.smithi072.stdout:3/846: creat d1/d15/d40/ffc x:0 0 0 2024-04-15T21:03:00.375 INFO:tasks.workunit.client.0.smithi072.stdout:9/899: rename d4/d76/d8f/f108 to d4/d1f/d9e/db3/f11b 0 2024-04-15T21:03:00.377 INFO:tasks.workunit.client.0.smithi072.stdout:2/900: symlink d2/d8/df3/l121 0 2024-04-15T21:03:00.377 INFO:tasks.workunit.client.0.smithi072.stdout:5/866: dread d0/d3/d7/d94/d86/fb9 [0,4194304] 0 2024-04-15T21:03:00.377 INFO:tasks.workunit.client.0.smithi072.stdout:2/901: write d2/d8/f13 [5194368,35377] 0 2024-04-15T21:03:00.378 INFO:tasks.workunit.client.0.smithi072.stdout:5/867: stat d0/d3/d6/d2d/l43 0 2024-04-15T21:03:00.389 INFO:tasks.workunit.client.0.smithi072.stdout:5/868: creat d0/f123 x:0 0 0 2024-04-15T21:03:00.397 INFO:tasks.workunit.client.0.smithi072.stdout:3/847: rename d1/d15/cb6 to d1/d15/d32/d2f/d1a/cfd 0 2024-04-15T21:03:00.401 INFO:tasks.workunit.client.0.smithi072.stdout:5/869: read d0/d3/d6/d14/fb2 [338556,76524] 0 2024-04-15T21:03:00.401 INFO:tasks.workunit.client.0.smithi072.stdout:8/873: dread d3/d4/d76/d8f/fdc [0,4194304] 0 2024-04-15T21:03:00.402 INFO:tasks.workunit.client.0.smithi072.stdout:0/882: link d0/d74/d94/lb6 d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/l12c 0 2024-04-15T21:03:00.405 INFO:tasks.workunit.client.0.smithi072.stdout:6/810: getdents d2/d10/d11/d1f/d60/d63/dd4 0 2024-04-15T21:03:00.408 INFO:tasks.workunit.client.0.smithi072.stdout:9/900: creat d4/d1f/db7/f11c x:0 0 0 2024-04-15T21:03:00.408 INFO:tasks.workunit.client.0.smithi072.stdout:7/838: sync 2024-04-15T21:03:00.410 INFO:tasks.workunit.client.0.smithi072.stdout:1/816: dwrite d5/db/d27/d5c/faf [0,4194304] 0 2024-04-15T21:03:00.411 INFO:tasks.workunit.client.0.smithi072.stdout:6/811: write d2/d10/d11/d1f/d60/d63/dd4/fec [690201,30635] 0 2024-04-15T21:03:00.412 INFO:tasks.workunit.client.0.smithi072.stdout:8/874: dwrite d3/d7e/fc1 [0,4194304] 0 2024-04-15T21:03:00.413 INFO:tasks.workunit.client.0.smithi072.stdout:1/817: chown d5/db/d27/f47 2 1 2024-04-15T21:03:00.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: pgmap v14: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 283 MiB/s wr, 586 op/s 2024-04-15T21:03:00.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:02:59 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.415 INFO:tasks.workunit.client.0.smithi072.stdout:3/848: dread d1/d15/d40/d9e/dc7/fcd [0,4194304] 0 2024-04-15T21:03:00.415 INFO:tasks.workunit.client.0.smithi072.stdout:5/870: truncate d0/d3/d6/d14/fd6 588975 0 2024-04-15T21:03:00.415 INFO:tasks.workunit.client.0.smithi072.stdout:8/875: write d3/d4/d76/fb8 [2514966,104127] 0 2024-04-15T21:03:00.418 INFO:tasks.workunit.client.0.smithi072.stdout:8/876: fsync d3/de/d1b/f93 0 2024-04-15T21:03:00.419 INFO:tasks.workunit.client.0.smithi072.stdout:8/877: chown d3/d4/d10b 152 1 2024-04-15T21:03:00.419 INFO:tasks.workunit.client.0.smithi072.stdout:8/878: chown d3/d4/d76/l80 2052247 1 2024-04-15T21:03:00.420 INFO:tasks.workunit.client.0.smithi072.stdout:8/879: chown d3/de/d1b/d44/c6f 8475264 1 2024-04-15T21:03:00.421 INFO:tasks.workunit.client.0.smithi072.stdout:2/902: link d2/da8/cf6 d2/d66/c122 0 2024-04-15T21:03:00.421 INFO:tasks.workunit.client.0.smithi072.stdout:2/903: write d2/f12 [8605581,77444] 0 2024-04-15T21:03:00.433 INFO:tasks.workunit.client.0.smithi072.stdout:6/812: mkdir d2/d10/d11/d1f/d60/df3 0 2024-04-15T21:03:00.434 INFO:tasks.workunit.client.0.smithi072.stdout:6/813: write d2/d10/d11/d1f/d60/d63/dd4/fec [438873,65066] 0 2024-04-15T21:03:00.435 INFO:tasks.workunit.client.0.smithi072.stdout:3/849: read - d1/d3f/d4f/da3/fcc zero size 2024-04-15T21:03:00.440 INFO:tasks.workunit.client.0.smithi072.stdout:0/883: dwrite d0/d45/d7a/fbd [0,4194304] 0 2024-04-15T21:03:00.441 INFO:tasks.workunit.client.0.smithi072.stdout:7/839: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab [1297793,25922] 0 2024-04-15T21:03:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: pgmap v14: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 283 MiB/s wr, 586 op/s 2024-04-15T21:03:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:00.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:02:59 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:00.446 INFO:tasks.workunit.client.0.smithi072.stdout:2/904: symlink d2/d38/d73/l123 0 2024-04-15T21:03:00.446 INFO:tasks.workunit.client.0.smithi072.stdout:2/905: stat d2/d3/f7f 0 2024-04-15T21:03:00.447 INFO:tasks.workunit.client.0.smithi072.stdout:1/818: mknod d5/cff 0 2024-04-15T21:03:00.448 INFO:tasks.workunit.client.0.smithi072.stdout:1/819: stat d5/db/daa/ccd 0 2024-04-15T21:03:00.450 INFO:tasks.workunit.client.0.smithi072.stdout:9/901: write d4/d1f/f24 [3413681,106086] 0 2024-04-15T21:03:00.450 INFO:tasks.workunit.client.0.smithi072.stdout:6/814: chown d2/d10/d11/d15/fbe 250 1 2024-04-15T21:03:00.455 INFO:tasks.workunit.client.0.smithi072.stdout:3/850: rename d1/d15/d32/d2f/l79 to d1/d15/d32/d2f/d1a/lfe 0 2024-04-15T21:03:00.455 INFO:tasks.workunit.client.0.smithi072.stdout:8/880: getdents d3/d4/d4c/de5 0 2024-04-15T21:03:00.458 INFO:tasks.workunit.client.0.smithi072.stdout:8/881: chown d3/de/d1b/d41/d74/ccb 140880306 1 2024-04-15T21:03:00.458 INFO:tasks.workunit.client.0.smithi072.stdout:5/871: dread d0/d3/d7/d12/d31/d62/db6/fd2 [0,4194304] 0 2024-04-15T21:03:00.458 INFO:tasks.workunit.client.0.smithi072.stdout:7/840: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/d10a 0 2024-04-15T21:03:00.458 INFO:tasks.workunit.client.0.smithi072.stdout:8/882: write d3/de/d1b/d3f/f83 [4082247,59193] 0 2024-04-15T21:03:00.461 INFO:tasks.workunit.client.0.smithi072.stdout:1/820: dread d5/db/d2d/f81 [0,4194304] 0 2024-04-15T21:03:00.462 INFO:tasks.workunit.client.0.smithi072.stdout:9/902: rename d4/d1f/d31/d4d/fbb to d4/d76/f11d 0 2024-04-15T21:03:00.463 INFO:tasks.workunit.client.0.smithi072.stdout:1/821: chown d5/db/d2d/d56/d93/la0 1190174 1 2024-04-15T21:03:00.464 INFO:tasks.workunit.client.0.smithi072.stdout:2/906: fdatasync d2/d8/f28 0 2024-04-15T21:03:00.466 INFO:tasks.workunit.client.0.smithi072.stdout:4/843: sync 2024-04-15T21:03:00.467 INFO:tasks.workunit.client.0.smithi072.stdout:0/884: dread d0/d19/d2b/f4d [0,4194304] 0 2024-04-15T21:03:00.470 INFO:tasks.workunit.client.0.smithi072.stdout:6/815: creat d2/d42/db9/dc9/ff4 x:0 0 0 2024-04-15T21:03:00.472 INFO:tasks.workunit.client.0.smithi072.stdout:7/841: write d2/d7/d25/d2d/d46/d5a/d5f/f5e [965015,66640] 0 2024-04-15T21:03:00.472 INFO:tasks.workunit.client.0.smithi072.stdout:8/883: symlink d3/de/d1b/d41/dae/dc0/de9/l10d 0 2024-04-15T21:03:00.475 INFO:tasks.workunit.client.0.smithi072.stdout:3/851: mkdir d1/d15/d40/dff 0 2024-04-15T21:03:00.476 INFO:tasks.workunit.client.0.smithi072.stdout:3/852: readlink d1/d15/d40/d9e/dc7/lef 0 2024-04-15T21:03:00.476 INFO:tasks.workunit.client.0.smithi072.stdout:9/903: rmdir d4/d1f/d31/d9b/dca 39 2024-04-15T21:03:00.480 INFO:tasks.workunit.client.0.smithi072.stdout:1/822: mkdir d5/db/d2d/d3a/d1f/d63/d100 0 2024-04-15T21:03:00.482 INFO:tasks.workunit.client.0.smithi072.stdout:9/904: dwrite d4/d29/d4c/d74/d84/df2/df4/ffb [0,4194304] 0 2024-04-15T21:03:00.483 INFO:tasks.workunit.client.0.smithi072.stdout:9/905: chown d4/d1f/d31/dcc 10547 1 2024-04-15T21:03:00.483 INFO:tasks.workunit.client.0.smithi072.stdout:5/872: creat d0/d3/d7/d94/d86/d10d/f124 x:0 0 0 2024-04-15T21:03:00.496 INFO:tasks.workunit.client.0.smithi072.stdout:1/823: rename d5/db/d2d/d3a to d5/db/d2d/d85/dbf/d101 0 2024-04-15T21:03:00.497 INFO:tasks.workunit.client.0.smithi072.stdout:2/907: truncate d2/d3/f15 1234106 0 2024-04-15T21:03:00.498 INFO:tasks.workunit.client.0.smithi072.stdout:4/844: write d7/d10/d41/d44/f73 [716000,44798] 0 2024-04-15T21:03:00.499 INFO:tasks.workunit.client.0.smithi072.stdout:9/906: mknod d4/d1f/d2c/de9/dfc/c11e 0 2024-04-15T21:03:00.502 INFO:tasks.workunit.client.0.smithi072.stdout:7/842: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d10b 0 2024-04-15T21:03:00.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/824: dwrite d5/d31/f87 [0,4194304] 0 2024-04-15T21:03:00.504 INFO:tasks.workunit.client.0.smithi072.stdout:3/853: link d1/f64 d1/d15/d40/d9e/dc7/f100 0 2024-04-15T21:03:00.507 INFO:tasks.workunit.client.0.smithi072.stdout:0/885: dwrite d0/d6/f25 [0,4194304] 0 2024-04-15T21:03:00.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/886: chown d0/d6/d6d/d117 136007 1 2024-04-15T21:03:00.509 INFO:tasks.workunit.client.0.smithi072.stdout:6/816: creat d2/d10/d18/ff5 x:0 0 0 2024-04-15T21:03:00.511 INFO:tasks.workunit.client.0.smithi072.stdout:0/887: rename d0/d6 to d0/d6/d6d/d12d 22 2024-04-15T21:03:00.514 INFO:tasks.workunit.client.0.smithi072.stdout:3/854: creat d1/d26/f101 x:0 0 0 2024-04-15T21:03:00.515 INFO:tasks.workunit.client.0.smithi072.stdout:4/845: dwrite d7/d71/db2/fcc [0,4194304] 0 2024-04-15T21:03:00.521 INFO:tasks.workunit.client.0.smithi072.stdout:4/846: dwrite d7/d10/d41/dc4/de8/d103/f90 [0,4194304] 0 2024-04-15T21:03:00.522 INFO:tasks.workunit.client.0.smithi072.stdout:4/847: chown d7/d28/f40 7687816 1 2024-04-15T21:03:00.526 INFO:tasks.workunit.client.0.smithi072.stdout:8/884: getdents d3/de/d1b/d41/da4 0 2024-04-15T21:03:00.529 INFO:tasks.workunit.client.0.smithi072.stdout:0/888: symlink d0/d45/d35/d3a/l12e 0 2024-04-15T21:03:00.534 INFO:tasks.workunit.client.0.smithi072.stdout:7/843: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/d107/c10c 0 2024-04-15T21:03:00.535 INFO:tasks.workunit.client.0.smithi072.stdout:1/825: getdents d5/db/d2d/d56/df0/d82/df8 0 2024-04-15T21:03:00.537 INFO:tasks.workunit.client.0.smithi072.stdout:4/848: creat d7/d10/d41/d44/d7a/d97/f10f x:0 0 0 2024-04-15T21:03:00.538 INFO:tasks.workunit.client.0.smithi072.stdout:9/907: truncate d4/d29/f71 2853285 0 2024-04-15T21:03:00.539 INFO:tasks.workunit.client.0.smithi072.stdout:5/873: getdents d0/d3/d7/d12 0 2024-04-15T21:03:00.540 INFO:tasks.workunit.client.0.smithi072.stdout:4/849: read d7/f4f [1362934,60040] 0 2024-04-15T21:03:00.541 INFO:tasks.workunit.client.0.smithi072.stdout:4/850: write d7/f38 [3156910,50365] 0 2024-04-15T21:03:00.541 INFO:tasks.workunit.client.0.smithi072.stdout:2/908: creat d2/d38/f124 x:0 0 0 2024-04-15T21:03:00.542 INFO:tasks.workunit.client.0.smithi072.stdout:0/889: fsync d0/d19/d71/d9e/fb9 0 2024-04-15T21:03:00.545 INFO:tasks.workunit.client.0.smithi072.stdout:1/826: symlink d5/db/d2d/d56/df0/d82/l102 0 2024-04-15T21:03:00.546 INFO:tasks.workunit.client.0.smithi072.stdout:1/827: truncate d5/d3d/fb7 1262405 0 2024-04-15T21:03:00.547 INFO:tasks.workunit.client.0.smithi072.stdout:9/908: creat d4/d1f/d9e/db3/f11f x:0 0 0 2024-04-15T21:03:00.552 INFO:tasks.workunit.client.0.smithi072.stdout:9/909: dwrite d4/d1f/d2c/dfa/fcb [0,4194304] 0 2024-04-15T21:03:00.554 INFO:tasks.workunit.client.0.smithi072.stdout:6/817: rename d2/d10/d11/l59 to d2/d40/dcb/lf6 0 2024-04-15T21:03:00.561 INFO:tasks.workunit.client.0.smithi072.stdout:7/844: creat d2/da7/f10d x:0 0 0 2024-04-15T21:03:00.571 INFO:tasks.workunit.client.0.smithi072.stdout:4/851: dwrite d7/d10/d41/f60 [0,4194304] 0 2024-04-15T21:03:00.572 INFO:tasks.workunit.client.0.smithi072.stdout:8/885: rename d3/d4/cea to d3/d4/d76/dde/c10e 0 2024-04-15T21:03:00.577 INFO:tasks.workunit.client.0.smithi072.stdout:5/874: truncate d0/d3/d6/f8 2288420 0 2024-04-15T21:03:00.578 INFO:tasks.workunit.client.0.smithi072.stdout:1/828: dwrite d5/db/d2d/d56/df0/f6f [0,4194304] 0 2024-04-15T21:03:00.582 INFO:tasks.workunit.client.0.smithi072.stdout:3/855: link d1/d5b/dbf/cb0 d1/d15/d32/d78/ded/c102 0 2024-04-15T21:03:00.583 INFO:tasks.workunit.client.0.smithi072.stdout:3/856: truncate d1/d15/d40/ffc 153966 0 2024-04-15T21:03:00.584 INFO:tasks.workunit.client.0.smithi072.stdout:7/845: rmdir d2/d7/d25/d72/d98/de2/de4 39 2024-04-15T21:03:00.587 INFO:tasks.workunit.client.0.smithi072.stdout:4/852: dread - d7/d24/f9d zero size 2024-04-15T21:03:00.591 INFO:tasks.workunit.client.0.smithi072.stdout:2/909: rename d2/l62 to d2/da1/l125 0 2024-04-15T21:03:00.591 INFO:tasks.workunit.client.0.smithi072.stdout:8/886: rmdir d3/ddb 39 2024-04-15T21:03:00.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/910: link d4/d29/d4c/d74/d84/df2/df4/ffb d4/d1f/d31/d4d/f120 0 2024-04-15T21:03:00.599 INFO:tasks.workunit.client.0.smithi072.stdout:1/829: unlink d5/d31/f49 0 2024-04-15T21:03:00.603 INFO:tasks.workunit.client.0.smithi072.stdout:3/857: dread d1/d15/d40/f22 [0,4194304] 0 2024-04-15T21:03:00.603 INFO:tasks.workunit.client.0.smithi072.stdout:0/890: write d0/d45/f111 [803645,11862] 0 2024-04-15T21:03:00.604 INFO:tasks.workunit.client.0.smithi072.stdout:7/846: stat d2/d7/d25/d2d/d46/d5a/f9b 0 2024-04-15T21:03:00.605 INFO:tasks.workunit.client.0.smithi072.stdout:0/891: readlink d0/d19/d2b/l32 0 2024-04-15T21:03:00.607 INFO:tasks.workunit.client.0.smithi072.stdout:4/853: fdatasync d7/f55 0 2024-04-15T21:03:00.611 INFO:tasks.workunit.client.0.smithi072.stdout:6/818: link d2/d40/d66/d7f/dd9/c37 d2/d40/d56/cf7 0 2024-04-15T21:03:00.611 INFO:tasks.workunit.client.0.smithi072.stdout:9/911: read d4/d29/f71 [1081288,11064] 0 2024-04-15T21:03:00.612 INFO:tasks.workunit.client.0.smithi072.stdout:9/912: readlink d4/d76/d8f/dbe/l10b 0 2024-04-15T21:03:00.616 INFO:tasks.workunit.client.0.smithi072.stdout:3/858: mknod d1/d15/d40/d9e/dc7/c103 0 2024-04-15T21:03:00.616 INFO:tasks.workunit.client.0.smithi072.stdout:1/830: dwrite d5/f70 [0,4194304] 0 2024-04-15T21:03:00.617 INFO:tasks.workunit.client.0.smithi072.stdout:0/892: mknod d0/d19/d71/c12f 0 2024-04-15T21:03:00.620 INFO:tasks.workunit.client.0.smithi072.stdout:4/854: mknod d7/d28/db1/c110 0 2024-04-15T21:03:00.623 INFO:tasks.workunit.client.0.smithi072.stdout:8/887: unlink d3/d4/d3b/f6e 0 2024-04-15T21:03:00.624 INFO:tasks.workunit.client.0.smithi072.stdout:6/819: creat d2/d40/dcb/d49/ff8 x:0 0 0 2024-04-15T21:03:00.629 INFO:tasks.workunit.client.0.smithi072.stdout:7/847: mknod d2/d7/c10e 0 2024-04-15T21:03:00.631 INFO:tasks.workunit.client.0.smithi072.stdout:0/893: mknod d0/d6/d6d/dcc/c130 0 2024-04-15T21:03:00.633 INFO:tasks.workunit.client.0.smithi072.stdout:5/875: rename d0/d3/d7/d94/f69 to d0/d3/d7/d12/d31/f125 0 2024-04-15T21:03:00.638 INFO:tasks.workunit.client.0.smithi072.stdout:0/894: dwrite d0/d45/d7a/f84 [4194304,4194304] 0 2024-04-15T21:03:00.640 INFO:tasks.workunit.client.0.smithi072.stdout:1/831: fsync d5/f3c 0 2024-04-15T21:03:00.650 INFO:tasks.workunit.client.0.smithi072.stdout:6/820: write d2/d40/d56/f98 [1823097,3223] 0 2024-04-15T21:03:00.651 INFO:tasks.workunit.client.0.smithi072.stdout:6/821: write d2/d40/d66/d7f/dd9/f75 [5299918,85954] 0 2024-04-15T21:03:00.655 INFO:tasks.workunit.client.0.smithi072.stdout:2/910: rename d2/d8/d41 to d2/d37/d126 0 2024-04-15T21:03:00.661 INFO:tasks.workunit.client.0.smithi072.stdout:8/888: truncate d3/de/d1b/d44/f78 1537022 0 2024-04-15T21:03:00.666 INFO:tasks.workunit.client.0.smithi072.stdout:5/876: truncate d0/d3/d33/d60/d81/daf/f82 1022497 0 2024-04-15T21:03:00.668 INFO:tasks.workunit.client.0.smithi072.stdout:7/848: fsync d2/d7/d25/f34 0 2024-04-15T21:03:00.682 INFO:tasks.workunit.client.0.smithi072.stdout:2/911: symlink d2/d3/d5f/dc8/l127 0 2024-04-15T21:03:00.682 INFO:tasks.workunit.client.0.smithi072.stdout:2/912: chown d2/d38 57 1 2024-04-15T21:03:00.683 INFO:tasks.workunit.client.0.smithi072.stdout:8/889: creat d3/d7e/dda/f10f x:0 0 0 2024-04-15T21:03:00.684 INFO:tasks.workunit.client.0.smithi072.stdout:2/913: read d2/d8/f13 [3589102,89408] 0 2024-04-15T21:03:00.684 INFO:tasks.workunit.client.0.smithi072.stdout:9/913: getdents d4/d29/d4c/d74 0 2024-04-15T21:03:00.685 INFO:tasks.workunit.client.0.smithi072.stdout:3/859: getdents d1/d15/d32/d2f/d1a 0 2024-04-15T21:03:00.689 INFO:tasks.workunit.client.0.smithi072.stdout:5/877: dread d0/d3/d7/d12/d1d/f74 [0,4194304] 0 2024-04-15T21:03:00.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/832: rename d5/db/c72 to d5/db/d2d/d85/dbf/d101/d1f/d63/d100/c103 0 2024-04-15T21:03:00.692 INFO:tasks.workunit.client.0.smithi072.stdout:2/914: mknod d2/d38/d73/c128 0 2024-04-15T21:03:00.694 INFO:tasks.workunit.client.0.smithi072.stdout:6/822: link d2/d42/c57 d2/d40/dcb/d49/cf9 0 2024-04-15T21:03:00.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/914: symlink d4/l121 0 2024-04-15T21:03:00.701 INFO:tasks.workunit.client.0.smithi072.stdout:5/878: link d0/d3/d6/d14/f1b d0/d3/d33/d60/d81/f126 0 2024-04-15T21:03:00.704 INFO:tasks.workunit.client.0.smithi072.stdout:9/915: creat d4/d76/d8f/f122 x:0 0 0 2024-04-15T21:03:00.704 INFO:tasks.workunit.client.0.smithi072.stdout:3/860: creat d1/d3f/d4f/f104 x:0 0 0 2024-04-15T21:03:00.704 INFO:tasks.workunit.client.0.smithi072.stdout:6/823: dwrite d2/fc [0,4194304] 0 2024-04-15T21:03:00.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/916: chown d4/d1f/d31/f7e 20607 1 2024-04-15T21:03:00.707 INFO:tasks.workunit.client.0.smithi072.stdout:7/849: rename d2/d7/d25/d2d/d47/d7e/f94 to d2/d7/f10f 0 2024-04-15T21:03:00.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/879: mkdir d0/d3/d33/d60/d81/daf/d127 0 2024-04-15T21:03:00.713 INFO:tasks.workunit.client.0.smithi072.stdout:3/861: creat d1/d5b/dbf/f105 x:0 0 0 2024-04-15T21:03:00.713 INFO:tasks.workunit.client.0.smithi072.stdout:2/915: getdents d2/d38/d91/dbb 0 2024-04-15T21:03:00.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/824: dwrite d2/d42/db9/dc9/ff4 [0,4194304] 0 2024-04-15T21:03:00.715 INFO:tasks.workunit.client.0.smithi072.stdout:8/890: dread d3/de/d1b/d41/d74/fd0 [0,4194304] 0 2024-04-15T21:03:00.717 INFO:tasks.workunit.client.0.smithi072.stdout:1/833: rename d5/d31/f87 to d5/df5/f104 0 2024-04-15T21:03:00.725 INFO:tasks.workunit.client.0.smithi072.stdout:2/916: stat d2/d66/d96/lb4 0 2024-04-15T21:03:00.810 INFO:tasks.workunit.client.0.smithi072.stdout:8/891: fdatasync d3/de/d1b/d3f/fc9 0 2024-04-15T21:03:00.811 INFO:tasks.workunit.client.0.smithi072.stdout:2/917: dread - d2/d66/d69/f10a zero size 2024-04-15T21:03:00.811 INFO:tasks.workunit.client.0.smithi072.stdout:1/834: creat d5/db/d2d/d85/dbf/d101/d1f/d63/d100/f105 x:0 0 0 2024-04-15T21:03:00.812 INFO:tasks.workunit.client.0.smithi072.stdout:5/880: write d0/d3/d7/d12/d31/f70 [933142,46323] 0 2024-04-15T21:03:00.812 INFO:tasks.workunit.client.0.smithi072.stdout:8/892: chown d3/de/d1b/d41/d74/d98 134 1 2024-04-15T21:03:00.814 INFO:tasks.workunit.client.0.smithi072.stdout:2/918: fdatasync d2/ffd 0 2024-04-15T21:03:00.816 INFO:tasks.workunit.client.0.smithi072.stdout:2/919: chown d2/da8/dfa 276379 1 2024-04-15T21:03:00.818 INFO:tasks.workunit.client.0.smithi072.stdout:9/917: dwrite d4/f4e [0,4194304] 0 2024-04-15T21:03:00.820 INFO:tasks.workunit.client.0.smithi072.stdout:6/825: dwrite d2/d10/d11/d15/fbe [0,4194304] 0 2024-04-15T21:03:00.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/835: symlink d5/d31/l106 0 2024-04-15T21:03:00.830 INFO:tasks.workunit.client.0.smithi072.stdout:1/836: read d5/db/d2d/d56/df0/f6f [3203966,21650] 0 2024-04-15T21:03:00.844 INFO:tasks.workunit.client.0.smithi072.stdout:8/893: mkdir d3/d7e/d110 0 2024-04-15T21:03:00.847 INFO:tasks.workunit.client.0.smithi072.stdout:9/918: symlink d4/d29/d4c/d74/d10e/d116/l123 0 2024-04-15T21:03:00.849 INFO:tasks.workunit.client.0.smithi072.stdout:6/826: symlink d2/d40/dc3/lfa 0 2024-04-15T21:03:00.851 INFO:tasks.workunit.client.0.smithi072.stdout:7/850: link d2/d7/lef d2/d7/d25/d72/d98/de2/de4/l110 0 2024-04-15T21:03:00.854 INFO:tasks.workunit.client.0.smithi072.stdout:4/855: sync 2024-04-15T21:03:00.857 INFO:tasks.workunit.client.0.smithi072.stdout:1/837: stat d5/db/d2d/d85/cd7 0 2024-04-15T21:03:00.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/881: dread d0/d3/d7/d12/d31/d49/fad [0,4194304] 0 2024-04-15T21:03:00.858 INFO:tasks.workunit.client.0.smithi072.stdout:5/882: readlink d0/d3/d6/d14/la2 0 2024-04-15T21:03:00.861 INFO:tasks.workunit.client.0.smithi072.stdout:2/920: dread d2/d38/f54 [0,4194304] 0 2024-04-15T21:03:00.862 INFO:tasks.workunit.client.0.smithi072.stdout:9/919: mknod d4/d76/c124 0 2024-04-15T21:03:00.863 INFO:tasks.workunit.client.0.smithi072.stdout:9/920: chown d4/d76 2 1 2024-04-15T21:03:00.871 INFO:tasks.workunit.client.0.smithi072.stdout:1/838: symlink d5/db/d2d/d56/df0/l107 0 2024-04-15T21:03:00.872 INFO:tasks.workunit.client.0.smithi072.stdout:5/883: symlink d0/d3/d7/d94/d92/l128 0 2024-04-15T21:03:00.873 INFO:tasks.workunit.client.0.smithi072.stdout:5/884: chown d0/d3/d7/d94/d86/d10d/f124 59 1 2024-04-15T21:03:00.875 INFO:tasks.workunit.client.0.smithi072.stdout:8/894: symlink d3/de/d1b/d41/dae/dc0/de9/l111 0 2024-04-15T21:03:00.876 INFO:tasks.workunit.client.0.smithi072.stdout:9/921: creat d4/d29/d4c/d74/d10e/d116/f125 x:0 0 0 2024-04-15T21:03:00.882 INFO:tasks.workunit.client.0.smithi072.stdout:4/856: rename d7/d10/cc1 to d7/d23/d6c/daf/c111 0 2024-04-15T21:03:00.885 INFO:tasks.workunit.client.0.smithi072.stdout:7/851: link d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c9e d2/d7/d25/d2d/d46/d5a/d5f/d1f/d10b/c111 0 2024-04-15T21:03:00.888 INFO:tasks.workunit.client.0.smithi072.stdout:1/839: rename d5/db/d2d/d56/df0/d82/ff4 to d5/db/d27/d5c/ddc/f108 0 2024-04-15T21:03:00.889 INFO:tasks.workunit.client.0.smithi072.stdout:5/885: dread d0/d3/d7/d12/f1a [0,4194304] 0 2024-04-15T21:03:00.892 INFO:tasks.workunit.client.0.smithi072.stdout:6/827: link d2/d40/d56/cf7 d2/d10/d18/d47/d6d/cfb 0 2024-04-15T21:03:00.893 INFO:tasks.workunit.client.0.smithi072.stdout:8/895: dread d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:03:00.893 INFO:tasks.workunit.client.0.smithi072.stdout:6/828: chown d2/d10/d11/d1f/fe0 38 1 2024-04-15T21:03:00.897 INFO:tasks.workunit.client.0.smithi072.stdout:1/840: stat d5/dcb 0 2024-04-15T21:03:00.900 INFO:tasks.workunit.client.0.smithi072.stdout:6/829: dwrite d2/d40/dc3/fe2 [0,4194304] 0 2024-04-15T21:03:00.903 INFO:tasks.workunit.client.0.smithi072.stdout:8/896: mknod d3/de/d1b/d44/d102/c112 0 2024-04-15T21:03:00.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/857: dread d7/f38 [0,4194304] 0 2024-04-15T21:03:00.906 INFO:tasks.workunit.client.0.smithi072.stdout:7/852: mkdir d2/d7/d25/d81/dce/d112 0 2024-04-15T21:03:00.909 INFO:tasks.workunit.client.0.smithi072.stdout:1/841: creat d5/db/d27/d5c/dbd/f109 x:0 0 0 2024-04-15T21:03:00.912 INFO:tasks.workunit.client.0.smithi072.stdout:8/897: mknod d3/de/d1b/d41/dae/c113 0 2024-04-15T21:03:00.913 INFO:tasks.workunit.client.0.smithi072.stdout:4/858: symlink d7/d15/ddd/df7/d76/d8b/l112 0 2024-04-15T21:03:00.914 INFO:tasks.workunit.client.0.smithi072.stdout:6/830: getdents d2/d10/d18/d47/deb 0 2024-04-15T21:03:00.914 INFO:tasks.workunit.client.0.smithi072.stdout:6/831: chown d2/fc 59384 1 2024-04-15T21:03:00.915 INFO:tasks.workunit.client.0.smithi072.stdout:6/832: write d2/d40/d66/d7f/dd9/f41 [4725154,128926] 0 2024-04-15T21:03:00.916 INFO:tasks.workunit.client.0.smithi072.stdout:6/833: chown d2/d40/dcb/f38 0 1 2024-04-15T21:03:00.921 INFO:tasks.workunit.client.0.smithi072.stdout:6/834: dread d2/d40/d56/f85 [0,4194304] 0 2024-04-15T21:03:00.922 INFO:tasks.workunit.client.0.smithi072.stdout:7/853: creat d2/d7/d25/d2d/d47/f113 x:0 0 0 2024-04-15T21:03:00.925 INFO:tasks.workunit.client.0.smithi072.stdout:1/842: rename d5/d31/c67 to d5/db/d2d/c10a 0 2024-04-15T21:03:00.925 INFO:tasks.workunit.client.0.smithi072.stdout:1/843: chown d5/d31/fab 1414313 1 2024-04-15T21:03:00.926 INFO:tasks.workunit.client.0.smithi072.stdout:8/898: creat d3/de/d1b/d41/f114 x:0 0 0 2024-04-15T21:03:00.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/899: fsync d3/de/d1b/d41/d74/d98/da5/ff1 0 2024-04-15T21:03:00.928 INFO:tasks.workunit.client.0.smithi072.stdout:4/859: unlink d7/d10/d41/d45/d7c/cc3 0 2024-04-15T21:03:00.929 INFO:tasks.workunit.client.0.smithi072.stdout:6/835: creat d2/da1/ffc x:0 0 0 2024-04-15T21:03:00.934 INFO:tasks.workunit.client.0.smithi072.stdout:6/836: dwrite d2/d42/db9/dc9/ff4 [4194304,4194304] 0 2024-04-15T21:03:00.937 INFO:tasks.workunit.client.0.smithi072.stdout:4/860: creat d7/d24/f113 x:0 0 0 2024-04-15T21:03:00.938 INFO:tasks.workunit.client.0.smithi072.stdout:4/861: write d7/d10/d41/d44/d7a/f10b [690313,42693] 0 2024-04-15T21:03:00.943 INFO:tasks.workunit.client.0.smithi072.stdout:6/837: fsync d2/d10/d18/fa5 0 2024-04-15T21:03:00.944 INFO:tasks.workunit.client.0.smithi072.stdout:8/900: truncate d3/de/d1b/d41/da4/f90 1045397 0 2024-04-15T21:03:00.945 INFO:tasks.workunit.client.0.smithi072.stdout:7/854: creat d2/d7/d25/f114 x:0 0 0 2024-04-15T21:03:00.945 INFO:tasks.workunit.client.0.smithi072.stdout:6/838: read d2/d40/fa3 [179258,80034] 0 2024-04-15T21:03:00.946 INFO:tasks.workunit.client.0.smithi072.stdout:4/862: dwrite d7/d10/d41/d44/d7a/f10b [0,4194304] 0 2024-04-15T21:03:00.949 INFO:tasks.workunit.client.0.smithi072.stdout:8/901: symlink d3/d4/d76/l115 0 2024-04-15T21:03:00.949 INFO:tasks.workunit.client.0.smithi072.stdout:5/886: write d0/d3/d7/d12/fdf [1033350,83420] 0 2024-04-15T21:03:00.952 INFO:tasks.workunit.client.0.smithi072.stdout:9/922: dwrite d4/d1f/d31/f44 [0,4194304] 0 2024-04-15T21:03:00.953 INFO:tasks.workunit.client.0.smithi072.stdout:7/855: truncate d2/d7/d25/d2d/d46/d5a/d5f/d43/db8/ffe 533180 0 2024-04-15T21:03:00.960 INFO:tasks.workunit.client.0.smithi072.stdout:0/895: sync 2024-04-15T21:03:00.961 INFO:tasks.workunit.client.0.smithi072.stdout:8/902: unlink d3/de/d1b/d41/d74/d98/da5/fc2 0 2024-04-15T21:03:00.969 INFO:tasks.workunit.client.0.smithi072.stdout:9/923: creat d4/d29/d4c/d74/d10e/f126 x:0 0 0 2024-04-15T21:03:00.969 INFO:tasks.workunit.client.0.smithi072.stdout:7/856: chown d2/leb 15896 1 2024-04-15T21:03:00.969 INFO:tasks.workunit.client.0.smithi072.stdout:9/924: chown d4 40132959 1 2024-04-15T21:03:00.973 INFO:tasks.workunit.client.0.smithi072.stdout:8/903: rmdir d3/d4/d4c 39 2024-04-15T21:03:00.974 INFO:tasks.workunit.client.0.smithi072.stdout:4/863: getdents d7/d28/d42/da1 0 2024-04-15T21:03:00.976 INFO:tasks.workunit.client.0.smithi072.stdout:1/844: write d5/f8 [2103622,49379] 0 2024-04-15T21:03:00.977 INFO:tasks.workunit.client.0.smithi072.stdout:7/857: symlink d2/d7/d25/d72/l115 0 2024-04-15T21:03:00.978 INFO:tasks.workunit.client.0.smithi072.stdout:7/858: chown d2/d7/d25/d2d/d46/d5a/d5f/d43 1288886 1 2024-04-15T21:03:00.979 INFO:tasks.workunit.client.0.smithi072.stdout:0/896: dread d0/d19/d71/d9e/fb9 [0,4194304] 0 2024-04-15T21:03:00.979 INFO:tasks.workunit.client.0.smithi072.stdout:5/887: getdents d0/d3/d33/d60 0 2024-04-15T21:03:00.981 INFO:tasks.workunit.client.0.smithi072.stdout:5/888: write d0/d3/d7/d12/d31/d55/d93/f109 [4672620,126272] 0 2024-04-15T21:03:01.022 INFO:tasks.workunit.client.0.smithi072.stdout:9/925: symlink d4/d29/d45/l127 0 2024-04-15T21:03:01.084 INFO:tasks.workunit.client.0.smithi072.stdout:3/862: sync 2024-04-15T21:03:01.084 INFO:tasks.workunit.client.0.smithi072.stdout:2/921: sync 2024-04-15T21:03:01.086 INFO:tasks.workunit.client.0.smithi072.stdout:1/845: creat d5/db/daa/f10b x:0 0 0 2024-04-15T21:03:01.087 INFO:tasks.workunit.client.0.smithi072.stdout:7/859: rename d2/d7/d25/d2d/l36 to d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/d107/l116 0 2024-04-15T21:03:01.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/922: dread - d2/ffb zero size 2024-04-15T21:03:01.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/904: write d3/de/d1b/d41/da4/f51 [1743868,3866] 0 2024-04-15T21:03:01.089 INFO:tasks.workunit.client.0.smithi072.stdout:5/889: chown d0/d3/d7/d12/d31/d55/c53 3 1 2024-04-15T21:03:01.094 INFO:tasks.workunit.client.0.smithi072.stdout:3/863: stat d1/d15/f5e 0 2024-04-15T21:03:01.095 INFO:tasks.workunit.client.0.smithi072.stdout:2/923: mkdir d2/d38/d91/dbb/d129 0 2024-04-15T21:03:01.096 INFO:tasks.workunit.client.0.smithi072.stdout:3/864: readlink d1/d15/d32/d2f/d1a/l6d 0 2024-04-15T21:03:01.097 INFO:tasks.workunit.client.0.smithi072.stdout:1/846: dread d5/db/d2d/d85/dbf/d101/d1f/d63/fa9 [0,4194304] 0 2024-04-15T21:03:01.097 INFO:tasks.workunit.client.0.smithi072.stdout:8/905: mkdir d3/de/d1b/d41/d74/d98/da5/d116 0 2024-04-15T21:03:01.097 INFO:tasks.workunit.client.0.smithi072.stdout:9/926: dwrite d4/d1f/d31/d4d/dbf/dd2/fd7 [0,4194304] 0 2024-04-15T21:03:01.099 INFO:tasks.workunit.client.0.smithi072.stdout:2/924: truncate d2/d38/d73/f10b 879338 0 2024-04-15T21:03:01.099 INFO:tasks.workunit.client.0.smithi072.stdout:8/906: fdatasync d3/de/d1b/d3f/f83 0 2024-04-15T21:03:01.099 INFO:tasks.workunit.client.0.smithi072.stdout:1/847: stat d5/db/d2d/d56/lc8 0 2024-04-15T21:03:01.099 INFO:tasks.workunit.client.0.smithi072.stdout:9/927: write d4/d1f/d2c/f35 [2536249,16001] 0 2024-04-15T21:03:01.100 INFO:tasks.workunit.client.0.smithi072.stdout:8/907: fdatasync d3/d7e/f8d 0 2024-04-15T21:03:01.100 INFO:tasks.workunit.client.0.smithi072.stdout:7/860: rename d2/d7/d25/d2d/d46/d5a/cd9 to d2/d7/d25/d2d/d46/d5a/d5f/d43/db9/c117 0 2024-04-15T21:03:01.103 INFO:tasks.workunit.client.0.smithi072.stdout:3/865: creat d1/d3f/d4f/da3/f106 x:0 0 0 2024-04-15T21:03:01.111 INFO:tasks.workunit.client.0.smithi072.stdout:5/890: dread d0/d3/d7/d12/d31/d55/d93/f109 [0,4194304] 0 2024-04-15T21:03:01.118 INFO:tasks.workunit.client.0.smithi072.stdout:1/848: readlink d5/db/d2d/d85/dbf/lcc 0 2024-04-15T21:03:01.121 INFO:tasks.workunit.client.0.smithi072.stdout:7/861: write d2/d7/d25/f42 [1536421,26359] 0 2024-04-15T21:03:01.122 INFO:tasks.workunit.client.0.smithi072.stdout:9/928: mkdir d4/d29/d4c/d74/d84/df2/df4/d128 0 2024-04-15T21:03:01.123 INFO:tasks.workunit.client.0.smithi072.stdout:3/866: mkdir d1/d15/d32/d78/d107 0 2024-04-15T21:03:01.124 INFO:tasks.workunit.client.0.smithi072.stdout:7/862: truncate d2/d7/d25/d2d/d47/f113 242197 0 2024-04-15T21:03:01.124 INFO:tasks.workunit.client.0.smithi072.stdout:2/925: mknod d2/d8/d8e/c12a 0 2024-04-15T21:03:01.125 INFO:tasks.workunit.client.0.smithi072.stdout:7/863: chown d2/d7/d25/d81/dbe/fc7 0 1 2024-04-15T21:03:01.125 INFO:tasks.workunit.client.0.smithi072.stdout:8/908: creat d3/de/d1b/d3f/dfb/f117 x:0 0 0 2024-04-15T21:03:01.125 INFO:tasks.workunit.client.0.smithi072.stdout:7/864: fdatasync d2/d7/d25/f42 0 2024-04-15T21:03:01.128 INFO:tasks.workunit.client.0.smithi072.stdout:9/929: creat d4/d29/d4c/d74/d10e/d116/f129 x:0 0 0 2024-04-15T21:03:01.129 INFO:tasks.workunit.client.0.smithi072.stdout:3/867: mknod d1/d3f/c108 0 2024-04-15T21:03:01.139 INFO:tasks.workunit.client.0.smithi072.stdout:3/868: dread d1/d15/d40/dc2/ff8 [0,4194304] 0 2024-04-15T21:03:01.139 INFO:tasks.workunit.client.0.smithi072.stdout:7/865: creat d2/d7/d25/d2d/d46/d5a/d5f/d26/f118 x:0 0 0 2024-04-15T21:03:01.139 INFO:tasks.workunit.client.0.smithi072.stdout:5/891: truncate d0/d3/d7/d12/fdf 512995 0 2024-04-15T21:03:01.141 INFO:tasks.workunit.client.0.smithi072.stdout:7/866: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc/fe6 [436661,88704] 0 2024-04-15T21:03:01.144 INFO:tasks.workunit.client.0.smithi072.stdout:6/839: sync 2024-04-15T21:03:01.144 INFO:tasks.workunit.client.0.smithi072.stdout:6/840: truncate d2/f14 5448863 0 2024-04-15T21:03:01.150 INFO:tasks.workunit.client.0.smithi072.stdout:1/849: rename d5/db/d27/d5c/le4 to d5/l10c 0 2024-04-15T21:03:01.151 INFO:tasks.workunit.client.0.smithi072.stdout:3/869: mknod d1/d15/d32/d78/c109 0 2024-04-15T21:03:01.160 INFO:tasks.workunit.client.0.smithi072.stdout:7/867: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/l119 0 2024-04-15T21:03:01.160 INFO:tasks.workunit.client.0.smithi072.stdout:5/892: write d0/d3/d6/d14/fb2 [540288,111085] 0 2024-04-15T21:03:01.162 INFO:tasks.workunit.client.0.smithi072.stdout:6/841: truncate d2/d42/dad/fb8 878048 0 2024-04-15T21:03:01.163 INFO:tasks.workunit.client.0.smithi072.stdout:9/930: symlink d4/d1f/d31/d9b/l12a 0 2024-04-15T21:03:01.164 INFO:tasks.workunit.client.0.smithi072.stdout:6/842: read d2/d10/d18/fa5 [4122225,77643] 0 2024-04-15T21:03:01.164 INFO:tasks.workunit.client.0.smithi072.stdout:2/926: creat d2/d66/f12b x:0 0 0 2024-04-15T21:03:01.165 INFO:tasks.workunit.client.0.smithi072.stdout:9/931: truncate d4/d29/d4c/d74/d10e/d116/f117 252303 0 2024-04-15T21:03:01.167 INFO:tasks.workunit.client.0.smithi072.stdout:1/850: unlink d5/db/d27/d5c/dbd/f109 0 2024-04-15T21:03:01.168 INFO:tasks.workunit.client.0.smithi072.stdout:7/868: creat d2/d7/d25/d72/f11a x:0 0 0 2024-04-15T21:03:01.168 INFO:tasks.workunit.client.0.smithi072.stdout:8/909: link d3/d4/d3b/f65 d3/de/d1b/d85/d101/f118 0 2024-04-15T21:03:01.170 INFO:tasks.workunit.client.0.smithi072.stdout:8/910: read d3/de/d1b/d85/fad [151071,45655] 0 2024-04-15T21:03:01.171 INFO:tasks.workunit.client.0.smithi072.stdout:6/843: creat d2/d40/d56/ffd x:0 0 0 2024-04-15T21:03:01.174 INFO:tasks.workunit.client.0.smithi072.stdout:9/932: mkdir d4/d1f/d31/d4d/d12b 0 2024-04-15T21:03:01.177 INFO:tasks.workunit.client.0.smithi072.stdout:1/851: read d5/db/d27/d5c/dbd/f95 [3969557,114355] 0 2024-04-15T21:03:01.177 INFO:tasks.workunit.client.0.smithi072.stdout:3/870: unlink d1/d15/d32/f65 0 2024-04-15T21:03:01.178 INFO:tasks.workunit.client.0.smithi072.stdout:5/893: creat d0/d3/d33/d60/d81/daf/d127/f129 x:0 0 0 2024-04-15T21:03:01.180 INFO:tasks.workunit.client.0.smithi072.stdout:8/911: fdatasync d3/d4/d3b/fb9 0 2024-04-15T21:03:01.182 INFO:tasks.workunit.client.0.smithi072.stdout:9/933: rmdir d4/d1f/d31/d42 39 2024-04-15T21:03:01.187 INFO:tasks.workunit.client.0.smithi072.stdout:5/894: symlink d0/d3/d7/d94/l12a 0 2024-04-15T21:03:01.188 INFO:tasks.workunit.client.0.smithi072.stdout:1/852: dread d5/db/d2d/d56/df0/f9b [0,4194304] 0 2024-04-15T21:03:01.189 INFO:tasks.workunit.client.0.smithi072.stdout:7/869: link d2/d7/d25/d2d/d46/d5a/d5f/f5e d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dd5/f11b 0 2024-04-15T21:03:01.197 INFO:tasks.workunit.client.0.smithi072.stdout:1/853: symlink d5/db/d2d/d85/dbf/l10d 0 2024-04-15T21:03:01.198 INFO:tasks.workunit.client.0.smithi072.stdout:7/870: creat d2/d7/d25/d2d/d46/d5a/d5f/d43/db9/f11c x:0 0 0 2024-04-15T21:03:01.203 INFO:tasks.workunit.client.0.smithi072.stdout:1/854: symlink d5/db/d2d/d56/df0/d82/l10e 0 2024-04-15T21:03:01.203 INFO:tasks.workunit.client.0.smithi072.stdout:2/927: write d2/d3/f5e [908232,109100] 0 2024-04-15T21:03:01.208 INFO:tasks.workunit.client.0.smithi072.stdout:3/871: dwrite d1/d5b/f97 [0,4194304] 0 2024-04-15T21:03:01.212 INFO:tasks.workunit.client.0.smithi072.stdout:1/855: creat d5/d3d/f10f x:0 0 0 2024-04-15T21:03:01.212 INFO:tasks.workunit.client.0.smithi072.stdout:8/912: dread d3/d4/d4c/ff7 [0,4194304] 0 2024-04-15T21:03:01.213 INFO:tasks.workunit.client.0.smithi072.stdout:8/913: write d3/d4/d4c/f105 [866137,362] 0 2024-04-15T21:03:01.213 INFO:tasks.workunit.client.0.smithi072.stdout:2/928: creat d2/dd7/f12c x:0 0 0 2024-04-15T21:03:01.215 INFO:tasks.workunit.client.0.smithi072.stdout:2/929: write d2/d3/f5e [1942863,19594] 0 2024-04-15T21:03:01.215 INFO:tasks.workunit.client.0.smithi072.stdout:5/895: link d0/d3/d6/d14/f5b d0/d3/d6/f12b 0 2024-04-15T21:03:01.218 INFO:tasks.workunit.client.0.smithi072.stdout:9/934: dwrite d4/d29/d45/fa1 [0,4194304] 0 2024-04-15T21:03:01.219 INFO:tasks.workunit.client.0.smithi072.stdout:9/935: chown d4/d1f/db7/d102 10104 1 2024-04-15T21:03:01.220 INFO:tasks.workunit.client.0.smithi072.stdout:9/936: write d4/d1f/d2c/f57 [4210080,98185] 0 2024-04-15T21:03:01.222 INFO:tasks.workunit.client.0.smithi072.stdout:7/871: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f58 [92990,94827] 0 2024-04-15T21:03:01.225 INFO:tasks.workunit.client.0.smithi072.stdout:2/930: rmdir d2/d8/da2 39 2024-04-15T21:03:01.227 INFO:tasks.workunit.client.0.smithi072.stdout:5/896: creat d0/d3/d7/d94/d5f/f12c x:0 0 0 2024-04-15T21:03:01.234 INFO:tasks.workunit.client.0.smithi072.stdout:7/872: unlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/l119 0 2024-04-15T21:03:01.236 INFO:tasks.workunit.client.0.smithi072.stdout:7/873: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab [2110975,58780] 0 2024-04-15T21:03:01.237 INFO:tasks.workunit.client.0.smithi072.stdout:5/897: fdatasync d0/d3/d7/d1f/d4c/fbf 0 2024-04-15T21:03:01.240 INFO:tasks.workunit.client.0.smithi072.stdout:1/856: creat d5/db/d2d/f110 x:0 0 0 2024-04-15T21:03:01.243 INFO:tasks.workunit.client.0.smithi072.stdout:3/872: truncate d1/d15/d40/d9e/fc6 3592834 0 2024-04-15T21:03:01.245 INFO:tasks.workunit.client.0.smithi072.stdout:2/931: rename d2/d64/dce/c116 to d2/d38/d91/dbb/d129/c12d 0 2024-04-15T21:03:01.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/898: creat d0/d3/d33/d60/f12d x:0 0 0 2024-04-15T21:03:01.249 INFO:tasks.workunit.client.0.smithi072.stdout:8/914: link d3/de/d1b/c28 d3/d7e/dda/c119 0 2024-04-15T21:03:01.250 INFO:tasks.workunit.client.0.smithi072.stdout:8/915: write d3/f1d [1829662,9961] 0 2024-04-15T21:03:01.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/937: rename d4/d1f/d31/d4d/df7/fff to d4/d1f/d31/d42/f12c 0 2024-04-15T21:03:01.258 INFO:tasks.workunit.client.0.smithi072.stdout:2/932: mkdir d2/d38/d91/dbb/d12e 0 2024-04-15T21:03:01.259 INFO:tasks.workunit.client.0.smithi072.stdout:7/874: mkdir d2/d7/d11d 0 2024-04-15T21:03:01.260 INFO:tasks.workunit.client.0.smithi072.stdout:4/864: sync 2024-04-15T21:03:01.260 INFO:tasks.workunit.client.0.smithi072.stdout:0/897: sync 2024-04-15T21:03:01.260 INFO:tasks.workunit.client.0.smithi072.stdout:4/865: dread - d7/d15/ddd/f104 zero size 2024-04-15T21:03:01.261 INFO:tasks.workunit.client.0.smithi072.stdout:4/866: read - d7/d28/db1/ffd zero size 2024-04-15T21:03:01.263 INFO:tasks.workunit.client.0.smithi072.stdout:1/857: write d5/db/d2d/d56/df0/d82/fb9 [845983,40989] 0 2024-04-15T21:03:01.266 INFO:tasks.workunit.client.0.smithi072.stdout:3/873: write d1/d3f/fd2 [2049920,66914] 0 2024-04-15T21:03:01.266 INFO:tasks.workunit.client.0.smithi072.stdout:0/898: dwrite d0/d6/d6d/dcc/f10a [0,4194304] 0 2024-04-15T21:03:01.269 INFO:tasks.workunit.client.0.smithi072.stdout:4/867: dwrite d7/d10/d41/d4c/f82 [0,4194304] 0 2024-04-15T21:03:01.273 INFO:tasks.workunit.client.0.smithi072.stdout:2/933: rmdir d2/da8 39 2024-04-15T21:03:01.285 INFO:tasks.workunit.client.0.smithi072.stdout:5/899: link d0/d3/d33/d60/fe6 d0/d3/d7/d94/d92/da0/dfc/d111/f12e 0 2024-04-15T21:03:01.287 INFO:tasks.workunit.client.0.smithi072.stdout:6/844: sync 2024-04-15T21:03:01.292 INFO:tasks.workunit.client.0.smithi072.stdout:8/916: creat d3/de/d1b/d44/d102/d10a/f11a x:0 0 0 2024-04-15T21:03:01.293 INFO:tasks.workunit.client.0.smithi072.stdout:8/917: chown d3/de/d1b/d41/da4/d2e/lc7 4205420 1 2024-04-15T21:03:01.299 INFO:tasks.workunit.client.0.smithi072.stdout:7/875: symlink d2/d7/d25/d2d/d46/l11e 0 2024-04-15T21:03:01.302 INFO:tasks.workunit.client.0.smithi072.stdout:5/900: rename d0/f123 to d0/d3/d7/d94/de1/f12f 0 2024-04-15T21:03:01.303 INFO:tasks.workunit.client.0.smithi072.stdout:1/858: symlink d5/l111 0 2024-04-15T21:03:01.303 INFO:tasks.workunit.client.0.smithi072.stdout:3/874: dwrite d1/f64 [4194304,4194304] 0 2024-04-15T21:03:01.303 INFO:tasks.workunit.client.0.smithi072.stdout:5/901: fdatasync d0/d3/d33/d60/d81/fed 0 2024-04-15T21:03:01.304 INFO:tasks.workunit.client.0.smithi072.stdout:9/938: truncate d4/d1f/d2c/fde 3449306 0 2024-04-15T21:03:01.306 INFO:tasks.workunit.client.0.smithi072.stdout:0/899: getdents d0/d6/d6d/d102 0 2024-04-15T21:03:01.309 INFO:tasks.workunit.client.0.smithi072.stdout:4/868: symlink d7/d23/l114 0 2024-04-15T21:03:01.314 INFO:tasks.workunit.client.0.smithi072.stdout:2/934: symlink d2/d64/d10f/l12f 0 2024-04-15T21:03:01.320 INFO:tasks.workunit.client.0.smithi072.stdout:6/845: dwrite d2/d10/f58 [0,4194304] 0 2024-04-15T21:03:01.320 INFO:tasks.workunit.client.0.smithi072.stdout:7/876: dwrite d2/d7/d25/d2d/d47/f4a [0,4194304] 0 2024-04-15T21:03:01.322 INFO:tasks.workunit.client.0.smithi072.stdout:1/859: rmdir d5/db/d2d/d56 39 2024-04-15T21:03:01.334 INFO:tasks.workunit.client.0.smithi072.stdout:8/918: truncate d3/de/d1b/d41/fa9 1237060 0 2024-04-15T21:03:01.336 INFO:tasks.workunit.client.0.smithi072.stdout:2/935: mknod d2/d64/d10f/c130 0 2024-04-15T21:03:01.339 INFO:tasks.workunit.client.0.smithi072.stdout:6/846: rename d2 to d2/d10/d18/dfe 22 2024-04-15T21:03:01.341 INFO:tasks.workunit.client.0.smithi072.stdout:1/860: chown d5/d31/l4e 0 1 2024-04-15T21:03:01.342 INFO:tasks.workunit.client.0.smithi072.stdout:4/869: dread d7/d15/ddd/df7/d76/d8b/fe2 [0,4194304] 0 2024-04-15T21:03:01.342 INFO:tasks.workunit.client.0.smithi072.stdout:8/919: creat d3/d4/d3b/f11b x:0 0 0 2024-04-15T21:03:01.344 INFO:tasks.workunit.client.0.smithi072.stdout:2/936: mkdir d2/d37/d131 0 2024-04-15T21:03:01.345 INFO:tasks.workunit.client.0.smithi072.stdout:0/900: dwrite d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/fec [0,4194304] 0 2024-04-15T21:03:01.345 INFO:tasks.workunit.client.0.smithi072.stdout:4/870: chown d7/d10/d41/f60 212554 1 2024-04-15T21:03:01.345 INFO:tasks.workunit.client.0.smithi072.stdout:7/877: symlink d2/d7/d11d/l11f 0 2024-04-15T21:03:01.347 INFO:tasks.workunit.client.0.smithi072.stdout:0/901: dread - d0/d19/d2b/fff zero size 2024-04-15T21:03:01.347 INFO:tasks.workunit.client.0.smithi072.stdout:6/847: readlink d2/d42/db9/lc0 0 2024-04-15T21:03:01.348 INFO:tasks.workunit.client.0.smithi072.stdout:5/902: link d0/d3/d7/d1f/l22 d0/d3/d33/d60/l130 0 2024-04-15T21:03:01.349 INFO:tasks.workunit.client.0.smithi072.stdout:9/939: link d4/c27 d4/d1f/d2c/dd8/c12d 0 2024-04-15T21:03:01.350 INFO:tasks.workunit.client.0.smithi072.stdout:5/903: chown d0/f35 2 1 2024-04-15T21:03:01.351 INFO:tasks.workunit.client.0.smithi072.stdout:8/920: mknod d3/de/d1b/d41/dae/c11c 0 2024-04-15T21:03:01.351 INFO:tasks.workunit.client.0.smithi072.stdout:1/861: chown d5/db/d2d/d56/df0/f9b 129882 1 2024-04-15T21:03:01.351 INFO:tasks.workunit.client.0.smithi072.stdout:7/878: truncate d2/d7/d25/d72/fd1 342530 0 2024-04-15T21:03:01.352 INFO:tasks.workunit.client.0.smithi072.stdout:6/848: symlink d2/d40/dc3/lff 0 2024-04-15T21:03:01.357 INFO:tasks.workunit.client.0.smithi072.stdout:2/937: dwrite d2/d38/f124 [0,4194304] 0 2024-04-15T21:03:01.357 INFO:tasks.workunit.client.0.smithi072.stdout:4/871: rename d7/d15/ddd/df7/d76/d8b/fd7 to d7/d15/ddd/df7/d76/d8b/dad/de1/f115 0 2024-04-15T21:03:01.362 INFO:tasks.workunit.client.0.smithi072.stdout:5/904: dread d0/f35 [0,4194304] 0 2024-04-15T21:03:01.370 INFO:tasks.workunit.client.0.smithi072.stdout:0/902: mkdir d0/d45/d7a/d70/d59/d8a/d7b/df8/d131 0 2024-04-15T21:03:01.373 INFO:tasks.workunit.client.0.smithi072.stdout:2/938: unlink d2/d37/d126/f120 0 2024-04-15T21:03:01.375 INFO:tasks.workunit.client.0.smithi072.stdout:8/921: rename d3/d4/d76/dde to d3/de/d1b/d41/dae/dc0/de9/d11d 0 2024-04-15T21:03:01.377 INFO:tasks.workunit.client.0.smithi072.stdout:4/872: symlink d7/d10/d41/d45/d93/de0/dfc/l116 0 2024-04-15T21:03:01.380 INFO:tasks.workunit.client.0.smithi072.stdout:1/862: write d5/db/d27/f33 [8822200,94478] 0 2024-04-15T21:03:01.380 INFO:tasks.workunit.client.0.smithi072.stdout:7/879: write d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 [1412984,64650] 0 2024-04-15T21:03:01.387 INFO:tasks.workunit.client.0.smithi072.stdout:2/939: creat d2/d64/dce/f132 x:0 0 0 2024-04-15T21:03:01.387 INFO:tasks.workunit.client.0.smithi072.stdout:9/940: truncate d4/d29/d45/fa1 2920088 0 2024-04-15T21:03:01.388 INFO:tasks.workunit.client.0.smithi072.stdout:6/849: truncate d2/d40/d66/d7f/dd9/f75 4828715 0 2024-04-15T21:03:01.390 INFO:tasks.workunit.client.0.smithi072.stdout:8/922: creat d3/de/d1b/d3f/f11e x:0 0 0 2024-04-15T21:03:01.391 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:00 smithi149 ceph-mon[36029]: Adjusting osd_memory_target on smithi072 to 1216M 2024-04-15T21:03:01.391 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:00 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:01.391 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:00 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:01.395 INFO:tasks.workunit.client.0.smithi072.stdout:1/863: creat d5/db/d2d/d56/df0/f112 x:0 0 0 2024-04-15T21:03:01.397 INFO:tasks.workunit.client.0.smithi072.stdout:7/880: rename d2/d7/d25/d2d/d46/d5a/d5f/dbc to d2/d7/d25/d81/d120 0 2024-04-15T21:03:01.398 INFO:tasks.workunit.client.0.smithi072.stdout:4/873: write d7/d10/d41/fb4 [1000943,12312] 0 2024-04-15T21:03:01.398 INFO:tasks.workunit.client.0.smithi072.stdout:7/881: dread - d2/d7/d25/d2d/d46/f101 zero size 2024-04-15T21:03:01.400 INFO:tasks.workunit.client.0.smithi072.stdout:7/882: chown d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c35 63 1 2024-04-15T21:03:01.400 INFO:tasks.workunit.client.0.smithi072.stdout:2/940: truncate d2/dd7/fe9 2901788 0 2024-04-15T21:03:01.401 INFO:tasks.workunit.client.0.smithi072.stdout:6/850: mknod d2/d10/d11/d1f/d60/df1/c100 0 2024-04-15T21:03:01.402 INFO:tasks.workunit.client.0.smithi072.stdout:5/905: write d0/d3/d6/d14/fd6 [328275,109876] 0 2024-04-15T21:03:01.405 INFO:tasks.workunit.client.0.smithi072.stdout:9/941: write d4/d1f/d2c/d62/f96 [868923,2496] 0 2024-04-15T21:03:01.412 INFO:tasks.workunit.client.0.smithi072.stdout:8/923: truncate d3/d4/d76/d8f/fed 774646 0 2024-04-15T21:03:01.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:00 smithi072 ceph-mon[29079]: Adjusting osd_memory_target on smithi072 to 1216M 2024-04-15T21:03:01.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:00 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:01.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:00 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:01.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/942: symlink d4/d1f/d31/d4d/dbf/l12e 0 2024-04-15T21:03:01.415 INFO:tasks.workunit.client.0.smithi072.stdout:6/851: dwrite d2/d40/dcb/f44 [0,4194304] 0 2024-04-15T21:03:01.417 INFO:tasks.workunit.client.0.smithi072.stdout:8/924: write d3/de/d1b/d85/f103 [3725351,125389] 0 2024-04-15T21:03:01.418 INFO:tasks.workunit.client.0.smithi072.stdout:1/864: link d5/db/d27/d9c/fa7 d5/db/d2d/d85/dbf/d101/d1f/d63/f113 0 2024-04-15T21:03:01.419 INFO:tasks.workunit.client.0.smithi072.stdout:1/865: chown d5/db/d2d/d85/dbf/d101/c11 4009239 1 2024-04-15T21:03:01.420 INFO:tasks.workunit.client.0.smithi072.stdout:9/943: mkdir d4/d29/d4c/d74/d84/dc0/d12f 0 2024-04-15T21:03:01.421 INFO:tasks.workunit.client.0.smithi072.stdout:2/941: creat d2/d3/f133 x:0 0 0 2024-04-15T21:03:01.423 INFO:tasks.workunit.client.0.smithi072.stdout:8/925: mknod d3/de/d1b/d3f/c11f 0 2024-04-15T21:03:01.425 INFO:tasks.workunit.client.0.smithi072.stdout:4/874: link d7/d28/l4b d7/d15/ddd/df7/d76/d8b/dad/de1/l117 0 2024-04-15T21:03:01.427 INFO:tasks.workunit.client.0.smithi072.stdout:5/906: getdents d0/d3/d7/d12/d1d/d102 0 2024-04-15T21:03:01.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/942: symlink d2/d37/l134 0 2024-04-15T21:03:01.429 INFO:tasks.workunit.client.0.smithi072.stdout:6/852: link d2/d42/db9/fe1 d2/d10/d11/d1f/d60/f101 0 2024-04-15T21:03:01.433 INFO:tasks.workunit.client.0.smithi072.stdout:5/907: mkdir d0/d3/d7/d1f/d4c/d131 0 2024-04-15T21:03:01.433 INFO:tasks.workunit.client.0.smithi072.stdout:8/926: symlink d3/d4/d10b/l120 0 2024-04-15T21:03:01.435 INFO:tasks.workunit.client.0.smithi072.stdout:4/875: mknod d7/d10/d41/d45/c118 0 2024-04-15T21:03:01.436 INFO:tasks.workunit.client.0.smithi072.stdout:2/943: dwrite d2/db3/f117 [0,4194304] 0 2024-04-15T21:03:01.439 INFO:tasks.workunit.client.0.smithi072.stdout:6/853: dwrite d2/d10/d11/d1f/d60/f61 [0,4194304] 0 2024-04-15T21:03:01.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/866: creat d5/d31/f114 x:0 0 0 2024-04-15T21:03:01.439 INFO:tasks.workunit.client.0.smithi072.stdout:9/944: creat d4/d1f/d31/d9b/f130 x:0 0 0 2024-04-15T21:03:01.440 INFO:tasks.workunit.client.0.smithi072.stdout:4/876: write d7/d15/ddd/df7/d76/f106 [422148,81864] 0 2024-04-15T21:03:01.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/927: mkdir d3/de/d1b/d41/dae/dc0/d121 0 2024-04-15T21:03:01.445 INFO:tasks.workunit.client.0.smithi072.stdout:2/944: mknod d2/d37/d126/db8/c135 0 2024-04-15T21:03:01.445 INFO:tasks.workunit.client.0.smithi072.stdout:1/867: creat d5/db/daa/f115 x:0 0 0 2024-04-15T21:03:01.445 INFO:tasks.workunit.client.0.smithi072.stdout:6/854: symlink d2/d42/db9/dc9/l102 0 2024-04-15T21:03:01.447 INFO:tasks.workunit.client.0.smithi072.stdout:4/877: creat d7/d10/d41/d4c/dc9/f119 x:0 0 0 2024-04-15T21:03:01.448 INFO:tasks.workunit.client.0.smithi072.stdout:9/945: rename d4/d29/d4c/d74/d84/cc7 to d4/d29/d4c/d74/d84/dc0/d12f/c131 0 2024-04-15T21:03:01.449 INFO:tasks.workunit.client.0.smithi072.stdout:6/855: chown d2/d40/l8f 0 1 2024-04-15T21:03:01.450 INFO:tasks.workunit.client.0.smithi072.stdout:1/868: mkdir d5/db/d2d/d85/dbf/d101/d1f/d116 0 2024-04-15T21:03:01.452 INFO:tasks.workunit.client.0.smithi072.stdout:2/945: mknod d2/d8/d8e/c136 0 2024-04-15T21:03:01.457 INFO:tasks.workunit.client.0.smithi072.stdout:3/875: sync 2024-04-15T21:03:01.457 INFO:tasks.workunit.client.0.smithi072.stdout:6/856: creat d2/d42/dad/f103 x:0 0 0 2024-04-15T21:03:01.458 INFO:tasks.workunit.client.0.smithi072.stdout:6/857: chown d2/d40/dcb/d49/f91 769160 1 2024-04-15T21:03:01.459 INFO:tasks.workunit.client.0.smithi072.stdout:1/869: creat d5/db/d27/d9c/f117 x:0 0 0 2024-04-15T21:03:01.468 INFO:tasks.workunit.client.0.smithi072.stdout:6/858: getdents d2/d10/d11/d1f 0 2024-04-15T21:03:01.469 INFO:tasks.workunit.client.0.smithi072.stdout:6/859: write d2/d40/dc3/fe2 [3402530,97391] 0 2024-04-15T21:03:01.470 INFO:tasks.workunit.client.0.smithi072.stdout:9/946: dread d4/d76/d8f/fa2 [0,4194304] 0 2024-04-15T21:03:01.470 INFO:tasks.workunit.client.0.smithi072.stdout:6/860: fsync d2/d10/d11/d15/f53 0 2024-04-15T21:03:01.471 INFO:tasks.workunit.client.0.smithi072.stdout:9/947: fdatasync d4/f6a 0 2024-04-15T21:03:01.472 INFO:tasks.workunit.client.0.smithi072.stdout:6/861: read - d2/d42/dad/f103 zero size 2024-04-15T21:03:01.473 INFO:tasks.workunit.client.0.smithi072.stdout:6/862: read d2/d40/dcb/f5c [3033998,120189] 0 2024-04-15T21:03:01.474 INFO:tasks.workunit.client.0.smithi072.stdout:9/948: mkdir d4/d1f/d9e/d132 0 2024-04-15T21:03:01.479 INFO:tasks.workunit.client.0.smithi072.stdout:3/876: dread d1/d3f/fc0 [0,4194304] 0 2024-04-15T21:03:01.480 INFO:tasks.workunit.client.0.smithi072.stdout:3/877: write d1/d3f/fc1 [570002,4933] 0 2024-04-15T21:03:01.484 INFO:tasks.workunit.client.0.smithi072.stdout:5/908: write d0/d3/d6/d2d/f9c [4966166,120641] 0 2024-04-15T21:03:01.490 INFO:tasks.workunit.client.0.smithi072.stdout:5/909: getdents d0/d3/d7/d12/d31/d55/d58 0 2024-04-15T21:03:01.491 INFO:tasks.workunit.client.0.smithi072.stdout:8/928: truncate d3/de/d1b/f62 3049458 0 2024-04-15T21:03:01.493 INFO:tasks.workunit.client.0.smithi072.stdout:8/929: mknod d3/d4/d4d/c122 0 2024-04-15T21:03:01.493 INFO:tasks.workunit.client.0.smithi072.stdout:4/878: dwrite d7/d10/d41/f51 [0,4194304] 0 2024-04-15T21:03:01.494 INFO:tasks.workunit.client.0.smithi072.stdout:2/946: write d2/d38/f54 [4499177,126086] 0 2024-04-15T21:03:01.496 INFO:tasks.workunit.client.0.smithi072.stdout:9/949: write d4/d1f/d2c/fde [2912931,2009] 0 2024-04-15T21:03:01.502 INFO:tasks.workunit.client.0.smithi072.stdout:1/870: dwrite d5/d3d/f94 [0,4194304] 0 2024-04-15T21:03:01.503 INFO:tasks.workunit.client.0.smithi072.stdout:3/878: truncate d1/d15/d40/dc2/ff8 7367541 0 2024-04-15T21:03:01.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/871: write d5/f32 [4501680,67488] 0 2024-04-15T21:03:01.507 INFO:tasks.workunit.client.0.smithi072.stdout:1/872: stat d5/db/d2d/d85/dbf/d101/d1f/d63/fd2 0 2024-04-15T21:03:01.508 INFO:tasks.workunit.client.0.smithi072.stdout:9/950: rename d4/d1f/f24 to d4/d29/d4c/d74/d84/df2/df4/d128/f133 0 2024-04-15T21:03:01.515 INFO:tasks.workunit.client.0.smithi072.stdout:3/879: creat d1/d15/d40/d9e/dc7/f10a x:0 0 0 2024-04-15T21:03:01.516 INFO:tasks.workunit.client.0.smithi072.stdout:3/880: chown d1/d15/d32/d78/cb7 0 1 2024-04-15T21:03:01.519 INFO:tasks.workunit.client.0.smithi072.stdout:1/873: creat d5/db/d2d/d85/f118 x:0 0 0 2024-04-15T21:03:01.520 INFO:tasks.workunit.client.0.smithi072.stdout:1/874: readlink d5/db/d2d/d85/dbf/d101/d1f/l46 0 2024-04-15T21:03:01.521 INFO:tasks.workunit.client.0.smithi072.stdout:2/947: creat d2/d8/daa/f137 x:0 0 0 2024-04-15T21:03:01.521 INFO:tasks.workunit.client.0.smithi072.stdout:8/930: getdents d3/de/d1b/d41/dae 0 2024-04-15T21:03:01.522 INFO:tasks.workunit.client.0.smithi072.stdout:1/875: dread d5/db/d2d/d56/df0/f9b [0,4194304] 0 2024-04-15T21:03:01.522 INFO:tasks.workunit.client.0.smithi072.stdout:2/948: dread - d2/d8/d8e/d90/fd2 zero size 2024-04-15T21:03:01.523 INFO:tasks.workunit.client.0.smithi072.stdout:9/951: symlink d4/d29/d4c/l134 0 2024-04-15T21:03:01.526 INFO:tasks.workunit.client.0.smithi072.stdout:4/879: dread d7/d10/d41/d44/f48 [0,4194304] 0 2024-04-15T21:03:01.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/952: unlink d4/d1f/d2c/d62/f81 0 2024-04-15T21:03:01.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/953: chown d4/d29/d45 0 1 2024-04-15T21:03:01.534 INFO:tasks.workunit.client.0.smithi072.stdout:8/931: link d3/de/d81/f86 d3/de/d1b/d41/da4/d2e/f123 0 2024-04-15T21:03:01.535 INFO:tasks.workunit.client.0.smithi072.stdout:3/881: write d1/d15/d32/d78/fad [4281375,86050] 0 2024-04-15T21:03:01.535 INFO:tasks.workunit.client.0.smithi072.stdout:8/932: readlink d3/ld 0 2024-04-15T21:03:01.543 INFO:tasks.workunit.client.0.smithi072.stdout:2/949: dwrite d2/d37/d126/f8d [0,4194304] 0 2024-04-15T21:03:01.544 INFO:tasks.workunit.client.0.smithi072.stdout:2/950: chown d2/dd7/cd4 836 1 2024-04-15T21:03:01.545 INFO:tasks.workunit.client.0.smithi072.stdout:8/933: read d3/de/f20 [40834,68146] 0 2024-04-15T21:03:01.545 INFO:tasks.workunit.client.0.smithi072.stdout:4/880: dwrite d7/f4f [0,4194304] 0 2024-04-15T21:03:01.547 INFO:tasks.workunit.client.0.smithi072.stdout:1/876: link d5/db/l48 d5/db/d2d/d85/dbf/d101/d1f/l119 0 2024-04-15T21:03:01.548 INFO:tasks.workunit.client.0.smithi072.stdout:3/882: creat d1/d15/d32/d78/d107/f10b x:0 0 0 2024-04-15T21:03:01.549 INFO:tasks.workunit.client.0.smithi072.stdout:3/883: write d1/d5b/ff5 [31647,88811] 0 2024-04-15T21:03:01.549 INFO:tasks.workunit.client.0.smithi072.stdout:2/951: unlink d2/d38/d73/d80/fa3 0 2024-04-15T21:03:01.550 INFO:tasks.workunit.client.0.smithi072.stdout:4/881: mknod d7/d10/d41/d4c/c11a 0 2024-04-15T21:03:01.555 INFO:tasks.workunit.client.0.smithi072.stdout:8/934: creat d3/de/d1b/d41/dae/dc0/de9/f124 x:0 0 0 2024-04-15T21:03:01.563 INFO:tasks.workunit.client.0.smithi072.stdout:2/952: mkdir d2/d66/df2/d138 0 2024-04-15T21:03:01.564 INFO:tasks.workunit.client.0.smithi072.stdout:2/953: write d2/d8/d8e/f11d [67024,97788] 0 2024-04-15T21:03:01.565 INFO:tasks.workunit.client.0.smithi072.stdout:2/954: fdatasync d2/d3/d5f/f7c 0 2024-04-15T21:03:01.566 INFO:tasks.workunit.client.0.smithi072.stdout:8/935: rmdir d3/de/d1b/d44/d102/d10a 39 2024-04-15T21:03:01.567 INFO:tasks.workunit.client.0.smithi072.stdout:2/955: stat d2/d3/d5f/f60 0 2024-04-15T21:03:01.569 INFO:tasks.workunit.client.0.smithi072.stdout:3/884: truncate d1/d5b/fbc 4473573 0 2024-04-15T21:03:01.569 INFO:tasks.workunit.client.0.smithi072.stdout:9/954: dwrite d4/d1f/d2c/f7d [0,4194304] 0 2024-04-15T21:03:01.574 INFO:tasks.workunit.client.0.smithi072.stdout:4/882: mkdir d7/d15/d58/d105/d11b 0 2024-04-15T21:03:01.578 INFO:tasks.workunit.client.0.smithi072.stdout:2/956: mkdir d2/d66/df2/d139 0 2024-04-15T21:03:01.581 INFO:tasks.workunit.client.0.smithi072.stdout:8/936: read - d3/de/d1b/d41/d74/d98/da5/ff0 zero size 2024-04-15T21:03:01.585 INFO:tasks.workunit.client.0.smithi072.stdout:1/877: link d5/db/d2d/d56/df0/d82/l102 d5/db/d2d/d85/dbf/d101/l11a 0 2024-04-15T21:03:01.586 INFO:tasks.workunit.client.0.smithi072.stdout:0/903: sync 2024-04-15T21:03:01.588 INFO:tasks.workunit.client.0.smithi072.stdout:4/883: unlink d7/d15/l18 0 2024-04-15T21:03:01.592 INFO:tasks.workunit.client.0.smithi072.stdout:9/955: dread d4/d1f/d31/f3f [0,4194304] 0 2024-04-15T21:03:01.597 INFO:tasks.workunit.client.0.smithi072.stdout:1/878: rename d5/db/d2d/d56/df0/d82/fb9 to d5/db/d27/d5c/f11b 0 2024-04-15T21:03:01.598 INFO:tasks.workunit.client.0.smithi072.stdout:0/904: symlink d0/d74/d94/l132 0 2024-04-15T21:03:01.599 INFO:tasks.workunit.client.0.smithi072.stdout:1/879: read - d5/db/d27/d9c/f117 zero size 2024-04-15T21:03:01.600 INFO:tasks.workunit.client.0.smithi072.stdout:0/905: dread - d0/d45/d7a/d70/d59/d8a/d7b/f9a zero size 2024-04-15T21:03:01.600 INFO:tasks.workunit.client.0.smithi072.stdout:9/956: dread d4/d1f/d2c/f35 [0,4194304] 0 2024-04-15T21:03:01.601 INFO:tasks.workunit.client.0.smithi072.stdout:2/957: write d2/d8/d8e/fe0 [1189900,127360] 0 2024-04-15T21:03:01.602 INFO:tasks.workunit.client.0.smithi072.stdout:2/958: chown d2/d8/d8e/d90/caf 3222 1 2024-04-15T21:03:01.605 INFO:tasks.workunit.client.0.smithi072.stdout:4/884: rename d7/d10/d41/d44/d7a/d97/db6/lcb to d7/d15/ddd/df7/d76/d8b/l11c 0 2024-04-15T21:03:01.606 INFO:tasks.workunit.client.0.smithi072.stdout:4/885: readlink d7/d10/d41/d45/d93/la4 0 2024-04-15T21:03:01.606 INFO:tasks.workunit.client.0.smithi072.stdout:1/880: creat d5/db/d27/d9c/f11c x:0 0 0 2024-04-15T21:03:01.608 INFO:tasks.workunit.client.0.smithi072.stdout:0/906: symlink d0/d19/d2b/l133 0 2024-04-15T21:03:01.609 INFO:tasks.workunit.client.0.smithi072.stdout:2/959: truncate d2/d3/f7f 634623 0 2024-04-15T21:03:01.611 INFO:tasks.workunit.client.0.smithi072.stdout:8/937: dwrite d3/de/d1b/d3f/fbb [0,4194304] 0 2024-04-15T21:03:01.619 INFO:tasks.workunit.client.0.smithi072.stdout:8/938: dwrite d3/de/d1b/d85/f103 [0,4194304] 0 2024-04-15T21:03:01.619 INFO:tasks.workunit.client.0.smithi072.stdout:2/960: mkdir d2/d64/dbd/d110/d13a 0 2024-04-15T21:03:01.625 INFO:tasks.workunit.client.0.smithi072.stdout:1/881: write d5/db/d27/d5c/dbd/f95 [1750133,63928] 0 2024-04-15T21:03:01.626 INFO:tasks.workunit.client.0.smithi072.stdout:0/907: write d0/fb3 [2565369,20960] 0 2024-04-15T21:03:01.628 INFO:tasks.workunit.client.0.smithi072.stdout:1/882: fsync d5/db/d2d/d85/dbf/d101/f88 0 2024-04-15T21:03:01.631 INFO:tasks.workunit.client.0.smithi072.stdout:4/886: dwrite d7/d10/d41/dc4/de8/fec [0,4194304] 0 2024-04-15T21:03:01.631 INFO:tasks.workunit.client.0.smithi072.stdout:2/961: rmdir d2/d8/d8e/d90 39 2024-04-15T21:03:01.632 INFO:tasks.workunit.client.0.smithi072.stdout:9/957: getdents d4/d29/d4c/d74/d84/dc0/d12f 0 2024-04-15T21:03:01.633 INFO:tasks.workunit.client.0.smithi072.stdout:0/908: symlink d0/d19/d71/l134 0 2024-04-15T21:03:01.639 INFO:tasks.workunit.client.0.smithi072.stdout:2/962: mknod d2/d64/c13b 0 2024-04-15T21:03:01.639 INFO:tasks.workunit.client.0.smithi072.stdout:0/909: read d0/f13 [2823232,99167] 0 2024-04-15T21:03:01.643 INFO:tasks.workunit.client.0.smithi072.stdout:9/958: getdents d4/d1f/d31/d9b 0 2024-04-15T21:03:01.644 INFO:tasks.workunit.client.0.smithi072.stdout:0/910: symlink d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/d109/l135 0 2024-04-15T21:03:01.646 INFO:tasks.workunit.client.0.smithi072.stdout:0/911: readlink d0/d45/d35/d3a/l44 0 2024-04-15T21:03:01.646 INFO:tasks.workunit.client.0.smithi072.stdout:0/912: readlink d0/d19/l27 0 2024-04-15T21:03:01.649 INFO:tasks.workunit.client.0.smithi072.stdout:9/959: dwrite d4/d76/d8f/f110 [0,4194304] 0 2024-04-15T21:03:01.653 INFO:tasks.workunit.client.0.smithi072.stdout:0/913: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/d11c/d136 0 2024-04-15T21:03:01.658 INFO:tasks.workunit.client.0.smithi072.stdout:8/939: write d3/de/f99 [5158064,111252] 0 2024-04-15T21:03:01.662 INFO:tasks.workunit.client.0.smithi072.stdout:0/914: fdatasync d0/d45/d35/d3a/f6c 0 2024-04-15T21:03:01.665 INFO:tasks.workunit.client.0.smithi072.stdout:1/883: dread d5/d31/dbc/feb [0,4194304] 0 2024-04-15T21:03:01.665 INFO:tasks.workunit.client.0.smithi072.stdout:8/940: dread d3/de/d1b/f43 [0,4194304] 0 2024-04-15T21:03:01.669 INFO:tasks.workunit.client.0.smithi072.stdout:4/887: write d7/d10/f85 [516534,90482] 0 2024-04-15T21:03:01.671 INFO:tasks.workunit.client.0.smithi072.stdout:2/963: write d2/d3/f46 [806636,90007] 0 2024-04-15T21:03:01.671 INFO:tasks.workunit.client.0.smithi072.stdout:4/888: dread - d7/d10/d41/d44/f8e zero size 2024-04-15T21:03:01.671 INFO:tasks.workunit.client.0.smithi072.stdout:9/960: link d4/d29/d4c/d91/lb2 d4/d29/d4c/d74/l135 0 2024-04-15T21:03:01.672 INFO:tasks.workunit.client.0.smithi072.stdout:2/964: chown d2/d38/d91/dbb 2346036 1 2024-04-15T21:03:01.673 INFO:tasks.workunit.client.0.smithi072.stdout:9/961: dread d4/d1f/d31/dcc/fe5 [0,4194304] 0 2024-04-15T21:03:01.676 INFO:tasks.workunit.client.0.smithi072.stdout:8/941: mknod d3/de/d1b/d85/d101/c125 0 2024-04-15T21:03:01.681 INFO:tasks.workunit.client.0.smithi072.stdout:7/883: sync 2024-04-15T21:03:01.687 INFO:tasks.workunit.client.0.smithi072.stdout:0/915: write d0/d45/d35/d3a/f28 [228049,53982] 0 2024-04-15T21:03:01.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/884: write d5/db/d27/d5c/f64 [2281894,60233] 0 2024-04-15T21:03:01.691 INFO:tasks.workunit.client.0.smithi072.stdout:7/884: dread d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/faa [0,4194304] 0 2024-04-15T21:03:01.693 INFO:tasks.workunit.client.0.smithi072.stdout:9/962: fdatasync d4/d1f/d31/f63 0 2024-04-15T21:03:01.694 INFO:tasks.workunit.client.0.smithi072.stdout:4/889: write d7/d15/d58/f77 [3300872,67046] 0 2024-04-15T21:03:01.697 INFO:tasks.workunit.client.0.smithi072.stdout:8/942: rename d3/d4/f56 to d3/de/d1b/d41/dae/dc0/d121/f126 0 2024-04-15T21:03:01.702 INFO:tasks.workunit.client.0.smithi072.stdout:0/916: creat d0/d19/d71/d9e/f137 x:0 0 0 2024-04-15T21:03:01.703 INFO:tasks.workunit.client.0.smithi072.stdout:2/965: mkdir d2/d8/d13c 0 2024-04-15T21:03:01.707 INFO:tasks.workunit.client.0.smithi072.stdout:7/885: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dd5/f121 x:0 0 0 2024-04-15T21:03:01.708 INFO:tasks.workunit.client.0.smithi072.stdout:2/966: dwrite d2/d8/d8e/f11d [0,4194304] 0 2024-04-15T21:03:01.709 INFO:tasks.workunit.client.0.smithi072.stdout:7/886: write d2/d7/d25/d2d/d47/f4a [2243327,13655] 0 2024-04-15T21:03:01.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/963: symlink d4/d1f/d2c/d62/l136 0 2024-04-15T21:03:01.712 INFO:tasks.workunit.client.0.smithi072.stdout:9/964: rename d4/d1f/d31 to d4/d1f/d31/d9b/dca/d137 22 2024-04-15T21:03:01.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/863: sync 2024-04-15T21:03:01.714 INFO:tasks.workunit.client.0.smithi072.stdout:3/885: sync 2024-04-15T21:03:01.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/910: sync 2024-04-15T21:03:01.716 INFO:tasks.workunit.client.0.smithi072.stdout:0/917: rmdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/df6 39 2024-04-15T21:03:01.717 INFO:tasks.workunit.client.0.smithi072.stdout:9/965: dread d4/d1f/d2c/f7d [0,4194304] 0 2024-04-15T21:03:01.719 INFO:tasks.workunit.client.0.smithi072.stdout:1/885: mknod d5/db/d2d/c11d 0 2024-04-15T21:03:01.720 INFO:tasks.workunit.client.0.smithi072.stdout:6/864: dwrite d2/d42/f93 [0,4194304] 0 2024-04-15T21:03:01.729 INFO:tasks.workunit.client.0.smithi072.stdout:8/943: mkdir d3/d4/d4c/de5/d127 0 2024-04-15T21:03:01.732 INFO:tasks.workunit.client.0.smithi072.stdout:3/886: fsync d1/d15/d40/f9 0 2024-04-15T21:03:01.734 INFO:tasks.workunit.client.0.smithi072.stdout:5/911: rename d0/l20 to d0/d3/d7/d12/d31/d62/dfa/l132 0 2024-04-15T21:03:01.736 INFO:tasks.workunit.client.0.smithi072.stdout:0/918: mknod d0/d97/c138 0 2024-04-15T21:03:01.736 INFO:tasks.workunit.client.0.smithi072.stdout:9/966: readlink d4/d1f/l28 0 2024-04-15T21:03:01.737 INFO:tasks.workunit.client.0.smithi072.stdout:4/890: dwrite d7/d23/f25 [0,4194304] 0 2024-04-15T21:03:01.739 INFO:tasks.workunit.client.0.smithi072.stdout:4/891: fsync d7/d15/d58/f7b 0 2024-04-15T21:03:01.740 INFO:tasks.workunit.client.0.smithi072.stdout:4/892: chown d7/d10/d41/d44/cd4 45646 1 2024-04-15T21:03:01.741 INFO:tasks.workunit.client.0.smithi072.stdout:2/967: link d2/d66/f12b d2/d64/dce/f13d 0 2024-04-15T21:03:01.741 INFO:tasks.workunit.client.0.smithi072.stdout:4/893: dread - d7/d15/ddd/f104 zero size 2024-04-15T21:03:01.744 INFO:tasks.workunit.client.0.smithi072.stdout:8/944: symlink d3/de/d1b/d41/d74/d98/l128 0 2024-04-15T21:03:01.749 INFO:tasks.workunit.client.0.smithi072.stdout:5/912: mknod d0/d3/d7/d1f/d50/c133 0 2024-04-15T21:03:01.749 INFO:tasks.workunit.client.0.smithi072.stdout:2/968: dwrite d2/d66/f74 [0,4194304] 0 2024-04-15T21:03:01.750 INFO:tasks.workunit.client.0.smithi072.stdout:1/886: getdents d5/db/d2d/d56/df0/d82/df8 0 2024-04-15T21:03:01.768 INFO:tasks.workunit.client.0.smithi072.stdout:5/913: mkdir d0/d3/d7/d94/d92/da0/dfc/d134 0 2024-04-15T21:03:01.768 INFO:tasks.workunit.client.0.smithi072.stdout:1/887: truncate d5/f3c 3910681 0 2024-04-15T21:03:01.768 INFO:tasks.workunit.client.0.smithi072.stdout:7/887: link d2/fa d2/d7/d25/d2d/d47/d7e/f122 0 2024-04-15T21:03:01.769 INFO:tasks.workunit.client.0.smithi072.stdout:3/887: creat d1/f10c x:0 0 0 2024-04-15T21:03:01.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/967: rename d4/c9d to d4/d29/d4c/c138 0 2024-04-15T21:03:01.771 INFO:tasks.workunit.client.0.smithi072.stdout:6/865: getdents d2/d10/d11/d1f/d60/d63 0 2024-04-15T21:03:01.775 INFO:tasks.workunit.client.0.smithi072.stdout:2/969: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-15T21:03:01.777 INFO:tasks.workunit.client.0.smithi072.stdout:3/888: mknod d1/d15/d40/d9e/c10d 0 2024-04-15T21:03:01.778 INFO:tasks.workunit.client.0.smithi072.stdout:5/914: dwrite d0/d3/d7/d1f/d50/fcf [0,4194304] 0 2024-04-15T21:03:01.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/866: symlink d2/d42/l104 0 2024-04-15T21:03:01.779 INFO:tasks.workunit.client.0.smithi072.stdout:0/919: dread d0/d45/d7a/d70/d59/d8a/d8b/db8/f33 [0,4194304] 0 2024-04-15T21:03:01.780 INFO:tasks.workunit.client.0.smithi072.stdout:0/920: chown d0/d19/d2b/fee 16026 1 2024-04-15T21:03:01.783 INFO:tasks.workunit.client.0.smithi072.stdout:1/888: mknod d5/db/d2d/d56/d93/c11e 0 2024-04-15T21:03:01.787 INFO:tasks.workunit.client.0.smithi072.stdout:7/888: creat d2/d7/d25/d72/d98/d108/f123 x:0 0 0 2024-04-15T21:03:01.788 INFO:tasks.workunit.client.0.smithi072.stdout:4/894: write d7/d15/ddd/df7/d76/d8b/fce [676614,86555] 0 2024-04-15T21:03:01.790 INFO:tasks.workunit.client.0.smithi072.stdout:2/970: write d2/f44 [1796537,74273] 0 2024-04-15T21:03:01.791 INFO:tasks.workunit.client.0.smithi072.stdout:2/971: chown d2/d64/c13b 231 1 2024-04-15T21:03:01.792 INFO:tasks.workunit.client.0.smithi072.stdout:3/889: mkdir d1/d3f/d10e 0 2024-04-15T21:03:01.795 INFO:tasks.workunit.client.0.smithi072.stdout:5/915: creat d0/d3/d6/d2d/d79/f135 x:0 0 0 2024-04-15T21:03:01.796 INFO:tasks.workunit.client.0.smithi072.stdout:2/972: read d2/d8/fb1 [2870564,31525] 0 2024-04-15T21:03:01.799 INFO:tasks.workunit.client.0.smithi072.stdout:1/889: creat d5/db/d2d/d85/dbf/d101/dc3/dd3/dde/f11f x:0 0 0 2024-04-15T21:03:01.801 INFO:tasks.workunit.client.0.smithi072.stdout:1/890: truncate d5/db/d2d/d85/dbf/d101/d1f/d63/fa9 5235573 0 2024-04-15T21:03:01.802 INFO:tasks.workunit.client.0.smithi072.stdout:1/891: truncate d5/db/d2d/d56/ff9 58010 0 2024-04-15T21:03:01.803 INFO:tasks.workunit.client.0.smithi072.stdout:7/889: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d43/db9 39 2024-04-15T21:03:01.808 INFO:tasks.workunit.client.0.smithi072.stdout:3/890: symlink d1/d5b/dbf/l10f 0 2024-04-15T21:03:01.817 INFO:tasks.workunit.client.0.smithi072.stdout:0/921: mkdir d0/d45/d7a/d70/d59/d8a/d8b/db8/d139 0 2024-04-15T21:03:01.818 INFO:tasks.workunit.client.0.smithi072.stdout:6/867: write d2/d10/d11/d1f/f4c [1928634,108872] 0 2024-04-15T21:03:01.819 INFO:tasks.workunit.client.0.smithi072.stdout:6/868: chown d2/d40/d66/da8/cdd 64 1 2024-04-15T21:03:01.819 INFO:tasks.workunit.client.0.smithi072.stdout:6/869: fdatasync d2/d40/dcb/d49/ff8 0 2024-04-15T21:03:01.821 INFO:tasks.workunit.client.0.smithi072.stdout:1/892: mknod d5/db/d27/d5c/ddc/c120 0 2024-04-15T21:03:01.826 INFO:tasks.workunit.client.0.smithi072.stdout:4/895: dwrite d7/d28/d42/f65 [0,4194304] 0 2024-04-15T21:03:01.828 INFO:tasks.workunit.client.0.smithi072.stdout:2/973: fsync d2/d8/f36 0 2024-04-15T21:03:01.831 INFO:tasks.workunit.client.0.smithi072.stdout:2/974: truncate d2/d66/d69/f10a 975885 0 2024-04-15T21:03:01.831 INFO:tasks.workunit.client.0.smithi072.stdout:9/968: rename d4/d1f/d31/d4d/dbf/dd2/cf6 to d4/c139 0 2024-04-15T21:03:01.832 INFO:tasks.workunit.client.0.smithi072.stdout:2/975: chown d2/d66 2919 1 2024-04-15T21:03:01.834 INFO:tasks.workunit.client.0.smithi072.stdout:4/896: dwrite d7/d10/d41/d44/d7a/ff1 [8388608,4194304] 0 2024-04-15T21:03:01.834 INFO:tasks.workunit.client.0.smithi072.stdout:6/870: creat d2/da1/f105 x:0 0 0 2024-04-15T21:03:01.835 INFO:tasks.workunit.client.0.smithi072.stdout:6/871: readlink d2/d42/db9/lc0 0 2024-04-15T21:03:01.838 INFO:tasks.workunit.client.0.smithi072.stdout:1/893: creat d5/db/d2d/d85/dbf/d101/d1f/d63/d100/f121 x:0 0 0 2024-04-15T21:03:01.854 INFO:tasks.workunit.client.0.smithi072.stdout:5/916: rename d0/d3/d7/d94/de1/f12f to d0/d3/d7/d94/d86/f136 0 2024-04-15T21:03:01.867 INFO:tasks.workunit.client.0.smithi072.stdout:5/917: symlink d0/d3/d7/d1f/d50/l137 0 2024-04-15T21:03:01.870 INFO:tasks.workunit.client.0.smithi072.stdout:2/976: mkdir d2/d8/d8e/d90/d13e 0 2024-04-15T21:03:01.874 INFO:tasks.workunit.client.0.smithi072.stdout:6/872: symlink d2/d10/d11/l106 0 2024-04-15T21:03:01.877 INFO:tasks.workunit.client.0.smithi072.stdout:3/891: getdents d1/d26 0 2024-04-15T21:03:01.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/890: write d2/f1c [6613926,107624] 0 2024-04-15T21:03:01.890 INFO:tasks.workunit.client.0.smithi072.stdout:8/945: sync 2024-04-15T21:03:01.901 INFO:tasks.workunit.client.0.smithi072.stdout:0/922: rename d0/d6/d55/d100 to d0/d13a 0 2024-04-15T21:03:01.906 INFO:tasks.workunit.client.0.smithi072.stdout:0/923: dwrite d0/d19/d2b/d63/fe9 [0,4194304] 0 2024-04-15T21:03:01.908 INFO:tasks.workunit.client.0.smithi072.stdout:8/946: mknod d3/d4/d4d/c129 0 2024-04-15T21:03:01.910 INFO:tasks.workunit.client.0.smithi072.stdout:6/873: fdatasync d2/d40/d66/d7f/dd9/f75 0 2024-04-15T21:03:01.910 INFO:tasks.workunit.client.0.smithi072.stdout:4/897: write d7/d28/f49 [70645,97796] 0 2024-04-15T21:03:01.922 INFO:tasks.workunit.client.0.smithi072.stdout:8/947: stat d3/de/d1b/d85/d101/f118 0 2024-04-15T21:03:01.924 INFO:tasks.workunit.client.0.smithi072.stdout:0/924: read d0/d6/d55/f5f [4685701,76251] 0 2024-04-15T21:03:01.924 INFO:tasks.workunit.client.0.smithi072.stdout:0/925: readlink d0/lb 0 2024-04-15T21:03:01.924 INFO:tasks.workunit.client.0.smithi072.stdout:6/874: creat d2/da1/f107 x:0 0 0 2024-04-15T21:03:01.925 INFO:tasks.workunit.client.0.smithi072.stdout:0/926: readlink d0/d45/d35/l6b 0 2024-04-15T21:03:01.925 INFO:tasks.workunit.client.0.smithi072.stdout:6/875: write d2/d40/dc3/fe2 [1585774,7284] 0 2024-04-15T21:03:01.927 INFO:tasks.workunit.client.0.smithi072.stdout:4/898: creat d7/d10/d41/d44/f11d x:0 0 0 2024-04-15T21:03:01.927 INFO:tasks.workunit.client.0.smithi072.stdout:3/892: creat d1/f110 x:0 0 0 2024-04-15T21:03:01.928 INFO:tasks.workunit.client.0.smithi072.stdout:4/899: truncate d7/d10/d41/dc4/de8/fec 4445104 0 2024-04-15T21:03:01.932 INFO:tasks.workunit.client.0.smithi072.stdout:9/969: link d4/d29/d45/l83 d4/d29/d4c/d74/d84/df2/l13a 0 2024-04-15T21:03:01.933 INFO:tasks.workunit.client.0.smithi072.stdout:9/970: truncate d4/d1f/d9e/db3/f11b 999563 0 2024-04-15T21:03:01.933 INFO:tasks.workunit.client.0.smithi072.stdout:8/948: mknod d3/de/d81/c12a 0 2024-04-15T21:03:01.934 INFO:tasks.workunit.client.0.smithi072.stdout:0/927: mkdir d0/d6/d48/d61/d13b 0 2024-04-15T21:03:01.934 INFO:tasks.workunit.client.0.smithi072.stdout:0/928: dread - d0/d45/d35/f122 zero size 2024-04-15T21:03:01.935 INFO:tasks.workunit.client.0.smithi072.stdout:3/893: symlink d1/d15/d40/dc2/l111 0 2024-04-15T21:03:01.937 INFO:tasks.workunit.client.0.smithi072.stdout:4/900: mkdir d7/d15/df0/d11e 0 2024-04-15T21:03:01.938 INFO:tasks.workunit.client.0.smithi072.stdout:7/891: link d2/d78/ff6 d2/d7/d25/d2d/d46/f124 0 2024-04-15T21:03:01.939 INFO:tasks.workunit.client.0.smithi072.stdout:8/949: symlink d3/de/d1b/d3f/dfb/l12b 0 2024-04-15T21:03:01.940 INFO:tasks.workunit.client.0.smithi072.stdout:8/950: stat d3/de/d1b/d41/d74/d98/lb4 0 2024-04-15T21:03:01.940 INFO:tasks.workunit.client.0.smithi072.stdout:0/929: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/d109/d13c 0 2024-04-15T21:03:01.940 INFO:tasks.workunit.client.0.smithi072.stdout:8/951: chown d3/de/d1b/ca7 56113776 1 2024-04-15T21:03:01.942 INFO:tasks.workunit.client.0.smithi072.stdout:4/901: symlink d7/d15/ddd/l11f 0 2024-04-15T21:03:01.943 INFO:tasks.workunit.client.0.smithi072.stdout:8/952: truncate d3/de/d1b/d41/dae/dc0/d121/f126 781089 0 2024-04-15T21:03:01.945 INFO:tasks.workunit.client.0.smithi072.stdout:3/894: rename d1/d3f/d4f/c90 to d1/d15/d40/d9e/dc7/c112 0 2024-04-15T21:03:01.946 INFO:tasks.workunit.client.0.smithi072.stdout:1/894: dwrite d5/d31/f4c [0,4194304] 0 2024-04-15T21:03:01.949 INFO:tasks.workunit.client.0.smithi072.stdout:9/971: getdents d4/d1f/d9e/db3 0 2024-04-15T21:03:01.951 INFO:tasks.workunit.client.0.smithi072.stdout:8/953: mknod d3/de/d1b/d44/d102/c12c 0 2024-04-15T21:03:01.955 INFO:tasks.workunit.client.0.smithi072.stdout:0/930: rename d0/d45/d7a/d70/d59/c10b to d0/d45/d7a/c13d 0 2024-04-15T21:03:01.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/895: dwrite d5/db/d27/d9c/f11c [0,4194304] 0 2024-04-15T21:03:01.955 INFO:tasks.workunit.client.0.smithi072.stdout:9/972: fdatasync d4/d1f/d31/f7e 0 2024-04-15T21:03:01.956 INFO:tasks.workunit.client.0.smithi072.stdout:5/918: dwrite d0/d3/d6/d14/fd0 [0,4194304] 0 2024-04-15T21:03:01.957 INFO:tasks.workunit.client.0.smithi072.stdout:9/973: dread - d4/d1f/db7/f100 zero size 2024-04-15T21:03:01.958 INFO:tasks.workunit.client.0.smithi072.stdout:5/919: chown d0/d3/d7/d1f/d50/fcf 2017 1 2024-04-15T21:03:01.959 INFO:tasks.workunit.client.0.smithi072.stdout:5/920: read - d0/d3/d7/d94/f116 zero size 2024-04-15T21:03:01.960 INFO:tasks.workunit.client.0.smithi072.stdout:8/954: read d3/d4/f1e [415418,101271] 0 2024-04-15T21:03:01.961 INFO:tasks.workunit.client.0.smithi072.stdout:8/955: fdatasync d3/f3c 0 2024-04-15T21:03:01.962 INFO:tasks.workunit.client.0.smithi072.stdout:8/956: write d3/de/d1b/d41/f114 [723834,37480] 0 2024-04-15T21:03:01.962 INFO:tasks.workunit.client.0.smithi072.stdout:4/902: rename d7/d10/c10e to d7/d10/d41/d45/d93/c120 0 2024-04-15T21:03:01.964 INFO:tasks.workunit.client.0.smithi072.stdout:0/931: fsync d0/d45/d35/d3a/f50 0 2024-04-15T21:03:01.964 INFO:tasks.workunit.client.0.smithi072.stdout:4/903: write d7/d28/db1/ffd [165697,58672] 0 2024-04-15T21:03:01.969 INFO:tasks.workunit.client.0.smithi072.stdout:2/977: truncate d2/d8/f72 715796 0 2024-04-15T21:03:01.972 INFO:tasks.workunit.client.0.smithi072.stdout:4/904: dwrite d7/d10/d41/d44/d7a/ff9 [0,4194304] 0 2024-04-15T21:03:01.975 INFO:tasks.workunit.client.0.smithi072.stdout:1/896: mknod d5/db/d2d/c122 0 2024-04-15T21:03:01.987 INFO:tasks.workunit.client.0.smithi072.stdout:1/897: creat d5/db/d27/d5c/ddc/f123 x:0 0 0 2024-04-15T21:03:01.991 INFO:tasks.workunit.client.0.smithi072.stdout:1/898: symlink d5/db/d27/d5c/l124 0 2024-04-15T21:03:01.993 INFO:tasks.workunit.client.0.smithi072.stdout:1/899: write d5/db/d2d/d85/dbf/d101/d1f/d63/d100/f105 [1039110,102468] 0 2024-04-15T21:03:01.993 INFO:tasks.workunit.client.0.smithi072.stdout:0/932: creat d0/d45/d7a/d70/d59/d8a/f13e x:0 0 0 2024-04-15T21:03:01.994 INFO:tasks.workunit.client.0.smithi072.stdout:0/933: dread - d0/d45/d7a/d70/dce/f101 zero size 2024-04-15T21:03:01.997 INFO:tasks.workunit.client.0.smithi072.stdout:6/876: write d2/d42/f97 [3108071,81013] 0 2024-04-15T21:03:01.999 INFO:tasks.workunit.client.0.smithi072.stdout:0/934: mkdir d0/d6/d48/d61/d13b/d13f 0 2024-04-15T21:03:02.001 INFO:tasks.workunit.client.0.smithi072.stdout:1/900: dwrite d5/db/d27/f47 [12582912,4194304] 0 2024-04-15T21:03:02.004 INFO:tasks.workunit.client.0.smithi072.stdout:0/935: truncate d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/fa4 672799 0 2024-04-15T21:03:02.005 INFO:tasks.workunit.client.0.smithi072.stdout:0/936: chown d0/d19/d2b/d63/ddb/fe5 108667 1 2024-04-15T21:03:02.007 INFO:tasks.workunit.client.0.smithi072.stdout:4/905: dread d7/d15/d58/f7b [0,4194304] 0 2024-04-15T21:03:02.008 INFO:tasks.workunit.client.0.smithi072.stdout:4/906: chown d7/d10/d41/d45/c5b 300 1 2024-04-15T21:03:02.010 INFO:tasks.workunit.client.0.smithi072.stdout:0/937: creat d0/d19/d71/de6/f140 x:0 0 0 2024-04-15T21:03:02.013 INFO:tasks.workunit.client.0.smithi072.stdout:7/892: dwrite d2/d7/f55 [0,4194304] 0 2024-04-15T21:03:02.015 INFO:tasks.workunit.client.0.smithi072.stdout:4/907: mknod d7/d10/d41/d44/c121 0 2024-04-15T21:03:02.016 INFO:tasks.workunit.client.0.smithi072.stdout:7/893: dread - d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa/f100 zero size 2024-04-15T21:03:02.021 INFO:tasks.workunit.client.0.smithi072.stdout:4/908: dread d7/d15/d58/f7b [0,4194304] 0 2024-04-15T21:03:02.021 INFO:tasks.workunit.client.0.smithi072.stdout:1/901: dread d5/db/d2d/d85/dbf/d101/d1f/f9a [0,4194304] 0 2024-04-15T21:03:02.021 INFO:tasks.workunit.client.0.smithi072.stdout:7/894: symlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/l125 0 2024-04-15T21:03:02.026 INFO:tasks.workunit.client.0.smithi072.stdout:4/909: creat d7/d15/ddd/df7/d76/d8b/dad/de1/f122 x:0 0 0 2024-04-15T21:03:02.026 INFO:tasks.workunit.client.0.smithi072.stdout:5/921: write d0/d3/d7/d12/f1a [2605757,127461] 0 2024-04-15T21:03:02.031 INFO:tasks.workunit.client.0.smithi072.stdout:1/902: unlink d5/db/d2d/d85/dbf/d101/dc3/dd3/dde/fac 0 2024-04-15T21:03:02.032 INFO:tasks.workunit.client.0.smithi072.stdout:0/938: link d0/d6/d6d/dcc/c130 d0/d45/d7a/d70/d59/d8a/d8b/db8/c141 0 2024-04-15T21:03:02.033 INFO:tasks.workunit.client.0.smithi072.stdout:9/974: write d4/d29/d45/f72 [1465574,84637] 0 2024-04-15T21:03:02.033 INFO:tasks.workunit.client.0.smithi072.stdout:2/978: write d2/d8/d8e/d90/fa5 [525251,59468] 0 2024-04-15T21:03:02.033 INFO:tasks.workunit.client.0.smithi072.stdout:8/957: write d3/de/d1b/f62 [3428695,105589] 0 2024-04-15T21:03:02.035 INFO:tasks.workunit.client.0.smithi072.stdout:9/975: stat d4/d1f/fc3 0 2024-04-15T21:03:02.036 INFO:tasks.workunit.client.0.smithi072.stdout:9/976: stat d4/d29/d45/l127 0 2024-04-15T21:03:02.038 INFO:tasks.workunit.client.0.smithi072.stdout:1/903: dread d5/db/d27/f47 [12582912,4194304] 0 2024-04-15T21:03:02.042 INFO:tasks.workunit.client.0.smithi072.stdout:6/877: dwrite d2/d10/d18/d47/d6d/f87 [0,4194304] 0 2024-04-15T21:03:02.058 INFO:tasks.workunit.client.0.smithi072.stdout:7/895: rename d2/d7/d25/d2d/d46/la9 to d2/d7/d25/d81/dbe/l126 0 2024-04-15T21:03:02.059 INFO:tasks.workunit.client.0.smithi072.stdout:5/922: mknod d0/d3/d6/d14/c138 0 2024-04-15T21:03:02.060 INFO:tasks.workunit.client.0.smithi072.stdout:5/923: write d0/d3/d6/d14/fb2 [841505,5372] 0 2024-04-15T21:03:02.060 INFO:tasks.workunit.client.0.smithi072.stdout:5/924: chown d0/l3f 94 1 2024-04-15T21:03:02.065 INFO:tasks.workunit.client.0.smithi072.stdout:0/939: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d142 0 2024-04-15T21:03:02.068 INFO:tasks.workunit.client.0.smithi072.stdout:1/904: fdatasync d5/db/d2d/d85/dbf/d101/d1f/fb6 0 2024-04-15T21:03:02.070 INFO:tasks.workunit.client.0.smithi072.stdout:1/905: read d5/f8 [820540,16716] 0 2024-04-15T21:03:02.071 INFO:tasks.workunit.client.0.smithi072.stdout:0/940: dwrite d0/d19/d71/de6/f140 [0,4194304] 0 2024-04-15T21:03:02.073 INFO:tasks.workunit.client.0.smithi072.stdout:6/878: creat d2/d42/db9/f108 x:0 0 0 2024-04-15T21:03:02.075 INFO:tasks.workunit.client.0.smithi072.stdout:3/895: sync 2024-04-15T21:03:02.076 INFO:tasks.workunit.client.0.smithi072.stdout:7/896: write d2/d7/d25/fed [710277,4828] 0 2024-04-15T21:03:02.078 INFO:tasks.workunit.client.0.smithi072.stdout:7/897: truncate d2/d7/d25/d2d/d46/d5a/d5f/d43/db8/ff0 673656 0 2024-04-15T21:03:02.085 INFO:tasks.workunit.client.0.smithi072.stdout:8/958: mkdir d3/de/d1b/d41/d74/d12d 0 2024-04-15T21:03:02.090 INFO:tasks.workunit.client.0.smithi072.stdout:0/941: fsync d0/d19/d58/f11d 0 2024-04-15T21:03:02.090 INFO:tasks.workunit.client.0.smithi072.stdout:6/879: rmdir d2/da1 39 2024-04-15T21:03:02.094 INFO:tasks.workunit.client.0.smithi072.stdout:8/959: symlink d3/d4/d4c/l12e 0 2024-04-15T21:03:02.095 INFO:tasks.workunit.client.0.smithi072.stdout:1/906: creat d5/dcb/f125 x:0 0 0 2024-04-15T21:03:02.099 INFO:tasks.workunit.client.0.smithi072.stdout:3/896: mkdir d1/d3f/d4f/d73/db3/dc4/d113 0 2024-04-15T21:03:02.100 INFO:tasks.workunit.client.0.smithi072.stdout:4/910: write d7/d10/d41/d45/d93/de0/dfc/fa5 [2033241,56498] 0 2024-04-15T21:03:02.100 INFO:tasks.workunit.client.0.smithi072.stdout:9/977: getdents d4/d1f/d31/d4d 0 2024-04-15T21:03:02.101 INFO:tasks.workunit.client.0.smithi072.stdout:2/979: write d2/d38/d73/d80/f92 [1084191,81159] 0 2024-04-15T21:03:02.102 INFO:tasks.workunit.client.0.smithi072.stdout:8/960: rename d3/d4/d10b/l120 to d3/de/d1b/d85/d101/l12f 0 2024-04-15T21:03:02.103 INFO:tasks.workunit.client.0.smithi072.stdout:9/978: stat d4/d29/d4c/d74/d84/df2/df4/d128 0 2024-04-15T21:03:02.105 INFO:tasks.workunit.client.0.smithi072.stdout:3/897: mknod d1/d15/d32/d78/ded/c114 0 2024-04-15T21:03:02.108 INFO:tasks.workunit.client.0.smithi072.stdout:2/980: creat d2/d37/d126/dde/f13f x:0 0 0 2024-04-15T21:03:02.110 INFO:tasks.workunit.client.0.smithi072.stdout:4/911: symlink d7/d15/ddd/df7/d76/d8b/l123 0 2024-04-15T21:03:02.112 INFO:tasks.workunit.client.0.smithi072.stdout:9/979: truncate d4/d1f/d31/d4d/f7b 843877 0 2024-04-15T21:03:02.115 INFO:tasks.workunit.client.0.smithi072.stdout:4/912: creat d7/d24/d3e/f124 x:0 0 0 2024-04-15T21:03:02.117 INFO:tasks.workunit.client.0.smithi072.stdout:5/925: dwrite d0/d3/d7/f3c [0,4194304] 0 2024-04-15T21:03:02.120 INFO:tasks.workunit.client.0.smithi072.stdout:6/880: write d2/d10/d11/d15/fd8 [492189,70002] 0 2024-04-15T21:03:02.120 INFO:tasks.workunit.client.0.smithi072.stdout:2/981: symlink d2/d66/df2/d139/l140 0 2024-04-15T21:03:02.121 INFO:tasks.workunit.client.0.smithi072.stdout:8/961: dread d3/de/f25 [0,4194304] 0 2024-04-15T21:03:02.122 INFO:tasks.workunit.client.0.smithi072.stdout:2/982: write d2/d66/f68 [4512791,116309] 0 2024-04-15T21:03:02.124 INFO:tasks.workunit.client.0.smithi072.stdout:9/980: dwrite d4/d76/f11d [0,4194304] 0 2024-04-15T21:03:02.127 INFO:tasks.workunit.client.0.smithi072.stdout:4/913: chown d7/d15/ddd/df7/d76/d8b/dad/de1/f115 263799 1 2024-04-15T21:03:02.128 INFO:tasks.workunit.client.0.smithi072.stdout:5/926: mknod d0/d3/d7/d94/de1/c139 0 2024-04-15T21:03:02.129 INFO:tasks.workunit.client.0.smithi072.stdout:5/927: readlink d0/d3/d33/le9 0 2024-04-15T21:03:02.131 INFO:tasks.workunit.client.0.smithi072.stdout:1/907: dwrite d5/db/d2d/d85/dbf/d101/f22 [0,4194304] 0 2024-04-15T21:03:02.133 INFO:tasks.workunit.client.0.smithi072.stdout:7/898: link d2/d7/d25/d2d/d52/d6d/l80 d2/d7/d25/d2d/d46/d5a/d5f/d43/l127 0 2024-04-15T21:03:02.138 INFO:tasks.workunit.client.0.smithi072.stdout:1/908: dwrite d5/db/d27/d9c/fb4 [0,4194304] 0 2024-04-15T21:03:02.151 INFO:tasks.workunit.client.0.smithi072.stdout:9/981: mkdir d4/d1f/d2c/de9/d13b 0 2024-04-15T21:03:02.151 INFO:tasks.workunit.client.0.smithi072.stdout:4/914: rmdir d7/d28/d6d 39 2024-04-15T21:03:02.151 INFO:tasks.workunit.client.0.smithi072.stdout:4/915: readlink d7/d71/lbd 0 2024-04-15T21:03:02.154 INFO:tasks.workunit.client.0.smithi072.stdout:1/909: mknod d5/db/d2d/d85/dbf/d101/d1f/d63/d100/c126 0 2024-04-15T21:03:02.155 INFO:tasks.workunit.client.0.smithi072.stdout:2/983: mknod d2/d64/c141 0 2024-04-15T21:03:02.155 INFO:tasks.workunit.client.0.smithi072.stdout:1/910: write d5/db/d2d/d85/dbf/d101/ffc [115558,82695] 0 2024-04-15T21:03:02.156 INFO:tasks.workunit.client.0.smithi072.stdout:1/911: chown d5/db/d2d/d56/df0 854382 1 2024-04-15T21:03:02.157 INFO:tasks.workunit.client.0.smithi072.stdout:8/962: rename d3/de/d1b/d44/d102/d10a to d3/de/d1b/d41/dae/dc0/d130 0 2024-04-15T21:03:02.158 INFO:tasks.workunit.client.0.smithi072.stdout:9/982: chown d4/d29/d4c/d74/d10e/d116/f117 0 1 2024-04-15T21:03:02.159 INFO:tasks.workunit.client.0.smithi072.stdout:5/928: symlink d0/d3/d6/l13a 0 2024-04-15T21:03:02.161 INFO:tasks.workunit.client.0.smithi072.stdout:8/963: dread d3/de/d1b/d41/da4/fc3 [0,4194304] 0 2024-04-15T21:03:02.162 INFO:tasks.workunit.client.0.smithi072.stdout:7/899: rename d2/d7/d25/d81/dce to d2/d7/d25/d2d/d52/d6d/d128 0 2024-04-15T21:03:02.164 INFO:tasks.workunit.client.0.smithi072.stdout:8/964: read d3/d7e/fc1 [3417205,70144] 0 2024-04-15T21:03:02.164 INFO:tasks.workunit.client.0.smithi072.stdout:6/881: getdents d2/d40/d66/d7f 0 2024-04-15T21:03:02.166 INFO:tasks.workunit.client.0.smithi072.stdout:9/983: mkdir d4/d29/d4c/d74/d84/df2/d13c 0 2024-04-15T21:03:02.167 INFO:tasks.workunit.client.0.smithi072.stdout:5/929: symlink d0/d3/d6/d2d/d79/l13b 0 2024-04-15T21:03:02.169 INFO:tasks.workunit.client.0.smithi072.stdout:5/930: fsync d0/d3/d33/d60/d81/fed 0 2024-04-15T21:03:02.170 INFO:tasks.workunit.client.0.smithi072.stdout:5/931: chown d0/d3/d33/d60/d81/daf/d127 296 1 2024-04-15T21:03:02.170 INFO:tasks.workunit.client.0.smithi072.stdout:1/912: dread d5/f70 [0,4194304] 0 2024-04-15T21:03:02.172 INFO:tasks.workunit.client.0.smithi072.stdout:7/900: creat d2/d7/d11d/f129 x:0 0 0 2024-04-15T21:03:02.173 INFO:tasks.workunit.client.0.smithi072.stdout:2/984: dread d2/d8/f13 [0,4194304] 0 2024-04-15T21:03:02.173 INFO:tasks.workunit.client.0.smithi072.stdout:4/916: creat d7/d71/f125 x:0 0 0 2024-04-15T21:03:02.175 INFO:tasks.workunit.client.0.smithi072.stdout:1/913: dread d5/db/d2d/d56/df0/d82/fae [0,4194304] 0 2024-04-15T21:03:02.177 INFO:tasks.workunit.client.0.smithi072.stdout:8/965: mknod d3/de/d1b/d41/dae/dc0/d121/c131 0 2024-04-15T21:03:02.182 INFO:tasks.workunit.client.0.smithi072.stdout:2/985: dread d2/d3/f46 [0,4194304] 0 2024-04-15T21:03:02.188 INFO:tasks.workunit.client.0.smithi072.stdout:8/966: dread d3/d4/d4c/ff7 [0,4194304] 0 2024-04-15T21:03:02.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/901: mknod d2/d7/d25/d81/d120/c12a 0 2024-04-15T21:03:02.188 INFO:tasks.workunit.client.0.smithi072.stdout:7/902: dread d2/d7/f9a [0,4194304] 0 2024-04-15T21:03:02.189 INFO:tasks.workunit.client.0.smithi072.stdout:7/903: readlink d2/d7/d25/d72/l99 0 2024-04-15T21:03:02.190 INFO:tasks.workunit.client.0.smithi072.stdout:4/917: rmdir d7/d71/db2 39 2024-04-15T21:03:02.195 INFO:tasks.workunit.client.0.smithi072.stdout:8/967: creat d3/de/d1b/d3f/f132 x:0 0 0 2024-04-15T21:03:02.196 INFO:tasks.workunit.client.0.smithi072.stdout:8/968: chown d3/de/d1b/d41/da4/d2e/f5c 177466 1 2024-04-15T21:03:02.198 INFO:tasks.workunit.client.0.smithi072.stdout:8/969: write d3/d4/f91 [535524,11940] 0 2024-04-15T21:03:02.199 INFO:tasks.workunit.client.0.smithi072.stdout:8/970: readlink d3/d4/d3b/lbe 0 2024-04-15T21:03:02.199 INFO:tasks.workunit.client.0.smithi072.stdout:9/984: dwrite d4/d1f/d31/d4d/f120 [0,4194304] 0 2024-04-15T21:03:02.201 INFO:tasks.workunit.client.0.smithi072.stdout:6/882: creat d2/d10/d11/f109 x:0 0 0 2024-04-15T21:03:02.205 INFO:tasks.workunit.client.0.smithi072.stdout:4/918: write d7/d15/ddd/df7/d76/f96 [1589572,34566] 0 2024-04-15T21:03:02.206 INFO:tasks.workunit.client.0.smithi072.stdout:8/971: rmdir d3/de/d1b/d41/d74/d98/da5 39 2024-04-15T21:03:02.211 INFO:tasks.workunit.client.0.smithi072.stdout:6/883: read d2/d10/f1d [2792061,115502] 0 2024-04-15T21:03:02.211 INFO:tasks.workunit.client.0.smithi072.stdout:5/932: dwrite d0/d3/d7/d12/fec [0,4194304] 0 2024-04-15T21:03:02.212 INFO:tasks.workunit.client.0.smithi072.stdout:1/914: dread d5/db/d2d/d85/dbf/d101/f39 [0,4194304] 0 2024-04-15T21:03:02.213 INFO:tasks.workunit.client.0.smithi072.stdout:8/972: creat d3/d4/d76/f133 x:0 0 0 2024-04-15T21:03:02.213 INFO:tasks.workunit.client.0.smithi072.stdout:7/904: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d43/f53 [0,4194304] 0 2024-04-15T21:03:02.215 INFO:tasks.workunit.client.0.smithi072.stdout:4/919: mkdir d7/d10/d41/dc4/de8/d126 0 2024-04-15T21:03:02.216 INFO:tasks.workunit.client.0.smithi072.stdout:4/920: dread - d7/ff3 zero size 2024-04-15T21:03:02.217 INFO:tasks.workunit.client.0.smithi072.stdout:9/985: dread d4/d29/d4c/f82 [0,4194304] 0 2024-04-15T21:03:02.218 INFO:tasks.workunit.client.0.smithi072.stdout:4/921: chown d7/d15/d58/f7b 29037 1 2024-04-15T21:03:02.219 INFO:tasks.workunit.client.0.smithi072.stdout:9/986: chown d4/d1f/d2c/d62/cbc 183 1 2024-04-15T21:03:02.220 INFO:tasks.workunit.client.0.smithi072.stdout:4/922: write d7/d24/f1e [2910740,37045] 0 2024-04-15T21:03:02.222 INFO:tasks.workunit.client.0.smithi072.stdout:1/915: unlink d5/d31/ld8 0 2024-04-15T21:03:02.223 INFO:tasks.workunit.client.0.smithi072.stdout:5/933: dwrite d0/d3/d7/d1f/d4c/fbf [4194304,4194304] 0 2024-04-15T21:03:02.223 INFO:tasks.workunit.client.0.smithi072.stdout:4/923: readlink d7/d15/d58/l9b 0 2024-04-15T21:03:02.227 INFO:tasks.workunit.client.0.smithi072.stdout:8/973: mknod d3/de/d1b/d41/dae/dc0/d130/c134 0 2024-04-15T21:03:02.228 INFO:tasks.workunit.client.0.smithi072.stdout:6/884: unlink d2/da1/fef 0 2024-04-15T21:03:02.229 INFO:tasks.workunit.client.0.smithi072.stdout:6/885: chown d2/d42/l104 11371829 1 2024-04-15T21:03:02.230 INFO:tasks.workunit.client.0.smithi072.stdout:6/886: chown d2/d10/d11/f109 6 1 2024-04-15T21:03:02.232 INFO:tasks.workunit.client.0.smithi072.stdout:5/934: dread d0/d3/d7/d12/d1d/f74 [0,4194304] 0 2024-04-15T21:03:02.240 INFO:tasks.workunit.client.0.smithi072.stdout:8/974: write d3/de/d1b/d41/d74/d98/da5/ff1 [4595254,87195] 0 2024-04-15T21:03:02.240 INFO:tasks.workunit.client.0.smithi072.stdout:6/887: creat d2/d40/d66/d7f/dd9/f10a x:0 0 0 2024-04-15T21:03:02.241 INFO:tasks.workunit.client.0.smithi072.stdout:5/935: mknod d0/d3/d7/d94/d5f/c13c 0 2024-04-15T21:03:02.243 INFO:tasks.workunit.client.0.smithi072.stdout:4/924: mkdir d7/d71/d127 0 2024-04-15T21:03:02.244 INFO:tasks.workunit.client.0.smithi072.stdout:6/888: creat d2/d10/d11/d1f/d60/d63/f10b x:0 0 0 2024-04-15T21:03:02.245 INFO:tasks.workunit.client.0.smithi072.stdout:6/889: write d2/d40/d56/d6a/fd0 [3071033,79788] 0 2024-04-15T21:03:02.246 INFO:tasks.workunit.client.0.smithi072.stdout:5/936: write d0/d3/d7/d12/d31/d62/db6/fd2 [5204573,104892] 0 2024-04-15T21:03:02.252 INFO:tasks.workunit.client.0.smithi072.stdout:8/975: rename d3/d4/d4c/de5 to d3/d4/d76/d8f/d135 0 2024-04-15T21:03:02.256 INFO:tasks.workunit.client.0.smithi072.stdout:4/925: getdents d7/d10/d41/dc4/de8 0 2024-04-15T21:03:02.259 INFO:tasks.workunit.client.0.smithi072.stdout:4/926: creat d7/d28/db1/f128 x:0 0 0 2024-04-15T21:03:02.261 INFO:tasks.workunit.client.0.smithi072.stdout:1/916: write d5/d31/dbc/fe1 [737859,69995] 0 2024-04-15T21:03:02.264 INFO:tasks.workunit.client.0.smithi072.stdout:9/987: dread d4/d76/fa9 [4194304,4194304] 0 2024-04-15T21:03:02.264 INFO:tasks.workunit.client.0.smithi072.stdout:9/988: chown d4/d76/c124 560180 1 2024-04-15T21:03:02.265 INFO:tasks.workunit.client.0.smithi072.stdout:1/917: symlink d5/db/l127 0 2024-04-15T21:03:02.266 INFO:tasks.workunit.client.0.smithi072.stdout:6/890: write d2/d42/fae [691080,22159] 0 2024-04-15T21:03:02.266 INFO:tasks.workunit.client.0.smithi072.stdout:9/989: mknod d4/d29/d45/ddc/ddd/c13d 0 2024-04-15T21:03:02.267 INFO:tasks.workunit.client.0.smithi072.stdout:1/918: write d5/db/d27/d5c/f84 [2416346,107502] 0 2024-04-15T21:03:02.267 INFO:tasks.workunit.client.0.smithi072.stdout:6/891: fdatasync d2/d40/d56/d95/fdf 0 2024-04-15T21:03:02.269 INFO:tasks.workunit.client.0.smithi072.stdout:1/919: chown d5/cff 58 1 2024-04-15T21:03:02.269 INFO:tasks.workunit.client.0.smithi072.stdout:5/937: write d0/d3/d7/d1f/f29 [1107268,36920] 0 2024-04-15T21:03:02.269 INFO:tasks.workunit.client.0.smithi072.stdout:8/976: write d3/de/d81/f86 [2135778,94382] 0 2024-04-15T21:03:02.270 INFO:tasks.workunit.client.0.smithi072.stdout:9/990: readlink d4/d29/d45/ddb/le0 0 2024-04-15T21:03:02.275 INFO:tasks.workunit.client.0.smithi072.stdout:5/938: truncate d0/d3/d33/d60/fe0 1578919 0 2024-04-15T21:03:02.275 INFO:tasks.workunit.client.0.smithi072.stdout:9/991: symlink d4/d1f/d31/d4d/d12b/l13e 0 2024-04-15T21:03:02.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/920: dwrite d5/db/d27/d9c/fb4 [0,4194304] 0 2024-04-15T21:03:02.280 INFO:tasks.workunit.client.0.smithi072.stdout:5/939: truncate d0/d3/d6/d2d/f96 1216916 0 2024-04-15T21:03:02.281 INFO:tasks.workunit.client.0.smithi072.stdout:8/977: dwrite d3/de/d1b/d3f/f67 [0,4194304] 0 2024-04-15T21:03:02.281 INFO:tasks.workunit.client.0.smithi072.stdout:5/940: chown d0/fa 29 1 2024-04-15T21:03:02.283 INFO:tasks.workunit.client.0.smithi072.stdout:5/941: write d0/d3/d7/d12/d31/d62/db6/fd2 [5853194,48604] 0 2024-04-15T21:03:02.285 INFO:tasks.workunit.client.0.smithi072.stdout:9/992: link d4/d1f/d31/d9b/dca/f103 d4/d1f/d31/d4d/dbf/f13f 0 2024-04-15T21:03:02.285 INFO:tasks.workunit.client.0.smithi072.stdout:6/892: dread d2/d10/d11/d15/f20 [8388608,4194304] 0 2024-04-15T21:03:02.289 INFO:tasks.workunit.client.0.smithi072.stdout:5/942: mknod d0/d3/d33/d60/c13d 0 2024-04-15T21:03:02.291 INFO:tasks.workunit.client.0.smithi072.stdout:1/921: dread d5/db/d2d/f8b [0,4194304] 0 2024-04-15T21:03:02.291 INFO:tasks.workunit.client.0.smithi072.stdout:5/943: write d0/d3/d7/d12/d31/d62/f118 [937812,107796] 0 2024-04-15T21:03:02.293 INFO:tasks.workunit.client.0.smithi072.stdout:9/993: dwrite d4/d29/d4c/d91/fe3 [0,4194304] 0 2024-04-15T21:03:02.297 INFO:tasks.workunit.client.0.smithi072.stdout:6/893: symlink d2/d40/d6e/l10c 0 2024-04-15T21:03:02.299 INFO:tasks.workunit.client.0.smithi072.stdout:1/922: dwrite d5/db/d2d/d85/dbf/d101/f22 [0,4194304] 0 2024-04-15T21:03:02.300 INFO:tasks.workunit.client.0.smithi072.stdout:1/923: write d5/f32 [3447149,74899] 0 2024-04-15T21:03:02.302 INFO:tasks.workunit.client.0.smithi072.stdout:9/994: mknod d4/d29/c140 0 2024-04-15T21:03:02.308 INFO:tasks.workunit.client.0.smithi072.stdout:9/995: symlink d4/d76/l141 0 2024-04-15T21:03:02.314 INFO:tasks.workunit.client.0.smithi072.stdout:9/996: creat d4/d29/d4c/d74/d10e/d116/f142 x:0 0 0 2024-04-15T21:03:02.319 INFO:tasks.workunit.client.0.smithi072.stdout:9/997: mkdir d4/d143 0 2024-04-15T21:03:02.320 INFO:tasks.workunit.client.0.smithi072.stdout:9/998: write d4/d1f/d9e/db3/f11f [618666,35699] 0 2024-04-15T21:03:02.394 INFO:tasks.workunit.client.0.smithi072.stdout:3/898: sync 2024-04-15T21:03:02.394 INFO:tasks.workunit.client.0.smithi072.stdout:2/986: sync 2024-04-15T21:03:02.394 INFO:tasks.workunit.client.0.smithi072.stdout:0/942: sync 2024-04-15T21:03:02.395 INFO:tasks.workunit.client.0.smithi072.stdout:2/987: truncate d2/d37/d126/f103 1266002 0 2024-04-15T21:03:02.399 INFO:tasks.workunit.client.0.smithi072.stdout:2/988: dwrite d2/d3/f5e [0,4194304] 0 2024-04-15T21:03:02.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:01 smithi072 ceph-mon[29079]: pgmap v15: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 72 MiB/s rd, 184 MiB/s wr, 386 op/s 2024-04-15T21:03:02.436 INFO:tasks.workunit.client.0.smithi072.stdout:7/905: sync 2024-04-15T21:03:02.436 INFO:tasks.workunit.client.0.smithi072.stdout:4/927: sync 2024-04-15T21:03:02.436 INFO:tasks.workunit.client.0.smithi072.stdout:1/924: sync 2024-04-15T21:03:02.438 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:01 smithi149 ceph-mon[36029]: pgmap v15: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 72 MiB/s rd, 184 MiB/s wr, 386 op/s 2024-04-15T21:03:02.462 INFO:tasks.workunit.client.0.smithi072.stdout:3/899: unlink d1/d15/d32/d2f/d1a/cb1 0 2024-04-15T21:03:02.464 INFO:tasks.workunit.client.0.smithi072.stdout:8/978: write d3/de/d1b/d41/fa9 [539700,81702] 0 2024-04-15T21:03:02.467 INFO:tasks.workunit.client.0.smithi072.stdout:0/943: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/d11c/d143 0 2024-04-15T21:03:02.468 INFO:tasks.workunit.client.0.smithi072.stdout:2/989: symlink d2/d66/d96/l142 0 2024-04-15T21:03:02.468 INFO:tasks.workunit.client.0.smithi072.stdout:0/944: write d0/d19/d2b/d63/fe2 [1844601,66447] 0 2024-04-15T21:03:02.469 INFO:tasks.workunit.client.0.smithi072.stdout:0/945: chown d0/d45/d7a/d70/dce 1 1 2024-04-15T21:03:02.470 INFO:tasks.workunit.client.0.smithi072.stdout:5/944: write d0/f80 [2514903,49264] 0 2024-04-15T21:03:02.470 INFO:tasks.workunit.client.0.smithi072.stdout:5/945: chown d0/d3/d33 0 1 2024-04-15T21:03:02.474 INFO:tasks.workunit.client.0.smithi072.stdout:4/928: creat d7/d15/f129 x:0 0 0 2024-04-15T21:03:02.476 INFO:tasks.workunit.client.0.smithi072.stdout:1/925: mkdir d5/db/d2d/d85/dbf/d101/dc3/dd3/d128 0 2024-04-15T21:03:02.478 INFO:tasks.workunit.client.0.smithi072.stdout:6/894: dwrite d2/f2a [8388608,4194304] 0 2024-04-15T21:03:02.478 INFO:tasks.workunit.client.0.smithi072.stdout:7/906: dread d2/fa [0,4194304] 0 2024-04-15T21:03:02.482 INFO:tasks.workunit.client.0.smithi072.stdout:9/999: dwrite d4/d1f/d31/d9b/dca/f103 [0,4194304] 0 2024-04-15T21:03:02.491 INFO:tasks.workunit.client.0.smithi072.stdout:5/946: symlink d0/d3/d33/d60/d81/daf/d127/l13e 0 2024-04-15T21:03:02.492 INFO:tasks.workunit.client.0.smithi072.stdout:5/947: truncate d0/d3/d7/d94/d5f/f12c 316059 0 2024-04-15T21:03:02.496 INFO:tasks.workunit.client.0.smithi072.stdout:1/926: fsync d5/db/d2d/d56/df0/f9b 0 2024-04-15T21:03:02.498 INFO:tasks.workunit.client.0.smithi072.stdout:6/895: dread d2/d10/fe5 [0,4194304] 0 2024-04-15T21:03:02.498 INFO:tasks.workunit.client.0.smithi072.stdout:3/900: mknod d1/d15/d40/dff/c115 0 2024-04-15T21:03:02.499 INFO:tasks.workunit.client.0.smithi072.stdout:3/901: readlink d1/d3f/d4f/d73/db3/dd5/le0 0 2024-04-15T21:03:02.500 INFO:tasks.workunit.client.0.smithi072.stdout:6/896: read d2/d40/d66/d7f/dd9/f55 [1023650,45712] 0 2024-04-15T21:03:02.508 INFO:tasks.workunit.client.0.smithi072.stdout:0/946: symlink d0/d45/d7a/d70/d59/d8a/d8b/db8/d139/l144 0 2024-04-15T21:03:02.517 INFO:tasks.workunit.client.0.smithi072.stdout:6/897: mkdir d2/d42/db9/d10d 0 2024-04-15T21:03:02.524 INFO:tasks.workunit.client.0.smithi072.stdout:3/902: getdents d1/d3f/d4f/d73/db3/dc4/d113 0 2024-04-15T21:03:02.524 INFO:tasks.workunit.client.0.smithi072.stdout:0/947: dwrite d0/d6/d48/f12a [0,4194304] 0 2024-04-15T21:03:02.525 INFO:tasks.workunit.client.0.smithi072.stdout:3/903: stat d1/d15/d32/fa4 0 2024-04-15T21:03:02.525 INFO:tasks.workunit.client.0.smithi072.stdout:0/948: read - d0/d19/d71/d9e/f104 zero size 2024-04-15T21:03:02.531 INFO:tasks.workunit.client.0.smithi072.stdout:0/949: creat d0/d45/d7a/d70/d59/d8a/d108/f145 x:0 0 0 2024-04-15T21:03:02.539 INFO:tasks.workunit.client.0.smithi072.stdout:4/929: sync 2024-04-15T21:03:02.539 INFO:tasks.workunit.client.0.smithi072.stdout:4/930: chown d7/d15/d58/f7b 0 1 2024-04-15T21:03:02.539 INFO:tasks.workunit.client.0.smithi072.stdout:0/950: dread d0/d19/d2b/d63/fe2 [0,4194304] 0 2024-04-15T21:03:02.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/898: getdents d2/d10/d11 0 2024-04-15T21:03:02.541 INFO:tasks.workunit.client.0.smithi072.stdout:0/951: write d0/d6/d6d/dcc/f10a [3464674,14469] 0 2024-04-15T21:03:02.544 INFO:tasks.workunit.client.0.smithi072.stdout:4/931: creat d7/d10/d41/dc4/de8/d103/f12a x:0 0 0 2024-04-15T21:03:02.545 INFO:tasks.workunit.client.0.smithi072.stdout:4/932: chown d7/d15/ddd/df7 1 1 2024-04-15T21:03:02.548 INFO:tasks.workunit.client.0.smithi072.stdout:6/899: truncate d2/d40/dcb/d49/f91 458120 0 2024-04-15T21:03:02.554 INFO:tasks.workunit.client.0.smithi072.stdout:6/900: creat d2/d40/dc3/f10e x:0 0 0 2024-04-15T21:03:02.555 INFO:tasks.workunit.client.0.smithi072.stdout:6/901: read d2/d40/dcb/f44 [3860042,5539] 0 2024-04-15T21:03:02.558 INFO:tasks.workunit.client.0.smithi072.stdout:6/902: readlink d2/d40/l80 0 2024-04-15T21:03:02.558 INFO:tasks.workunit.client.0.smithi072.stdout:6/903: read d2/d10/d18/d47/d6d/f87 [902642,24512] 0 2024-04-15T21:03:02.579 INFO:tasks.workunit.client.0.smithi072.stdout:6/904: dread d2/d40/d6e/f36 [0,4194304] 0 2024-04-15T21:03:02.581 INFO:tasks.workunit.client.0.smithi072.stdout:6/905: creat d2/d42/dad/f10f x:0 0 0 2024-04-15T21:03:02.584 INFO:tasks.workunit.client.0.smithi072.stdout:6/906: creat d2/d40/d56/d6a/f110 x:0 0 0 2024-04-15T21:03:02.589 INFO:tasks.workunit.client.0.smithi072.stdout:6/907: dwrite d2/d40/dcb/f44 [0,4194304] 0 2024-04-15T21:03:02.589 INFO:tasks.workunit.client.0.smithi072.stdout:6/908: stat d2/d40/dcb 0 2024-04-15T21:03:02.594 INFO:tasks.workunit.client.0.smithi072.stdout:6/909: mknod d2/d40/d66/d7f/c111 0 2024-04-15T21:03:02.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/910: mkdir d2/d40/d6e/d112 0 2024-04-15T21:03:02.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/911: stat d2/d42/dad/f103 0 2024-04-15T21:03:02.600 INFO:tasks.workunit.client.0.smithi072.stdout:8/979: rmdir d3/de/d1b/d41/dae/dc0/d130 39 2024-04-15T21:03:02.606 INFO:tasks.workunit.client.0.smithi072.stdout:8/980: dwrite d3/de/d1b/d41/da4/fc3 [0,4194304] 0 2024-04-15T21:03:02.615 INFO:tasks.workunit.client.0.smithi072.stdout:6/912: dread d2/d40/d66/d7f/dd9/f75 [0,4194304] 0 2024-04-15T21:03:02.617 INFO:tasks.workunit.client.0.smithi072.stdout:6/913: stat d2/d10/c12 0 2024-04-15T21:03:02.620 INFO:tasks.workunit.client.0.smithi072.stdout:6/914: mkdir d2/d42/db9/dc9/d113 0 2024-04-15T21:03:02.622 INFO:tasks.workunit.client.0.smithi072.stdout:6/915: truncate d2/d10/d18/fa5 2492795 0 2024-04-15T21:03:02.623 INFO:tasks.workunit.client.0.smithi072.stdout:6/916: fsync d2/d42/f97 0 2024-04-15T21:03:02.626 INFO:tasks.workunit.client.0.smithi072.stdout:6/917: fdatasync d2/da1/faa 0 2024-04-15T21:03:02.631 INFO:tasks.workunit.client.0.smithi072.stdout:6/918: dwrite d2/d10/d11/d1f/d60/d63/f10b [0,4194304] 0 2024-04-15T21:03:02.647 INFO:tasks.workunit.client.0.smithi072.stdout:2/990: rmdir d2/d64/d10f 39 2024-04-15T21:03:02.677 INFO:tasks.workunit.client.0.smithi072.stdout:5/948: write d0/d3/d7/d94/d92/fbb [83521,73085] 0 2024-04-15T21:03:02.678 INFO:tasks.workunit.client.0.smithi072.stdout:7/907: dwrite d2/d7/d25/d72/f92 [0,4194304] 0 2024-04-15T21:03:02.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/949: chown d0/d3/d7/f8a 383831 1 2024-04-15T21:03:02.679 INFO:tasks.workunit.client.0.smithi072.stdout:5/950: chown d0/d3/d7/d12/d31/d62/db6/cf4 797 1 2024-04-15T21:03:02.689 INFO:tasks.workunit.client.0.smithi072.stdout:3/904: write d1/f14 [1678680,79699] 0 2024-04-15T21:03:02.692 INFO:tasks.workunit.client.0.smithi072.stdout:3/905: creat d1/d3f/f116 x:0 0 0 2024-04-15T21:03:02.692 INFO:tasks.workunit.client.0.smithi072.stdout:3/906: chown d1/d5b/f75 3872 1 2024-04-15T21:03:02.694 INFO:tasks.workunit.client.0.smithi072.stdout:3/907: symlink d1/d3f/d7f/l117 0 2024-04-15T21:03:02.696 INFO:tasks.workunit.client.0.smithi072.stdout:3/908: mkdir d1/d15/d32/d78/d118 0 2024-04-15T21:03:02.699 INFO:tasks.workunit.client.0.smithi072.stdout:3/909: truncate d1/d5b/fbc 650295 0 2024-04-15T21:03:02.701 INFO:tasks.workunit.client.0.smithi072.stdout:0/952: truncate d0/d6/feb 1928459 0 2024-04-15T21:03:02.701 INFO:tasks.workunit.client.0.smithi072.stdout:3/910: dread - d1/d3f/d4f/d73/fde zero size 2024-04-15T21:03:02.703 INFO:tasks.workunit.client.0.smithi072.stdout:0/953: mkdir d0/d13a/d146 0 2024-04-15T21:03:02.704 INFO:tasks.workunit.client.0.smithi072.stdout:4/933: dwrite d7/d15/ddd/df7/d76/fd5 [0,4194304] 0 2024-04-15T21:03:02.706 INFO:tasks.workunit.client.0.smithi072.stdout:3/911: creat d1/d15/d32/d78/ded/f119 x:0 0 0 2024-04-15T21:03:02.709 INFO:tasks.workunit.client.0.smithi072.stdout:0/954: fsync d0/d97/fdc 0 2024-04-15T21:03:02.711 INFO:tasks.workunit.client.0.smithi072.stdout:0/955: mkdir d0/d45/d7a/d70/d59/d8a/d108/d147 0 2024-04-15T21:03:02.717 INFO:tasks.workunit.client.0.smithi072.stdout:3/912: link d1/d3f/laf d1/d3f/d4f/d73/db3/dd5/dea/l11a 0 2024-04-15T21:03:02.718 INFO:tasks.workunit.client.0.smithi072.stdout:0/956: truncate d0/d19/d2b/fba 326960 0 2024-04-15T21:03:02.721 INFO:tasks.workunit.client.0.smithi072.stdout:0/957: creat d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dfc/f148 x:0 0 0 2024-04-15T21:03:02.727 INFO:tasks.workunit.client.0.smithi072.stdout:0/958: dread d0/d45/d35/d3a/f99 [0,4194304] 0 2024-04-15T21:03:02.727 INFO:tasks.workunit.client.0.smithi072.stdout:6/919: fsync d2/d40/d56/d6a/f110 0 2024-04-15T21:03:02.742 INFO:tasks.workunit.client.0.smithi072.stdout:6/920: dread d2/d40/f86 [0,4194304] 0 2024-04-15T21:03:02.743 INFO:tasks.workunit.client.0.smithi072.stdout:1/927: mknod d5/db/d2d/d56/df0/c129 0 2024-04-15T21:03:02.743 INFO:tasks.workunit.client.0.smithi072.stdout:1/928: write d5/dcb/f125 [820957,3055] 0 2024-04-15T21:03:02.746 INFO:tasks.workunit.client.0.smithi072.stdout:1/929: fsync d5/db/d2d/d56/df0/f6f 0 2024-04-15T21:03:02.748 INFO:tasks.workunit.client.0.smithi072.stdout:1/930: creat d5/d31/dbc/f12a x:0 0 0 2024-04-15T21:03:02.749 INFO:tasks.workunit.client.0.smithi072.stdout:8/981: rename d3/de/d1b/d41/c9e to d3/c136 0 2024-04-15T21:03:02.750 INFO:tasks.workunit.client.0.smithi072.stdout:1/931: mkdir d5/db/d2d/d85/dbf/d101/dc3/dd3/d128/d12b 0 2024-04-15T21:03:02.751 INFO:tasks.workunit.client.0.smithi072.stdout:1/932: fdatasync d5/db/d2d/d56/df0/f112 0 2024-04-15T21:03:02.752 INFO:tasks.workunit.client.0.smithi072.stdout:7/908: sync 2024-04-15T21:03:02.752 INFO:tasks.workunit.client.0.smithi072.stdout:2/991: rename d2/d66/f68 to d2/d64/dbd/d110/d13a/f143 0 2024-04-15T21:03:02.753 INFO:tasks.workunit.client.0.smithi072.stdout:2/992: dread - d2/d64/dbd/d110/f11a zero size 2024-04-15T21:03:02.758 INFO:tasks.workunit.client.0.smithi072.stdout:1/933: truncate d5/db/d2d/d85/dbf/d101/d1f/f9a 3833738 0 2024-04-15T21:03:02.758 INFO:tasks.workunit.client.0.smithi072.stdout:5/951: rename d0/d3/d7/d12/d31/d49/c5a to d0/d3/d7/d12/d1d/c13f 0 2024-04-15T21:03:02.759 INFO:tasks.workunit.client.0.smithi072.stdout:2/993: creat d2/d8/d8e/d90/d13e/f144 x:0 0 0 2024-04-15T21:03:02.760 INFO:tasks.workunit.client.0.smithi072.stdout:2/994: dread - d2/d37/d126/dde/f13f zero size 2024-04-15T21:03:02.761 INFO:tasks.workunit.client.0.smithi072.stdout:2/995: chown d2/d8/d8e 7228 1 2024-04-15T21:03:02.761 INFO:tasks.workunit.client.0.smithi072.stdout:3/913: rename d1/d5b/dbf to d1/d3f/d4f/d73/d11b 0 2024-04-15T21:03:02.764 INFO:tasks.workunit.client.0.smithi072.stdout:5/952: dread d0/f35 [0,4194304] 0 2024-04-15T21:03:02.764 INFO:tasks.workunit.client.0.smithi072.stdout:1/934: mknod d5/db/daa/c12c 0 2024-04-15T21:03:02.768 INFO:tasks.workunit.client.0.smithi072.stdout:7/909: rename d2/d7/d25/d2d/d46/d5a/d5f/d1f/fab to d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/f12b 0 2024-04-15T21:03:02.769 INFO:tasks.workunit.client.0.smithi072.stdout:3/914: mkdir d1/d15/d32/d78/d11c 0 2024-04-15T21:03:02.770 INFO:tasks.workunit.client.0.smithi072.stdout:3/915: read d1/d3f/d4f/f68 [3617744,114612] 0 2024-04-15T21:03:02.771 INFO:tasks.workunit.client.0.smithi072.stdout:5/953: creat d0/d3/d6/d2d/f140 x:0 0 0 2024-04-15T21:03:02.772 INFO:tasks.workunit.client.0.smithi072.stdout:1/935: creat d5/db/d2d/d85/dbf/d101/dc3/dd3/dde/f12d x:0 0 0 2024-04-15T21:03:02.773 INFO:tasks.workunit.client.0.smithi072.stdout:1/936: write d5/db/d2d/d85/dbf/d101/d1f/d63/d100/f105 [994528,110761] 0 2024-04-15T21:03:02.780 INFO:tasks.workunit.client.0.smithi072.stdout:1/937: mkdir d5/d31/dbc/d12e 0 2024-04-15T21:03:02.782 INFO:tasks.workunit.client.0.smithi072.stdout:5/954: dread d0/d3/d7/ff0 [0,4194304] 0 2024-04-15T21:03:02.783 INFO:tasks.workunit.client.0.smithi072.stdout:0/959: write d0/d45/d7a/d70/d59/d8a/f65 [211685,20315] 0 2024-04-15T21:03:02.784 INFO:tasks.workunit.client.0.smithi072.stdout:1/938: mkdir d5/db/d2d/d85/dbf/d101/dc3/dd3/dde/d12f 0 2024-04-15T21:03:02.785 INFO:tasks.workunit.client.0.smithi072.stdout:0/960: write d0/d6/d55/f8f [1642429,127370] 0 2024-04-15T21:03:02.786 INFO:tasks.workunit.client.0.smithi072.stdout:0/961: chown d0/d19/d2b/fa3 89850203 1 2024-04-15T21:03:02.787 INFO:tasks.workunit.client.0.smithi072.stdout:1/939: read d5/db/d27/d5c/f11b [143525,20084] 0 2024-04-15T21:03:02.787 INFO:tasks.workunit.client.0.smithi072.stdout:4/934: rmdir d7/d15/ddd/df7/d76 39 2024-04-15T21:03:02.788 INFO:tasks.workunit.client.0.smithi072.stdout:5/955: dread d0/d3/d6/d14/fd0 [0,4194304] 0 2024-04-15T21:03:02.788 INFO:tasks.workunit.client.0.smithi072.stdout:4/935: fdatasync d7/d10/f11 0 2024-04-15T21:03:02.789 INFO:tasks.workunit.client.0.smithi072.stdout:3/916: dread d1/d15/d32/f24 [0,4194304] 0 2024-04-15T21:03:02.793 INFO:tasks.workunit.client.0.smithi072.stdout:6/921: write d2/d40/dcb/fc8 [475580,71926] 0 2024-04-15T21:03:02.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/962: rmdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dfc 39 2024-04-15T21:03:02.802 INFO:tasks.workunit.client.0.smithi072.stdout:5/956: creat d0/d3/d33/d60/d81/daf/d127/f141 x:0 0 0 2024-04-15T21:03:02.803 INFO:tasks.workunit.client.0.smithi072.stdout:3/917: creat d1/d3f/d4f/da3/f11d x:0 0 0 2024-04-15T21:03:02.804 INFO:tasks.workunit.client.0.smithi072.stdout:3/918: chown d1/d15/d40/f22 363526958 1 2024-04-15T21:03:02.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/936: write d7/d71/db2/fc5 [5327141,61906] 0 2024-04-15T21:03:02.808 INFO:tasks.workunit.client.0.smithi072.stdout:0/963: truncate d0/d6/f4c 1157739 0 2024-04-15T21:03:02.810 INFO:tasks.workunit.client.0.smithi072.stdout:0/964: read d0/d45/d7a/d70/f11a [163076,89727] 0 2024-04-15T21:03:02.812 INFO:tasks.workunit.client.0.smithi072.stdout:8/982: sync 2024-04-15T21:03:02.813 INFO:tasks.workunit.client.0.smithi072.stdout:8/983: write d3/d4/d4c/f105 [1096264,17701] 0 2024-04-15T21:03:02.813 INFO:tasks.workunit.client.0.smithi072.stdout:6/922: dread d2/d40/d56/d6a/f72 [0,4194304] 0 2024-04-15T21:03:02.818 INFO:tasks.workunit.client.0.smithi072.stdout:2/996: dwrite d2/d8/fbc [0,4194304] 0 2024-04-15T21:03:02.822 INFO:tasks.workunit.client.0.smithi072.stdout:7/910: write d2/d7/d25/d2d/d46/fc8 [432117,36778] 0 2024-04-15T21:03:02.839 INFO:tasks.workunit.client.0.smithi072.stdout:4/937: mkdir d7/d15/df0/d11e/d12b 0 2024-04-15T21:03:02.839 INFO:tasks.workunit.client.0.smithi072.stdout:2/997: dread d2/d37/f49 [0,4194304] 0 2024-04-15T21:03:02.840 INFO:tasks.workunit.client.0.smithi072.stdout:4/938: read d7/d10/d41/d45/fba [3334431,22478] 0 2024-04-15T21:03:02.841 INFO:tasks.workunit.client.0.smithi072.stdout:8/984: creat d3/dd9/f137 x:0 0 0 2024-04-15T21:03:02.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/939: readlink d7/d15/ddd/l11f 0 2024-04-15T21:03:02.843 INFO:tasks.workunit.client.0.smithi072.stdout:4/940: truncate d7/d10/d41/d45/fba 6711021 0 2024-04-15T21:03:02.843 INFO:tasks.workunit.client.0.smithi072.stdout:6/923: rename d2/d40/d66/da8/la9 to d2/d42/db9/l114 0 2024-04-15T21:03:02.844 INFO:tasks.workunit.client.0.smithi072.stdout:0/965: dread d0/d6/ff [0,4194304] 0 2024-04-15T21:03:02.845 INFO:tasks.workunit.client.0.smithi072.stdout:0/966: read - d0/d45/d7a/d70/d59/f119 zero size 2024-04-15T21:03:02.849 INFO:tasks.workunit.client.0.smithi072.stdout:1/940: getdents d5/db/d2d/d85/dbf/d101/d1f/d63/d100 0 2024-04-15T21:03:02.855 INFO:tasks.workunit.client.0.smithi072.stdout:5/957: dwrite d0/f35 [0,4194304] 0 2024-04-15T21:03:02.857 INFO:tasks.workunit.client.0.smithi072.stdout:3/919: rmdir d1/d15/d32/d78/d118 0 2024-04-15T21:03:02.859 INFO:tasks.workunit.client.0.smithi072.stdout:2/998: mkdir d2/d64/dbd/d145 0 2024-04-15T21:03:02.862 INFO:tasks.workunit.client.0.smithi072.stdout:8/985: dread d3/d4/d3b/f88 [0,4194304] 0 2024-04-15T21:03:02.863 INFO:tasks.workunit.client.0.smithi072.stdout:8/986: write d3/d4/d76/fb8 [947978,36843] 0 2024-04-15T21:03:02.864 INFO:tasks.workunit.client.0.smithi072.stdout:8/987: chown d3/dd9/f137 416423 1 2024-04-15T21:03:02.864 INFO:tasks.workunit.client.0.smithi072.stdout:4/941: dread d7/d10/d41/d45/f8a [0,4194304] 0 2024-04-15T21:03:02.865 INFO:tasks.workunit.client.0.smithi072.stdout:8/988: readlink d3/de/d1b/d41/da4/lb5 0 2024-04-15T21:03:02.868 INFO:tasks.workunit.client.0.smithi072.stdout:1/941: dread d5/db/d27/d5c/f64 [0,4194304] 0 2024-04-15T21:03:02.877 INFO:tasks.workunit.client.0.smithi072.stdout:7/911: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/d10b/c12c 0 2024-04-15T21:03:02.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/958: fdatasync d0/d3/d7/d94/fa1 0 2024-04-15T21:03:02.883 INFO:tasks.workunit.client.0.smithi072.stdout:5/959: dwrite d0/d3/d7/d1f/d4c/fbf [0,4194304] 0 2024-04-15T21:03:02.893 INFO:tasks.workunit.client.0.smithi072.stdout:0/967: symlink d0/d45/l149 0 2024-04-15T21:03:02.893 INFO:tasks.workunit.client.0.smithi072.stdout:0/968: chown d0/d19/d71/de6 450 1 2024-04-15T21:03:02.911 INFO:tasks.workunit.client.0.smithi072.stdout:5/960: rmdir d0/d3/d7/d12/d1d/d8c 39 2024-04-15T21:03:02.913 INFO:tasks.workunit.client.0.smithi072.stdout:4/942: dread d7/d28/d6d/faa [4194304,4194304] 0 2024-04-15T21:03:02.923 INFO:tasks.workunit.client.0.smithi072.stdout:6/924: rename d2/d42/c78 to d2/d10/c115 0 2024-04-15T21:03:02.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/989: mknod d3/de/d1b/d41/d74/d98/da5/d116/c138 0 2024-04-15T21:03:02.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/990: dwrite d3/de/d81/f86 [4194304,4194304] 0 2024-04-15T21:03:02.935 INFO:tasks.workunit.client.0.smithi072.stdout:7/912: link d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa/f100 d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/f12d 0 2024-04-15T21:03:02.936 INFO:tasks.workunit.client.0.smithi072.stdout:8/991: write d3/d7e/f8d [917801,40774] 0 2024-04-15T21:03:02.936 INFO:tasks.workunit.client.0.smithi072.stdout:3/920: link d1/d3f/f95 d1/d3f/d4f/d73/db3/dd5/f11e 0 2024-04-15T21:03:02.943 INFO:tasks.workunit.client.0.smithi072.stdout:5/961: rename d0/d3/d33/d60/d81/daf/d127/f141 to d0/d3/d7/d94/d86/f142 0 2024-04-15T21:03:02.947 INFO:tasks.workunit.client.0.smithi072.stdout:4/943: dread d7/f12 [0,4194304] 0 2024-04-15T21:03:02.948 INFO:tasks.workunit.client.0.smithi072.stdout:0/969: symlink d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d129/dad/dc8/df6/l14a 0 2024-04-15T21:03:02.948 INFO:tasks.workunit.client.0.smithi072.stdout:0/970: write d0/f1 [104507,83173] 0 2024-04-15T21:03:02.952 INFO:tasks.workunit.client.0.smithi072.stdout:8/992: mknod d3/de/d1b/d41/d74/d98/da5/c139 0 2024-04-15T21:03:02.953 INFO:tasks.workunit.client.0.smithi072.stdout:2/999: getdents d2/d8/d8e 0 2024-04-15T21:03:02.954 INFO:tasks.workunit.client.0.smithi072.stdout:0/971: dwrite d0/d6/d55/ff1 [4194304,4194304] 0 2024-04-15T21:03:02.958 INFO:tasks.workunit.client.0.smithi072.stdout:6/925: mkdir d2/d10/d18/d47/d116 0 2024-04-15T21:03:02.959 INFO:tasks.workunit.client.0.smithi072.stdout:6/926: write d2/d40/d56/d95/fdf [907230,70802] 0 2024-04-15T21:03:02.961 INFO:tasks.workunit.client.0.smithi072.stdout:4/944: dread - d7/d15/ddd/df7/d76/d8b/dad/de1/f122 zero size 2024-04-15T21:03:02.962 INFO:tasks.workunit.client.0.smithi072.stdout:4/945: dread - d7/d10/d41/d4c/dc9/f119 zero size 2024-04-15T21:03:02.973 INFO:tasks.workunit.client.0.smithi072.stdout:3/921: mknod d1/c11f 0 2024-04-15T21:03:02.973 INFO:tasks.workunit.client.0.smithi072.stdout:0/972: mknod d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/c14b 0 2024-04-15T21:03:02.974 INFO:tasks.workunit.client.0.smithi072.stdout:0/973: dread - d0/d45/d7a/d70/d59/d8a/d7b/fde zero size 2024-04-15T21:03:02.978 INFO:tasks.workunit.client.0.smithi072.stdout:6/927: stat d2/da1/fb3 0 2024-04-15T21:03:02.981 INFO:tasks.workunit.client.0.smithi072.stdout:4/946: dread d7/d10/d41/d44/d7a/ff1 [8388608,4194304] 0 2024-04-15T21:03:02.982 INFO:tasks.workunit.client.0.smithi072.stdout:5/962: link d0/d3/d7/d1f/l27 d0/d3/d33/d60/l143 0 2024-04-15T21:03:02.983 INFO:tasks.workunit.client.0.smithi072.stdout:5/963: chown d0/d3/d7/d94/d86/fb9 189 1 2024-04-15T21:03:02.985 INFO:tasks.workunit.client.0.smithi072.stdout:0/974: mknod d0/d19/d2b/d63/ddb/c14c 0 2024-04-15T21:03:02.985 INFO:tasks.workunit.client.0.smithi072.stdout:0/975: readlink d0/d74/l105 0 2024-04-15T21:03:02.986 INFO:tasks.workunit.client.0.smithi072.stdout:6/928: fsync d2/d40/dcb/f38 0 2024-04-15T21:03:02.988 INFO:tasks.workunit.client.0.smithi072.stdout:8/993: rename d3/d4/d4c/c8c to d3/de/d1b/d41/d74/d98/c13a 0 2024-04-15T21:03:02.990 INFO:tasks.workunit.client.0.smithi072.stdout:8/994: read d3/d4/f1e [1734489,77117] 0 2024-04-15T21:03:02.990 INFO:tasks.workunit.client.0.smithi072.stdout:8/995: fdatasync d3/d7e/ff3 0 2024-04-15T21:03:02.990 INFO:tasks.workunit.client.0.smithi072.stdout:0/976: creat d0/d19/d71/d9e/f14d x:0 0 0 2024-04-15T21:03:02.994 INFO:tasks.workunit.client.0.smithi072.stdout:4/947: rename d7/d10/d41/d45/c118 to d7/d15/df0/d11e/d12b/c12c 0 2024-04-15T21:03:02.995 INFO:tasks.workunit.client.0.smithi072.stdout:5/964: symlink d0/d3/d7/d12/d31/l144 0 2024-04-15T21:03:02.997 INFO:tasks.workunit.client.0.smithi072.stdout:8/996: rmdir d3/d7e/dc6 39 2024-04-15T21:03:02.998 INFO:tasks.workunit.client.0.smithi072.stdout:8/997: readlink d3/d4/d4c/l5f 0 2024-04-15T21:03:03.000 INFO:tasks.workunit.client.0.smithi072.stdout:8/998: dread - d3/de/d1b/d3f/dfb/f117 zero size 2024-04-15T21:03:03.002 INFO:tasks.workunit.client.0.smithi072.stdout:5/965: dwrite d0/d3/d6/d14/fd6 [0,4194304] 0 2024-04-15T21:03:03.006 INFO:tasks.workunit.client.0.smithi072.stdout:4/948: dread d7/d15/f33 [0,4194304] 0 2024-04-15T21:03:03.006 INFO:tasks.workunit.client.0.smithi072.stdout:3/922: rename d1/d3f/d4f/d73/db3/dd5/dea/l11a to d1/d3f/d4f/d73/db3/dc4/dd0/l120 0 2024-04-15T21:03:03.007 INFO:tasks.workunit.client.0.smithi072.stdout:3/923: chown d1/d5b/cf3 41826432 1 2024-04-15T21:03:03.008 INFO:tasks.workunit.client.0.smithi072.stdout:3/924: chown d1/c83 199619853 1 2024-04-15T21:03:03.009 INFO:tasks.workunit.client.0.smithi072.stdout:5/966: mknod d0/d3/d33/c145 0 2024-04-15T21:03:03.012 INFO:tasks.workunit.client.0.smithi072.stdout:1/942: truncate d5/d3d/f75 1303183 0 2024-04-15T21:03:03.013 INFO:tasks.workunit.client.0.smithi072.stdout:1/943: write d5/db/d2d/f110 [128658,73060] 0 2024-04-15T21:03:03.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/949: unlink d7/d28/d42/d8c/da9/f109 0 2024-04-15T21:03:03.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/950: fsync d7/d10/f11 0 2024-04-15T21:03:03.020 INFO:tasks.workunit.client.0.smithi072.stdout:3/925: creat d1/d3f/d4f/d73/d11b/f121 x:0 0 0 2024-04-15T21:03:03.022 INFO:tasks.workunit.client.0.smithi072.stdout:5/967: mkdir d0/d3/d7/d94/d146 0 2024-04-15T21:03:03.024 INFO:tasks.workunit.client.0.smithi072.stdout:8/999: creat d3/de/d1b/d44/d102/f13b x:0 0 0 2024-04-15T21:03:03.026 INFO:tasks.workunit.client.0.smithi072.stdout:7/913: write d2/d78/fbb [201177,100265] 0 2024-04-15T21:03:03.027 INFO:tasks.workunit.client.0.smithi072.stdout:7/914: write d2/d7/d25/d72/d98/d108/f123 [965066,111134] 0 2024-04-15T21:03:03.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/926: mkdir d1/d15/d40/d9e/d122 0 2024-04-15T21:03:03.036 INFO:tasks.workunit.client.0.smithi072.stdout:4/951: mknod d7/c12d 0 2024-04-15T21:03:03.045 INFO:tasks.workunit.client.0.smithi072.stdout:0/977: write d0/d19/d2b/f37 [4669827,17858] 0 2024-04-15T21:03:03.046 INFO:tasks.workunit.client.0.smithi072.stdout:1/944: dread d5/f9 [4194304,4194304] 0 2024-04-15T21:03:03.046 INFO:tasks.workunit.client.0.smithi072.stdout:6/929: dwrite d2/d40/d56/f77 [4194304,4194304] 0 2024-04-15T21:03:03.065 INFO:tasks.workunit.client.0.smithi072.stdout:7/915: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f5e [0,4194304] 0 2024-04-15T21:03:03.066 INFO:tasks.workunit.client.0.smithi072.stdout:7/916: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/f104 [728347,60966] 0 2024-04-15T21:03:03.067 INFO:tasks.workunit.client.0.smithi072.stdout:7/917: dread - d2/d7/d25/f114 zero size 2024-04-15T21:03:03.072 INFO:tasks.workunit.client.0.smithi072.stdout:7/918: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d26/f118 [0,4194304] 0 2024-04-15T21:03:03.076 INFO:tasks.workunit.client.0.smithi072.stdout:3/927: truncate d1/f17 1836481 0 2024-04-15T21:03:03.077 INFO:tasks.workunit.client.0.smithi072.stdout:3/928: chown d1/d3f/d4f/d73/d11b 2642772 1 2024-04-15T21:03:03.081 INFO:tasks.workunit.client.0.smithi072.stdout:1/945: unlink d5/d31/f37 0 2024-04-15T21:03:03.082 INFO:tasks.workunit.client.0.smithi072.stdout:1/946: write d5/d31/f114 [670386,54734] 0 2024-04-15T21:03:03.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/919: symlink d2/d7/d25/d4c/l12e 0 2024-04-15T21:03:03.087 INFO:tasks.workunit.client.0.smithi072.stdout:4/952: mkdir d7/d71/d127/d12e 0 2024-04-15T21:03:03.088 INFO:tasks.workunit.client.0.smithi072.stdout:3/929: stat d1/d3f/f95 0 2024-04-15T21:03:03.089 INFO:tasks.workunit.client.0.smithi072.stdout:1/947: mknod d5/d3d/c130 0 2024-04-15T21:03:03.092 INFO:tasks.workunit.client.0.smithi072.stdout:4/953: rename d7/d71/d127/d12e to d7/d28/d6d/de7/d12f 0 2024-04-15T21:03:03.094 INFO:tasks.workunit.client.0.smithi072.stdout:1/948: dwrite d5/db/d27/d5c/dbd/f95 [0,4194304] 0 2024-04-15T21:03:03.096 INFO:tasks.workunit.client.0.smithi072.stdout:7/920: mkdir d2/d7/d25/d2d/d46/d5a/d12f 0 2024-04-15T21:03:03.096 INFO:tasks.workunit.client.0.smithi072.stdout:7/921: chown d2/d7/d25/fed 748502431 1 2024-04-15T21:03:03.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/930: mkdir d1/d3f/d4f/d73/db3/dc4/d113/d123 0 2024-04-15T21:03:03.103 INFO:tasks.workunit.client.0.smithi072.stdout:4/954: unlink d7/d15/ddd/df7/d76/d8b/fe2 0 2024-04-15T21:03:03.103 INFO:tasks.workunit.client.0.smithi072.stdout:4/955: chown d7/d10/d41/dc4 1771956 1 2024-04-15T21:03:03.104 INFO:tasks.workunit.client.0.smithi072.stdout:7/922: fdatasync d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa/f100 0 2024-04-15T21:03:03.106 INFO:tasks.workunit.client.0.smithi072.stdout:7/923: write d2/d7/d25/d2d/d46/d5a/d5f/f3c [2620007,103306] 0 2024-04-15T21:03:03.107 INFO:tasks.workunit.client.0.smithi072.stdout:1/949: mknod d5/db/d27/c131 0 2024-04-15T21:03:03.108 INFO:tasks.workunit.client.0.smithi072.stdout:0/978: dread d0/d45/d7a/f3c [0,4194304] 0 2024-04-15T21:03:03.109 INFO:tasks.workunit.client.0.smithi072.stdout:4/956: mkdir d7/d15/d130 0 2024-04-15T21:03:03.112 INFO:tasks.workunit.client.0.smithi072.stdout:3/931: rename d1/f10 to d1/d15/d40/dff/f124 0 2024-04-15T21:03:03.117 INFO:tasks.workunit.client.0.smithi072.stdout:1/950: dwrite d5/db/f52 [0,4194304] 0 2024-04-15T21:03:03.118 INFO:tasks.workunit.client.0.smithi072.stdout:3/932: rename d1/d15/d32/d78/d11c to d1/d15/d40/dff/d125 0 2024-04-15T21:03:03.124 INFO:tasks.workunit.client.0.smithi072.stdout:1/951: mknod d5/db/d2d/c132 0 2024-04-15T21:03:03.150 INFO:tasks.workunit.client.0.smithi072.stdout:7/924: truncate d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/f12d 991879 0 2024-04-15T21:03:03.152 INFO:tasks.workunit.client.0.smithi072.stdout:0/979: write d0/d6/fb0 [858582,109887] 0 2024-04-15T21:03:03.153 INFO:tasks.workunit.client.0.smithi072.stdout:0/980: dread - d0/d45/d7a/d70/d59/f119 zero size 2024-04-15T21:03:03.157 INFO:tasks.workunit.client.0.smithi072.stdout:4/957: truncate d7/d28/f49 688049 0 2024-04-15T21:03:03.158 INFO:tasks.workunit.client.0.smithi072.stdout:4/958: write d7/d15/d58/f77 [1774241,13958] 0 2024-04-15T21:03:03.158 INFO:tasks.workunit.client.0.smithi072.stdout:0/981: mkdir d0/d6/d48/d61/d13b/d14e 0 2024-04-15T21:03:03.161 INFO:tasks.workunit.client.0.smithi072.stdout:3/933: write d1/d15/f5e [1189906,106044] 0 2024-04-15T21:03:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:3/934: unlink d1/f64 0 2024-04-15T21:03:03.170 INFO:tasks.workunit.client.0.smithi072.stdout:7/925: dread d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:03:03.180 INFO:tasks.workunit.client.0.smithi072.stdout:4/959: dwrite d7/d28/f49 [0,4194304] 0 2024-04-15T21:03:03.181 INFO:tasks.workunit.client.0.smithi072.stdout:4/960: readlink d7/d15/ddd/df7/d76/d8b/l123 0 2024-04-15T21:03:03.182 INFO:tasks.workunit.client.0.smithi072.stdout:0/982: write d0/d45/f111 [108481,107065] 0 2024-04-15T21:03:03.183 INFO:tasks.workunit.client.0.smithi072.stdout:3/935: creat d1/d15/d40/f126 x:0 0 0 2024-04-15T21:03:03.183 INFO:tasks.workunit.client.0.smithi072.stdout:0/983: stat d0/d45/d7a/d70/dce/f118 0 2024-04-15T21:03:03.185 INFO:tasks.workunit.client.0.smithi072.stdout:4/961: creat d7/d15/df0/d11e/f131 x:0 0 0 2024-04-15T21:03:03.186 INFO:tasks.workunit.client.0.smithi072.stdout:4/962: fsync d7/d15/ddd/df7/d76/d8b/fce 0 2024-04-15T21:03:03.194 INFO:tasks.workunit.client.0.smithi072.stdout:4/963: rename d7/d10/d41/d4c/dc9 to d7/d15/d132 0 2024-04-15T21:03:03.194 INFO:tasks.workunit.client.0.smithi072.stdout:7/926: write d2/d78/fa4 [1042595,29356] 0 2024-04-15T21:03:03.197 INFO:tasks.workunit.client.0.smithi072.stdout:7/927: write d2/d7/d25/d2d/d46/d5a/d5f/d43/f90 [1311163,83448] 0 2024-04-15T21:03:03.200 INFO:tasks.workunit.client.0.smithi072.stdout:3/936: dread d1/d3f/d4f/f7e [0,4194304] 0 2024-04-15T21:03:03.203 INFO:tasks.workunit.client.0.smithi072.stdout:4/964: mknod d7/d15/ddd/df7/d76/d8b/dad/de1/c133 0 2024-04-15T21:03:03.204 INFO:tasks.workunit.client.0.smithi072.stdout:4/965: readlink d7/d24/lb9 0 2024-04-15T21:03:03.205 INFO:tasks.workunit.client.0.smithi072.stdout:4/966: chown d7/d24/f59 182860 1 2024-04-15T21:03:03.206 INFO:tasks.workunit.client.0.smithi072.stdout:0/984: dwrite d0/d19/f22 [0,4194304] 0 2024-04-15T21:03:03.212 INFO:tasks.workunit.client.0.smithi072.stdout:3/937: mkdir d1/d3f/d4f/d73/d127 0 2024-04-15T21:03:03.215 INFO:tasks.workunit.client.0.smithi072.stdout:0/985: fdatasync d0/f13 0 2024-04-15T21:03:03.219 INFO:tasks.workunit.client.0.smithi072.stdout:4/967: mkdir d7/d134 0 2024-04-15T21:03:03.222 INFO:tasks.workunit.client.0.smithi072.stdout:7/928: link d2/d7/d25/d72/f9c d2/d7/d11d/f130 0 2024-04-15T21:03:03.224 INFO:tasks.workunit.client.0.smithi072.stdout:4/968: write d7/f38 [3028441,121084] 0 2024-04-15T21:03:03.226 INFO:tasks.workunit.client.0.smithi072.stdout:7/929: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/d131 0 2024-04-15T21:03:03.228 INFO:tasks.workunit.client.0.smithi072.stdout:4/969: rmdir d7/d15/d58 39 2024-04-15T21:03:03.230 INFO:tasks.workunit.client.0.smithi072.stdout:7/930: unlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/laf 0 2024-04-15T21:03:03.232 INFO:tasks.workunit.client.0.smithi072.stdout:3/938: truncate d1/d15/feb 1248563 0 2024-04-15T21:03:03.235 INFO:tasks.workunit.client.0.smithi072.stdout:4/970: dwrite d7/d10/d41/d45/d93/de0/dfc/fa5 [0,4194304] 0 2024-04-15T21:03:03.235 INFO:tasks.workunit.client.0.smithi072.stdout:7/931: mkdir d2/d7/d25/d2d/d46/d5a/d12f/d132 0 2024-04-15T21:03:03.235 INFO:tasks.workunit.client.0.smithi072.stdout:0/986: dwrite d0/d74/d94/f103 [0,4194304] 0 2024-04-15T21:03:03.237 INFO:tasks.workunit.client.0.smithi072.stdout:4/971: write d7/d15/d132/f119 [1004079,67845] 0 2024-04-15T21:03:03.240 INFO:tasks.workunit.client.0.smithi072.stdout:3/939: dread d1/d15/d32/d78/fe4 [4194304,4194304] 0 2024-04-15T21:03:03.240 INFO:tasks.workunit.client.0.smithi072.stdout:4/972: read - d7/d24/f113 zero size 2024-04-15T21:03:03.243 INFO:tasks.workunit.client.0.smithi072.stdout:7/932: mkdir d2/d7/d25/d2d/d46/d5a/d5f/d43/db8/d133 0 2024-04-15T21:03:03.245 INFO:tasks.workunit.client.0.smithi072.stdout:0/987: creat d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f14f x:0 0 0 2024-04-15T21:03:03.245 INFO:tasks.workunit.client.0.smithi072.stdout:5/968: sync 2024-04-15T21:03:03.248 INFO:tasks.workunit.client.0.smithi072.stdout:3/940: dwrite d1/d3f/fd2 [0,4194304] 0 2024-04-15T21:03:03.248 INFO:tasks.workunit.client.0.smithi072.stdout:7/933: chown d2/d78/ce9 2061 1 2024-04-15T21:03:03.249 INFO:tasks.workunit.client.0.smithi072.stdout:4/973: dread d7/d15/ddd/df7/d76/f106 [0,4194304] 0 2024-04-15T21:03:03.251 INFO:tasks.workunit.client.0.smithi072.stdout:4/974: dread d7/d10/d41/d44/d7a/fc0 [0,4194304] 0 2024-04-15T21:03:03.251 INFO:tasks.workunit.client.0.smithi072.stdout:0/988: symlink d0/d19/d58/l150 0 2024-04-15T21:03:03.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/934: truncate d2/d7/d25/f8b 71226 0 2024-04-15T21:03:03.256 INFO:tasks.workunit.client.0.smithi072.stdout:0/989: dread d0/d74/d94/f103 [0,4194304] 0 2024-04-15T21:03:03.259 INFO:tasks.workunit.client.0.smithi072.stdout:0/990: creat d0/d19/d2b/f151 x:0 0 0 2024-04-15T21:03:03.260 INFO:tasks.workunit.client.0.smithi072.stdout:3/941: getdents d1/d3f/d4f/d73/db3/dd5 0 2024-04-15T21:03:03.263 INFO:tasks.workunit.client.0.smithi072.stdout:7/935: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/dcc/fe6 [0,4194304] 0 2024-04-15T21:03:03.266 INFO:tasks.workunit.client.0.smithi072.stdout:3/942: creat d1/d3f/d10e/f128 x:0 0 0 2024-04-15T21:03:03.267 INFO:tasks.workunit.client.0.smithi072.stdout:7/936: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/d107 39 2024-04-15T21:03:03.268 INFO:tasks.workunit.client.0.smithi072.stdout:0/991: rmdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e 39 2024-04-15T21:03:03.272 INFO:tasks.workunit.client.0.smithi072.stdout:3/943: mkdir d1/d3f/d4f/d73/db3/dd5/d129 0 2024-04-15T21:03:03.276 INFO:tasks.workunit.client.0.smithi072.stdout:3/944: creat d1/d26/f12a x:0 0 0 2024-04-15T21:03:03.276 INFO:tasks.workunit.client.0.smithi072.stdout:0/992: dread d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/f10c [0,4194304] 0 2024-04-15T21:03:03.277 INFO:tasks.workunit.client.0.smithi072.stdout:3/945: dread d1/d15/d32/f4a [0,4194304] 0 2024-04-15T21:03:03.280 INFO:tasks.workunit.client.0.smithi072.stdout:7/937: rename d2/d7/d25/d72/d98/de2/de4/l110 to d2/d7/d25/d81/l134 0 2024-04-15T21:03:03.280 INFO:tasks.workunit.client.0.smithi072.stdout:4/975: write d7/d28/f8f [640701,129509] 0 2024-04-15T21:03:03.284 INFO:tasks.workunit.client.0.smithi072.stdout:0/993: dwrite d0/d6/d6d/dcc/f10a [0,4194304] 0 2024-04-15T21:03:03.286 INFO:tasks.workunit.client.0.smithi072.stdout:3/946: dwrite d1/d15/d40/ffc [0,4194304] 0 2024-04-15T21:03:03.290 INFO:tasks.workunit.client.0.smithi072.stdout:4/976: symlink d7/d10/d41/d44/d7a/d97/l135 0 2024-04-15T21:03:03.298 INFO:tasks.workunit.client.0.smithi072.stdout:4/977: mknod d7/d28/db1/c136 0 2024-04-15T21:03:03.301 INFO:tasks.workunit.client.0.smithi072.stdout:7/938: link d2/d7/d25/d2d/d46/d5a/d5f/f2a d2/d7/d25/d81/d120/f135 0 2024-04-15T21:03:03.302 INFO:tasks.workunit.client.0.smithi072.stdout:3/947: mknod d1/d3f/d4f/d73/db3/dc4/d113/d123/c12b 0 2024-04-15T21:03:03.305 INFO:tasks.workunit.client.0.smithi072.stdout:4/978: mknod d7/d10/d41/d45/d93/de0/dfc/c137 0 2024-04-15T21:03:03.308 INFO:tasks.workunit.client.0.smithi072.stdout:0/994: dread d0/d45/d7a/d70/d59/d8a/d8b/db8/fa [0,4194304] 0 2024-04-15T21:03:03.309 INFO:tasks.workunit.client.0.smithi072.stdout:0/995: fdatasync d0/d74/f11f 0 2024-04-15T21:03:03.309 INFO:tasks.workunit.client.0.smithi072.stdout:4/979: mkdir d7/d10/d41/dc4/de8/d103/d138 0 2024-04-15T21:03:03.313 INFO:tasks.workunit.client.0.smithi072.stdout:4/980: mknod d7/d15/df0/c139 0 2024-04-15T21:03:03.314 INFO:tasks.workunit.client.0.smithi072.stdout:4/981: write d7/d71/db2/fc5 [4676140,4546] 0 2024-04-15T21:03:03.315 INFO:tasks.workunit.client.0.smithi072.stdout:4/982: truncate d7/d28/f8f 1789810 0 2024-04-15T21:03:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:7/939: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d26/f29 [4194304,4194304] 0 2024-04-15T21:03:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:0/996: mkdir d0/d45/d7a/d70/d59/d8a/d7b/daa/d8e/dd2/d142/d152 0 2024-04-15T21:03:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:7/940: fdatasync d2/d7/f55 0 2024-04-15T21:03:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:4/983: unlink d7/d28/ce5 0 2024-04-15T21:03:03.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/948: getdents d1/d3f/d4f/d73/db3/dc4/d113/d123 0 2024-04-15T21:03:03.327 INFO:tasks.workunit.client.0.smithi072.stdout:0/997: mknod d0/d45/d7a/d70/d59/d8a/d7b/c153 0 2024-04-15T21:03:03.330 INFO:tasks.workunit.client.0.smithi072.stdout:4/984: symlink d7/d23/d6c/daf/l13a 0 2024-04-15T21:03:03.338 INFO:tasks.workunit.client.0.smithi072.stdout:4/985: rename d7/d71 to d7/d10/d41/d44/d13b 0 2024-04-15T21:03:03.341 INFO:tasks.workunit.client.0.smithi072.stdout:0/998: write d0/d19/fb4 [4490929,97481] 0 2024-04-15T21:03:03.342 INFO:tasks.workunit.client.0.smithi072.stdout:7/941: rmdir d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/d10a 0 2024-04-15T21:03:03.344 INFO:tasks.workunit.client.0.smithi072.stdout:4/986: mknod d7/d10/d41/d44/d7a/d97/db6/c13c 0 2024-04-15T21:03:03.346 INFO:tasks.workunit.client.0.smithi072.stdout:3/949: dwrite d1/d15/d40/fb [4194304,4194304] 0 2024-04-15T21:03:03.346 INFO:tasks.workunit.client.0.smithi072.stdout:4/987: rmdir d7/d10/d41/d4c 39 2024-04-15T21:03:03.348 INFO:tasks.workunit.client.0.smithi072.stdout:7/942: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/c136 0 2024-04-15T21:03:03.355 INFO:tasks.workunit.client.0.smithi072.stdout:3/950: mknod d1/d3f/da2/c12c 0 2024-04-15T21:03:03.363 INFO:tasks.workunit.client.0.smithi072.stdout:4/988: creat d7/d28/f13d x:0 0 0 2024-04-15T21:03:03.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/943: write d2/d7/d25/d2d/d46/d5a/f7c [449489,99349] 0 2024-04-15T21:03:03.364 INFO:tasks.workunit.client.0.smithi072.stdout:1/952: sync 2024-04-15T21:03:03.364 INFO:tasks.workunit.client.0.smithi072.stdout:6/930: sync 2024-04-15T21:03:03.366 INFO:tasks.workunit.client.0.smithi072.stdout:0/999: dread d0/d6/d6d/fc1 [0,4194304] 0 2024-04-15T21:03:03.367 INFO:tasks.workunit.client.0.smithi072.stdout:3/951: dread d1/d3f/da2/fb8 [0,4194304] 0 2024-04-15T21:03:03.368 INFO:tasks.workunit.client.0.smithi072.stdout:4/989: read d7/d15/d58/f7b [97307,34728] 0 2024-04-15T21:03:03.369 INFO:tasks.workunit.client.0.smithi072.stdout:4/990: chown d7/d28/d6d 0 1 2024-04-15T21:03:03.370 INFO:tasks.workunit.client.0.smithi072.stdout:4/991: chown d7/d10/d41/d45/d93/de0/dfc/fa5 400567 1 2024-04-15T21:03:03.372 INFO:tasks.workunit.client.0.smithi072.stdout:7/944: truncate d2/d7/d25/d4c/fe5 82910 0 2024-04-15T21:03:03.372 INFO:tasks.workunit.client.0.smithi072.stdout:6/931: write d2/d42/f8b [424820,63018] 0 2024-04-15T21:03:03.375 INFO:tasks.workunit.client.0.smithi072.stdout:1/953: write d5/db/d27/d5c/dbd/fe7 [649876,57270] 0 2024-04-15T21:03:03.375 INFO:tasks.workunit.client.0.smithi072.stdout:3/952: mknod d1/d3f/da2/c12d 0 2024-04-15T21:03:03.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/954: fdatasync d5/db/d27/d5c/dbd/f95 0 2024-04-15T21:03:03.379 INFO:tasks.workunit.client.0.smithi072.stdout:6/932: dwrite d2/d40/d66/d7f/dd9/fe9 [0,4194304] 0 2024-04-15T21:03:03.384 INFO:tasks.workunit.client.0.smithi072.stdout:6/933: dwrite d2/d40/d66/d7f/dd9/f55 [0,4194304] 0 2024-04-15T21:03:03.386 INFO:tasks.workunit.client.0.smithi072.stdout:3/953: truncate d1/d3f/d4f/f7e 1602680 0 2024-04-15T21:03:03.390 INFO:tasks.workunit.client.0.smithi072.stdout:4/992: dread d7/d10/d41/d44/d13b/db2/fc5 [0,4194304] 0 2024-04-15T21:03:03.391 INFO:tasks.workunit.client.0.smithi072.stdout:4/993: chown d7/d23/ceb 3 1 2024-04-15T21:03:03.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/945: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f13 [4194304,4194304] 0 2024-04-15T21:03:03.396 INFO:tasks.workunit.client.0.smithi072.stdout:6/934: unlink d2/d40/d66/d7f/dd9/ce8 0 2024-04-15T21:03:03.399 INFO:tasks.workunit.client.0.smithi072.stdout:3/954: fsync d1/d3f/d4f/d73/f87 0 2024-04-15T21:03:03.400 INFO:tasks.workunit.client.0.smithi072.stdout:3/955: chown d1/d3f/d4f/d73/d11b/f105 1725 1 2024-04-15T21:03:03.401 INFO:tasks.workunit.client.0.smithi072.stdout:7/946: creat d2/d7/d25/d81/f137 x:0 0 0 2024-04-15T21:03:03.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/955: mkdir d5/db/d2d/d85/dbf/d101/dc3/dd3/d128/d12b/d133 0 2024-04-15T21:03:03.403 INFO:tasks.workunit.client.0.smithi072.stdout:6/935: creat d2/d10/d18/d47/d6d/f117 x:0 0 0 2024-04-15T21:03:03.404 INFO:tasks.workunit.client.0.smithi072.stdout:6/936: write d2/f14 [746061,59258] 0 2024-04-15T21:03:03.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/956: unlink d1/d3f/d4f/d73/d11b/fd8 0 2024-04-15T21:03:03.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/957: readlink d1/d15/d32/l88 0 2024-04-15T21:03:03.408 INFO:tasks.workunit.client.0.smithi072.stdout:1/956: rmdir d5/db/d2d/d85/dbf/d101/d1f/d63/d100 39 2024-04-15T21:03:03.411 INFO:tasks.workunit.client.0.smithi072.stdout:6/937: rename d2/d40/d6e/l8c to d2/d10/d11/d1f/l118 0 2024-04-15T21:03:03.412 INFO:tasks.workunit.client.0.smithi072.stdout:3/958: creat d1/d3f/da2/f12e x:0 0 0 2024-04-15T21:03:03.413 INFO:tasks.workunit.client.0.smithi072.stdout:3/959: write d1/d26/fab [2184701,47151] 0 2024-04-15T21:03:03.414 INFO:tasks.workunit.client.0.smithi072.stdout:5/969: sync 2024-04-15T21:03:03.416 INFO:tasks.workunit.client.0.smithi072.stdout:6/938: mkdir d2/d10/d18/d47/d116/d119 0 2024-04-15T21:03:03.417 INFO:tasks.workunit.client.0.smithi072.stdout:3/960: creat d1/d15/d32/d78/d107/f12f x:0 0 0 2024-04-15T21:03:03.419 INFO:tasks.workunit.client.0.smithi072.stdout:5/970: fsync d0/d3/d33/fac 0 2024-04-15T21:03:03.423 INFO:tasks.workunit.client.0.smithi072.stdout:3/961: mkdir d1/d3f/d7f/d130 0 2024-04-15T21:03:03.423 INFO:tasks.workunit.client.0.smithi072.stdout:4/994: write d7/d10/d41/d45/d93/fb8 [631209,104301] 0 2024-04-15T21:03:03.425 INFO:tasks.workunit.client.0.smithi072.stdout:5/971: symlink d0/d3/d7/d94/d86/d10d/l147 0 2024-04-15T21:03:03.426 INFO:tasks.workunit.client.0.smithi072.stdout:6/939: mkdir d2/d10/d11/d1f/d60/df3/d11a 0 2024-04-15T21:03:03.428 INFO:tasks.workunit.client.0.smithi072.stdout:3/962: symlink d1/d15/d40/dff/l131 0 2024-04-15T21:03:03.431 INFO:tasks.workunit.client.0.smithi072.stdout:7/947: dread d2/d7/d25/d2d/d47/d7e/f91 [0,4194304] 0 2024-04-15T21:03:03.432 INFO:tasks.workunit.client.0.smithi072.stdout:1/957: write d5/db/d2d/d56/df0/d82/fec [188872,81045] 0 2024-04-15T21:03:03.433 INFO:tasks.workunit.client.0.smithi072.stdout:3/963: mkdir d1/d26/d132 0 2024-04-15T21:03:03.434 INFO:tasks.workunit.client.0.smithi072.stdout:1/958: dread d5/db/d2d/f110 [0,4194304] 0 2024-04-15T21:03:03.441 INFO:tasks.workunit.client.0.smithi072.stdout:5/972: creat d0/d3/d7/f148 x:0 0 0 2024-04-15T21:03:03.442 INFO:tasks.workunit.client.0.smithi072.stdout:5/973: dread - d0/d3/d33/d60/d81/daf/d127/f129 zero size 2024-04-15T21:03:03.442 INFO:tasks.workunit.client.0.smithi072.stdout:3/964: rename d1/d15/d40/c53 to d1/d15/d32/d2f/df4/c133 0 2024-04-15T21:03:03.445 INFO:tasks.workunit.client.0.smithi072.stdout:1/959: symlink d5/df5/l134 0 2024-04-15T21:03:03.448 INFO:tasks.workunit.client.0.smithi072.stdout:7/948: symlink d2/l138 0 2024-04-15T21:03:03.448 INFO:tasks.workunit.client.0.smithi072.stdout:7/949: chown d2/d7/d25/fed 30302 1 2024-04-15T21:03:03.449 INFO:tasks.workunit.client.0.smithi072.stdout:4/995: truncate d7/d10/d41/d4c/f82 3862387 0 2024-04-15T21:03:03.451 INFO:tasks.workunit.client.0.smithi072.stdout:5/974: creat d0/d3/d7/d12/d31/d49/f149 x:0 0 0 2024-04-15T21:03:03.453 INFO:tasks.workunit.client.0.smithi072.stdout:6/940: getdents d2/d40/d66 0 2024-04-15T21:03:03.454 INFO:tasks.workunit.client.0.smithi072.stdout:3/965: dwrite d1/f2b [4194304,4194304] 0 2024-04-15T21:03:03.456 INFO:tasks.workunit.client.0.smithi072.stdout:4/996: mkdir d7/d28/d42/d13e 0 2024-04-15T21:03:03.458 INFO:tasks.workunit.client.0.smithi072.stdout:5/975: rmdir d0/d3/d7/d12/d31/d62/db6 39 2024-04-15T21:03:03.460 INFO:tasks.workunit.client.0.smithi072.stdout:1/960: fdatasync d5/f7d 0 2024-04-15T21:03:03.460 INFO:tasks.workunit.client.0.smithi072.stdout:1/961: chown d5/db/d2d/le0 600 1 2024-04-15T21:03:03.466 INFO:tasks.workunit.client.0.smithi072.stdout:6/941: rename d2/d42/db9/dc9 to d2/d40/d56/d6a/d11b 0 2024-04-15T21:03:03.470 INFO:tasks.workunit.client.0.smithi072.stdout:3/966: mkdir d1/d15/d40/dff/d125/d134 0 2024-04-15T21:03:03.471 INFO:tasks.workunit.client.0.smithi072.stdout:4/997: symlink d7/d10/d41/d44/d7a/l13f 0 2024-04-15T21:03:03.474 INFO:tasks.workunit.client.0.smithi072.stdout:7/950: write d2/d7/d25/d2d/d52/f9d [2057724,23005] 0 2024-04-15T21:03:03.478 INFO:tasks.workunit.client.0.smithi072.stdout:6/942: symlink d2/d10/d11/d1f/d60/l11c 0 2024-04-15T21:03:03.484 INFO:tasks.workunit.client.0.smithi072.stdout:7/951: chown d2/f5 122353 1 2024-04-15T21:03:03.486 INFO:tasks.workunit.client.0.smithi072.stdout:1/962: dwrite d5/db/d27/d5c/f64 [0,4194304] 0 2024-04-15T21:03:03.486 INFO:tasks.workunit.client.0.smithi072.stdout:4/998: mkdir d7/d23/d140 0 2024-04-15T21:03:03.487 INFO:tasks.workunit.client.0.smithi072.stdout:4/999: chown d7/d10/d41/dc4 1409739 1 2024-04-15T21:03:03.488 INFO:tasks.workunit.client.0.smithi072.stdout:5/976: write d0/d3/d33/d60/fe0 [246850,100228] 0 2024-04-15T21:03:03.488 INFO:tasks.workunit.client.0.smithi072.stdout:6/943: mkdir d2/d10/d18/d47/d116/d119/d11d 0 2024-04-15T21:03:03.490 INFO:tasks.workunit.client.0.smithi072.stdout:7/952: creat d2/d7/d25/d2d/d52/d6d/d128/f139 x:0 0 0 2024-04-15T21:03:03.492 INFO:tasks.workunit.client.0.smithi072.stdout:7/953: write d2/d7/d25/d2d/d46/d5a/d5f/f5e [1022023,94921] 0 2024-04-15T21:03:03.492 INFO:tasks.workunit.client.0.smithi072.stdout:5/977: mkdir d0/d3/d6/d14/d14a 0 2024-04-15T21:03:03.496 INFO:tasks.workunit.client.0.smithi072.stdout:5/978: fdatasync d0/fa 0 2024-04-15T21:03:03.506 INFO:tasks.workunit.client.0.smithi072.stdout:5/979: mknod d0/d3/d7/c14b 0 2024-04-15T21:03:03.509 INFO:tasks.workunit.client.0.smithi072.stdout:3/967: dread d1/d15/d40/f13 [0,4194304] 0 2024-04-15T21:03:03.510 INFO:tasks.workunit.client.0.smithi072.stdout:3/968: write d1/d15/d32/d2f/fe6 [198833,12982] 0 2024-04-15T21:03:03.517 INFO:tasks.workunit.client.0.smithi072.stdout:5/980: getdents d0/d3/d7/d12/d31/d49 0 2024-04-15T21:03:03.520 INFO:tasks.workunit.client.0.smithi072.stdout:1/963: truncate d5/db/d2d/d85/dbf/d101/f22 1956241 0 2024-04-15T21:03:03.521 INFO:tasks.workunit.client.0.smithi072.stdout:5/981: creat d0/d3/d7/d94/de1/f14c x:0 0 0 2024-04-15T21:03:03.522 INFO:tasks.workunit.client.0.smithi072.stdout:6/944: dread d2/d10/d18/f26 [0,4194304] 0 2024-04-15T21:03:03.522 INFO:tasks.workunit.client.0.smithi072.stdout:7/954: write d2/d7/d25/d2d/d46/d5a/d5f/f11 [1484606,54877] 0 2024-04-15T21:03:03.525 INFO:tasks.workunit.client.0.smithi072.stdout:1/964: mkdir d5/db/d2d/d56/df0/d135 0 2024-04-15T21:03:03.527 INFO:tasks.workunit.client.0.smithi072.stdout:3/969: link d1/d15/f6f d1/d15/d40/dff/f135 0 2024-04-15T21:03:03.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/945: mkdir d2/d40/d66/da8/d11e 0 2024-04-15T21:03:03.531 INFO:tasks.workunit.client.0.smithi072.stdout:5/982: fsync d0/d3/d7/d12/d1d/d8c/f88 0 2024-04-15T21:03:03.533 INFO:tasks.workunit.client.0.smithi072.stdout:3/970: dwrite d1/d15/d40/f126 [0,4194304] 0 2024-04-15T21:03:03.535 INFO:tasks.workunit.client.0.smithi072.stdout:3/971: dread - d1/d15/d32/d78/d107/f12f zero size 2024-04-15T21:03:03.536 INFO:tasks.workunit.client.0.smithi072.stdout:7/955: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/f13a x:0 0 0 2024-04-15T21:03:03.536 INFO:tasks.workunit.client.0.smithi072.stdout:1/965: dread d5/d3d/f6a [0,4194304] 0 2024-04-15T21:03:03.536 INFO:tasks.workunit.client.0.smithi072.stdout:7/956: stat d2/d7/d25/d81 0 2024-04-15T21:03:03.541 INFO:tasks.workunit.client.0.smithi072.stdout:1/966: dwrite d5/db/d27/d5c/dbd/fe7 [0,4194304] 0 2024-04-15T21:03:03.543 INFO:tasks.workunit.client.0.smithi072.stdout:6/946: rename d2/d40/d6e/l10c to d2/d10/d18/d47/d116/d119/l11f 0 2024-04-15T21:03:03.545 INFO:tasks.workunit.client.0.smithi072.stdout:5/983: mkdir d0/d3/d7/d12/d31/d49/d14d 0 2024-04-15T21:03:03.548 INFO:tasks.workunit.client.0.smithi072.stdout:7/957: rmdir d2/d7/d11d 39 2024-04-15T21:03:03.552 INFO:tasks.workunit.client.0.smithi072.stdout:1/967: unlink d5/db/d2d/d85/dbf/ldb 0 2024-04-15T21:03:03.554 INFO:tasks.workunit.client.0.smithi072.stdout:3/972: dread d1/d15/f31 [0,4194304] 0 2024-04-15T21:03:03.555 INFO:tasks.workunit.client.0.smithi072.stdout:6/947: mkdir d2/d42/d120 0 2024-04-15T21:03:03.556 INFO:tasks.workunit.client.0.smithi072.stdout:5/984: symlink d0/d3/d7/d12/d31/d62/d8e/l14e 0 2024-04-15T21:03:03.558 INFO:tasks.workunit.client.0.smithi072.stdout:6/948: dread d2/d10/d18/f26 [0,4194304] 0 2024-04-15T21:03:03.563 INFO:tasks.workunit.client.0.smithi072.stdout:1/968: getdents d5/db/d2d/d56/df0/d135 0 2024-04-15T21:03:03.563 INFO:tasks.workunit.client.0.smithi072.stdout:6/949: mknod d2/d40/d66/da8/c121 0 2024-04-15T21:03:03.565 INFO:tasks.workunit.client.0.smithi072.stdout:5/985: symlink d0/d3/d7/d12/d31/l14f 0 2024-04-15T21:03:03.566 INFO:tasks.workunit.client.0.smithi072.stdout:7/958: rename d2/d7/d25/d2d/d46/l97 to d2/d7/d25/d2d/d46/d5a/d5f/d1f/l13b 0 2024-04-15T21:03:03.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/950: symlink d2/d10/d18/d47/d116/l122 0 2024-04-15T21:03:03.571 INFO:tasks.workunit.client.0.smithi072.stdout:3/973: getdents d1/d3f/d4f/d73/db3/dc4/d113 0 2024-04-15T21:03:03.573 INFO:tasks.workunit.client.0.smithi072.stdout:7/959: dwrite d2/d7/d25/d2d/d46/d5a/d5f/f11 [0,4194304] 0 2024-04-15T21:03:03.575 INFO:tasks.workunit.client.0.smithi072.stdout:6/951: unlink d2/d40/ce4 0 2024-04-15T21:03:03.576 INFO:tasks.workunit.client.0.smithi072.stdout:6/952: dread - d2/d40/dcb/d49/ff8 zero size 2024-04-15T21:03:03.577 INFO:tasks.workunit.client.0.smithi072.stdout:3/974: truncate d1/d15/d40/f13 329563 0 2024-04-15T21:03:03.579 INFO:tasks.workunit.client.0.smithi072.stdout:7/960: mkdir d2/da7/d13c 0 2024-04-15T21:03:03.580 INFO:tasks.workunit.client.0.smithi072.stdout:1/969: dread d5/f3c [0,4194304] 0 2024-04-15T21:03:03.582 INFO:tasks.workunit.client.0.smithi072.stdout:7/961: chown d2/d7/d25/c2c 842 1 2024-04-15T21:03:03.586 INFO:tasks.workunit.client.0.smithi072.stdout:7/962: read d2/d7/f55 [1761903,98124] 0 2024-04-15T21:03:03.587 INFO:tasks.workunit.client.0.smithi072.stdout:5/986: write d0/d3/d33/d85/f89 [1085894,91898] 0 2024-04-15T21:03:03.588 INFO:tasks.workunit.client.0.smithi072.stdout:1/970: read d5/f96 [305381,92957] 0 2024-04-15T21:03:03.588 INFO:tasks.workunit.client.0.smithi072.stdout:6/953: mknod d2/d40/c123 0 2024-04-15T21:03:03.588 INFO:tasks.workunit.client.0.smithi072.stdout:7/963: write d2/d7/d25/d72/f92 [7122745,102114] 0 2024-04-15T21:03:03.590 INFO:tasks.workunit.client.0.smithi072.stdout:6/954: dread d2/d40/dcb/d49/f65 [0,4194304] 0 2024-04-15T21:03:03.590 INFO:tasks.workunit.client.0.smithi072.stdout:5/987: fdatasync d0/d3/d7/d94/fd5 0 2024-04-15T21:03:03.591 INFO:tasks.workunit.client.0.smithi072.stdout:6/955: truncate d2/d42/f93 5152675 0 2024-04-15T21:03:03.592 INFO:tasks.workunit.client.0.smithi072.stdout:1/971: creat d5/dcb/f136 x:0 0 0 2024-04-15T21:03:03.592 INFO:tasks.workunit.client.0.smithi072.stdout:6/956: stat d2/d40/d6e/f4e 0 2024-04-15T21:03:03.593 INFO:tasks.workunit.client.0.smithi072.stdout:1/972: chown d5/db/d2d/d85/dbf/d101/l5f 0 1 2024-04-15T21:03:03.594 INFO:tasks.workunit.client.0.smithi072.stdout:1/973: stat d5/dcb 0 2024-04-15T21:03:03.597 INFO:tasks.workunit.client.0.smithi072.stdout:5/988: truncate d0/d3/d7/d12/d31/d55/d58/fc5 201028 0 2024-04-15T21:03:03.597 INFO:tasks.workunit.client.0.smithi072.stdout:5/989: chown d0/d3/d7/d94/d146 24 1 2024-04-15T21:03:03.607 INFO:tasks.workunit.client.0.smithi072.stdout:5/990: creat d0/d3/d7/d12/d31/d62/db6/f150 x:0 0 0 2024-04-15T21:03:03.608 INFO:tasks.workunit.client.0.smithi072.stdout:5/991: dread - d0/d3/d33/d60/d81/f122 zero size 2024-04-15T21:03:03.610 INFO:tasks.workunit.client.0.smithi072.stdout:1/974: rmdir d5/db/d2d/d85/dbf/d101/dc3/dd3/d128/d12b/d133 0 2024-04-15T21:03:03.611 INFO:tasks.workunit.client.0.smithi072.stdout:6/957: dwrite d2/d10/d11/d1f/d60/f9f [0,4194304] 0 2024-04-15T21:03:03.612 INFO:tasks.workunit.client.0.smithi072.stdout:1/975: dread - d5/db/daa/f10b zero size 2024-04-15T21:03:03.612 INFO:tasks.workunit.client.0.smithi072.stdout:7/964: dread d2/d7/d25/d2d/d46/d5a/d5f/f82 [0,4194304] 0 2024-04-15T21:03:03.613 INFO:tasks.workunit.client.0.smithi072.stdout:5/992: truncate d0/d3/d7/d12/d31/d55/d93/f115 1059339 0 2024-04-15T21:03:03.617 INFO:tasks.workunit.client.0.smithi072.stdout:6/958: read d2/d10/fe5 [523651,52485] 0 2024-04-15T21:03:03.619 INFO:tasks.workunit.client.0.smithi072.stdout:5/993: dwrite d0/d3/d7/d94/d92/da0/da7/fbd [0,4194304] 0 2024-04-15T21:03:03.626 INFO:tasks.workunit.client.0.smithi072.stdout:1/976: getdents d5/db/d27/d5c/ddc/de6 0 2024-04-15T21:03:03.630 INFO:tasks.workunit.client.0.smithi072.stdout:7/965: creat d2/d7/d25/d2d/d46/d5a/d12f/d132/f13d x:0 0 0 2024-04-15T21:03:03.631 INFO:tasks.workunit.client.0.smithi072.stdout:6/959: fsync d2/d42/db9/fe1 0 2024-04-15T21:03:03.633 INFO:tasks.workunit.client.0.smithi072.stdout:1/977: unlink d5/db/d2d/c4d 0 2024-04-15T21:03:03.636 INFO:tasks.workunit.client.0.smithi072.stdout:6/960: stat d2/d40/d56/d95/fea 0 2024-04-15T21:03:03.638 INFO:tasks.workunit.client.0.smithi072.stdout:7/966: creat d2/d7/d25/d2d/d46/df9/f13e x:0 0 0 2024-04-15T21:03:03.641 INFO:tasks.workunit.client.0.smithi072.stdout:7/967: chown d2/d7/d25/d2d 402 1 2024-04-15T21:03:03.641 INFO:tasks.workunit.client.0.smithi072.stdout:7/968: dread - d2/d7/d25/f114 zero size 2024-04-15T21:03:03.641 INFO:tasks.workunit.client.0.smithi072.stdout:5/994: link d0/d3/d7/d12/d31/l14f d0/d3/d33/d85/l151 0 2024-04-15T21:03:03.642 INFO:tasks.workunit.client.0.smithi072.stdout:6/961: creat d2/d10/d11/d1f/d60/df3/f124 x:0 0 0 2024-04-15T21:03:03.645 INFO:tasks.workunit.client.0.smithi072.stdout:7/969: mknod d2/d7/d25/d2d/d46/d5a/d5f/d43/db9/c13f 0 2024-04-15T21:03:03.646 INFO:tasks.workunit.client.0.smithi072.stdout:6/962: mkdir d2/d10/d18/d125 0 2024-04-15T21:03:03.650 INFO:tasks.workunit.client.0.smithi072.stdout:6/963: symlink d2/d40/d66/da8/l126 0 2024-04-15T21:03:03.651 INFO:tasks.workunit.client.0.smithi072.stdout:5/995: getdents d0/d3/d7/d94/d5f 0 2024-04-15T21:03:03.653 INFO:tasks.workunit.client.0.smithi072.stdout:7/970: mknod d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/df4/c140 0 2024-04-15T21:03:03.655 INFO:tasks.workunit.client.0.smithi072.stdout:5/996: truncate d0/d3/d7/d12/d1d/f74 775967 0 2024-04-15T21:03:03.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/964: mkdir d2/d40/dcb/d127 0 2024-04-15T21:03:03.661 INFO:tasks.workunit.client.0.smithi072.stdout:1/978: dwrite d5/db/d2d/f8b [0,4194304] 0 2024-04-15T21:03:03.664 INFO:tasks.workunit.client.0.smithi072.stdout:7/971: truncate d2/d7/d25/d72/fc2 1150548 0 2024-04-15T21:03:03.664 INFO:tasks.workunit.client.0.smithi072.stdout:5/997: dwrite d0/d3/d7/d12/d31/d62/db6/f10f [0,4194304] 0 2024-04-15T21:03:03.668 INFO:tasks.workunit.client.0.smithi072.stdout:6/965: dwrite d2/d42/dad/f103 [0,4194304] 0 2024-04-15T21:03:03.668 INFO:tasks.workunit.client.0.smithi072.stdout:7/972: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/db0/fb6 [1908850,106998] 0 2024-04-15T21:03:03.676 INFO:tasks.workunit.client.0.smithi072.stdout:5/998: mkdir d0/d3/d7/d12/d1d/d102/d152 0 2024-04-15T21:03:03.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/999: truncate d0/d3/d33/d60/d81/daf/d127/f129 405640 0 2024-04-15T21:03:03.685 INFO:tasks.workunit.client.0.smithi072.stdout:7/973: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/f141 x:0 0 0 2024-04-15T21:03:03.686 INFO:tasks.workunit.client.0.smithi072.stdout:6/966: dwrite d2/d40/f86 [0,4194304] 0 2024-04-15T21:03:03.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/979: link d5/f3c d5/db/f137 0 2024-04-15T21:03:03.690 INFO:tasks.workunit.client.0.smithi072.stdout:6/967: fdatasync d2/d40/d56/d95/fea 0 2024-04-15T21:03:03.708 INFO:tasks.workunit.client.0.smithi072.stdout:7/974: write d2/d7/d25/d2d/d46/d5a/d5f/f2a [1596313,29474] 0 2024-04-15T21:03:03.714 INFO:tasks.workunit.client.0.smithi072.stdout:3/975: sync 2024-04-15T21:03:03.717 INFO:tasks.workunit.client.0.smithi072.stdout:3/976: chown d1/d3f/d4f/d73/fde 5 1 2024-04-15T21:03:03.718 INFO:tasks.workunit.client.0.smithi072.stdout:6/968: dwrite d2/da1/fb3 [0,4194304] 0 2024-04-15T21:03:03.719 INFO:tasks.workunit.client.0.smithi072.stdout:1/980: dwrite d5/db/d2d/d85/dbf/d101/d1f/f79 [0,4194304] 0 2024-04-15T21:03:03.720 INFO:tasks.workunit.client.0.smithi072.stdout:1/981: chown d5/f96 64883948 1 2024-04-15T21:03:03.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/975: write d2/d7/d25/d4c/fe5 [808177,124468] 0 2024-04-15T21:03:03.721 INFO:tasks.workunit.client.0.smithi072.stdout:3/977: rmdir d1/d15/d32/d2f 39 2024-04-15T21:03:03.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/982: creat d5/db/d27/d9c/f138 x:0 0 0 2024-04-15T21:03:03.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/983: readlink d5/db/d2d/d56/df0/d82/l9f 0 2024-04-15T21:03:03.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/976: mkdir d2/d7/d25/d72/d98/d108/d142 0 2024-04-15T21:03:03.733 INFO:tasks.workunit.client.0.smithi072.stdout:3/978: rmdir d1/d3f/d4f/da3 39 2024-04-15T21:03:03.737 INFO:tasks.workunit.client.0.smithi072.stdout:6/969: mknod d2/d10/c128 0 2024-04-15T21:03:03.738 INFO:tasks.workunit.client.0.smithi072.stdout:1/984: symlink d5/db/d2d/d85/dbf/d101/dc3/l139 0 2024-04-15T21:03:03.743 INFO:tasks.workunit.client.0.smithi072.stdout:6/970: creat d2/d10/d18/d47/d6d/f129 x:0 0 0 2024-04-15T21:03:03.744 INFO:tasks.workunit.client.0.smithi072.stdout:1/985: mknod d5/db/d2d/d85/dbf/d101/dc3/dd3/d128/d12b/c13a 0 2024-04-15T21:03:03.751 INFO:tasks.workunit.client.0.smithi072.stdout:1/986: rename d5/db/d2d/d56/c60 to d5/db/d2d/d85/dbf/d101/dc3/dd3/dde/d12f/c13b 0 2024-04-15T21:03:03.758 INFO:tasks.workunit.client.0.smithi072.stdout:7/977: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d26/dfa/f100 [0,4194304] 0 2024-04-15T21:03:03.760 INFO:tasks.workunit.client.0.smithi072.stdout:7/978: fdatasync d2/d78/f95 0 2024-04-15T21:03:03.763 INFO:tasks.workunit.client.0.smithi072.stdout:7/979: chown d2/d7/d25/d2d/d46/d5a/d5f/d43/cd3 675 1 2024-04-15T21:03:03.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/979: dread d1/d26/fab [0,4194304] 0 2024-04-15T21:03:03.765 INFO:tasks.workunit.client.0.smithi072.stdout:6/971: dread d2/d42/f45 [0,4194304] 0 2024-04-15T21:03:03.770 INFO:tasks.workunit.client.0.smithi072.stdout:3/980: mknod d1/d3f/d4f/da3/c136 0 2024-04-15T21:03:03.773 INFO:tasks.workunit.client.0.smithi072.stdout:7/980: dwrite d2/d7/d25/d2d/d47/f102 [0,4194304] 0 2024-04-15T21:03:03.776 INFO:tasks.workunit.client.0.smithi072.stdout:7/981: write d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/f87 [1229121,25364] 0 2024-04-15T21:03:03.778 INFO:tasks.workunit.client.0.smithi072.stdout:1/987: dread d5/f9 [0,4194304] 0 2024-04-15T21:03:03.780 INFO:tasks.workunit.client.0.smithi072.stdout:3/981: dread d1/f74 [4194304,4194304] 0 2024-04-15T21:03:03.782 INFO:tasks.workunit.client.0.smithi072.stdout:6/972: dwrite d2/d40/d56/d95/fab [0,4194304] 0 2024-04-15T21:03:03.787 INFO:tasks.workunit.client.0.smithi072.stdout:3/982: unlink d1/f110 0 2024-04-15T21:03:03.793 INFO:tasks.workunit.client.0.smithi072.stdout:7/982: mkdir d2/d7/d25/d72/d98/de2/d143 0 2024-04-15T21:03:03.793 INFO:tasks.workunit.client.0.smithi072.stdout:3/983: dwrite d1/d3f/f116 [0,4194304] 0 2024-04-15T21:03:03.797 INFO:tasks.workunit.client.0.smithi072.stdout:7/983: dread d2/d7/d25/d2d/f44 [0,4194304] 0 2024-04-15T21:03:03.798 INFO:tasks.workunit.client.0.smithi072.stdout:6/973: write d2/d42/db9/fe1 [166625,43830] 0 2024-04-15T21:03:03.801 INFO:tasks.workunit.client.0.smithi072.stdout:1/988: creat d5/db/d27/f13c x:0 0 0 2024-04-15T21:03:03.802 INFO:tasks.workunit.client.0.smithi072.stdout:6/974: symlink d2/d40/d56/l12a 0 2024-04-15T21:03:03.809 INFO:tasks.workunit.client.0.smithi072.stdout:7/984: creat d2/d7/d25/d2d/d46/d5a/f144 x:0 0 0 2024-04-15T21:03:03.812 INFO:tasks.workunit.client.0.smithi072.stdout:7/985: dread - d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/dc9/fcd zero size 2024-04-15T21:03:03.816 INFO:tasks.workunit.client.0.smithi072.stdout:1/989: write d5/f8 [414631,15666] 0 2024-04-15T21:03:03.819 INFO:tasks.workunit.client.0.smithi072.stdout:3/984: dwrite d1/d5b/f60 [4194304,4194304] 0 2024-04-15T21:03:03.823 INFO:tasks.workunit.client.0.smithi072.stdout:1/990: getdents d5/db/d2d/d56/df0/d82/df8 0 2024-04-15T21:03:03.826 INFO:tasks.workunit.client.0.smithi072.stdout:7/986: dwrite d2/d7/d25/d2d/d46/d5a/d5f/d1f/f7d [0,4194304] 0 2024-04-15T21:03:03.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/991: mkdir d5/db/d2d/d85/dbf/d101/d13d 0 2024-04-15T21:03:03.836 INFO:tasks.workunit.client.0.smithi072.stdout:1/992: mkdir d5/db/d27/d9c/d13e 0 2024-04-15T21:03:03.837 INFO:tasks.workunit.client.0.smithi072.stdout:1/993: chown d5/db/d2d/d56/c66 9543348 1 2024-04-15T21:03:03.839 INFO:tasks.workunit.client.0.smithi072.stdout:6/975: dread d2/d10/d11/d1f/f30 [0,4194304] 0 2024-04-15T21:03:03.841 INFO:tasks.workunit.client.0.smithi072.stdout:6/976: truncate d2/d40/d66/d7f/dd9/f10a 477270 0 2024-04-15T21:03:03.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/985: link d1/c4c d1/d15/d32/d2f/df4/c137 0 2024-04-15T21:03:03.844 INFO:tasks.workunit.client.0.smithi072.stdout:7/987: symlink d2/d7/d25/d2d/d52/d6d/d128/d112/l145 0 2024-04-15T21:03:03.855 INFO:tasks.workunit.client.0.smithi072.stdout:7/988: symlink d2/d7/l146 0 2024-04-15T21:03:03.859 INFO:tasks.workunit.client.0.smithi072.stdout:6/977: truncate d2/d40/dcb/f38 660599 0 2024-04-15T21:03:03.859 INFO:tasks.workunit.client.0.smithi072.stdout:6/978: fsync d2/d42/f8b 0 2024-04-15T21:03:03.860 INFO:tasks.workunit.client.0.smithi072.stdout:6/979: chown d2/d42/dad/f103 176923868 1 2024-04-15T21:03:03.863 INFO:tasks.workunit.client.0.smithi072.stdout:7/989: symlink d2/d7/d25/d2d/d52/l147 0 2024-04-15T21:03:03.864 INFO:tasks.workunit.client.0.smithi072.stdout:7/990: fdatasync d2/d7/d25/d72/d98/d108/f123 0 2024-04-15T21:03:03.865 INFO:tasks.workunit.client.0.smithi072.stdout:7/991: truncate d2/d7/d25/d2d/d46/d5a/d5f/d26/f40 1766678 0 2024-04-15T21:03:03.866 INFO:tasks.workunit.client.0.smithi072.stdout:6/980: mkdir d2/d40/d66/da8/d11e/d12b 0 2024-04-15T21:03:03.868 INFO:tasks.workunit.client.0.smithi072.stdout:7/992: unlink d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/c8a 0 2024-04-15T21:03:03.871 INFO:tasks.workunit.client.0.smithi072.stdout:7/993: creat d2/d7/d25/d2d/d46/d5a/d5f/d1f/d38/d8d/f148 x:0 0 0 2024-04-15T21:03:03.872 INFO:tasks.workunit.client.0.smithi072.stdout:6/981: mknod d2/d42/d120/c12c 0 2024-04-15T21:03:03.876 INFO:tasks.workunit.client.0.smithi072.stdout:3/986: write d1/d15/d40/d9e/fb9 [641761,13736] 0 2024-04-15T21:03:03.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/994: dwrite d2/d7/d25/d2d/d47/f102 [4194304,4194304] 0 2024-04-15T21:03:03.880 INFO:tasks.workunit.client.0.smithi072.stdout:6/982: mkdir d2/da1/d12d 0 2024-04-15T21:03:03.882 INFO:tasks.workunit.client.0.smithi072.stdout:6/983: chown d2/d40/d56/f98 31378 1 2024-04-15T21:03:03.883 INFO:tasks.workunit.client.0.smithi072.stdout:6/984: chown d2/d10/d18/d47/d116 557 1 2024-04-15T21:03:03.886 INFO:tasks.workunit.client.0.smithi072.stdout:3/987: fsync d1/d3f/da2/fb8 0 2024-04-15T21:03:03.890 INFO:tasks.workunit.client.0.smithi072.stdout:1/994: write d5/db/d2d/d85/dbf/d101/d1f/f9a [4848049,88236] 0 2024-04-15T21:03:03.894 INFO:tasks.workunit.client.0.smithi072.stdout:6/985: creat d2/d10/d11/f12e x:0 0 0 2024-04-15T21:03:03.902 INFO:tasks.workunit.client.0.smithi072.stdout:1/995: write d5/db/d2d/d85/dbf/d101/d1f/d63/d100/f121 [58460,60741] 0 2024-04-15T21:03:03.912 INFO:tasks.workunit.client.0.smithi072.stdout:6/986: dread d2/d10/d18/d47/d6d/f87 [0,4194304] 0 2024-04-15T21:03:03.942 INFO:tasks.workunit.client.0.smithi072.stdout:3/988: dwrite d1/d3f/da2/fb8 [0,4194304] 0 2024-04-15T21:03:03.947 INFO:tasks.workunit.client.0.smithi072.stdout:7/995: write d2/d7/d25/f8b [256974,464] 0 2024-04-15T21:03:03.949 INFO:tasks.workunit.client.0.smithi072.stdout:3/989: rename d1/d15/f98 to d1/d15/d40/f138 0 2024-04-15T21:03:03.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/996: creat d2/d7/d25/d4c/f149 x:0 0 0 2024-04-15T21:03:03.951 INFO:tasks.workunit.client.0.smithi072.stdout:1/996: write d5/db/d2d/d85/dbf/d101/d1f/f98 [925583,30070] 0 2024-04-15T21:03:03.952 INFO:tasks.workunit.client.0.smithi072.stdout:7/997: write d2/d7/d25/d2d/d47/f102 [7813163,13730] 0 2024-04-15T21:03:03.953 INFO:tasks.workunit.client.0.smithi072.stdout:1/997: write d5/db/d2d/f8b [3853400,104039] 0 2024-04-15T21:03:03.957 INFO:tasks.workunit.client.0.smithi072.stdout:1/998: getdents d5/db/d2d/d56/d93 0 2024-04-15T21:03:03.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/999: mkdir d5/d31/d13f 0 2024-04-15T21:03:04.107 INFO:tasks.workunit.client.0.smithi072.stdout:6/987: sync 2024-04-15T21:03:04.111 INFO:tasks.workunit.client.0.smithi072.stdout:6/988: unlink d2/d40/d66/da8/led 0 2024-04-15T21:03:04.117 INFO:tasks.workunit.client.0.smithi072.stdout:6/989: dwrite d2/d40/d56/d95/fdf [0,4194304] 0 2024-04-15T21:03:04.125 INFO:tasks.workunit.client.0.smithi072.stdout:6/990: getdents d2/d10 0 2024-04-15T21:03:04.130 INFO:tasks.workunit.client.0.smithi072.stdout:6/991: truncate d2/d40/f81 560466 0 2024-04-15T21:03:04.137 INFO:tasks.workunit.client.0.smithi072.stdout:6/992: rmdir d2/d40/d56/d6a/d11b/d113 0 2024-04-15T21:03:04.139 INFO:tasks.workunit.client.0.smithi072.stdout:6/993: write d2/d10/d11/d1f/f28 [5337601,37219] 0 2024-04-15T21:03:04.140 INFO:tasks.workunit.client.0.smithi072.stdout:7/998: sync 2024-04-15T21:03:04.140 INFO:tasks.workunit.client.0.smithi072.stdout:3/990: sync 2024-04-15T21:03:04.144 INFO:tasks.workunit.client.0.smithi072.stdout:7/999: dread d2/d7/d25/fed [0,4194304] 0 2024-04-15T21:03:04.145 INFO:tasks.workunit.client.0.smithi072.stdout:3/991: truncate d1/d15/d32/f81 1120969 0 2024-04-15T21:03:04.147 INFO:tasks.workunit.client.0.smithi072.stdout:3/992: creat d1/d3f/d4f/d73/f139 x:0 0 0 2024-04-15T21:03:04.148 INFO:tasks.workunit.client.0.smithi072.stdout:3/993: mknod d1/d3f/d10e/c13a 0 2024-04-15T21:03:04.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/994: dread d2/d40/d56/d6a/fd0 [0,4194304] 0 2024-04-15T21:03:04.150 INFO:tasks.workunit.client.0.smithi072.stdout:3/994: mknod d1/d3f/d10e/c13b 0 2024-04-15T21:03:04.151 INFO:tasks.workunit.client.0.smithi072.stdout:6/995: creat d2/d40/d66/d7f/dd9/f12f x:0 0 0 2024-04-15T21:03:04.153 INFO:tasks.workunit.client.0.smithi072.stdout:6/996: chown d2/d40/d56/d95/l9e 158 1 2024-04-15T21:03:04.155 INFO:tasks.workunit.client.0.smithi072.stdout:3/995: dwrite d1/f10c [0,4194304] 0 2024-04-15T21:03:04.156 INFO:tasks.workunit.client.0.smithi072.stdout:6/997: symlink d2/d40/d6e/d112/l130 0 2024-04-15T21:03:04.163 INFO:tasks.workunit.client.0.smithi072.stdout:3/996: getdents d1/d3f/d4f/d73/d11b 0 2024-04-15T21:03:04.164 INFO:tasks.workunit.client.0.smithi072.stdout:6/998: getdents d2/d40/d66/da8 0 2024-04-15T21:03:04.167 INFO:tasks.workunit.client.0.smithi072.stdout:6/999: stat d2/d42/dad/fb8 0 2024-04-15T21:03:04.169 INFO:tasks.workunit.client.0.smithi072.stdout:3/997: rename d1/d15/d40/dff/d125/d134 to d1/d3f/d4f/d73/db3/dd5/d129/d13c 0 2024-04-15T21:03:04.174 INFO:tasks.workunit.client.0.smithi072.stdout:3/998: dwrite d1/f8f [4194304,4194304] 0 2024-04-15T21:03:04.183 INFO:tasks.workunit.client.0.smithi072.stdout:3/999: link d1/d15/d32/d78/c9b d1/d3f/d4f/d73/db3/dd5/d129/d13c/c13d 0 2024-04-15T21:03:04.186 INFO:tasks.workunit.client.0.smithi072.stderr:+ rm -rf -- ./tmp.tOuWzzvqjV 2024-04-15T21:03:04.282 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:03 smithi072 ceph-mon[29079]: pgmap v16: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 75 MiB/s rd, 192 MiB/s wr, 402 op/s 2024-04-15T21:03:04.422 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:03 smithi149 ceph-mon[36029]: pgmap v16: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 75 MiB/s rd, 192 MiB/s wr, 402 op/s 2024-04-15T21:03:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 -- 172.21.15.72:0/571068783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 msgr2=0x7fc2d4100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 --2- 172.21.15.72:0/571068783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4100660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009910 tx=0x7fc2d0009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 -- 172.21.15.72:0/571068783 shutdown_connections 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 --2- 172.21.15.72:0/571068783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 0x7fc2d41018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 --2- 172.21.15.72:0/571068783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4100660 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 -- 172.21.15.72:0/571068783 >> 172.21.15.72:0/571068783 conn(0x7fc2d40fb7e0 msgr2=0x7fc2d40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 -- 172.21.15.72:0/571068783 shutdown_connections 2024-04-15T21:03:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.341+0000 7fc2dc207700 1 -- 172.21.15.72:0/571068783 wait complete. 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 Processor -- start 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 -- start start 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 0x7fc2d4073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4073680 con 0x7fc2d4100250 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2dc207700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40737c0 con 0x7fc2d4101450 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55960/0 (socket says 172.21.15.72:55960) 2024-04-15T21:03:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 -- 172.21.15.72:0/3639203371 learned_addr learned my addr 172.21.15.72:0/3639203371 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d97a2700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 0x7fc2d4073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 -- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 msgr2=0x7fc2d4073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 0x7fc2d4073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.342+0000 7fc2d9fa3700 1 -- 172.21.15.72:0/3639203371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00095f0 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2d9fa3700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000bd70 tx=0x7fc2d000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d001d070 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4073a40 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2d000f460 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d0021640 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.343+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d4073f30 con 0x7fc2d4100250 2024-04-15T21:03:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.344+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4108da0 con 0x7fc2d4100250 2024-04-15T21:03:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.344+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7fc2d000fab0 con 0x7fc2d4100250 2024-04-15T21:03:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.345+0000 7fc2caffd700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 0x7fc2c006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.345+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc2d008e520 con 0x7fc2d4100250 2024-04-15T21:03:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.345+0000 7fc2d97a2700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 0x7fc2c006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.346+0000 7fc2d97a2700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 0x7fc2c006fdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005950 tx=0x7fc2c400b410 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.350+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7fc2d005b210 con 0x7fc2d4100250 2024-04-15T21:03:05.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.604+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 --> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2d419dfc0 con 0x7fc2c006d920 2024-04-15T21:03:05.597 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: pgmap v17: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 104 MiB/s rd, 244 MiB/s wr, 555 op/s 2024-04-15T21:03:05.597 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:05.597 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:05.597 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:05.597 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:05.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:05 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:05.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.610+0000 7fc2caffd700 1 -- 172.21.15.72:0/3639203371 <== mgr.24423 v2:172.21.15.149:6828/2367773940 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc2d419dfc0 con 0x7fc2c006d920 2024-04-15T21:03:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 msgr2=0x7fc2c006fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 0x7fc2c006fdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005950 tx=0x7fc2c400b410 comp rx=0 tx=0).stop 2024-04-15T21:03:05.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 msgr2=0x7fc2d4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000bd70 tx=0x7fc2d000bda0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 shutdown_connections 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fc2c006d920 0x7fc2c006fdd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2d4100250 0x7fc2d4074af0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 --2- 172.21.15.72:0/3639203371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2d4101450 0x7fc2d4073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 >> 172.21.15.72:0/3639203371 conn(0x7fc2d40fb7e0 msgr2=0x7fc2d4104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:05.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 shutdown_connections 2024-04-15T21:03:05.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.613+0000 7fc2dc207700 1 -- 172.21.15.72:0/3639203371 wait complete. 2024-04-15T21:03:05.616 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:03:05.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- 172.21.15.72:0/1486225090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 msgr2=0x7f5bfc1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/1486225090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc1018a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009910 tx=0x7f5bf0009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:05.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- 172.21.15.72:0/1486225090 shutdown_connections 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/1486225090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc1018a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/1486225090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 0x7f5bfc100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- 172.21.15.72:0/1486225090 >> 172.21.15.72:0/1486225090 conn(0x7f5bfc0fb7e0 msgr2=0x7f5bfc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- 172.21.15.72:0/1486225090 shutdown_connections 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- 172.21.15.72:0/1486225090 wait complete. 2024-04-15T21:03:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 Processor -- start 2024-04-15T21:03:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.730+0000 7f5c01fb6700 1 -- start start 2024-04-15T21:03:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 0x7f5bfc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc073680 con 0x7f5bfc101450 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0737c0 con 0x7f5bfc100250 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55970/0 (socket says 172.21.15.72:55970) 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 -- 172.21.15.72:0/490027714 learned_addr learned my addr 172.21.15.72:0/490027714 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfb7fe700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 0x7f5bfc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 -- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 msgr2=0x7f5bfc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 0x7f5bfc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 -- 172.21.15.72:0/490027714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00095f0 con 0x7f5bfc101450 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bfaffd700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0000c00 tx=0x7f5bf000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf001d070 con 0x7f5bfc101450 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bf0005dc0 con 0x7f5bfc101450 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc073a40 con 0x7f5bfc101450 2024-04-15T21:03:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf00226a0 con 0x7f5bfc101450 2024-04-15T21:03:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.731+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc073f30 con 0x7f5bfc101450 2024-04-15T21:03:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.732+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc108da0 con 0x7f5bfc101450 2024-04-15T21:03:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.733+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7f5bf00038f0 con 0x7f5bfc101450 2024-04-15T21:03:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.733+0000 7f5bf8ff9700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 0x7f5be406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.733+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5bf008e830 con 0x7f5bfc101450 2024-04-15T21:03:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.733+0000 7f5bfb7fe700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 0x7f5be406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.734+0000 7f5bfb7fe700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 0x7f5be406fdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc1012b0 tx=0x7f5bec009260 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:05.738+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f5bf005b480 con 0x7f5bfc101450 2024-04-15T21:03:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: pgmap v17: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 104 MiB/s rd, 244 MiB/s wr, 555 op/s 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:03:05.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:05.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:05.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:05.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:05 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.007+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 --> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bfc19df80 con 0x7f5be406d920 2024-04-15T21:03:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.008+0000 7f5bf8ff9700 1 -- 172.21.15.72:0/490027714 <== mgr.24423 v2:172.21.15.149:6828/2367773940 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5bfc19df80 con 0x7f5be406d920 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 msgr2=0x7f5be406fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 0x7f5be406fdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc1012b0 tx=0x7f5bec009260 comp rx=0 tx=0).stop 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 msgr2=0x7f5bfc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0000c00 tx=0x7f5bf000f690 comp rx=0 tx=0).stop 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 shutdown_connections 2024-04-15T21:03:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f5be406d920 0x7f5be406fdd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bfc100250 0x7f5bfc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 --2- 172.21.15.72:0/490027714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bfc101450 0x7f5bfc073140 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 >> 172.21.15.72:0/490027714 conn(0x7f5bfc0fb7e0 msgr2=0x7f5bfc104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 shutdown_connections 2024-04-15T21:03:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.010+0000 7f5c01fb6700 1 -- 172.21.15.72:0/490027714 wait complete. 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1889334531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e041014e0 msgr2=0x7f6e04101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1889334531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e041014e0 0x7f6e04101950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009910 tx=0x7f6df8009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1889334531 shutdown_connections 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1889334531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e041014e0 0x7f6e04101950 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1889334531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e04100240 0x7f6e04100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1889334531 >> 172.21.15.72:0/1889334531 conn(0x7f6e040fb890 msgr2=0x7f6e040fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1889334531 shutdown_connections 2024-04-15T21:03:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.123+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1889334531 wait complete. 2024-04-15T21:03:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.124+0000 7f6e08a8a700 1 Processor -- start 2024-04-15T21:03:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.124+0000 7f6e08a8a700 1 -- start start 2024-04-15T21:03:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.124+0000 7f6e08a8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e08a8a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e041014e0 0x7f6e04195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e08a8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04196610 con 0x7f6e04100240 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e08a8a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04196750 con 0x7f6e041014e0 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55986/0 (socket says 172.21.15.72:55986) 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 -- 172.21.15.72:0/1591757267 learned_addr learned my addr 172.21.15.72:0/1591757267 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e01d9b700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e041014e0 0x7f6e04195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 -- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e041014e0 msgr2=0x7f6e04195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e041014e0 0x7f6e04195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 -- 172.21.15.72:0/1591757267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80095f0 con 0x7f6e04100240 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e0259c700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e940 tx=0x7f6df400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df400cba0 con 0x7f6e04100240 2024-04-15T21:03:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6df400ee90 con 0x7f6e04100240 2024-04-15T21:03:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.125+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0419b200 con 0x7f6e04100240 2024-04-15T21:03:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.126+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df4005650 con 0x7f6e04100240 2024-04-15T21:03:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.126+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0419b750 con 0x7f6e04100240 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.127+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04108d40 con 0x7f6e04100240 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.127+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7f6df4004750 con 0x7f6e04100240 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.128+0000 7f6df37fe700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 0x7f6dec06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.128+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6df4014070 con 0x7f6e04100240 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.128+0000 7f6e01d9b700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 0x7f6dec06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.129+0000 7f6e01d9b700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 0x7f6dec06fdd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009fd0 tx=0x7f6df8005940 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.133+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f6df405a410 con 0x7f6e04100240 2024-04-15T21:03:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.372+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 --> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e0419b390 con 0x7f6dec06d920 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.385+0000 7f6df37fe700 1 -- 172.21.15.72:0/1591757267 <== mgr.24423 v2:172.21.15.149:6828/2367773940 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6e0419b390 con 0x7f6dec06d920 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (7m) 8s ago 9m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (9m) 8s ago 9m 7658k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (8m) 7s ago 8m 7591k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:03:06.378 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (9m) 8s ago 9m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (8m) 7s ago 8m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (7m) 8s ago 8m 83.5M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (3m) 8s ago 3m 15.3M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (3m) 8s ago 3m 13.7M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (3m) 7s ago 3m 15.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (3m) 7s ago 3m 233M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:9283,8765,8443 running (10m) 8s ago 10m 433M - 18.2.0 dc2bc1663786 fa35a6a00dcf 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (54s) 7s ago 8m 491M - 19.0.0-3084-g87dbfb63 a452a57266c7 6ee5d0e0d775 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (10m) 8s ago 10m 54.5M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (8m) 7s ago 8m 41.9M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (9m) 8s ago 9m 15.9M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 7s ago 8m 16.9M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 8s ago 7m 205M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:03:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 8s ago 6m 200M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 8s ago 6m 168M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (5m) 7s ago 5m 227M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (5m) 7s ago 5m 197M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (5m) 7s ago 5m 214M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (7m) 8s ago 8m 67.2M - 2.43.0 a07b618ecd1d 3b69be8e7534 2024-04-15T21:03:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 msgr2=0x7f6dec06fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 0x7f6dec06fdd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009fd0 tx=0x7f6df8005940 comp rx=0 tx=0).stop 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 msgr2=0x7f6e04195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e940 tx=0x7f6df400ec50 comp rx=0 tx=0).stop 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 shutdown_connections 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6dec06d920 0x7f6dec06fdd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e04100240 0x7f6e04195ab0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 --2- 172.21.15.72:0/1591757267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e041014e0 0x7f6e04195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 >> 172.21.15.72:0/1591757267 conn(0x7f6e040fb890 msgr2=0x7f6e04104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 shutdown_connections 2024-04-15T21:03:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.388+0000 7f6e08a8a700 1 -- 172.21.15.72:0/1591757267 wait complete. 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 -- 172.21.15.72:0/3799280083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0069230 msgr2=0x7f24f0102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 --2- 172.21.15.72:0/3799280083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0069230 0x7f24f0102e10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009910 tx=0x7f24ec009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 -- 172.21.15.72:0/3799280083 shutdown_connections 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 --2- 172.21.15.72:0/3799280083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0103350 0x7f24f0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 --2- 172.21.15.72:0/3799280083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0069230 0x7f24f0102e10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 -- 172.21.15.72:0/3799280083 >> 172.21.15.72:0/3799280083 conn(0x7f24f00fa780 msgr2=0x7f24f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 -- 172.21.15.72:0/3799280083 shutdown_connections 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.504+0000 7f24f74f6700 1 -- 172.21.15.72:0/3799280083 wait complete. 2024-04-15T21:03:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 Processor -- start 2024-04-15T21:03:06.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 -- start start 2024-04-15T21:03:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0069230 0x7f24f0195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01965e0 con 0x7f24f0103350 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f74f6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0196720 con 0x7f24f0069230 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56012/0 (socket says 172.21.15.72:56012) 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 -- 172.21.15.72:0/2436754908 learned_addr learned my addr 172.21.15.72:0/2436754908 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f5292700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0069230 0x7f24f0195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 -- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0069230 msgr2=0x7f24f0195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0069230 0x7f24f0195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 -- 172.21.15.72:0/2436754908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0095f0 con 0x7f24f0103350 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.505+0000 7f24f4a91700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e920 tx=0x7f24e000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.506+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e000c9d0 con 0x7f24f0103350 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.506+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24e0010430 con 0x7f24f0103350 2024-04-15T21:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.506+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f019b1d0 con 0x7f24f0103350 2024-04-15T21:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.506+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e0018650 con 0x7f24f0103350 2024-04-15T21:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.506+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f019b720 con 0x7f24f0103350 2024-04-15T21:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.507+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f0108cf0 con 0x7f24f0103350 2024-04-15T21:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.507+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7f24e00105a0 con 0x7f24f0103350 2024-04-15T21:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.508+0000 7f24e67fc700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 0x7f24dc06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.508+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f24e0014070 con 0x7f24f0103350 2024-04-15T21:03:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.508+0000 7f24f5292700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 0x7f24dc06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.509+0000 7f24f5292700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 0x7f24dc06fdd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0059d0 tx=0x7f24ec005940 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.513+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f24e0053ca0 con 0x7f24f0103350 2024-04-15T21:03:06.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.860+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24f0108eb0 con 0x7f24f0103350 2024-04-15T21:03:06.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.860+0000 7f24e67fc700 1 -- 172.21.15.72:0/2436754908 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f24e0056070 con 0x7f24f0103350 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:03:06.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:03:06.854 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:03:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 msgr2=0x7f24dc06fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 0x7f24dc06fdd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0059d0 tx=0x7f24ec005940 comp rx=0 tx=0).stop 2024-04-15T21:03:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 msgr2=0x7f24f0195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24e000e920 tx=0x7f24e000ec30 comp rx=0 tx=0).stop 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 shutdown_connections 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f24dc06d920 0x7f24dc06fdd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24f0069230 0x7f24f0195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 --2- 172.21.15.72:0/2436754908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24f0103350 0x7f24f0195fc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 >> 172.21.15.72:0/2436754908 conn(0x7f24f00fa780 msgr2=0x7f24f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 shutdown_connections 2024-04-15T21:03:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.863+0000 7f24f74f6700 1 -- 172.21.15.72:0/2436754908 wait complete. 2024-04-15T21:03:06.886 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:06.886 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T21:03:06.887 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:06 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T21:03:06.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:06 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 -- 172.21.15.72:0/1142311406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 msgr2=0x7f6b6c0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 --2- 172.21.15.72:0/1142311406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c0ffa70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009910 tx=0x7f6b68009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 -- 172.21.15.72:0/1142311406 shutdown_connections 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 --2- 172.21.15.72:0/1142311406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 0x7f6b6c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 --2- 172.21.15.72:0/1142311406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c0ffa70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 -- 172.21.15.72:0/1142311406 >> 172.21.15.72:0/1142311406 conn(0x7f6b6c0f9f10 msgr2=0x7f6b6c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 -- 172.21.15.72:0/1142311406 shutdown_connections 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.977+0000 7f6b73aad700 1 -- 172.21.15.72:0/1142311406 wait complete. 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 Processor -- start 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 -- start start 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 0x7f6b6c196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1966a0 con 0x7f6b6c0ff660 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b73aad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1967e0 con 0x7f6b6c0fffb0 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56036/0 (socket says 172.21.15.72:56036) 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 -- 172.21.15.72:0/3052944776 learned_addr learned my addr 172.21.15.72:0/3052944776 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71048700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 0x7f6b6c196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 -- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 msgr2=0x7f6b6c196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 0x7f6b6c196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 -- 172.21.15.72:0/3052944776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680095f0 con 0x7f6b6c0ff660 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.978+0000 7f6b71849700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800bda0 tx=0x7f6b6800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.979+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b6801d070 con 0x7f6b6c0ff660 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.979+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c19b230 con 0x7f6b6c0ff660 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.979+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b6800f460 con 0x7f6b6c0ff660 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.979+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b68021640 con 0x7f6b6c0ff660 2024-04-15T21:03:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.979+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c19b720 con 0x7f6b6c0ff660 2024-04-15T21:03:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.980+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c108d20 con 0x7f6b6c0ff660 2024-04-15T21:03:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.980+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7f6b6800f5d0 con 0x7f6b6c0ff660 2024-04-15T21:03:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.981+0000 7f6b62ffd700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 0x7f6b5806fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.981+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6b6808e580 con 0x7f6b6c0ff660 2024-04-15T21:03:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.981+0000 7f6b71048700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 0x7f6b5806fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.981+0000 7f6b71048700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 0x7f6b5806fdd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0ff390 tx=0x7f6b5c0073d0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:06.986+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f6b6805b270 con 0x7f6b6c0ff660 2024-04-15T21:03:07.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.334+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b6c19c0b0 con 0x7f6b6c0ff660 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.334+0000 7f6b62ffd700 1 -- 172.21.15.72:0/3052944776 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f6b6808ce60 con 0x7f6b6c0ff660 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:03:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:03:07.328 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:03:07.329 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:07.330 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:07.330 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:07.330 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 msgr2=0x7f6b5806fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 0x7f6b5806fdd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0ff390 tx=0x7f6b5c0073d0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 msgr2=0x7f6b6c195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800bda0 tx=0x7f6b6800bdd0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 shutdown_connections 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f6b5806d920 0x7f6b5806fdd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0ff660 0x7f6b6c195b40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 --2- 172.21.15.72:0/3052944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6c0fffb0 0x7f6b6c196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 >> 172.21.15.72:0/3052944776 conn(0x7f6b6c0f9f10 msgr2=0x7f6b6c103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 shutdown_connections 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.337+0000 7f6b73aad700 1 -- 172.21.15.72:0/3052944776 wait complete. 2024-04-15T21:03:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 -- 172.21.15.72:0/1268317407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc102210 msgr2=0x7f73bc0fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 --2- 172.21.15.72:0/1268317407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc102210 0x7f73bc0fe340 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009910 tx=0x7f73b0009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 -- 172.21.15.72:0/1268317407 shutdown_connections 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 --2- 172.21.15.72:0/1268317407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc102210 0x7f73bc0fe340 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 --2- 172.21.15.72:0/1268317407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc1018c0 0x7f73bc101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 -- 172.21.15.72:0/1268317407 >> 172.21.15.72:0/1268317407 conn(0x7f73bc0f9f10 msgr2=0x7f73bc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 -- 172.21.15.72:0/1268317407 shutdown_connections 2024-04-15T21:03:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.444+0000 7f73c0993700 1 -- 172.21.15.72:0/1268317407 wait complete. 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 Processor -- start 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 -- start start 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc102210 0x7f73bc1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1966e0 con 0x7f73bc1018c0 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73c0993700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc196820 con 0x7f73bc102210 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73ba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73ba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56052/0 (socket says 172.21.15.72:56052) 2024-04-15T21:03:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73ba59c700 1 -- 172.21.15.72:0/2497913831 learned_addr learned my addr 172.21.15.72:0/2497913831 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.445+0000 7f73b9d9b700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc102210 0x7f73bc1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ba59c700 1 -- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc102210 msgr2=0x7f73bc1960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ba59c700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc102210 0x7f73bc1960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ba59c700 1 -- 172.21.15.72:0/2497913831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00095f0 con 0x7f73bc1018c0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ba59c700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b4b0 tx=0x7f73ac00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73ac011800 con 0x7f73bc1018c0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73ac011e10 con 0x7f73bc1018c0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73ac00f2e0 con 0x7f73bc1018c0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc19b2d0 con 0x7f73bc1018c0 2024-04-15T21:03:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.446+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc19b820 con 0x7f73bc1018c0 2024-04-15T21:03:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.447+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc108db0 con 0x7f73bc1018c0 2024-04-15T21:03:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.447+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7f73ac011960 con 0x7f73bc1018c0 2024-04-15T21:03:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.448+0000 7f73ab7fe700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 0x7f73a406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.448+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f73ac08cce0 con 0x7f73bc1018c0 2024-04-15T21:03:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.448+0000 7f73b9d9b700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 0x7f73a406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.449+0000 7f73b9d9b700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 0x7f73a406fdd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73b0006010 tx=0x7f73b000b540 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.453+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f73ac059b60 con 0x7f73bc1018c0 2024-04-15T21:03:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.691+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 --> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73bc19bf10 con 0x7f73a406d920 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.692+0000 7f73ab7fe700 1 -- 172.21.15.72:0/2497913831 <== mgr.24423 v2:172.21.15.149:6828/2367773940 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f73bc19bf10 con 0x7f73a406d920 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:03:07.684 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:03:07.685 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "1/23 daemons upgraded", 2024-04-15T21:03:07.685 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-04-15T21:03:07.685 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:03:07.685 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 msgr2=0x7f73a406fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 0x7f73a406fdd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73b0006010 tx=0x7f73b000b540 comp rx=0 tx=0).stop 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 msgr2=0x7f73bc195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b4b0 tx=0x7f73ac00b7c0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 shutdown_connections 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7f73a406d920 0x7f73a406fdd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73bc1018c0 0x7f73bc195b80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 --2- 172.21.15.72:0/2497913831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73bc102210 0x7f73bc1960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 >> 172.21.15.72:0/2497913831 conn(0x7f73bc0f9f10 msgr2=0x7f73bc104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 shutdown_connections 2024-04-15T21:03:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.694+0000 7f73c0993700 1 -- 172.21.15.72:0/2497913831 wait complete. 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 -- 172.21.15.72:0/2160051722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 msgr2=0x7fec640ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 --2- 172.21.15.72:0/2160051722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec640ff560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec58009910 tx=0x7fec58009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 -- 172.21.15.72:0/2160051722 shutdown_connections 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 --2- 172.21.15.72:0/2160051722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 0x7fec64100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 --2- 172.21.15.72:0/2160051722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec640ff560 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 -- 172.21.15.72:0/2160051722 >> 172.21.15.72:0/2160051722 conn(0x7fec640fa7a0 msgr2=0x7fec640fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 -- 172.21.15.72:0/2160051722 shutdown_connections 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.807+0000 7fec6ac77700 1 -- 172.21.15.72:0/2160051722 wait complete. 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 Processor -- start 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 -- start start 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 0x7fec64195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64195870 con 0x7fec640ff150 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec6ac77700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6419a280 con 0x7fec641003f0 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec68a13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec68a13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56066/0 (socket says 172.21.15.72:56066) 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.808+0000 7fec68a13700 1 -- 172.21.15.72:0/199566464 learned_addr learned my addr 172.21.15.72:0/199566464 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec63fff700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 0x7fec64195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec68a13700 1 -- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 msgr2=0x7fec64195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec68a13700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 0x7fec64195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec68a13700 1 -- 172.21.15.72:0/199566464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580095f0 con 0x7fec640ff150 2024-04-15T21:03:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec68a13700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec58000c00 tx=0x7fec5800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5801d070 con 0x7fec640ff150 2024-04-15T21:03:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec58005dc0 con 0x7fec640ff150 2024-04-15T21:03:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec580226a0 con 0x7fec640ff150 2024-04-15T21:03:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6419a420 con 0x7fec640ff150 2024-04-15T21:03:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.809+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6419a8e0 con 0x7fec640ff150 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.810+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64068ab0 con 0x7fec640ff150 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.811+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91360+0+0 (secure 0 0 0) 0x7fec580038f0 con 0x7fec640ff150 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.811+0000 7fec61ffb700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 0x7fec5406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.811+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fec5808e700 con 0x7fec640ff150 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.812+0000 7fec63fff700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 0x7fec5406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:07.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.812+0000 7fec63fff700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 0x7fec5406fdd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec50009c60 tx=0x7fec50009260 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:07.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:07.816+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7fec58057940 con 0x7fec640ff150 2024-04-15T21:03:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.152+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fec6419ab20 con 0x7fec640ff150 2024-04-15T21:03:08.145 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:07 smithi072 ceph-mon[29079]: pgmap v18: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 72 MiB/s rd, 160 MiB/s wr, 380 op/s 2024-04-15T21:03:08.145 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:07 smithi072 ceph-mon[29079]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:08.145 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:07 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2436754908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:03:08.145 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:07 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/3052944776' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:03:08.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.152+0000 7fec61ffb700 1 -- 172.21.15.72:0/199566464 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fec58003680 con 0x7fec640ff150 2024-04-15T21:03:08.146 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:03:08.146 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:03:08.146 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 msgr2=0x7fec5406fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 0x7fec5406fdd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec50009c60 tx=0x7fec50009260 comp rx=0 tx=0).stop 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 msgr2=0x7fec64194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec58000c00 tx=0x7fec5800f690 comp rx=0 tx=0).stop 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 shutdown_connections 2024-04-15T21:03:08.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:6828/2367773940,v1:172.21.15.149:6829/2367773940] conn(0x7fec5406d920 0x7fec5406fdd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:08.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec640ff150 0x7fec64194d10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:08.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 --2- 172.21.15.72:0/199566464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec641003f0 0x7fec64195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:08.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 >> 172.21.15.72:0/199566464 conn(0x7fec640fa7a0 msgr2=0x7fec641036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:08.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 shutdown_connections 2024-04-15T21:03:08.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:08.155+0000 7fec6ac77700 1 -- 172.21.15.72:0/199566464 wait complete. 2024-04-15T21:03:08.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:07 smithi149 ceph-mon[36029]: pgmap v18: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 72 MiB/s rd, 160 MiB/s wr, 380 op/s 2024-04-15T21:03:08.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:07 smithi149 ceph-mon[36029]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:08.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:07 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2436754908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:03:08.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:07 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3052944776' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:03:09.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:08 smithi072 ceph-mon[29079]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:09.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:08 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/199566464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:03:09.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:08 smithi149 ceph-mon[36029]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:09.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:08 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/199566464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:03:10.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:09 smithi072 ceph-mon[29079]: pgmap v19: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 87 MiB/s rd, 184 MiB/s wr, 500 op/s 2024-04-15T21:03:10.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:09 smithi149 ceph-mon[36029]: pgmap v19: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 87 MiB/s rd, 184 MiB/s wr, 500 op/s 2024-04-15T21:03:11.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:11 smithi072 ceph-mon[29079]: pgmap v20: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 97 MiB/s wr, 307 op/s 2024-04-15T21:03:12.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:11 smithi149 ceph-mon[36029]: pgmap v20: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 97 MiB/s wr, 307 op/s 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: Upgrade: Need to upgrade myself (mgr.smithi149.qgbaiy) 2024-04-15T21:03:13.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:12 smithi149 ceph-mon[36029]: Upgrade: Need to upgrade myself (mgr.smithi149.qgbaiy) 2024-04-15T21:03:13.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:13.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:13.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:13.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:13.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:13.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: Upgrade: Need to upgrade myself (mgr.smithi149.qgbaiy) 2024-04-15T21:03:13.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:12 smithi072 ceph-mon[29079]: Upgrade: Need to upgrade myself (mgr.smithi149.qgbaiy) 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: pgmap v21: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 97 MiB/s wr, 313 op/s 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:03:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:13 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: pgmap v21: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 53 MiB/s rd, 97 MiB/s wr, 313 op/s 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:03:14.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:13 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:15.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:14 smithi149 ceph-mon[36029]: Upgrade: Updating mgr.smithi072.wfjmmp 2024-04-15T21:03:15.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:14 smithi149 ceph-mon[36029]: Deploying daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T21:03:15.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:14 smithi072 ceph-mon[29079]: Upgrade: Updating mgr.smithi072.wfjmmp 2024-04-15T21:03:15.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:14 smithi072 ceph-mon[29079]: Deploying daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T21:03:16.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:15 smithi149 ceph-mon[36029]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 90 MiB/s wr, 377 op/s 2024-04-15T21:03:16.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:15 smithi072 ceph-mon[29079]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 90 MiB/s wr, 377 op/s 2024-04-15T21:03:18.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:17 smithi072 ceph-mon[29079]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 204 op/s 2024-04-15T21:03:18.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:17 smithi149 ceph-mon[36029]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 15 MiB/s rd, 24 MiB/s wr, 204 op/s 2024-04-15T21:03:18.837 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-15T21:03:18.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-15T21:03:19.606 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 15 MiB/s rd, 25 MiB/s wr, 283 op/s 2024-04-15T21:03:19.606 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.606 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.606 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:19.607 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.607 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:19 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 15 MiB/s rd, 25 MiB/s wr, 283 op/s 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:19.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:19 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:20.893 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-15T21:03:20.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-15T21:03:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:21 smithi072 ceph-mon[29079]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-04-15T21:03:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:21 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:21 smithi149 ceph-mon[36029]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-04-15T21:03:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:21 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:23.768 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:23 smithi072 ceph-mon[29079]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 35 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-15T21:03:23.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:23 smithi149 ceph-mon[36029]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 35 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-04-15T21:03:25.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:25 smithi149 ceph-mon[36029]: pgmap v27: 65 pgs: 65 active+clean; 502 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-04-15T21:03:25.840 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:25 smithi072 ceph-mon[29079]: pgmap v27: 65 pgs: 65 active+clean; 502 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: Standby manager daemon smithi072.wfjmmp restarted 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: Standby manager daemon smithi072.wfjmmp started 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/crt"}]: dispatch 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/key"}]: dispatch 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:26.873 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:26 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: Standby manager daemon smithi072.wfjmmp restarted 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: Standby manager daemon smithi072.wfjmmp started 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/crt"}]: dispatch 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.wfjmmp/key"}]: dispatch 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:26.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:26 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:27.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:27 smithi072 ceph-mon[29079]: pgmap v28: 65 pgs: 65 active+clean; 502 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-04-15T21:03:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:27 smithi072 ceph-mon[29079]: mgrmap e26: smithi149.qgbaiy(active, since 50s), standbys: smithi072.wfjmmp 2024-04-15T21:03:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:27 smithi149 ceph-mon[36029]: pgmap v28: 65 pgs: 65 active+clean; 502 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-04-15T21:03:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:27 smithi149 ceph-mon[36029]: mgrmap e26: smithi149.qgbaiy(active, since 50s), standbys: smithi072.wfjmmp 2024-04-15T21:03:29.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:28 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:29.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:28 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:29.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:28 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:29.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:28 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:30.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:29 smithi072 ceph-mon[29079]: pgmap v29: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-04-15T21:03:30.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:29 smithi149 ceph-mon[36029]: pgmap v29: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-04-15T21:03:32.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: pgmap v30: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-04-15T21:03:32.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:32.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:32.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:32.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:32.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:32.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: osdmap e48: 6 total, 6 up, 6 in 2024-04-15T21:03:32.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd='[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]': finished 2024-04-15T21:03:32.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: mgrmap e27: smithi072.wfjmmp(active, starting, since 0.00575376s) 2024-04-15T21:03:32.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:03:32.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:03:32.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:03:32.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:03:32.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:03:32.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:03:32.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T21:03:32.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:03:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:31 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T21:03:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: pgmap v30: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-04-15T21:03:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 172.21.15.149:0/3320736161' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:32.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: osdmap e48: 6 total, 6 up, 6 in 2024-04-15T21:03:32.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.24423 ' entity='mgr.smithi149.qgbaiy' cmd='[{"prefix": "mgr fail", "who": "smithi149.qgbaiy"}]': finished 2024-04-15T21:03:32.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: mgrmap e27: smithi072.wfjmmp(active, starting, since 0.00575376s) 2024-04-15T21:03:32.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:03:32.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:03:32.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:03:32.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:03:32.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:03:32.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:03:32.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:03:32.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:03:32.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:03:32.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:03:32.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:03:32.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T21:03:32.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:32.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:32.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:03:32.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:31 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T21:03:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:33 smithi149 ceph-mon[36029]: mgrmap e28: smithi072.wfjmmp(active, since 1.00869s) 2024-04-15T21:03:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:33 smithi149 ceph-mon[36029]: [15/Apr/2024:21:03:32] ENGINE Bus STARTING 2024-04-15T21:03:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:33 smithi149 ceph-mon[36029]: [15/Apr/2024:21:03:32] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T21:03:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:33 smithi149 ceph-mon[36029]: [15/Apr/2024:21:03:32] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T21:03:33.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:33 smithi149 ceph-mon[36029]: [15/Apr/2024:21:03:32] ENGINE Bus STARTED 2024-04-15T21:03:34.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:33 smithi072 ceph-mon[29079]: mgrmap e28: smithi072.wfjmmp(active, since 1.00869s) 2024-04-15T21:03:34.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:33 smithi072 ceph-mon[29079]: [15/Apr/2024:21:03:32] ENGINE Bus STARTING 2024-04-15T21:03:34.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:33 smithi072 ceph-mon[29079]: [15/Apr/2024:21:03:32] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T21:03:34.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:33 smithi072 ceph-mon[29079]: [15/Apr/2024:21:03:32] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T21:03:34.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:33 smithi072 ceph-mon[29079]: [15/Apr/2024:21:03:32] ENGINE Bus STARTED 2024-04-15T21:03:34.792 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:34 smithi149 ceph-mon[36029]: pgmap v4: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:34.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:34 smithi072 ceph-mon[29079]: pgmap v4: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:35.831 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:35 smithi149 ceph-mon[36029]: mgrmap e29: smithi072.wfjmmp(active, since 3s) 2024-04-15T21:03:36.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:35 smithi072 ceph-mon[29079]: mgrmap e29: smithi072.wfjmmp(active, since 3s) 2024-04-15T21:03:36.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:36 smithi149 ceph-mon[36029]: pgmap v5: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:37.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:36 smithi072 ceph-mon[29079]: pgmap v5: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.290+0000 7f480ac35700 1 -- 172.21.15.72:0/476758602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48041003d0 msgr2=0x7f4804100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.290+0000 7f480ac35700 1 --2- 172.21.15.72:0/476758602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48041003d0 0x7f4804100840 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009910 tx=0x7f47f0009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 -- 172.21.15.72:0/476758602 shutdown_connections 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 --2- 172.21.15.72:0/476758602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48041003d0 0x7f4804100840 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 --2- 172.21.15.72:0/476758602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48040ff130 0x7f48040ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 -- 172.21.15.72:0/476758602 >> 172.21.15.72:0/476758602 conn(0x7f48040fa780 msgr2=0x7f48040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 -- 172.21.15.72:0/476758602 shutdown_connections 2024-04-15T21:03:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.291+0000 7f480ac35700 1 -- 172.21.15.72:0/476758602 wait complete. 2024-04-15T21:03:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 Processor -- start 2024-04-15T21:03:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 -- start start 2024-04-15T21:03:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48041961e0 0x7f480419b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4804196680 con 0x7f48040ff130 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f480ac35700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041967f0 con 0x7f48041961e0 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f48089d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f48089d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42102/0 (socket says 172.21.15.72:42102) 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f48089d1700 1 -- 172.21.15.72:0/1366211300 learned_addr learned my addr 172.21.15.72:0/1366211300 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.292+0000 7f4803fff700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48041961e0 0x7f480419b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f48089d1700 1 -- 172.21.15.72:0/1366211300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48041961e0 msgr2=0x7f480419b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f48089d1700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48041961e0 0x7f480419b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f48089d1700 1 -- 172.21.15.72:0/1366211300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00095f0 con 0x7f48040ff130 2024-04-15T21:03:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f48089d1700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f47f800d8d0 tx=0x7f47f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f80098a0 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480419b7e0 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47f8010460 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f800f5f0 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.293+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480419bd00 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.294+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f47f800f750 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.294+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4804107c10 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.295+0000 7f4801ffb700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 0x7f47f403bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.295+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f47f804db60 con 0x7f48040ff130 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.295+0000 7f4803fff700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 0x7f47f403bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.295+0000 7f4803fff700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 0x7f47f403bd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48041971b0 tx=0x7f47f000b560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.304+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f47f80228b0 con 0x7f48040ff130 2024-04-15T21:03:38.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.599+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4804068c50 con 0x7f47f40398c0 2024-04-15T21:03:38.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.601+0000 7f4801ffb700 1 -- 172.21.15.72:0/1366211300 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f4804068c50 con 0x7f47f40398c0 2024-04-15T21:03:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 msgr2=0x7f47f403bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 0x7f47f403bd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48041971b0 tx=0x7f47f000b560 comp rx=0 tx=0).stop 2024-04-15T21:03:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 msgr2=0x7f4804195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f47f800d8d0 tx=0x7f47f800dbe0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 shutdown_connections 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f47f40398c0 0x7f47f403bd70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48040ff130 0x7f4804195ca0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 --2- 172.21.15.72:0/1366211300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48041961e0 0x7f480419b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 >> 172.21.15.72:0/1366211300 conn(0x7f48040fa780 msgr2=0x7f4804068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 shutdown_connections 2024-04-15T21:03:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.604+0000 7f480ac35700 1 -- 172.21.15.72:0/1366211300 wait complete. 2024-04-15T21:03:38.609 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:03:38.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 -- 172.21.15.72:0/4147502297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 msgr2=0x7f6974100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 --2- 172.21.15.72:0/4147502297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974100650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6964009910 tx=0x7f6964009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:38.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 -- 172.21.15.72:0/4147502297 shutdown_connections 2024-04-15T21:03:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 --2- 172.21.15.72:0/4147502297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 0x7f6974101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 --2- 172.21.15.72:0/4147502297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974100650 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 -- 172.21.15.72:0/4147502297 >> 172.21.15.72:0/4147502297 conn(0x7f69740fb890 msgr2=0x7f69740fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 -- 172.21.15.72:0/4147502297 shutdown_connections 2024-04-15T21:03:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.721+0000 7f697a056700 1 -- 172.21.15.72:0/4147502297 wait complete. 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 Processor -- start 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 -- start start 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 0x7f6974195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741965f0 con 0x7f6974100240 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f697a056700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974196730 con 0x7f69741014e0 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f69737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f69737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42124/0 (socket says 172.21.15.72:42124) 2024-04-15T21:03:38.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f69737fe700 1 -- 172.21.15.72:0/2400171289 learned_addr learned my addr 172.21.15.72:0/2400171289 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.722+0000 7f6972ffd700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 0x7f6974195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f69737fe700 1 -- 172.21.15.72:0/2400171289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 msgr2=0x7f6974195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f69737fe700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 0x7f6974195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f69737fe700 1 -- 172.21.15.72:0/2400171289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640095f0 con 0x7f6974100240 2024-04-15T21:03:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f69737fe700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f696400fa00 tx=0x7f696400fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696401d070 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697419b180 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697419b670 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6964005640 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.723+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6964017630 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.724+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960005320 con 0x7f6974100240 2024-04-15T21:03:38.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.724+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f6964017790 con 0x7f6974100240 2024-04-15T21:03:38.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.725+0000 7f6970ff9700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 0x7f695c03bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:38.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.725+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f696404f330 con 0x7f6974100240 2024-04-15T21:03:38.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.725+0000 7f6972ffd700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 0x7f695c03bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:38.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.725+0000 7f6972ffd700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 0x7f695c03bd70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6968009c60 tx=0x7f6968009260 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:38.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.731+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f69640163b0 con 0x7f6974100240 2024-04-15T21:03:38.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:38 smithi072 ceph-mon[29079]: pgmap v6: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:38.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:38 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:38.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:38 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:38.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:38 smithi149 ceph-mon[36029]: pgmap v6: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:03:38.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:38 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:38.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:38 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:38.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.985+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6960000bf0 con 0x7f695c0398c0 2024-04-15T21:03:38.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.986+0000 7f6970ff9700 1 -- 172.21.15.72:0/2400171289 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f6960000bf0 con 0x7f695c0398c0 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.988+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 msgr2=0x7f695c03bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.988+0000 7f697a056700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 0x7f695c03bd70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6968009c60 tx=0x7f6968009260 comp rx=0 tx=0).stop 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.988+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 msgr2=0x7f6974195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.988+0000 7f697a056700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f696400fa00 tx=0x7f696400fa30 comp rx=0 tx=0).stop 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 shutdown_connections 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f695c0398c0 0x7f695c03bd70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6974100240 0x7f6974195a90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 --2- 172.21.15.72:0/2400171289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69741014e0 0x7f6974195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 >> 172.21.15.72:0/2400171289 conn(0x7f69740fb890 msgr2=0x7f6974104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 shutdown_connections 2024-04-15T21:03:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:38.989+0000 7f697a056700 1 -- 172.21.15.72:0/2400171289 wait complete. 2024-04-15T21:03:39.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 -- 172.21.15.72:0/2239421500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35740ff130 msgr2=0x7f35740ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 --2- 172.21.15.72:0/2239421500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35740ff130 0x7f35740ff540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3564009910 tx=0x7f3564009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:39.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 -- 172.21.15.72:0/2239421500 shutdown_connections 2024-04-15T21:03:39.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 --2- 172.21.15.72:0/2239421500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35741003d0 0x7f3574100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 --2- 172.21.15.72:0/2239421500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35740ff130 0x7f35740ff540 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 -- 172.21.15.72:0/2239421500 >> 172.21.15.72:0/2239421500 conn(0x7f35740fa780 msgr2=0x7f35740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 -- 172.21.15.72:0/2239421500 shutdown_connections 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.106+0000 7f3579873700 1 -- 172.21.15.72:0/2239421500 wait complete. 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 Processor -- start 2024-04-15T21:03:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 -- start start 2024-04-15T21:03:39.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35740ff130 0x7f3574195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574196600 con 0x7f35741003d0 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.107+0000 7f3579873700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574196740 con 0x7f35740ff130 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42142/0 (socket says 172.21.15.72:42142) 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 -- 172.21.15.72:0/1158616142 learned_addr learned my addr 172.21.15.72:0/1158616142 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3572ffd700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35740ff130 0x7f3574195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 -- 172.21.15.72:0/1158616142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35740ff130 msgr2=0x7f3574195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35740ff130 0x7f3574195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 -- 172.21.15.72:0/1158616142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640095f0 con 0x7f35741003d0 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f35727fc700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f356800d8d0 tx=0x7f356800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35680098a0 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3568010460 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357419b1f0 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356800f5f0 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.108+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357419b740 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.109+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3574107c10 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.109+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f3568009a00 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.110+0000 7f3578871700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 0x7f355c03bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.110+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f356804dae0 con 0x7f35741003d0 2024-04-15T21:03:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.110+0000 7f3572ffd700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 0x7f355c03bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.110+0000 7f3572ffd700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 0x7f355c03bdc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3564006010 tx=0x7f356400b540 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.115+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f356801a980 con 0x7f35741003d0 2024-04-15T21:03:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.345+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3574068c50 con 0x7f355c039910 2024-04-15T21:03:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.357+0000 7f3578871700 1 -- 172.21.15.72:0/1158616142 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3574068c50 con 0x7f355c039910 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (8m) 12s ago 9m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (10m) 12s ago 10m 7704k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (8m) 0s ago 8m 7658k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (10m) 12s ago 10m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (8m) 0s ago 8m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (8m) 12s ago 9m 84.2M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (4m) 12s ago 4m 15.5M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (4m) 12s ago 4m 13.9M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (4m) 0s ago 4m 15.6M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (4m) 0s ago 4m 257M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:03:39.350 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (21s) 12s ago 11m 95.0M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (87s) 0s ago 8m 115M - 19.0.0-3084-g87dbfb63 a452a57266c7 6ee5d0e0d775 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (11m) 12s ago 11m 56.1M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (8m) 0s ago 8m 42.5M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (10m) 12s ago 10m 16.1M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 0s ago 8m 16.4M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 12s ago 7m 179M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 12s ago 7m 188M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 12s ago 6m 152M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (6m) 0s ago 6m 208M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (6m) 0s ago 6m 190M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (5m) 0s ago 5m 169M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:03:39.351 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (27s) 12s ago 9m 42.3M - 2.43.0 a07b618ecd1d d7914d3aff7a 2024-04-15T21:03:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 msgr2=0x7f355c03bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 0x7f355c03bdc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3564006010 tx=0x7f356400b540 comp rx=0 tx=0).stop 2024-04-15T21:03:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 msgr2=0x7f3574195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f356800d8d0 tx=0x7f356800dbe0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 shutdown_connections 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f355c039910 0x7f355c03bdc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35740ff130 0x7f3574195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 --2- 172.21.15.72:0/1158616142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35741003d0 0x7f3574195fe0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 >> 172.21.15.72:0/1158616142 conn(0x7f35740fa780 msgr2=0x7f3574068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 shutdown_connections 2024-04-15T21:03:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.360+0000 7f3579873700 1 -- 172.21.15.72:0/1158616142 wait complete. 2024-04-15T21:03:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.483+0000 7f1ab3e15700 1 -- 172.21.15.72:0/4290986257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac0ff130 msgr2=0x7f1aac0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.483+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/4290986257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac0ff130 0x7f1aac0ff540 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009910 tx=0x7f1aa8009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 -- 172.21.15.72:0/4290986257 shutdown_connections 2024-04-15T21:03:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/4290986257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac1003d0 0x7f1aac100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/4290986257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac0ff130 0x7f1aac0ff540 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 -- 172.21.15.72:0/4290986257 >> 172.21.15.72:0/4290986257 conn(0x7f1aac0fa780 msgr2=0x7f1aac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 -- 172.21.15.72:0/4290986257 shutdown_connections 2024-04-15T21:03:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.484+0000 7f1ab3e15700 1 -- 172.21.15.72:0/4290986257 wait complete. 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 Processor -- start 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 -- start start 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0ff130 0x7f1aac197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac1987c0 con 0x7f1aac1003d0 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab3e15700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac198930 con 0x7f1aac0ff130 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab13b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab13b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42166/0 (socket says 172.21.15.72:42166) 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab13b0700 1 -- 172.21.15.72:0/2550525068 learned_addr learned my addr 172.21.15.72:0/2550525068 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.485+0000 7f1ab1bb1700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0ff130 0x7f1aac197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab13b0700 1 -- 172.21.15.72:0/2550525068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0ff130 msgr2=0x7f1aac197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab13b0700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0ff130 0x7f1aac197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab13b0700 1 -- 172.21.15.72:0/2550525068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80095f0 con 0x7f1aac1003d0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab13b0700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e920 tx=0x7f1a9c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9c00c9d0 con 0x7f1aac1003d0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a9c010430 con 0x7f1aac1003d0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac19d3c0 con 0x7f1aac1003d0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac19d910 con 0x7f1aac1003d0 2024-04-15T21:03:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.486+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9c018650 con 0x7f1aac1003d0 2024-04-15T21:03:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.487+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac1064c0 con 0x7f1aac1003d0 2024-04-15T21:03:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.488+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f1a9c018910 con 0x7f1aac1003d0 2024-04-15T21:03:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.488+0000 7f1aa2ffd700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 0x7f1a9803bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.488+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1a9c014070 con 0x7f1aac1003d0 2024-04-15T21:03:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.489+0000 7f1ab1bb1700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 0x7f1a9803bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:39.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.491+0000 7f1ab1bb1700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 0x7f1a9803bd70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009fd0 tx=0x7f1aa8005fd0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.497+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f1a9c01fdf0 con 0x7f1aac1003d0 2024-04-15T21:03:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.893+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1aac02ce40 con 0x7f1aac1003d0 2024-04-15T21:03:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.894+0000 7f1aa2ffd700 1 -- 172.21.15.72:0/2550525068 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f1a9c01f310 con 0x7f1aac1003d0 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:03:39.887 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:03:39.888 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-15T21:03:39.888 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:03:39.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:03:39.888 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 msgr2=0x7f1a9803bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 0x7f1a9803bd70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009fd0 tx=0x7f1aa8005fd0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 msgr2=0x7f1aac1981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e920 tx=0x7f1a9c00ec30 comp rx=0 tx=0).stop 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 shutdown_connections 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f1a980398c0 0x7f1a9803bd70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0ff130 0x7f1aac197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 --2- 172.21.15.72:0/2550525068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aac1003d0 0x7f1aac1981c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 >> 172.21.15.72:0/2550525068 conn(0x7f1aac0fa780 msgr2=0x7f1aac103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.896+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 shutdown_connections 2024-04-15T21:03:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:39.897+0000 7f1ab3e15700 1 -- 172.21.15.72:0/2550525068 wait complete. 2024-04-15T21:03:40.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1927200993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f481003d0 msgr2=0x7f5f48100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1927200993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f481003d0 0x7f5f48100840 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009910 tx=0x7f5f38009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:40.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1927200993 shutdown_connections 2024-04-15T21:03:40.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1927200993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f481003d0 0x7f5f48100840 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1927200993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f480ff130 0x7f5f480ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1927200993 >> 172.21.15.72:0/1927200993 conn(0x7f5f480fa780 msgr2=0x7f5f480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:40.007 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:39 smithi072 ceph-mon[29079]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:40.007 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:39 smithi072 ceph-mon[29079]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:40.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1927200993 shutdown_connections 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1927200993 wait complete. 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.014+0000 7f5f4f90f700 1 Processor -- start 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4f90f700 1 -- start start 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4f90f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4f90f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f481003d0 0x7f5f481017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4f90f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48101cf0 con 0x7f5f480ff130 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4f90f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48101e30 con 0x7f5f481003d0 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42178/0 (socket says 172.21.15.72:42178) 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 -- 172.21.15.72:0/1539146726 learned_addr learned my addr 172.21.15.72:0/1539146726 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4ceaa700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f481003d0 0x7f5f481017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 -- 172.21.15.72:0/1539146726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f481003d0 msgr2=0x7f5f481017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f481003d0 0x7f5f481017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 -- 172.21.15.72:0/1539146726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380095f0 con 0x7f5f480ff130 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.015+0000 7f5f4d6ab700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d8d0 tx=0x7f5f4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.016+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f44009940 con 0x7f5f480ff130 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.016+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f44010460 con 0x7f5f480ff130 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.016+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f48102110 con 0x7f5f480ff130 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.016+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4400f5f0 con 0x7f5f480ff130 2024-04-15T21:03:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.016+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4819dac0 con 0x7f5f480ff130 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.017+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f5f4400f750 con 0x7f5f480ff130 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.017+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48107c10 con 0x7f5f480ff130 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.017+0000 7f5f3e7fc700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 0x7f5f3403bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.017+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5f4404dc50 con 0x7f5f480ff130 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.017+0000 7f5f4ceaa700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 0x7f5f3403bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.018+0000 7f5f4ceaa700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 0x7f5f3403bdc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005b40 tx=0x7f5f38005a90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.023+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f5f4401e4f0 con 0x7f5f480ff130 2024-04-15T21:03:40.061 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:39 smithi149 ceph-mon[36029]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:40.061 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:39 smithi149 ceph-mon[36029]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.307+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f4819e390 con 0x7f5f480ff130 2024-04-15T21:03:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.308+0000 7f5f3e7fc700 1 -- 172.21.15.72:0/1539146726 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f5f4404de60 con 0x7f5f480ff130 2024-04-15T21:03:40.300 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:03:40.300 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:03:40.301 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:03:40.302 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:40.303 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:03:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 msgr2=0x7f5f3403bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 0x7f5f3403bdc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005b40 tx=0x7f5f38005a90 comp rx=0 tx=0).stop 2024-04-15T21:03:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 msgr2=0x7f5f48103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d8d0 tx=0x7f5f4400dc90 comp rx=0 tx=0).stop 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 shutdown_connections 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f5f34039910 0x7f5f3403bdc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f480ff130 0x7f5f48103160 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 --2- 172.21.15.72:0/1539146726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f481003d0 0x7f5f481017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 >> 172.21.15.72:0/1539146726 conn(0x7f5f480fa780 msgr2=0x7f5f48068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 shutdown_connections 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.311+0000 7f5f4f90f700 1 -- 172.21.15.72:0/1539146726 wait complete. 2024-04-15T21:03:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:03:40.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 -- 172.21.15.72:0/3063790706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fe500 msgr2=0x7f9d100fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 --2- 172.21.15.72:0/3063790706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fe500 0x7f9d100fe910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009910 tx=0x7f9d00009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 -- 172.21.15.72:0/3063790706 shutdown_connections 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 --2- 172.21.15.72:0/3063790706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fee50 0x7f9d10101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 --2- 172.21.15.72:0/3063790706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fe500 0x7f9d100fe910 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 -- 172.21.15.72:0/3063790706 >> 172.21.15.72:0/3063790706 conn(0x7f9d100f9f10 msgr2=0x7f9d100fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 -- 172.21.15.72:0/3063790706 shutdown_connections 2024-04-15T21:03:40.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.426+0000 7f9d1493a700 1 -- 172.21.15.72:0/3063790706 wait complete. 2024-04-15T21:03:40.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 Processor -- start 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 -- start start 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fe500 0x7f9d10195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101966a0 con 0x7f9d100fee50 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d1493a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101967e0 con 0x7f9d100fe500 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d0dd9b700 1 -- 172.21.15.72:0/453545305 learned_addr learned my addr 172.21.15.72:0/453545305 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.427+0000 7f9d0e59c700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fe500 0x7f9d10195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d0dd9b700 1 -- 172.21.15.72:0/453545305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fe500 msgr2=0x7f9d10195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d0dd9b700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fe500 0x7f9d10195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d0dd9b700 1 -- 172.21.15.72:0/453545305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000095f0 con 0x7f9d100fee50 2024-04-15T21:03:40.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d0dd9b700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e940 tx=0x7f9d0400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d04004a00 con 0x7f9d100fee50 2024-04-15T21:03:40.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d0400cc70 con 0x7f9d100fee50 2024-04-15T21:03:40.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d040055f0 con 0x7f9d100fee50 2024-04-15T21:03:40.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1019b290 con 0x7f9d100fee50 2024-04-15T21:03:40.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.428+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1019b7e0 con 0x7f9d100fee50 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.429+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10108d70 con 0x7f9d100fee50 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.429+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7f9d04021440 con 0x7f9d100fee50 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.430+0000 7f9cff7fe700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 0x7f9cf803bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.430+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9d04014070 con 0x7f9d100fee50 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.430+0000 7f9d0e59c700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 0x7f9cf803bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.431+0000 7f9d0e59c700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 0x7f9cf803bd70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009fd0 tx=0x7f9d00005940 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.438+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f9d04016330 con 0x7f9d100fee50 2024-04-15T21:03:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.733+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d10105ed0 con 0x7f9cf80398c0 2024-04-15T21:03:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.734+0000 7f9cff7fe700 1 -- 172.21.15.72:0/453545305 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9d10105ed0 con 0x7f9cf80398c0 2024-04-15T21:03:40.726 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:03:40.726 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:03:40.726 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:03:40.727 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 msgr2=0x7f9cf803bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 0x7f9cf803bd70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009fd0 tx=0x7f9d00005940 comp rx=0 tx=0).stop 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 msgr2=0x7f9d10196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e940 tx=0x7f9d0400ec50 comp rx=0 tx=0).stop 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 shutdown_connections 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f9cf80398c0 0x7f9cf803bd70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100fe500 0x7f9d10195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 --2- 172.21.15.72:0/453545305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100fee50 0x7f9d10196080 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 >> 172.21.15.72:0/453545305 conn(0x7f9d100f9f10 msgr2=0x7f9d101047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.736+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 shutdown_connections 2024-04-15T21:03:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.737+0000 7f9d1493a700 1 -- 172.21.15.72:0/453545305 wait complete. 2024-04-15T21:03:40.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 -- 172.21.15.72:0/3534292753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c0ff430 msgr2=0x7ff55c0ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 --2- 172.21.15.72:0/3534292753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c0ff430 0x7ff55c0ff8a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff548009910 tx=0x7ff548009c20 comp rx=0 tx=0).stop 2024-04-15T21:03:40.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 -- 172.21.15.72:0/3534292753 shutdown_connections 2024-04-15T21:03:40.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 --2- 172.21.15.72:0/3534292753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c0ff430 0x7ff55c0ff8a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 --2- 172.21.15.72:0/3534292753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c100730 0x7ff55c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.849+0000 7ff56316c700 1 -- 172.21.15.72:0/3534292753 >> 172.21.15.72:0/3534292753 conn(0x7ff55c0f9f10 msgr2=0x7ff55c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:40.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 -- 172.21.15.72:0/3534292753 shutdown_connections 2024-04-15T21:03:40.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 -- 172.21.15.72:0/3534292753 wait complete. 2024-04-15T21:03:40.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 Processor -- start 2024-04-15T21:03:40.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 -- start start 2024-04-15T21:03:40.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0ff430 0x7ff55c1949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c195520 con 0x7ff55c100730 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.850+0000 7ff56316c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c195660 con 0x7ff55c0ff430 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42196/0 (socket says 172.21.15.72:42196) 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 -- 172.21.15.72:0/1497621493 learned_addr learned my addr 172.21.15.72:0/1497621493 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff560f08700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0ff430 0x7ff55c1949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 -- 172.21.15.72:0/1497621493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0ff430 msgr2=0x7ff55c1949c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0ff430 0x7ff55c1949c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 -- 172.21.15.72:0/1497621493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480095f0 con 0x7ff55c100730 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff55bfff700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c00 tx=0x7ff54800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff54801d070 con 0x7ff55c100730 2024-04-15T21:03:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff548005dc0 con 0x7ff55c100730 2024-04-15T21:03:40.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5480226a0 con 0x7ff55c100730 2024-04-15T21:03:40.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.851+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c0fe320 con 0x7ff55c100730 2024-04-15T21:03:40.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.852+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c0fe810 con 0x7ff55c100730 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.852+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 46697+0+0 (secure 0 0 0) 0x7ff5480038f0 con 0x7ff55c100730 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.853+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c107d40 con 0x7ff55c100730 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.853+0000 7ff559ffb700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 0x7ff54c03bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.853+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff54804f1f0 con 0x7ff55c100730 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.853+0000 7ff560f08700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 0x7ff54c03bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:03:40.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.853+0000 7ff560f08700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 0x7ff54c03bd70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff550009c60 tx=0x7ff550010040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:03:40.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:40.858+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7ff5480052a0 con 0x7ff55c100730 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2550525068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:41.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:40 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1539146726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:03:41.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.173+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff55c0feea0 con 0x7ff55c100730 2024-04-15T21:03:41.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.173+0000 7ff559ffb700 1 -- 172.21.15.72:0/1497621493 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff548016c40 con 0x7ff55c100730 2024-04-15T21:03:41.166 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:03:41.166 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:03:41.166 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.176+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 msgr2=0x7ff54c03bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.176+0000 7ff56316c700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 0x7ff54c03bd70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff550009c60 tx=0x7ff550010040 comp rx=0 tx=0).stop 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.176+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 msgr2=0x7ff55c194f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.176+0000 7ff56316c700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c00 tx=0x7ff54800f690 comp rx=0 tx=0).stop 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 shutdown_connections 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7ff54c0398c0 0x7ff54c03bd70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff55c0ff430 0x7ff55c1949c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 --2- 172.21.15.72:0/1497621493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c100730 0x7ff55c194f00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:03:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 >> 172.21.15.72:0/1497621493 conn(0x7ff55c0f9f10 msgr2=0x7ff55c103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:03:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 shutdown_connections 2024-04-15T21:03:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:03:41.177+0000 7ff56316c700 1 -- 172.21.15.72:0/1497621493 wait complete. 2024-04-15T21:03:41.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:41.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: pgmap v7: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-04-15T21:03:41.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2550525068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:03:41.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:40 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1539146726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:03:42.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:42 smithi072 ceph-mon[29079]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:42.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:42 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:42.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:42 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:42.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:42 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/1497621493' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:03:42.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:42 smithi149 ceph-mon[36029]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:03:42.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:42 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:42.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:42 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:42.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:42 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/1497621493' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:03:43.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-04-15T21:03:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:03:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:03:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:03:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:03:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:43 smithi072 ceph-mon[29079]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: pgmap v8: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:03:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:43 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/994621122' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:03:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:44 smithi072 ceph-mon[29079]: mgrmap e30: smithi072.wfjmmp(active, since 11s), standbys: smithi149.qgbaiy 2024-04-15T21:03:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:44 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:44 smithi149 ceph-mon[36029]: mgrmap e30: smithi072.wfjmmp(active, since 11s), standbys: smithi149.qgbaiy 2024-04-15T21:03:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:44 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:03:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:45 smithi072 ceph-mon[29079]: pgmap v9: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-04-15T21:03:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:45 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:45 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:45 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:45 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:45.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:45 smithi149 ceph-mon[36029]: pgmap v9: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 1.6 MiB/s wr, 102 op/s 2024-04-15T21:03:45.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:45 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:45.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:45 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:45.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:45 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:03:45.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:45 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:03:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:46 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:03:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:46 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:03:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:46 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:46 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:46 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:46.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:46 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:03:46.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:46 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:03:46.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:46 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:46.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:46 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:46.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:46 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:47 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:47.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:47 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:03:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:48 smithi072 ceph-mon[29079]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:48 smithi072 ceph-mon[29079]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:48 smithi072 ceph-mon[29079]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T21:03:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:48 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:03:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:48 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:03:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:48 smithi149 ceph-mon[36029]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-04-15T21:03:49.372 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:49 smithi072 ceph-mon[29079]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T21:03:49.372 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:49 smithi072 ceph-mon[29079]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66 KiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-04-15T21:03:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:49 smithi149 ceph-mon[36029]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-04-15T21:03:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:49 smithi149 ceph-mon[36029]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66 KiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-04-15T21:03:51.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:51 smithi072 ceph-mon[29079]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66 KiB/s rd, 2.4 MiB/s wr, 139 op/s 2024-04-15T21:03:51.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:51 smithi149 ceph-mon[36029]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 66 KiB/s rd, 2.4 MiB/s wr, 139 op/s 2024-04-15T21:03:52.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:52 smithi072 ceph-mon[29079]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 88 op/s 2024-04-15T21:03:52.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:52 smithi149 ceph-mon[36029]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 88 op/s 2024-04-15T21:03:54.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:54 smithi072 ceph-mon[29079]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 2.5 MiB/s wr, 141 op/s 2024-04-15T21:03:55.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:54 smithi149 ceph-mon[36029]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 2.5 MiB/s wr, 141 op/s 2024-04-15T21:03:56.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:56.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:56.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:56.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:56.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:56.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:56 smithi149 ceph-mon[36029]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 98 op/s 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:03:56.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:56 smithi072 ceph-mon[29079]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 98 op/s 2024-04-15T21:03:59.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:03:58 smithi072 ceph-mon[29079]: pgmap v16: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-04-15T21:03:59.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:03:58 smithi149 ceph-mon[36029]: pgmap v16: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2024-04-15T21:04:01.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:00 smithi072 ceph-mon[29079]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-04-15T21:04:01.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:00 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:04:01.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:00 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:04:01.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:00 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:01.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:00 smithi149 ceph-mon[36029]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-04-15T21:04:01.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:00 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:04:01.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:00 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:04:01.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:00 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:02.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:01 smithi072 ceph-mon[29079]: Upgrade: Updating mgr.smithi149.qgbaiy 2024-04-15T21:04:02.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:01 smithi072 ceph-mon[29079]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:04:02.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:01 smithi149 ceph-mon[36029]: Upgrade: Updating mgr.smithi149.qgbaiy 2024-04-15T21:04:02.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:01 smithi149 ceph-mon[36029]: Deploying daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:04:03.028 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:02 smithi149 ceph-mon[36029]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-04-15T21:04:03.028 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:02 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:03.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:02 smithi072 ceph-mon[29079]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-04-15T21:04:03.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:02 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:04.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:04 smithi149 ceph-mon[36029]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 367 op/s 2024-04-15T21:04:05.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:04 smithi072 ceph-mon[29079]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 367 op/s 2024-04-15T21:04:07.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:06 smithi072 ceph-mon[29079]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 315 op/s 2024-04-15T21:04:07.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:06 smithi149 ceph-mon[36029]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 315 op/s 2024-04-15T21:04:08.536 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:08 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:08.536 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:08 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:08.537 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:08 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:08.537 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:08 smithi072 ceph-mon[29079]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 326 op/s 2024-04-15T21:04:08.869 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:08 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:08.870 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:08 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:08.870 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:08 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:08.870 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:08 smithi149 ceph-mon[36029]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 326 op/s 2024-04-15T21:04:10.988 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:10 smithi072 ceph-mon[29079]: pgmap v22: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 386 op/s 2024-04-15T21:04:11.069 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:10 smithi149 ceph-mon[36029]: pgmap v22: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 386 op/s 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 -- 172.21.15.72:0/1749469480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 msgr2=0x7efee0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 --2- 172.21.15.72:0/1749469480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0100840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efed4009870 tx=0x7efed4009b80 comp rx=0 tx=0).stop 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 -- 172.21.15.72:0/1749469480 shutdown_connections 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 --2- 172.21.15.72:0/1749469480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0100840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 --2- 172.21.15.72:0/1749469480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 -- 172.21.15.72:0/1749469480 >> 172.21.15.72:0/1749469480 conn(0x7efee00fa780 msgr2=0x7efee00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 -- 172.21.15.72:0/1749469480 shutdown_connections 2024-04-15T21:04:11.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.303+0000 7efee54b4700 1 -- 172.21.15.72:0/1749469480 wait complete. 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.304+0000 7efee54b4700 1 Processor -- start 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.304+0000 7efee54b4700 1 -- start start 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.304+0000 7efee54b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.304+0000 7efee54b4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efee54b4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0195490 con 0x7efee00ff130 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efedeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efedeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35930/0 (socket says 172.21.15.72:35930) 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efedeffd700 1 -- 172.21.15.72:0/3949139263 learned_addr learned my addr 172.21.15.72:0/3949139263 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efede7fc700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee01955d0 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efede7fc700 1 -- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 msgr2=0x7efee0194930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efede7fc700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efede7fc700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4009520 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efedeffd700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.305+0000 7efede7fc700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0194e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efed4000c00 tx=0x7efed400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.306+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed401c070 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.306+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee019a020 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.306+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efed400fd60 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.306+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed4022da0 con 0x7efee01003d0 2024-04-15T21:04:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.306+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee019a510 con 0x7efee01003d0 2024-04-15T21:04:11.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.307+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0107c10 con 0x7efee01003d0 2024-04-15T21:04:11.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.308+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7efed4020070 con 0x7efee01003d0 2024-04-15T21:04:11.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.308+0000 7efec7fff700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 0x7efec8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.308+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efed408fd20 con 0x7efee01003d0 2024-04-15T21:04:11.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.308+0000 7efedeffd700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 0x7efec8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.309+0000 7efedeffd700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 0x7efec8070f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efed0005950 tx=0x7efed0009310 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.315+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7efed405c8c0 con 0x7efee01003d0 2024-04-15T21:04:11.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.560+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efee0104d20 con 0x7efec806ea80 2024-04-15T21:04:11.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.561+0000 7efec7fff700 1 -- 172.21.15.72:0/3949139263 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7efee0104d20 con 0x7efec806ea80 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 msgr2=0x7efec8070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 0x7efec8070f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efed0005950 tx=0x7efed0009310 comp rx=0 tx=0).stop 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 msgr2=0x7efee0194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0194e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efed4000c00 tx=0x7efed400f690 comp rx=0 tx=0).stop 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 shutdown_connections 2024-04-15T21:04:11.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7efec806ea80 0x7efec8070f30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efee00ff130 0x7efee0194930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 --2- 172.21.15.72:0/3949139263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efee01003d0 0x7efee0194e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 >> 172.21.15.72:0/3949139263 conn(0x7efee00fa780 msgr2=0x7efee0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 shutdown_connections 2024-04-15T21:04:11.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.564+0000 7efee54b4700 1 -- 172.21.15.72:0/3949139263 wait complete. 2024-04-15T21:04:11.570 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:04:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 -- 172.21.15.72:0/2542428678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00ff130 msgr2=0x7f35a00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 --2- 172.21.15.72:0/2542428678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00ff130 0x7f35a00ff540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3590009910 tx=0x7f3590009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 -- 172.21.15.72:0/2542428678 shutdown_connections 2024-04-15T21:04:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 --2- 172.21.15.72:0/2542428678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a01003d0 0x7f35a0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 --2- 172.21.15.72:0/2542428678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00ff130 0x7f35a00ff540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 -- 172.21.15.72:0/2542428678 >> 172.21.15.72:0/2542428678 conn(0x7f35a00fa780 msgr2=0x7f35a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 -- 172.21.15.72:0/2542428678 shutdown_connections 2024-04-15T21:04:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.691+0000 7f35a6903700 1 -- 172.21.15.72:0/2542428678 wait complete. 2024-04-15T21:04:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 Processor -- start 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 -- start start 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a00ff130 0x7f35a00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a019adc0 con 0x7f35a01003d0 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f35a6903700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a019af30 con 0x7f35a00ff130 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f359f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f359f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54168/0 (socket says 172.21.15.72:54168) 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f359ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a00ff130 0x7f35a00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.692+0000 7f359f7fe700 1 -- 172.21.15.72:0/185593793 learned_addr learned my addr 172.21.15.72:0/185593793 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359f7fe700 1 -- 172.21.15.72:0/185593793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a00ff130 msgr2=0x7f35a00690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359f7fe700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a00ff130 0x7f35a00690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359f7fe700 1 -- 172.21.15.72:0/185593793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900095f0 con 0x7f35a01003d0 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359f7fe700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f359400e920 tx=0x7f359400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359400c9d0 con 0x7f35a01003d0 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3594010430 con 0x7f35a01003d0 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3594018650 con 0x7f35a01003d0 2024-04-15T21:04:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a019b210 con 0x7f35a01003d0 2024-04-15T21:04:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.693+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a019b760 con 0x7f35a01003d0 2024-04-15T21:04:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.695+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0107c10 con 0x7f35a01003d0 2024-04-15T21:04:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.695+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f35940105a0 con 0x7f35a01003d0 2024-04-15T21:04:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.696+0000 7f359d7fa700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 0x7f3588070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.696+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3594014070 con 0x7f35a01003d0 2024-04-15T21:04:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.696+0000 7f359ffff700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 0x7f3588070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.697+0000 7f359ffff700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 0x7f3588070f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3590009fd0 tx=0x7f3590005940 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:11.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.702+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f3594058610 con 0x7f35a01003d0 2024-04-15T21:04:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.980+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35a0104d20 con 0x7f358806ea80 2024-04-15T21:04:11.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.982+0000 7f359d7fa700 1 -- 172.21.15.72:0/185593793 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f35a0104d20 con 0x7f358806ea80 2024-04-15T21:04:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 msgr2=0x7f3588070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 0x7f3588070f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3590009fd0 tx=0x7f3590005940 comp rx=0 tx=0).stop 2024-04-15T21:04:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 msgr2=0x7f35a019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f359400e920 tx=0x7f359400ec30 comp rx=0 tx=0).stop 2024-04-15T21:04:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 shutdown_connections 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f358806ea80 0x7f3588070f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35a00ff130 0x7f35a00690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 --2- 172.21.15.72:0/185593793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a01003d0 0x7f35a019a7f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 >> 172.21.15.72:0/185593793 conn(0x7f35a00fa780 msgr2=0x7f35a0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 shutdown_connections 2024-04-15T21:04:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:11.986+0000 7f35a6903700 1 -- 172.21.15.72:0/185593793 wait complete. 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 -- 172.21.15.72:0/3334128995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0101440 msgr2=0x7f2da0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 --2- 172.21.15.72:0/3334128995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0101440 0x7f2da0101890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009910 tx=0x7f2d88009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 -- 172.21.15.72:0/3334128995 shutdown_connections 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 --2- 172.21.15.72:0/3334128995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0101440 0x7f2da0101890 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 --2- 172.21.15.72:0/3334128995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0100240 0x7f2da0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 -- 172.21.15.72:0/3334128995 >> 172.21.15.72:0/3334128995 conn(0x7f2da00fb7f0 msgr2=0x7f2da00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 -- 172.21.15.72:0/3334128995 shutdown_connections 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.140+0000 7f2da680f700 1 -- 172.21.15.72:0/3334128995 wait complete. 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 Processor -- start 2024-04-15T21:04:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 -- start start 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0101440 0x7f2da0196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0196650 con 0x7f2da0100240 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2da680f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0196790 con 0x7f2da0101440 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54188/0 (socket says 172.21.15.72:54188) 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 -- 172.21.15.72:0/3091331632 learned_addr learned my addr 172.21.15.72:0/3091331632 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d97fff700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0101440 0x7f2da0196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 -- 172.21.15.72:0/3091331632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0101440 msgr2=0x7f2da0196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0101440 0x7f2da0196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 -- 172.21.15.72:0/3091331632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880095f0 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.141+0000 7f2d9ffff700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000e8d0 tx=0x7f2d9000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.142+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90009770 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.142+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d9000c810 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.142+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da019b240 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.142+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90003da0 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.142+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da019b790 con 0x7f2da0100240 2024-04-15T21:04:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.143+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0108db0 con 0x7f2da0100240 2024-04-15T21:04:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.143+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f2d90004200 con 0x7f2da0100240 2024-04-15T21:04:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.144+0000 7f2d9dffb700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 0x7f2d8c070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.144+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d90014070 con 0x7f2da0100240 2024-04-15T21:04:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.144+0000 7f2d97fff700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 0x7f2d8c070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.144+0000 7f2d97fff700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 0x7f2d8c070f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009fd0 tx=0x7f2d88005940 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:12.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.149+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f2d90094020 con 0x7f2da0100240 2024-04-15T21:04:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.385+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2da0105d90 con 0x7f2d8c06ea80 2024-04-15T21:04:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.397+0000 7f2d9dffb700 1 -- 172.21.15.72:0/3091331632 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f2da0105d90 con 0x7f2d8c06ea80 2024-04-15T21:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (8m) 32s ago 10m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (10m) 32s ago 10m 7721k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (9m) 0s ago 9m 7734k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (10m) 32s ago 10m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (9m) 0s ago 9m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (8m) 32s ago 10m 84.3M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (4m) 32s ago 4m 15.7M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (4m) 32s ago 4m 14.1M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (4m) 0s ago 4m 15.9M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (4m) 0s ago 4m 213M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (54s) 32s ago 11m 474M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (6s) 0s ago 9m 35.0M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (11m) 32s ago 12m 55.5M 2048M 18.2.0 dc2bc1663786 0f0de76e1f10 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (9m) 0s ago 9m 44.7M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (10m) 32s ago 10m 15.6M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 0s ago 9m 16.3M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (8m) 32s ago 8m 182M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 32s ago 7m 188M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (7m) 32s ago 7m 156M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (7m) 0s ago 6m 236M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (6m) 0s ago 6m 210M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (6m) 0s ago 6m 184M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 starting - - - - 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 msgr2=0x7f2d8c070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 0x7f2d8c070f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009fd0 tx=0x7f2d88005940 comp rx=0 tx=0).stop 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 msgr2=0x7f2da0195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000e8d0 tx=0x7f2d9000ebe0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 shutdown_connections 2024-04-15T21:04:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f2d8c06ea80 0x7f2d8c070f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da0100240 0x7f2da0195af0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 --2- 172.21.15.72:0/3091331632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2da0101440 0x7f2da0196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 >> 172.21.15.72:0/3091331632 conn(0x7f2da00fb7f0 msgr2=0x7f2da0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 shutdown_connections 2024-04-15T21:04:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.400+0000 7f2da680f700 1 -- 172.21.15.72:0/3091331632 wait complete. 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.515+0000 7f989f0b5700 1 -- 172.21.15.72:0/952984586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898069270 msgr2=0x7f9898102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.515+0000 7f989f0b5700 1 --2- 172.21.15.72:0/952984586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898069270 0x7f9898102dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f988c009910 tx=0x7f988c009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.515+0000 7f989f0b5700 1 -- 172.21.15.72:0/952984586 shutdown_connections 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.515+0000 7f989f0b5700 1 --2- 172.21.15.72:0/952984586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9898103310 0x7f9898105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.515+0000 7f989f0b5700 1 --2- 172.21.15.72:0/952984586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898069270 0x7f9898102dd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- 172.21.15.72:0/952984586 >> 172.21.15.72:0/952984586 conn(0x7f98980fa780 msgr2=0x7f98980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- 172.21.15.72:0/952984586 shutdown_connections 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- 172.21.15.72:0/952984586 wait complete. 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 Processor -- start 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- start start 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98980fed70 0x7f98980ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980ff720 con 0x7f9898103310 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.516+0000 7f989f0b5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980ff890 con 0x7f98980fed70 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54214/0 (socket says 172.21.15.72:54214) 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 -- 172.21.15.72:0/753729090 learned_addr learned my addr 172.21.15.72:0/753729090 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f9897fff700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98980fed70 0x7f98980ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 -- 172.21.15.72:0/753729090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98980fed70 msgr2=0x7f98980ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98980fed70 0x7f98980ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 -- 172.21.15.72:0/753729090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0095f0 con 0x7f9898103310 2024-04-15T21:04:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989ce51700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f988c00bda0 tx=0x7f988c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c01d070 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980ffb10 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f988c00f460 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c021620 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.517+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989819dcf0 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.518+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989818fbd0 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.519+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f988c00f5d0 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.519+0000 7f9895ffb700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 0x7f9888070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.520+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f988c08fde0 con 0x7f9898103310 2024-04-15T21:04:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.520+0000 7f9897fff700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 0x7f9888070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.520+0000 7f9897fff700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 0x7f9888070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9884005950 tx=0x7f988400b410 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:12.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.525+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f988c05c980 con 0x7f9898103310 2024-04-15T21:04:12.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.849+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9898069430 con 0x7f9898103310 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.849+0000 7f9895ffb700 1 -- 172.21.15.72:0/753729090 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f988c05c510 con 0x7f9898103310 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:04:12.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:04:12.843 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.855+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 msgr2=0x7f9888070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.855+0000 7f989f0b5700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 0x7f9888070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9884005950 tx=0x7f988400b410 comp rx=0 tx=0).stop 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.855+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 msgr2=0x7f9898100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.855+0000 7f989f0b5700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f988c00bda0 tx=0x7f988c00bdd0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.856+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 shutdown_connections 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.856+0000 7f989f0b5700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f988806ea80 0x7f9888070f30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.856+0000 7f989f0b5700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9898103310 0x7f9898100720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.856+0000 7f989f0b5700 1 --2- 172.21.15.72:0/753729090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98980fed70 0x7f98980ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.856+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 >> 172.21.15.72:0/753729090 conn(0x7f98980fa780 msgr2=0x7f98980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.857+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 shutdown_connections 2024-04-15T21:04:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:12.857+0000 7f989f0b5700 1 -- 172.21.15.72:0/753729090 wait complete. 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 -- 172.21.15.72:0/3435915217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c1003d0 msgr2=0x7f231c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 --2- 172.21.15.72:0/3435915217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c1003d0 0x7f231c100840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2304009910 tx=0x7f2304009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 -- 172.21.15.72:0/3435915217 shutdown_connections 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 --2- 172.21.15.72:0/3435915217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c1003d0 0x7f231c100840 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 --2- 172.21.15.72:0/3435915217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ff130 0x7f231c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 -- 172.21.15.72:0/3435915217 >> 172.21.15.72:0/3435915217 conn(0x7f231c0fa780 msgr2=0x7f231c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.026+0000 7f23221b6700 1 -- 172.21.15.72:0/3435915217 shutdown_connections 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.027+0000 7f23221b6700 1 -- 172.21.15.72:0/3435915217 wait complete. 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.027+0000 7f23221b6700 1 Processor -- start 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.027+0000 7f23221b6700 1 -- start start 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f23221b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f23221b6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c1003d0 0x7f231c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f231b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f231b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54222/0 (socket says 172.21.15.72:54222) 2024-04-15T21:04:13.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f231b7fe700 1 -- 172.21.15.72:0/2667223384 learned_addr learned my addr 172.21.15.72:0/2667223384 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:13.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c1965d0 con 0x7f231c0ff130 2024-04-15T21:04:13.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c196710 con 0x7f231c1003d0 2024-04-15T21:04:13.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.028+0000 7f2313fff700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c1003d0 0x7f231c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.029+0000 7f231b7fe700 1 -- 172.21.15.72:0/2667223384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c1003d0 msgr2=0x7f231c195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.029+0000 7f231b7fe700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c1003d0 0x7f231c195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.029+0000 7f231b7fe700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040095f0 con 0x7f231c0ff130 2024-04-15T21:04:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.029+0000 7f231b7fe700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e920 tx=0x7f230c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.030+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c009790 con 0x7f231c0ff130 2024-04-15T21:04:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.030+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c19b1c0 con 0x7f231c0ff130 2024-04-15T21:04:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.030+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c19b710 con 0x7f231c0ff130 2024-04-15T21:04:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.030+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f230c00cba0 con 0x7f231c0ff130 2024-04-15T21:04:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.030+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c018630 con 0x7f231c0ff130 2024-04-15T21:04:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.031+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc005320 con 0x7f231c0ff130 2024-04-15T21:04:13.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.032+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f230c00cd10 con 0x7f231c0ff130 2024-04-15T21:04:13.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.033+0000 7f23197fa700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 0x7f2308070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.033+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f230c014070 con 0x7f231c0ff130 2024-04-15T21:04:13.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.033+0000 7f2313fff700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 0x7f2308070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.034+0000 7f2313fff700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 0x7f2308070f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23040059d0 tx=0x7f2304005940 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.039+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f230c053ca0 con 0x7f231c0ff130 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: pgmap v23: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 247 op/s 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:13.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:13 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/753729090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:13.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:13.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: pgmap v23: 65 pgs: 65 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 247 op/s 2024-04-15T21:04:13.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:13.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:13.263 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:13.263 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:13 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/753729090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.328+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f22fc005cc0 con 0x7f231c0ff130 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.329+0000 7f23197fa700 1 -- 172.21.15.72:0/2667223384 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1826 (secure 0 0 0) 0x7f230c094020 con 0x7f231c0ff130 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 msgr2=0x7f2308070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 0x7f2308070f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23040059d0 tx=0x7f2304005940 comp rx=0 tx=0).stop 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 msgr2=0x7f231c195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e920 tx=0x7f230c00ece0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 shutdown_connections 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f230806ea80 0x7f2308070f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f231c0ff130 0x7f231c195a70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 --2- 172.21.15.72:0/2667223384 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c1003d0 0x7f231c195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 >> 172.21.15.72:0/2667223384 conn(0x7f231c0fa780 msgr2=0x7f231c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 shutdown_connections 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.331+0000 7f23221b6700 1 -- 172.21.15.72:0/2667223384 wait complete. 2024-04-15T21:04:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 -- 172.21.15.72:0/1127542471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 msgr2=0x7f792c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 --2- 172.21.15.72:0/1127542471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c101890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7920009910 tx=0x7f7920009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 -- 172.21.15.72:0/1127542471 shutdown_connections 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 --2- 172.21.15.72:0/1127542471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c101890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 --2- 172.21.15.72:0/1127542471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 0x7f792c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 -- 172.21.15.72:0/1127542471 >> 172.21.15.72:0/1127542471 conn(0x7f792c0fb7f0 msgr2=0x7f792c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 -- 172.21.15.72:0/1127542471 shutdown_connections 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.450+0000 7f7931a13700 1 -- 172.21.15.72:0/1127542471 wait complete. 2024-04-15T21:04:13.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 Processor -- start 2024-04-15T21:04:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 -- start start 2024-04-15T21:04:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 0x7f792c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c1965f0 con 0x7f792c101440 2024-04-15T21:04:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f7931a13700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c196730 con 0x7f792c100240 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54244/0 (socket says 172.21.15.72:54244) 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f792a7fc700 1 -- 172.21.15.72:0/1239803017 learned_addr learned my addr 172.21.15.72:0/1239803017 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.451+0000 7f792affd700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 0x7f792c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f792a7fc700 1 -- 172.21.15.72:0/1239803017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 msgr2=0x7f792c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f792a7fc700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 0x7f792c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f792a7fc700 1 -- 172.21.15.72:0/1239803017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200095f0 con 0x7f792c101440 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f792a7fc700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7920000c00 tx=0x7f792000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792001d070 con 0x7f792c101440 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c19b180 con 0x7f792c101440 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c19b670 con 0x7f792c101440 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7920005dc0 con 0x7f792c101440 2024-04-15T21:04:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.452+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7920022470 con 0x7f792c101440 2024-04-15T21:04:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.453+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918005320 con 0x7f792c101440 2024-04-15T21:04:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.454+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f7920003680 con 0x7f792c101440 2024-04-15T21:04:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.454+0000 7f7930a11700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 0x7f7914070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.454+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7920090060 con 0x7f792c101440 2024-04-15T21:04:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.454+0000 7f792affd700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 0x7f7914070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.455+0000 7f792affd700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 0x7f7914070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f792c1012a0 tx=0x7f791c009260 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.459+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f792005cc00 con 0x7f792c101440 2024-04-15T21:04:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.707+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 --> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7918000bf0 con 0x7f791406ea80 2024-04-15T21:04:13.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.708+0000 7f7930a11700 1 -- 172.21.15.72:0/1239803017 <== mgr.14756 v2:172.21.15.72:6800/2725585914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7918000bf0 con 0x7f791406ea80 2024-04-15T21:04:13.700 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mgr daemons", 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.710+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 msgr2=0x7f7914070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.710+0000 7f7931a13700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 0x7f7914070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f792c1012a0 tx=0x7f791c009260 comp rx=0 tx=0).stop 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.710+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 msgr2=0x7f792c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.710+0000 7f7931a13700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7920000c00 tx=0x7f792000f690 comp rx=0 tx=0).stop 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 shutdown_connections 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f791406ea80 0x7f7914070f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792c100240 0x7f792c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 --2- 172.21.15.72:0/1239803017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c101440 0x7f792c195fd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 >> 172.21.15.72:0/1239803017 conn(0x7f792c0fb7f0 msgr2=0x7f792c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 shutdown_connections 2024-04-15T21:04:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.711+0000 7f7931a13700 1 -- 172.21.15.72:0/1239803017 wait complete. 2024-04-15T21:04:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/1387546805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58101440 msgr2=0x7f0f58101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/1387546805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58101440 0x7f0f58101890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009910 tx=0x7f0f44009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/1387546805 shutdown_connections 2024-04-15T21:04:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/1387546805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58101440 0x7f0f58101890 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/1387546805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58100240 0x7f0f58100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/1387546805 >> 172.21.15.72:0/1387546805 conn(0x7f0f580fb7f0 msgr2=0x7f0f580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/1387546805 shutdown_connections 2024-04-15T21:04:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.827+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/1387546805 wait complete. 2024-04-15T21:04:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 Processor -- start 2024-04-15T21:04:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 -- start start 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58101440 0x7f0f58196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58196640 con 0x7f0f58100240 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5eaa7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58196780 con 0x7f0f58101440 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54270/0 (socket says 172.21.15.72:54270) 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 -- 172.21.15.72:0/2306911621 learned_addr learned my addr 172.21.15.72:0/2306911621 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f57fff700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58101440 0x7f0f58196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 -- 172.21.15.72:0/2306911621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58101440 msgr2=0x7f0f58196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58101440 0x7f0f58196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 -- 172.21.15.72:0/2306911621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440095f0 con 0x7f0f58100240 2024-04-15T21:04:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.828+0000 7f0f5c843700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d900 tx=0x7f0f4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.829+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c00b920 con 0x7f0f58100240 2024-04-15T21:04:13.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.829+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5819b230 con 0x7f0f58100240 2024-04-15T21:04:13.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.829+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f4c010460 con 0x7f0f58100240 2024-04-15T21:04:13.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.829+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c00f590 con 0x7f0f58100240 2024-04-15T21:04:13.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.829+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5819b780 con 0x7f0f58100240 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.830+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58108d90 con 0x7f0f58100240 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.830+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 92700+0+0 (secure 0 0 0) 0x7f0f4c0105d0 con 0x7f0f58100240 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.831+0000 7f0f55ffb700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 0x7f0f48070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.831+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0f4c08e760 con 0x7f0f58100240 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.831+0000 7f0f57fff700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 0x7f0f48070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.831+0000 7f0f57fff700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 0x7f0f48070f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f44006010 tx=0x7f0f4400b560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:13.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:13.836+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187527 (secure 0 0 0) 0x7f0f4c05b300 con 0x7f0f58100240 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2667223384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:14 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.199+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0f58108f50 con 0x7f0f58100240 2024-04-15T21:04:14.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.200+0000 7f0f55ffb700 1 -- 172.21.15.72:0/2306911621 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0f4c05ae90 con 0x7f0f58100240 2024-04-15T21:04:14.192 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:14.192 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:14.192 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:14.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 msgr2=0x7f0f48070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 0x7f0f48070f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f44006010 tx=0x7f0f4400b560 comp rx=0 tx=0).stop 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 msgr2=0x7f0f58195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d900 tx=0x7f0f4c00dc10 comp rx=0 tx=0).stop 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 shutdown_connections 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:6800/2725585914,v1:172.21.15.72:6801/2725585914] conn(0x7f0f4806ea70 0x7f0f48070f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f58100240 0x7f0f58195ae0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 --2- 172.21.15.72:0/2306911621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f58101440 0x7f0f58196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 >> 172.21.15.72:0/2306911621 conn(0x7f0f580fb7f0 msgr2=0x7f0f58104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 shutdown_connections 2024-04-15T21:04:14.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:14.202+0000 7f0f5eaa7700 1 -- 172.21.15.72:0/2306911621 wait complete. 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2667223384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:14.352 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:14 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:15.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:15 smithi072 ceph-mon[29079]: pgmap v24: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-04-15T21:04:15.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:15 smithi072 ceph-mon[29079]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:15.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:15 smithi072 ceph-mon[29079]: from='client.? 172.21.15.72:0/2306911621' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:04:15.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:15 smithi149 ceph-mon[36029]: pgmap v24: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-04-15T21:04:15.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:15 smithi149 ceph-mon[36029]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:15.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:15 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/2306911621' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:04:17.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:17 smithi072 ceph-mon[29079]: pgmap v25: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-04-15T21:04:17.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:17 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:17.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:17 smithi149 ceph-mon[36029]: pgmap v25: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-04-15T21:04:17.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:17 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:19.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: pgmap v26: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 198 op/s 2024-04-15T21:04:19.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.wfjmmp"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.wfjmmp"}]': finished 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.qgbaiy"}]: dispatch 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.qgbaiy"}]': finished 2024-04-15T21:04:19.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:19 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: pgmap v26: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 198 op/s 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.wfjmmp"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.wfjmmp"}]': finished 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.qgbaiy"}]: dispatch 2024-04-15T21:04:19.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.qgbaiy"}]': finished 2024-04-15T21:04:19.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:19 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-15T21:04:20.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:20 smithi072 ceph-mon[29079]: Upgrade: Setting container_image for all mgr 2024-04-15T21:04:20.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:20 smithi149 ceph-mon[36029]: Upgrade: Setting container_image for all mgr 2024-04-15T21:04:21.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:21 smithi072 ceph-mon[29079]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 236 op/s 2024-04-15T21:04:21.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:21 smithi149 ceph-mon[36029]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 236 op/s 2024-04-15T21:04:22.856 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:22 smithi072 ceph-mon[29079]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-04-15T21:04:22.856 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:22 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:22.856 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:22 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:04:22.857 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:22 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:04:22.857 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:22 smithi072 ceph-mon[29079]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:22.891 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:22 smithi149 ceph-mon[36029]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-04-15T21:04:22.891 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:22 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:22.891 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:22 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:04:22.891 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:22 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:04:22.891 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:22 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:23.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:23 smithi072 ceph-mon[29079]: Upgrade: Updating mon.smithi072 2024-04-15T21:04:23.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:23 smithi072 ceph-mon[29079]: Deploying daemon mon.smithi072 on smithi072 2024-04-15T21:04:23.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:23 smithi149 ceph-mon[36029]: Upgrade: Updating mon.smithi072 2024-04-15T21:04:23.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:23 smithi149 ceph-mon[36029]: Deploying daemon mon.smithi072 on smithi072 2024-04-15T21:04:24.570 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:24 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:04:24.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:24 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[29075]: 2024-04-15T21:04:24.577+0000 7f508eda4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:04:24.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:24 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[29075]: 2024-04-15T21:04:24.577+0000 7f508eda4700 -1 mon.smithi072@0(leader) e2 *** Got Signal Terminated *** 2024-04-15T21:04:25.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:24 smithi072 podman[78796]: 2024-04-15 21:04:24.831888619 +0000 UTC m=+0.376971173 container died 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-15T21:04:26.036 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-15T21:04:26.037 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-15T21:04:26.400 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 podman[78796]: 2024-04-15 21:04:26.035380428 +0000 UTC m=+1.580462990 container cleanup 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-04-15T21:04:26.400 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 bash[78796]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072 2024-04-15T21:04:26.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 podman[78821]: 2024-04-15 21:04:26.408573419 +0000 UTC m=+1.579384392 container remove 0f0de76e1f10f06432c484652dbf19729688a42ee60ec5824f6287e3f61fe4dd (image=quay.io/ceph/ceph:v18.2.0, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux ) 2024-04-15T21:04:26.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Deactivated successfully. 2024-04-15T21:04:26.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 systemd[1]: Stopped Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:04:26.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Consumed 12.075s CPU time. 2024-04-15T21:04:27.016 DEBUG:teuthology.parallel:result is None 2024-04-15T21:04:27.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:26 smithi072 systemd[1]: Starting Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:04:27.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 podman[78951]: 2024-04-15 21:04:26.977779253 +0000 UTC m=+0.022985970 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:04:27.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 podman[78951]: 2024-04-15 21:04:27.086056829 +0000 UTC m=+0.131263541 container create f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240409, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2) 2024-04-15T21:04:27.486 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 podman[78951]: 2024-04-15 21:04:27.343249415 +0000 UTC m=+0.388456124 container init f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:04:27.486 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 podman[78951]: 2024-04-15 21:04:27.346752936 +0000 UTC m=+0.391959645 container start f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: set uid:gid to 167:167 (ceph:ceph) 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev), process ceph-mon, pid 2 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: pidfile_write: ignore empty --pid-file 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: load: jerasure load: lrc 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: RocksDB version: 7.9.2 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Git sha 0 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Compile date 2024-04-14 15:12:02 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: DB SUMMARY 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: DB Session ID: KEKMSX9PQK55ODYT4L6C 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: CURRENT file: CURRENT 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: IDENTITY file: IDENTITY 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1517 Bytes 2024-04-15T21:04:27.487 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi072/store.db dir, Total Num: 1, files: 000032.sst 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi072/store.db: 000030.log size: 2466893 ; 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.error_if_exists: 0 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.create_if_missing: 0 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.paranoid_checks: 1 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.env: 0x5640f975acc0 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.fs: PosixFileSystem 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.info_log: 0x5640facdfac0 2024-04-15T21:04:27.488 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_file_opening_threads: 16 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.statistics: (nil) 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.use_fsync: 0 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_log_file_size: 0 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.keep_log_file_num: 1000 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.recycle_log_file_num: 0 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_fallocate: 1 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_mmap_reads: 0 2024-04-15T21:04:27.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_mmap_writes: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.use_direct_reads: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.create_missing_column_families: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.db_log_dir: 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.wal_dir: 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.advise_random_on_open: 1 2024-04-15T21:04:27.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.db_write_buffer_size: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.write_buffer_manager: 0x5640facae1e0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.rate_limiter: (nil) 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.wal_recovery_mode: 2 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enable_thread_tracking: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enable_pipelined_write: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.unordered_write: 0 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-15T21:04:27.492 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.row_cache: None 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.wal_filter: None 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_ingest_behind: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.two_write_queues: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.manual_wal_flush: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.wal_compression: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.atomic_flush: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.log_readahead_size: 0 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-15T21:04:27.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.best_efforts_recovery: 0 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.allow_data_in_errors: 0 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.db_host_id: __hostname__ 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_background_jobs: 2 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_background_compactions: -1 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_subcompactions: 1 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_total_wal_size: 0 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-15T21:04:27.494 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_open_files: -1 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bytes_per_sync: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_readahead_size: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_background_flushes: -1 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Compression algorithms supported: 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kZSTD supported: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kXpressCompression supported: 0 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kLZ4HCCompression supported: 1 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kZlibCompression supported: 1 2024-04-15T21:04:27.495 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kSnappyCompression supported: 1 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kLZ4Compression supported: 1 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: kBZip2Compression supported: 0 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000015 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.merge_operator: 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_filter: None 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_filter_factory: None 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.sst_partitioner_factory: None 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-15T21:04:27.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5640facdfca0) 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks: 1 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_top_level_index_and_filter: 1 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_type: 0 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_index_type: 0 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_shortening: 1 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: checksum: 4 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: no_block_cache: 0 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache: 0x5640face1090 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_name: BinnedLRUCache 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_options: 2024-04-15T21:04:27.497 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: capacity : 536870912 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_shard_bits : 4 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: strict_capacity_limit : 0 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: high_pri_pool_ratio: 0.000 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_compressed: (nil) 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: persistent_cache: (nil) 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size: 4096 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size_deviation: 10 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_restart_interval: 16 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_block_restart_interval: 1 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_block_size: 4096 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: partition_filters: 0 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: use_delta_encoding: 1 2024-04-15T21:04:27.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: filter_policy: bloomfilter 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: whole_key_filtering: 1 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: verify_compression: 0 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: read_amp_bytes_per_bit: 0 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: format_version: 5 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_index_compression: 1 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_align: 0 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_auto_readahead_size: 262144 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: prepopulate_block_cache: 0 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: initial_auto_readahead_size: 8192 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_file_reads_for_auto_readahead: 2 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.write_buffer_size: 33554432 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_write_buffer_number: 2 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression: NoCompression 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression: Disabled 2024-04-15T21:04:27.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.prefix_extractor: nullptr 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.num_levels: 7 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-15T21:04:27.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.level: 32767 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.strategy: 0 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.enabled: false 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.target_file_size_base: 67108864 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-15T21:04:27.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.arena_block_size: 1048576 2024-04-15T21:04:27.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.disable_auto_compactions: 0 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.inplace_update_support: 0 2024-04-15T21:04:27.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.bloom_locality: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.max_successive_merges: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.paranoid_file_checks: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.force_consistency_checks: 1 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.report_bg_io_stats: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.ttl: 2592000 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-15T21:04:27.504 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enable_blob_files: false 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.min_blob_size: 0 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_file_size: 268435456 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.blob_file_starting_level: 0 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12060, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a9a56ff-83a8-48b5-9778-6b7d54cc777a 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215067378412, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-04-15T21:04:27.505 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215067391343, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2216383, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12061, "largest_seqno": 13242, "table_properties": {"data_size": 2210702, "index_size": 3356, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11300, "raw_average_key_size": 22, "raw_value_size": 2199975, "raw_average_value_size": 4435, "num_data_blocks": 154, "num_entries": 496, "num_filter_entries": 496, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713215067, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a9a56ff-83a8-48b5-9778-6b7d54cc777a", "db_session_id": "KEKMSX9PQK55ODYT4L6C", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215067391424, "job": 1, "event": "recovery_finished"} 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi072/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5640fadce000 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: DB pointer 0x5640fadb8000 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** DB Stats ** 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:27.506 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L0 1/0 2.11 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L6 1/0 4.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Sum 2/0 6.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-04-15T21:04:27.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 278.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative compaction: 0.00 GB write, 95.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval compaction: 0.00 GB write, 95.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T21:04:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache BinnedLRUCache@0x5640face1090#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: starting mon.smithi072 rank 0 at public addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] at bind addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi072 fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???) e2 preinit fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).mds e14 new map 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).mds e14 print_map 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: e14 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:27.509 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: legacy client fscid: 1 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Filesystem 'cephfs' (1) 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: fs_name cephfs 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: epoch 14 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: tableserver 0 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: root 0 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: session_timeout 60 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: session_autoclose 300 2024-04-15T21:04:27.510 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_file_size 1099511627776 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_xattr_size 65536 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: required_client_features {} 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: last_failure 0 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: last_failure_osd_epoch 46 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_mds 1 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: in 0 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: up {0=24257} 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: failed 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: damaged 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: stopped 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_pools [3] 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_pool 2 2024-04-15T21:04:27.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: inline_data enabled 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: balancer 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: bal_rank_mask -1 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: standby_count_wanted 1 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: qdb_cluster leader: 0 members: 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Standby daemons: 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:27.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 bash[78951]: f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 2024-04-15T21:04:27.513 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 systemd[1]: Started Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 172 op/s 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072 calling monitor election 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: monmap epoch 2 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: last_changed 2024-04-15T20:55:02.697678+0000 2024-04-15T21:04:27.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: created 2024-04-15T20:51:54.748398+0000 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: min_mon_release 18 (reef) 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: election_strategy: 1 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.smithi072 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: osdmap e48: 6 total, 6 up, 6 in 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mgrmap e30: smithi072.wfjmmp(active, since 55s), standbys: smithi149.qgbaiy 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: from='mgr.14756 ' entity='' 2024-04-15T21:04:27.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:27 smithi072 ceph-mon[78970]: mgrmap e31: smithi072.wfjmmp(active, since 55s), standbys: smithi149.qgbaiy 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: from='mgr.14756 172.21.15.72:0/2257550379' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 172 op/s 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: mon.smithi072 calling monitor election 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T21:04:27.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: monmap epoch 2 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: last_changed 2024-04-15T20:55:02.697678+0000 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: created 2024-04-15T20:51:54.748398+0000 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: min_mon_release 18 (reef) 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: election_strategy: 1 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.smithi072 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: osdmap e48: 6 total, 6 up, 6 in 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: mgrmap e30: smithi072.wfjmmp(active, since 55s), standbys: smithi149.qgbaiy 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: from='mgr.14756 ' entity='' 2024-04-15T21:04:27.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:27 smithi149 ceph-mon[36029]: mgrmap e31: smithi072.wfjmmp(active, since 55s), standbys: smithi149.qgbaiy 2024-04-15T21:04:30.106 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-15T21:04:30.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-15T21:04:30.407 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:30 smithi072 ceph-mon[78970]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:04:30.407 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:30 smithi072 ceph-mon[78970]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:04:30.407 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:30 smithi072 ceph-mon[78970]: from='mgr.? 172.21.15.149:0/3581212144' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:04:30.408 DEBUG:teuthology.parallel:result is None 2024-04-15T21:04:30.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T21:04:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:30 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:04:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:30 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:04:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:30 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/3581212144' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:04:31.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:31 smithi149 ceph-mon[36029]: mgrmap e32: smithi072.wfjmmp(active, since 58s), standbys: smithi149.qgbaiy 2024-04-15T21:04:31.565 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:31 smithi072 ceph-mon[78970]: mgrmap e32: smithi072.wfjmmp(active, since 58s), standbys: smithi149.qgbaiy 2024-04-15T21:04:34.959 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T21:04:34.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-15T21:04:34.996 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-15T21:04:34.997 DEBUG:teuthology.parallel:result is None 2024-04-15T21:04:35.138 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: Active manager daemon smithi072.wfjmmp restarted 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: Activating manager daemon smithi072.wfjmmp 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: osdmap e49: 6 total, 6 up, 6 in 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: mgrmap e33: smithi072.wfjmmp(active, starting, since 0.00535834s), standbys: smithi149.qgbaiy 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:04:35.139 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T21:04:35.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:34 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: Active manager daemon smithi072.wfjmmp restarted 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: Activating manager daemon smithi072.wfjmmp 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: osdmap e49: 6 total, 6 up, 6 in 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: mgrmap e33: smithi072.wfjmmp(active, starting, since 0.00535834s), standbys: smithi149.qgbaiy 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:35.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi072.wfjmmp", "id": "smithi072.wfjmmp"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr metadata", "who": "smithi149.qgbaiy", "id": "smithi149.qgbaiy"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-15T21:04:35.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-15T21:04:35.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-15T21:04:35.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: Manager daemon smithi072.wfjmmp is now available 2024-04-15T21:04:35.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:36.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:36 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:36.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:36 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:04:36.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:36 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T21:04:36.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:36 smithi149 ceph-mon[36029]: [15/Apr/2024:21:04:35] ENGINE Bus STARTING 2024-04-15T21:04:36.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:36 smithi149 ceph-mon[36029]: mgrmap e34: smithi072.wfjmmp(active, since 1.00945s), standbys: smithi149.qgbaiy 2024-04-15T21:04:36.204 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:04:36.204 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/mirror_snapshot_schedule"}]: dispatch 2024-04-15T21:04:36.204 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.wfjmmp/trash_purge_schedule"}]: dispatch 2024-04-15T21:04:36.205 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:36 smithi072 ceph-mon[78970]: [15/Apr/2024:21:04:35] ENGINE Bus STARTING 2024-04-15T21:04:36.205 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:36 smithi072 ceph-mon[78970]: mgrmap e34: smithi072.wfjmmp(active, since 1.00945s), standbys: smithi149.qgbaiy 2024-04-15T21:04:37.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:37 smithi072 ceph-mon[78970]: [15/Apr/2024:21:04:35] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T21:04:37.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:37 smithi072 ceph-mon[78970]: [15/Apr/2024:21:04:35] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T21:04:37.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:37 smithi072 ceph-mon[78970]: [15/Apr/2024:21:04:35] ENGINE Bus STARTED 2024-04-15T21:04:37.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:37 smithi072 ceph-mon[78970]: pgmap v3: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:37.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:37 smithi149 ceph-mon[36029]: [15/Apr/2024:21:04:35] ENGINE Serving on https://172.21.15.72:7150 2024-04-15T21:04:37.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:37 smithi149 ceph-mon[36029]: [15/Apr/2024:21:04:35] ENGINE Serving on http://172.21.15.72:8765 2024-04-15T21:04:37.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:37 smithi149 ceph-mon[36029]: [15/Apr/2024:21:04:35] ENGINE Bus STARTED 2024-04-15T21:04:37.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:37 smithi149 ceph-mon[36029]: pgmap v3: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: pgmap v4: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: mgrmap e35: smithi072.wfjmmp(active, since 2s), standbys: smithi149.qgbaiy 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:04:38.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:04:38.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:04:38.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:38 smithi149 ceph-mon[36029]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:04:38.270 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: pgmap v4: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: mgrmap e35: smithi072.wfjmmp(active, since 2s), standbys: smithi149.qgbaiy 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: Standby manager daemon smithi149.qgbaiy restarted 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: Standby manager daemon smithi149.qgbaiy started 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/crt"}]: dispatch 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.qgbaiy/key"}]: dispatch 2024-04-15T21:04:38.271 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:38 smithi072 ceph-mon[78970]: from='mgr.? 172.21.15.149:0/2997278915' entity='mgr.smithi149.qgbaiy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-15T21:04:39.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:39 smithi072 ceph-mon[78970]: mgrmap e36: smithi072.wfjmmp(active, since 3s), standbys: smithi149.qgbaiy 2024-04-15T21:04:39.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:39 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:39.356 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:39 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:39.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:39 smithi149 ceph-mon[36029]: mgrmap e36: smithi072.wfjmmp(active, since 3s), standbys: smithi149.qgbaiy 2024-04-15T21:04:39.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:39 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:39.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:39 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:40.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:40 smithi072 ceph-mon[78970]: pgmap v5: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:40.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:40 smithi072 ceph-mon[78970]: mgrmap e37: smithi072.wfjmmp(active, since 4s), standbys: smithi149.qgbaiy 2024-04-15T21:04:40.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:40.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:40 smithi149 ceph-mon[36029]: pgmap v5: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:40 smithi149 ceph-mon[36029]: mgrmap e37: smithi072.wfjmmp(active, since 4s), standbys: smithi149.qgbaiy 2024-04-15T21:04:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:40 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:40.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:40 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:41.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:41 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:41.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:41 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:41 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:41.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:41 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:42.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:42 smithi072 ceph-mon[78970]: pgmap v6: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:42.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:42.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:42.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:42 smithi149 ceph-mon[36029]: pgmap v6: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:42.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:42 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:42.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:42 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:04:43.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: pgmap v7: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1 KiB/s wr, 18 op/s 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:04:43.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:43 smithi072 ceph-mon[78970]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:04:44.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.conf 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.conf 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: pgmap v7: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1 KiB/s wr, 18 op/s 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.conf 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:04:44.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:43 smithi149 ceph-mon[36029]: Updating smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/config/ceph.client.admin.keyring 2024-04-15T21:04:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 -- 172.21.15.72:0/439137818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 msgr2=0x7f516c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 --2- 172.21.15.72:0/439137818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c100650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f515c009910 tx=0x7f515c009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 -- 172.21.15.72:0/439137818 shutdown_connections 2024-04-15T21:04:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 --2- 172.21.15.72:0/439137818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 0x7f516c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 --2- 172.21.15.72:0/439137818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c100650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 -- 172.21.15.72:0/439137818 >> 172.21.15.72:0/439137818 conn(0x7f516c0fb7f0 msgr2=0x7f516c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 -- 172.21.15.72:0/439137818 shutdown_connections 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.313+0000 7f517442e700 1 -- 172.21.15.72:0/439137818 wait complete. 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 Processor -- start 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 -- start start 2024-04-15T21:04:44.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 0x7f516c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c196610 con 0x7f516c100240 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f517442e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c196750 con 0x7f516c101440 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48660/0 (socket says 172.21.15.72:48660) 2024-04-15T21:04:44.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 -- 172.21.15.72:0/3511231712 learned_addr learned my addr 172.21.15.72:0/3511231712 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51719c9700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 0x7f516c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 -- 172.21.15.72:0/3511231712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 msgr2=0x7f516c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 0x7f516c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.314+0000 7f51721ca700 1 -- 172.21.15.72:0/3511231712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0095f0 con 0x7f516c100240 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f51721ca700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f515c00bda0 tx=0x7f515c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515c01d070 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c19b1a0 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f515c00f460 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515c021620 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.315+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c19b690 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.316+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c108d90 con 0x7f516c100240 2024-04-15T21:04:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.316+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f515c00f5d0 con 0x7f516c100240 2024-04-15T21:04:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.317+0000 7f51637fe700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 0x7f51580712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.317+0000 7f51719c9700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 0x7f51580712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.317+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f515c0903c0 con 0x7f516c100240 2024-04-15T21:04:44.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.317+0000 7f51719c9700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 0x7f51580712a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5168005950 tx=0x7f516800b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.322+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f515c05ca80 con 0x7f516c100240 2024-04-15T21:04:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.541+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f516c105d90 con 0x7f515806edf0 2024-04-15T21:04:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.543+0000 7f51637fe700 1 -- 172.21.15.72:0/3511231712 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f516c105d90 con 0x7f515806edf0 2024-04-15T21:04:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 msgr2=0x7f51580712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 0x7f51580712a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5168005950 tx=0x7f516800b410 comp rx=0 tx=0).stop 2024-04-15T21:04:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 msgr2=0x7f516c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f515c00bda0 tx=0x7f515c00bdd0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 shutdown_connections 2024-04-15T21:04:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f515806edf0 0x7f51580712a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f516c100240 0x7f516c195ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 --2- 172.21.15.72:0/3511231712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f516c101440 0x7f516c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 >> 172.21.15.72:0/3511231712 conn(0x7f516c0fb7f0 msgr2=0x7f516c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 shutdown_connections 2024-04-15T21:04:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.545+0000 7f517442e700 1 -- 172.21.15.72:0/3511231712 wait complete. 2024-04-15T21:04:44.547 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:04:44.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 -- 172.21.15.72:0/2293721437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc100240 msgr2=0x7fa9cc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 --2- 172.21.15.72:0/2293721437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc100240 0x7fa9cc100650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00b0a0 tx=0x7fa9bc00b3b0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 -- 172.21.15.72:0/2293721437 shutdown_connections 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 --2- 172.21.15.72:0/2293721437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc101440 0x7fa9cc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 --2- 172.21.15.72:0/2293721437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc100240 0x7fa9cc100650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 -- 172.21.15.72:0/2293721437 >> 172.21.15.72:0/2293721437 conn(0x7fa9cc0fb7f0 msgr2=0x7fa9cc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 -- 172.21.15.72:0/2293721437 shutdown_connections 2024-04-15T21:04:44.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.652+0000 7fa9d2070700 1 -- 172.21.15.72:0/2293721437 wait complete. 2024-04-15T21:04:44.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 Processor -- start 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 -- start start 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc100240 0x7fa9cc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc073680 con 0x7fa9cc101440 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.653+0000 7fa9d2070700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0737c0 con 0x7fa9cc100240 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48672/0 (socket says 172.21.15.72:48672) 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 -- 172.21.15.72:0/302370763 learned_addr learned my addr 172.21.15.72:0/302370763 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc100240 0x7fa9cc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 -- 172.21.15.72:0/302370763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc100240 msgr2=0x7fa9cc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc100240 0x7fa9cc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 -- 172.21.15.72:0/302370763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc009d00 con 0x7fa9cc101440 2024-04-15T21:04:44.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9caffd700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000d8d0 tx=0x7fa9c000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c00098a0 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc073aa0 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9c0010460 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c000f5f0 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.654+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc19db30 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.656+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b8005320 con 0x7fa9cc101440 2024-04-15T21:04:44.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.656+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fa9c0009a00 con 0x7fa9cc101440 2024-04-15T21:04:44.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.657+0000 7fa9c8ff9700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 0x7fa9b40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:44.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.657+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa9c008ee50 con 0x7fa9cc101440 2024-04-15T21:04:44.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.657+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 0x7fa9b40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:44.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.657+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 0x7fa9b40712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00b830 tx=0x7fa9bc0060c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:44.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.662+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa9c005b590 con 0x7fa9cc101440 2024-04-15T21:04:44.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.894+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9b8000bf0 con 0x7fa9b406ee00 2024-04-15T21:04:44.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.895+0000 7fa9c8ff9700 1 -- 172.21.15.72:0/302370763 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa9b8000bf0 con 0x7fa9b406ee00 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 msgr2=0x7fa9b40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 0x7fa9b40712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00b830 tx=0x7fa9bc0060c0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 msgr2=0x7fa9cc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000d8d0 tx=0x7fa9c000dbe0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 shutdown_connections 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa9b406ee00 0x7fa9b40712b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9cc100240 0x7fa9cc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 --2- 172.21.15.72:0/302370763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc101440 0x7fa9cc073140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:44.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 >> 172.21.15.72:0/302370763 conn(0x7fa9cc0fb7f0 msgr2=0x7fa9cc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:44.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 shutdown_connections 2024-04-15T21:04:44.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:44.898+0000 7fa9d2070700 1 -- 172.21.15.72:0/302370763 wait complete. 2024-04-15T21:04:44.910 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.910 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.910 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.910 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.911 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:44.911 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:44.911 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:44.911 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-15T21:04:44.911 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:44 smithi072 ceph-mon[78970]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:45.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 -- 172.21.15.72:0/176118296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0201003d0 msgr2=0x7fd020100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 --2- 172.21.15.72:0/176118296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0201003d0 0x7fd020100840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd010009910 tx=0x7fd010009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 -- 172.21.15.72:0/176118296 shutdown_connections 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 --2- 172.21.15.72:0/176118296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0201003d0 0x7fd020100840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 --2- 172.21.15.72:0/176118296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0200ff130 0x7fd0200ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 -- 172.21.15.72:0/176118296 >> 172.21.15.72:0/176118296 conn(0x7fd0200fa780 msgr2=0x7fd0200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 -- 172.21.15.72:0/176118296 shutdown_connections 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.008+0000 7fd0279a7700 1 -- 172.21.15.72:0/176118296 wait complete. 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 Processor -- start 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 -- start start 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201003d0 0x7fd02019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02019ad80 con 0x7fd0200ff130 2024-04-15T21:04:45.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd0279a7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02019aec0 con 0x7fd0201003d0 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd025743700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd025743700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48686/0 (socket says 172.21.15.72:48686) 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd025743700 1 -- 172.21.15.72:0/2753738876 learned_addr learned my addr 172.21.15.72:0/2753738876 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.009+0000 7fd024f42700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201003d0 0x7fd02019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd025743700 1 -- 172.21.15.72:0/2753738876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201003d0 msgr2=0x7fd02019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd025743700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201003d0 0x7fd02019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd025743700 1 -- 172.21.15.72:0/2753738876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0100095f0 con 0x7fd0200ff130 2024-04-15T21:04:45.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd025743700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00d900 tx=0x7fd01c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c0041f0 con 0x7fd0200ff130 2024-04-15T21:04:45.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd01c004ce0 con 0x7fd0200ff130 2024-04-15T21:04:45.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02019b1a0 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c00b750 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.010+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02019b6f0 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.011+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd020107c10 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.012+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fd01c004e50 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.012+0000 7fd0167fc700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 0x7fd00c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.012+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd01c08eeb0 con 0x7fd0200ff130 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.012+0000 7fd024f42700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 0x7fd00c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.013+0000 7fd024f42700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 0x7fd00c0712b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd01000b5c0 tx=0x7fd010005ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.017+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd01c05b5f0 con 0x7fd0200ff130 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-15T21:04:45.074 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:44 smithi149 ceph-mon[36029]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.237+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd020104d20 con 0x7fd00c06ee00 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.247+0000 7fd0167fc700 1 -- 172.21.15.72:0/2753738876 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd020104d20 con 0x7fd00c06ee00 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (9m) 4s ago 10m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (11m) 4s ago 11m 7805k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (10m) 6s ago 9m 7776k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (11m) 4s ago 11m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (9m) 6s ago 9m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:04:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (9m) 4s ago 10m 84.7M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (5m) 4s ago 5m 16.6M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (5m) 4s ago 5m 14.8M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (5m) 6s ago 5m 16.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (5m) 6s ago 5m 159M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (87s) 4s ago 12m 475M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (38s) 6s ago 9m 347M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (18s) 4s ago 12m 28.9M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (9m) 6s ago 9m 49.3M 2048M 18.2.0 dc2bc1663786 2dad6840485a 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (11m) 4s ago 11m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 6s ago 9m 16.5M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (8m) 4s ago 8m 214M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (8m) 4s ago 8m 220M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:04:45.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (7m) 4s ago 7m 181M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (7m) 6s ago 7m 244M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (7m) 6s ago 7m 219M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (6m) 6s ago 6m 197M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (50s) 4s ago 10m 60.0M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 msgr2=0x7fd00c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 0x7fd00c0712b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd01000b5c0 tx=0x7fd010005ee0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 msgr2=0x7fd020069100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00d900 tx=0x7fd01c00dc10 comp rx=0 tx=0).stop 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 shutdown_connections 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd00c06ee00 0x7fd00c0712b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0200ff130 0x7fd020069100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 --2- 172.21.15.72:0/2753738876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201003d0 0x7fd02019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 >> 172.21.15.72:0/2753738876 conn(0x7fd0200fa780 msgr2=0x7fd020103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 shutdown_connections 2024-04-15T21:04:45.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.250+0000 7fd0279a7700 1 -- 172.21.15.72:0/2753738876 wait complete. 2024-04-15T21:04:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 -- 172.21.15.72:0/4036529125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 msgr2=0x7f25a01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/4036529125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a01018a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f258c009910 tx=0x7f258c009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 -- 172.21.15.72:0/4036529125 shutdown_connections 2024-04-15T21:04:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/4036529125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a01018a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/4036529125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 0x7f25a0100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.356+0000 7f25a6ac9700 1 -- 172.21.15.72:0/4036529125 >> 172.21.15.72:0/4036529125 conn(0x7f25a00fb7e0 msgr2=0x7f25a00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 -- 172.21.15.72:0/4036529125 shutdown_connections 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 -- 172.21.15.72:0/4036529125 wait complete. 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 Processor -- start 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 -- start start 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 0x7f25a0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0073680 con 0x7f25a0101450 2024-04-15T21:04:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f25a6ac9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00737c0 con 0x7f25a0100250 2024-04-15T21:04:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f259ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f259ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48704/0 (socket says 172.21.15.72:48704) 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.357+0000 7f259ffff700 1 -- 172.21.15.72:0/3771031325 learned_addr learned my addr 172.21.15.72:0/3771031325 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f25a4865700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 0x7f25a0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259ffff700 1 -- 172.21.15.72:0/3771031325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 msgr2=0x7f25a0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259ffff700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 0x7f25a0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259ffff700 1 -- 172.21.15.72:0/3771031325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0095f0 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259ffff700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f258c006010 tx=0x7f258c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f258c01d070 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f258c00f460 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f258c021640 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a0073a40 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.358+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a0073f30 con 0x7f25a0101450 2024-04-15T21:04:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.359+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a0108da0 con 0x7f25a0101450 2024-04-15T21:04:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.360+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f258c00fab0 con 0x7f25a0101450 2024-04-15T21:04:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.360+0000 7f259dffb700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 0x7f25900712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.360+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f258c090320 con 0x7f25a0101450 2024-04-15T21:04:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.361+0000 7f25a4865700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 0x7f25900712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.361+0000 7f25a4865700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 0x7f25900712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25a01012b0 tx=0x7f259400b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.365+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f258c05c9c0 con 0x7f25a0101450 2024-04-15T21:04:45.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.663+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f25a0108f90 con 0x7f25a0101450 2024-04-15T21:04:45.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.664+0000 7f259dffb700 1 -- 172.21.15.72:0/3771031325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7f258c05c550 con 0x7f25a0101450 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:04:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:04:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:04:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 11, 2024-04-15T21:04:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 3 2024-04-15T21:04:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:04:45.658 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.667+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 msgr2=0x7f25900712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.667+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 0x7f25900712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25a01012b0 tx=0x7f259400b410 comp rx=0 tx=0).stop 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.667+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 msgr2=0x7f25a0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.667+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f258c006010 tx=0x7f258c00bd70 comp rx=0 tx=0).stop 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 shutdown_connections 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f259006ee00 0x7f25900712b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a0100250 0x7f25a0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 --2- 172.21.15.72:0/3771031325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a0101450 0x7f25a0073140 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 >> 172.21.15.72:0/3771031325 conn(0x7f25a00fb7e0 msgr2=0x7f25a0104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 shutdown_connections 2024-04-15T21:04:45.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.668+0000 7f25a6ac9700 1 -- 172.21.15.72:0/3771031325 wait complete. 2024-04-15T21:04:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 -- 172.21.15.72:0/2374364883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 msgr2=0x7f2a000ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 --2- 172.21.15.72:0/2374364883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a000ff4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009910 tx=0x7f29f0009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 -- 172.21.15.72:0/2374364883 shutdown_connections 2024-04-15T21:04:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 --2- 172.21.15.72:0/2374364883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a000ff4b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 --2- 172.21.15.72:0/2374364883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 0x7f2a00100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 -- 172.21.15.72:0/2374364883 >> 172.21.15.72:0/2374364883 conn(0x7f2a000f9f10 msgr2=0x7f2a000fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 -- 172.21.15.72:0/2374364883 shutdown_connections 2024-04-15T21:04:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.777+0000 7f2a080dd700 1 -- 172.21.15.72:0/2374364883 wait complete. 2024-04-15T21:04:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 Processor -- start 2024-04-15T21:04:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 -- start start 2024-04-15T21:04:45.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 0x7f2a00195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a00196600 con 0x7f2a001010a0 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.778+0000 7f2a080dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a00196740 con 0x7f2a00100750 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48722/0 (socket says 172.21.15.72:48722) 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05e79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 0x7f2a00195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 -- 172.21.15.72:0/4067667832 learned_addr learned my addr 172.21.15.72:0/4067667832 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 -- 172.21.15.72:0/4067667832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 msgr2=0x7f2a00195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 0x7f2a00195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 -- 172.21.15.72:0/4067667832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00095f0 con 0x7f2a001010a0 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a05678700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006010 tx=0x7f29f000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f001d070 con 0x7f2a001010a0 2024-04-15T21:04:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29f000f460 con 0x7f2a001010a0 2024-04-15T21:04:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0019b190 con 0x7f2a001010a0 2024-04-15T21:04:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f0021640 con 0x7f2a001010a0 2024-04-15T21:04:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.779+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0019b680 con 0x7f2a001010a0 2024-04-15T21:04:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.780+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a00107c00 con 0x7f2a001010a0 2024-04-15T21:04:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.781+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f29f000fab0 con 0x7f2a001010a0 2024-04-15T21:04:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.781+0000 7f29f6ffd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 0x7f29ec0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.781+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f29f0090330 con 0x7f2a001010a0 2024-04-15T21:04:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.782+0000 7f2a05e79700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 0x7f29ec0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.782+0000 7f2a05e79700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 0x7f29ec0712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2a00068510 tx=0x7f29fc00b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:45.786+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f29f005c9f0 con 0x7f2a001010a0 2024-04-15T21:04:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:45 smithi072 ceph-mon[78970]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:45 smithi072 ceph-mon[78970]: pgmap v8: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 796 B/s wr, 14 op/s 2024-04-15T21:04:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:45 smithi072 ceph-mon[78970]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:45.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:45 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3771031325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:46.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.043+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a00107df0 con 0x7f2a001010a0 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.043+0000 7f29f6ffd700 1 -- 172.21.15.72:0/4067667832 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f29f005c580 con 0x7f2a001010a0 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 msgr2=0x7f29ec0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 0x7f29ec0712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2a00068510 tx=0x7f29fc00b410 comp rx=0 tx=0).stop 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 msgr2=0x7f2a00195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006010 tx=0x7f29f000bd70 comp rx=0 tx=0).stop 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 shutdown_connections 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ec06ee00 0x7f29ec0712b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a00100750 0x7f2a00195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 --2- 172.21.15.72:0/4067667832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a001010a0 0x7f2a00195fe0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.045+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 >> 172.21.15.72:0/4067667832 conn(0x7f2a000f9f10 msgr2=0x7f2a000fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.046+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 shutdown_connections 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.046+0000 7f2a080dd700 1 -- 172.21.15.72:0/4067667832 wait complete. 2024-04-15T21:04:46.040 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:04:46.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 -- 172.21.15.72:0/4016767465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934101440 msgr2=0x7f1934101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 --2- 172.21.15.72:0/4016767465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934101440 0x7f1934101890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1928009910 tx=0x7f1928009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 -- 172.21.15.72:0/4016767465 shutdown_connections 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 --2- 172.21.15.72:0/4016767465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934101440 0x7f1934101890 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 --2- 172.21.15.72:0/4016767465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934100240 0x7f1934100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 -- 172.21.15.72:0/4016767465 >> 172.21.15.72:0/4016767465 conn(0x7f19340fb7f0 msgr2=0x7f19340fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 -- 172.21.15.72:0/4016767465 shutdown_connections 2024-04-15T21:04:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.152+0000 7f19399d1700 1 -- 172.21.15.72:0/4016767465 wait complete. 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 Processor -- start 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 -- start start 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934101440 0x7f1934195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341965f0 con 0x7f1934100240 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19399d1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934196730 con 0x7f1934101440 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f1932ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f1932ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48742/0 (socket says 172.21.15.72:48742) 2024-04-15T21:04:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f1932ffd700 1 -- 172.21.15.72:0/1136038771 learned_addr learned my addr 172.21.15.72:0/1136038771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.153+0000 7f19327fc700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934101440 0x7f1934195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f1932ffd700 1 -- 172.21.15.72:0/1136038771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934101440 msgr2=0x7f1934195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f1932ffd700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934101440 0x7f1934195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f1932ffd700 1 -- 172.21.15.72:0/1136038771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280095f0 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f1932ffd700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f192400d900 tx=0x7f192400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192400b920 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1924010460 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192400f590 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193419b1e0 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.154+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193419b730 con 0x7f1934100240 2024-04-15T21:04:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.155+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934108d90 con 0x7f1934100240 2024-04-15T21:04:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.156+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f19240105d0 con 0x7f1934100240 2024-04-15T21:04:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.156+0000 7f19389cf700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 0x7f191c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.156+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f192408ef50 con 0x7f1934100240 2024-04-15T21:04:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.156+0000 7f19327fc700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 0x7f191c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.156+0000 7f19327fc700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 0x7f191c0712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f192800b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.161+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f19240c3ff0 con 0x7f1934100240 2024-04-15T21:04:46.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:45 smithi149 ceph-mon[36029]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:45 smithi149 ceph-mon[36029]: pgmap v8: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 796 B/s wr, 14 op/s 2024-04-15T21:04:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:45 smithi149 ceph-mon[36029]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:45 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/3771031325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:04:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.380+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1934105d90 con 0x7f191c06ee00 2024-04-15T21:04:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.382+0000 7f19389cf700 1 -- 172.21.15.72:0/1136038771 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1934105d90 con 0x7f191c06ee00 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "3/23 daemons upgraded", 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mon daemons", 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:04:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:04:46.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 msgr2=0x7f191c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 0x7f191c0712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f192800b540 comp rx=0 tx=0).stop 2024-04-15T21:04:46.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 msgr2=0x7f1934195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f192400d900 tx=0x7f192400dc10 comp rx=0 tx=0).stop 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 shutdown_connections 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f191c06ee00 0x7f191c0712b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1934100240 0x7f1934195a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 --2- 172.21.15.72:0/1136038771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934101440 0x7f1934195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 >> 172.21.15.72:0/1136038771 conn(0x7f19340fb7f0 msgr2=0x7f1934104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 shutdown_connections 2024-04-15T21:04:46.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.384+0000 7f19399d1700 1 -- 172.21.15.72:0/1136038771 wait complete. 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- 172.21.15.72:0/725041178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5410074d80 msgr2=0x7f54100731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 --2- 172.21.15.72:0/725041178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5410074d80 0x7f54100731e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5400009910 tx=0x7f5400009c20 comp rx=0 tx=0).stop 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- 172.21.15.72:0/725041178 shutdown_connections 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 --2- 172.21.15.72:0/725041178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54100737b0 0x7f5410073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 --2- 172.21.15.72:0/725041178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5410074d80 0x7f54100731e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- 172.21.15.72:0/725041178 >> 172.21.15.72:0/725041178 conn(0x7f54100fb7f0 msgr2=0x7f54100fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- 172.21.15.72:0/725041178 shutdown_connections 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- 172.21.15.72:0/725041178 wait complete. 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 Processor -- start 2024-04-15T21:04:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.489+0000 7f541590b700 1 -- start start 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 0x7f541019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541019cc70 con 0x7f54100737b0 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541019cdb0 con 0x7f5410074d80 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48766/0 (socket says 172.21.15.72:48766) 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 -- 172.21.15.72:0/706268572 learned_addr learned my addr 172.21.15.72:0/706268572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f5407fff700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 0x7f541019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 -- 172.21.15.72:0/706268572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 msgr2=0x7f541019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 0x7f541019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 -- 172.21.15.72:0/706268572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000095f0 con 0x7f54100737b0 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f5407fff700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 0x7f541019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f540effd700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5400005b40 tx=0x7f540000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540001d070 con 0x7f54100737b0 2024-04-15T21:04:46.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5400022470 con 0x7f54100737b0 2024-04-15T21:04:46.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54101a1800 con 0x7f54100737b0 2024-04-15T21:04:46.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540000f690 con 0x7f54100737b0 2024-04-15T21:04:46.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.490+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54101a1cf0 con 0x7f54100737b0 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.491+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541010f3f0 con 0x7f54100737b0 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.492+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f54000225e0 con 0x7f54100737b0 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.492+0000 7f5414909700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 0x7f53fc0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.492+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5400090920 con 0x7f54100737b0 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.492+0000 7f5407fff700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 0x7f53fc0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:04:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.493+0000 7f5407fff700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 0x7f53fc0712a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099d0 tx=0x7f53f8008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:04:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.497+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f540005d060 con 0x7f54100737b0 2024-04-15T21:04:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.784+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f54101a2650 con 0x7f54100737b0 2024-04-15T21:04:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.784+0000 7f5414909700 1 -- 172.21.15.72:0/706268572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f54000270e0 con 0x7f54100737b0 2024-04-15T21:04:46.776 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:46.776 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 msgr2=0x7f53fc0712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 0x7f53fc0712a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099d0 tx=0x7f53f8008040 comp rx=0 tx=0).stop 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 msgr2=0x7f541019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5400005b40 tx=0x7f540000be20 comp rx=0 tx=0).stop 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 shutdown_connections 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53fc06edf0 0x7f53fc0712a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54100737b0 0x7f541019c110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 --2- 172.21.15.72:0/706268572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5410074d80 0x7f541019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 >> 172.21.15.72:0/706268572 conn(0x7f54100fb7f0 msgr2=0x7f5410101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:04:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 shutdown_connections 2024-04-15T21:04:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:04:46.787+0000 7f541590b700 1 -- 172.21.15.72:0/706268572 wait complete. 2024-04-15T21:04:46.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: Upgrade: Updating mon.smithi149 2024-04-15T21:04:46.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:46.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:04:46.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:04:46.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:46.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: Deploying daemon mon.smithi149 on smithi149 2024-04-15T21:04:46.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/4067667832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:04:46.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:46.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:46 smithi149 ceph-mon[36029]: from='client.? 172.21.15.72:0/706268572' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: Upgrade: Updating mon.smithi149 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: Deploying daemon mon.smithi149 on smithi149 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/4067667832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:04:47.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:46 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/706268572' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:04:47.916 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:47 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:04:47.916 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:47 smithi149 ceph-mon[36029]: pgmap v9: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 651 B/s wr, 11 op/s 2024-04-15T21:04:48.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:47 smithi072 ceph-mon[78970]: pgmap v9: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 651 B/s wr, 11 op/s 2024-04-15T21:04:48.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149[36023]: 2024-04-15T21:04:47.922+0000 7f2acdc55700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:04:48.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149[36023]: 2024-04-15T21:04:47.922+0000 7f2acdc55700 -1 mon.smithi149@1(peon) e2 *** Got Signal Terminated *** 2024-04-15T21:04:48.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 podman[66870]: 2024-04-15 21:04:48.056995293 +0000 UTC m=+0.226363027 container died 2dad6840485a51dafca5469baee3169abbefc71441c0b79f594b3f0d9af775b7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-04-15T21:04:48.652 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 podman[66870]: 2024-04-15 21:04:48.440483926 +0000 UTC m=+0.609851668 container cleanup 2dad6840485a51dafca5469baee3169abbefc71441c0b79f594b3f0d9af775b7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, ceph=True) 2024-04-15T21:04:48.652 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 bash[66870]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149 2024-04-15T21:04:48.910 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 podman[66884]: 2024-04-15 21:04:48.66001289 +0000 UTC m=+0.556615843 container remove 2dad6840485a51dafca5469baee3169abbefc71441c0b79f594b3f0d9af775b7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212) 2024-04-15T21:04:48.910 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi149.service: Deactivated successfully. 2024-04-15T21:04:48.910 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 systemd[1]: Stopped Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:04:48.910 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:48 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi149.service: Consumed 6.841s CPU time. 2024-04-15T21:04:49.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:49 smithi149 systemd[1]: Starting Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:04:49.574 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:49 smithi149 podman[67017]: 2024-04-15 21:04:49.231933945 +0000 UTC m=+0.017770270 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:04:49.574 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:49 smithi149 podman[67017]: 2024-04-15 21:04:49.35961648 +0000 UTC m=+0.145452773 container create 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:04:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:49 smithi149 podman[67017]: 2024-04-15 21:04:49.691928846 +0000 UTC m=+0.477765155 container init 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-15T21:04:49.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:49 smithi149 podman[67017]: 2024-04-15 21:04:49.69578657 +0000 UTC m=+0.481622864 container start 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=main-87dbfb6) 2024-04-15T21:04:50.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 bash[67017]: 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 systemd[1]: Started Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: set uid:gid to 167:167 (ceph:ceph) 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev), process ceph-mon, pid 2 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: pidfile_write: ignore empty --pid-file 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: load: jerasure load: lrc 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: RocksDB version: 7.9.2 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Git sha 0 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Compile date 2024-04-14 15:12:02 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: DB SUMMARY 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: DB Session ID: 8RFNINGX21CI5F1XNLOH 2024-04-15T21:04:50.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: CURRENT file: CURRENT 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: IDENTITY file: IDENTITY 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi149/store.db dir, Total Num: 1, files: 000027.sst 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi149/store.db: 000025.log size: 6896272 ; 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.error_if_exists: 0 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.create_if_missing: 0 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.paranoid_checks: 1 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-15T21:04:50.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.env: 0x5608fd8e2cc0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.fs: PosixFileSystem 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.info_log: 0x5608fe5d7ac0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_file_opening_threads: 16 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.statistics: (nil) 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.use_fsync: 0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_log_file_size: 0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.keep_log_file_num: 1000 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.recycle_log_file_num: 0 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_fallocate: 1 2024-04-15T21:04:50.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_mmap_reads: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_mmap_writes: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.use_direct_reads: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.create_missing_column_families: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.db_log_dir: 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.wal_dir: 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.advise_random_on_open: 1 2024-04-15T21:04:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.db_write_buffer_size: 0 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.write_buffer_manager: 0x5608fe5a61e0 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.rate_limiter: (nil) 2024-04-15T21:04:50.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.wal_recovery_mode: 2 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enable_thread_tracking: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enable_pipelined_write: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.unordered_write: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.row_cache: None 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.wal_filter: None 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_ingest_behind: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.two_write_queues: 0 2024-04-15T21:04:50.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.manual_wal_flush: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.wal_compression: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.atomic_flush: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.log_readahead_size: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.best_efforts_recovery: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.allow_data_in_errors: 0 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.db_host_id: __hostname__ 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-15T21:04:50.698 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_background_jobs: 2 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_background_compactions: -1 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_subcompactions: 1 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_total_wal_size: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_open_files: -1 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bytes_per_sync: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_readahead_size: 0 2024-04-15T21:04:50.699 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_background_flushes: -1 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Compression algorithms supported: 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kZSTD supported: 0 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kXpressCompression supported: 0 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kLZ4HCCompression supported: 1 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kZlibCompression supported: 1 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kSnappyCompression supported: 1 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kLZ4Compression supported: 1 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: kBZip2Compression supported: 0 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-15T21:04:50.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.merge_operator: 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_filter: None 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_filter_factory: None 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.sst_partitioner_factory: None 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5608fe5d7ca0) 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_type: 0 2024-04-15T21:04:50.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_index_type: 0 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_shortening: 1 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: checksum: 4 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: no_block_cache: 0 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache: 0x5608fe5d9090 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_options: 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: capacity : 536870912 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_shard_bits : 4 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: strict_capacity_limit : 0 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_compressed: (nil) 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: persistent_cache: (nil) 2024-04-15T21:04:50.702 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size: 4096 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size_deviation: 10 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_restart_interval: 16 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_block_restart_interval: 1 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_block_size: 4096 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: partition_filters: 0 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: use_delta_encoding: 1 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: filter_policy: bloomfilter 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: whole_key_filtering: 1 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: verify_compression: 0 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: format_version: 5 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_index_compression: 1 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_align: 0 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_auto_readahead_size: 262144 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: prepopulate_block_cache: 0 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: initial_auto_readahead_size: 8192 2024-04-15T21:04:50.703 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.write_buffer_size: 33554432 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_write_buffer_number: 2 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression: NoCompression 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression: Disabled 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.prefix_extractor: nullptr 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.num_levels: 7 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-15T21:04:50.704 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.level: 32767 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.strategy: 0 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.enabled: false 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-15T21:04:50.705 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.target_file_size_base: 67108864 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-15T21:04:50.706 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.arena_block_size: 1048576 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.disable_auto_compactions: 0 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-15T21:04:50.707 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.inplace_update_support: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.bloom_locality: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.max_successive_merges: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.paranoid_file_checks: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.force_consistency_checks: 1 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.report_bg_io_stats: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.ttl: 2592000 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-15T21:04:50.708 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enable_blob_files: false 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.min_blob_size: 0 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_file_size: 268435456 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.blob_file_starting_level: 0 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12038, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 62ed047f-0528-4563-80e4-60ae6ab25e1b 2024-04-15T21:04:50.709 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215090288602, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215090320858, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4136580, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12044, "largest_seqno": 13876, "table_properties": {"data_size": 4128860, "index_size": 4882, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1797, "raw_key_size": 16428, "raw_average_key_size": 22, "raw_value_size": 4113546, "raw_average_value_size": 5745, "num_data_blocks": 222, "num_entries": 716, "num_filter_entries": 716, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713215090, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "62ed047f-0528-4563-80e4-60ae6ab25e1b", "db_session_id": "8RFNINGX21CI5F1XNLOH", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713215090321021, "job": 1, "event": "recovery_finished"} 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi149/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5608fe6c6000 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: DB pointer 0x5608fe6b0000 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** DB Stats ** 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T21:04:50.710 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L0 1/0 3.94 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 311.2 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L6 1/0 4.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-15T21:04:50.711 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Sum 2/0 8.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 311.2 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 311.2 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 311.2 0.01 0.00 1 0.013 0 0 0.0 0.0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-15T21:04:50.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative compaction: 0.00 GB write, 92.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval compaction: 0.00 GB write, 92.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache BinnedLRUCache@0x5608fe5d9090#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.9e-05 secs_since: 0 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: starting mon.smithi149 rank 1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi149 fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???) e2 preinit fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).mds e14 new map 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).mds e14 print_map 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: e14 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: legacy client fscid: 1 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.713 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Filesystem 'cephfs' (1) 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: fs_name cephfs 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: epoch 14 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: tableserver 0 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: root 0 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_timeout 60 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_autoclose 300 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_file_size 1099511627776 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_xattr_size 65536 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: required_client_features {} 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure 0 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure_osd_epoch 46 2024-04-15T21:04:50.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_mds 1 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: in 0 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: up {0=24257} 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: failed 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: damaged 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: stopped 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_pools [3] 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_pool 2 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: inline_data enabled 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: balancer 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: bal_rank_mask -1 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: standby_count_wanted 1 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: qdb_cluster leader: 0 members: 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Standby daemons: 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-15T21:04:50.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:50 smithi149 ceph-mon[67036]: mon.smithi149@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-04-15T21:04:52.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: pgmap v11: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-15T21:04:52.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:52.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: mon.smithi072 calling monitor election 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: mon.smithi149 calling monitor election 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: monmap epoch 3 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: last_changed 2024-04-15T21:04:51.646400+0000 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: created 2024-04-15T20:51:54.748398+0000 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: min_mon_release 19 (squid) 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: election_strategy: 1 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.smithi072 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: osdmap e49: 6 total, 6 up, 6 in 2024-04-15T21:04:52.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: mgrmap e37: smithi072.wfjmmp(active, since 16s), standbys: smithi149.qgbaiy 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: pgmap v11: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-15T21:04:52.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: mon.smithi072 calling monitor election 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: mon.smithi149 calling monitor election 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: mon.smithi072 is new leader, mons smithi072,smithi149 in quorum (ranks 0,1) 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: monmap epoch 3 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: last_changed 2024-04-15T21:04:51.646400+0000 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: created 2024-04-15T20:51:54.748398+0000 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: min_mon_release 19 (squid) 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: election_strategy: 1 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.smithi072 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.smithi149 2024-04-15T21:04:52.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: osdmap e49: 6 total, 6 up, 6 in 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: mgrmap e37: smithi072.wfjmmp(active, since 16s), standbys: smithi149.qgbaiy 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:04:52.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:52.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:54.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:54 smithi072 ceph-mon[78970]: pgmap v12: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-15T21:04:54.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:54 smithi149 ceph-mon[67036]: pgmap v12: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-15T21:04:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:56 smithi072 ceph-mon[78970]: pgmap v13: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:56 smithi149 ceph-mon[67036]: pgmap v13: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:57.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:57.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:57.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:57.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:04:58.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:04:58 smithi072 ceph-mon[78970]: pgmap v14: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:04:58.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:04:58 smithi149 ceph-mon[67036]: pgmap v14: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: pgmap v15: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: Reconfiguring mon.smithi072 (monmap changed)... 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:05:00.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:00 smithi072 ceph-mon[78970]: Reconfiguring daemon mon.smithi072 on smithi072 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: pgmap v15: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: Reconfiguring mon.smithi072 (monmap changed)... 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:05:00.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:05:00.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:00.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:00 smithi149 ceph-mon[67036]: Reconfiguring daemon mon.smithi072 on smithi072 2024-04-15T21:05:02.654 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: pgmap v16: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:02.654 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:02.654 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:02.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: Reconfiguring mgr.smithi072.wfjmmp (monmap changed)... 2024-04-15T21:05:02.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:05:02.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:05:02.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:02.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:02 smithi072 ceph-mon[78970]: Reconfiguring daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: pgmap v16: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: Reconfiguring mgr.smithi072.wfjmmp (monmap changed)... 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.wfjmmp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:02 smithi149 ceph-mon[67036]: Reconfiguring daemon mgr.smithi072.wfjmmp on smithi072 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: pgmap v17: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: Unable to update caps for client.ceph-exporter.smithi072 2024-04-15T21:05:04.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi072"}]: dispatch 2024-04-15T21:05:04.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:04.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:04 smithi072 ceph-mon[78970]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: pgmap v17: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T21:05:04.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: Unable to update caps for client.ceph-exporter.smithi072 2024-04-15T21:05:04.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi072"}]: dispatch 2024-04-15T21:05:04.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:04.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:04 smithi149 ceph-mon[67036]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: pgmap v18: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: Reconfiguring crash.smithi072 (monmap changed)... 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: Reconfiguring daemon crash.smithi072 on smithi072 2024-04-15T21:05:06.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: pgmap v18: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: Reconfiguring crash.smithi072 (monmap changed)... 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: Reconfiguring daemon crash.smithi072 on smithi072 2024-04-15T21:05:06.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T21:05:07.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:07.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:07.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:07.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T21:05:07.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: Reconfiguring osd.0 (monmap changed)... 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.0 on smithi072 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: pgmap v19: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: Reconfiguring osd.1 (monmap changed)... 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:08 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.1 on smithi072 2024-04-15T21:05:08.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: Reconfiguring osd.0 (monmap changed)... 2024-04-15T21:05:08.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.0 on smithi072 2024-04-15T21:05:08.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: pgmap v19: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:08.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:08.994 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:08.994 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: Reconfiguring osd.1 (monmap changed)... 2024-04-15T21:05:08.994 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T21:05:08.994 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:08.994 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:08 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.1 on smithi072 2024-04-15T21:05:10.032 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:09 smithi072 ceph-mon[78970]: pgmap v20: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:10.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:09 smithi149 ceph-mon[67036]: pgmap v20: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: Reconfiguring osd.2 (monmap changed)... 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:11 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.2 on smithi072 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: Reconfiguring osd.2 (monmap changed)... 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:11 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.2 on smithi072 2024-04-15T21:05:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:12 smithi072 ceph-mon[78970]: pgmap v21: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:12 smithi149 ceph-mon[67036]: pgmap v21: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:13 smithi072 ceph-mon[78970]: Reconfiguring mds.cephfs.smithi072.zkrubp (monmap changed)... 2024-04-15T21:05:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:13 smithi072 ceph-mon[78970]: Reconfiguring daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T21:05:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:13 smithi149 ceph-mon[67036]: Reconfiguring mds.cephfs.smithi072.zkrubp (monmap changed)... 2024-04-15T21:05:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:13 smithi149 ceph-mon[67036]: Reconfiguring daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T21:05:14.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: pgmap v22: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: Reconfiguring mds.cephfs.smithi072.pbknte (monmap changed)... 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:14 smithi072 ceph-mon[78970]: Reconfiguring daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: pgmap v22: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: Reconfiguring mds.cephfs.smithi072.pbknte (monmap changed)... 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:14.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:14 smithi149 ceph-mon[67036]: Reconfiguring daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: pgmap v23: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: Unable to update caps for client.ceph-exporter.smithi149 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi149"}]: dispatch 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:16.833 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:16 smithi072 ceph-mon[78970]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.900+0000 7f3f301e9700 1 -- 172.21.15.72:0/2808951139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f280ff150 msgr2=0x7f3f280ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.900+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2808951139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f280ff150 0x7f3f280ff560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009910 tx=0x7f3f18009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 -- 172.21.15.72:0/2808951139 shutdown_connections 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2808951139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f28100350 0x7f3f281007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2808951139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f280ff150 0x7f3f280ff560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 -- 172.21.15.72:0/2808951139 >> 172.21.15.72:0/2808951139 conn(0x7f3f280fa700 msgr2=0x7f3f280fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 -- 172.21.15.72:0/2808951139 shutdown_connections 2024-04-15T21:05:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 -- 172.21.15.72:0/2808951139 wait complete. 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 Processor -- start 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.901+0000 7f3f301e9700 1 -- start start 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f301e9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 0x7f3f28195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f301e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 0x7f3f28196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f301e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28196620 con 0x7f3f28100350 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f301e9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28196760 con 0x7f3f280ff150 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2df85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 0x7f3f28195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2d784700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 0x7f3f28196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2df85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 0x7f3f28195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:43236/0 (socket says 172.21.15.72:43236) 2024-04-15T21:05:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2df85700 1 -- 172.21.15.72:0/2940673884 learned_addr learned my addr 172.21.15.72:0/2940673884 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2d784700 1 -- 172.21.15.72:0/2940673884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 msgr2=0x7f3f28195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2d784700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 0x7f3f28195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2d784700 1 -- 172.21.15.72:0/2940673884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180095f0 con 0x7f3f28100350 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f2d784700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 0x7f3f28196000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c8f0 tx=0x7f3f2400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2400e850 con 0x7f3f28100350 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2819b210 con 0x7f3f28100350 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f2400ee60 con 0x7f3f28100350 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.902+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f24018630 con 0x7f3f28100350 2024-04-15T21:05:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.903+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2819b760 con 0x7f3f28100350 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.903+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f28107ca0 con 0x7f3f28100350 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.904+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f3f2400f8a0 con 0x7f3f28100350 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.905+0000 7f3f1effd700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 0x7f3f140712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.905+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3f2408ef70 con 0x7f3f28100350 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.905+0000 7f3f2df85700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 0x7f3f140712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.905+0000 7f3f2df85700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 0x7f3f140712b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f18006010 tx=0x7f3f1800b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:16.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:16.910+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3f240c3ff0 con 0x7f3f28100350 2024-04-15T21:05:16.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: pgmap v23: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:16.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:16.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: Unable to update caps for client.ceph-exporter.smithi149 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi149"}]: dispatch 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:16 smithi149 ceph-mon[67036]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-04-15T21:05:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.141+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f280694c0 con 0x7f3f1406ee00 2024-04-15T21:05:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.142+0000 7f3f1effd700 1 -- 172.21.15.72:0/2940673884 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f3f280694c0 con 0x7f3f1406ee00 2024-04-15T21:05:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 msgr2=0x7f3f140712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 0x7f3f140712b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f18006010 tx=0x7f3f1800b540 comp rx=0 tx=0).stop 2024-04-15T21:05:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 msgr2=0x7f3f28196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 0x7f3f28196000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c8f0 tx=0x7f3f2400cc00 comp rx=0 tx=0).stop 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 shutdown_connections 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f1406ee00 0x7f3f140712b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f280ff150 0x7f3f28195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 --2- 172.21.15.72:0/2940673884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f28100350 0x7f3f28196000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 >> 172.21.15.72:0/2940673884 conn(0x7f3f280fa700 msgr2=0x7f3f28068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 shutdown_connections 2024-04-15T21:05:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.146+0000 7f3f301e9700 1 -- 172.21.15.72:0/2940673884 wait complete. 2024-04-15T21:05:17.153 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 -- 172.21.15.72:0/1351644743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 msgr2=0x7f4eb8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 --2- 172.21.15.72:0/1351644743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8100840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009910 tx=0x7f4eac009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 -- 172.21.15.72:0/1351644743 shutdown_connections 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 --2- 172.21.15.72:0/1351644743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8100840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 --2- 172.21.15.72:0/1351644743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 -- 172.21.15.72:0/1351644743 >> 172.21.15.72:0/1351644743 conn(0x7f4eb80fa780 msgr2=0x7f4eb80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 -- 172.21.15.72:0/1351644743 shutdown_connections 2024-04-15T21:05:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.261+0000 7f4ebe356700 1 -- 172.21.15.72:0/1351644743 wait complete. 2024-04-15T21:05:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 Processor -- start 2024-04-15T21:05:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 -- start start 2024-04-15T21:05:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb8195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb81965e0 con 0x7f4eb81003d0 2024-04-15T21:05:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4ebe356700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8196720 con 0x7f4eb80ff130 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4eb77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4eb77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44230/0 (socket says 172.21.15.72:44230) 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.262+0000 7f4eb77fe700 1 -- 172.21.15.72:0/4282309924 learned_addr learned my addr 172.21.15.72:0/4282309924 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb7fff700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb8195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb77fe700 1 -- 172.21.15.72:0/4282309924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 msgr2=0x7f4eb8195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb77fe700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb8195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb77fe700 1 -- 172.21.15.72:0/4282309924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0095f0 con 0x7f4eb81003d0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb7fff700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb8195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb77fe700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b5c0 tx=0x7f4eac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac01d070 con 0x7f4eb81003d0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4eac022470 con 0x7f4eb81003d0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb819b170 con 0x7f4eb81003d0 2024-04-15T21:05:17.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac00f690 con 0x7f4eb81003d0 2024-04-15T21:05:17.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.263+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb819b660 con 0x7f4eb81003d0 2024-04-15T21:05:17.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.264+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb818fb00 con 0x7f4eb81003d0 2024-04-15T21:05:17.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.265+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4eac004b70 con 0x7f4eb81003d0 2024-04-15T21:05:17.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.265+0000 7f4eb57fa700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 0x7f4ea00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.265+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4eac0907e0 con 0x7f4eb81003d0 2024-04-15T21:05:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.265+0000 7f4eb7fff700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 0x7f4ea00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.266+0000 7f4eb7fff700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 0x7f4ea00712a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005950 tx=0x7f4ea8005f50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.270+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4eac05cf50 con 0x7f4eb81003d0 2024-04-15T21:05:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.502+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eb8061190 con 0x7f4ea006edf0 2024-04-15T21:05:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.504+0000 7f4eb57fa700 1 -- 172.21.15.72:0/4282309924 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4eb8061190 con 0x7f4ea006edf0 2024-04-15T21:05:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 msgr2=0x7f4ea00712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 0x7f4ea00712a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005950 tx=0x7f4ea8005f50 comp rx=0 tx=0).stop 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 msgr2=0x7f4eb8195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b5c0 tx=0x7f4eac00be20 comp rx=0 tx=0).stop 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 shutdown_connections 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4ea006edf0 0x7f4ea00712a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb80ff130 0x7f4eb8195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 --2- 172.21.15.72:0/4282309924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb81003d0 0x7f4eb8195fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 >> 172.21.15.72:0/4282309924 conn(0x7f4eb80fa780 msgr2=0x7f4eb80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 shutdown_connections 2024-04-15T21:05:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.506+0000 7f4ebe356700 1 -- 172.21.15.72:0/4282309924 wait complete. 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 -- 172.21.15.72:0/41807322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1021f0 msgr2=0x7f282c0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 --2- 172.21.15.72:0/41807322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1021f0 0x7f282c0fe320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f281c009910 tx=0x7f281c009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 -- 172.21.15.72:0/41807322 shutdown_connections 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 --2- 172.21.15.72:0/41807322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1021f0 0x7f282c0fe320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 --2- 172.21.15.72:0/41807322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1018a0 0x7f282c101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 -- 172.21.15.72:0/41807322 >> 172.21.15.72:0/41807322 conn(0x7f282c0f9f10 msgr2=0x7f282c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 -- 172.21.15.72:0/41807322 shutdown_connections 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.615+0000 7f2833e9b700 1 -- 172.21.15.72:0/41807322 wait complete. 2024-04-15T21:05:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 Processor -- start 2024-04-15T21:05:17.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 -- start start 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1021f0 0x7f282c0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0ffb30 con 0x7f282c1018a0 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2833e9b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0ffc70 con 0x7f282c1021f0 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2831c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2831c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44246/0 (socket says 172.21.15.72:44246) 2024-04-15T21:05:17.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2831c37700 1 -- 172.21.15.72:0/2549175431 learned_addr learned my addr 172.21.15.72:0/2549175431 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.616+0000 7f2831436700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1021f0 0x7f282c0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2831c37700 1 -- 172.21.15.72:0/2549175431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1021f0 msgr2=0x7f282c0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2831c37700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1021f0 0x7f282c0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2831c37700 1 -- 172.21.15.72:0/2549175431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0095f0 con 0x7f282c1018a0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2831c37700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f282800e920 tx=0x7f282800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282800c9d0 con 0x7f282c1018a0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2828010430 con 0x7f282c1018a0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0fff50 con 0x7f282c1018a0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.617+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828018650 con 0x7f282c1018a0 2024-04-15T21:05:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.618+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c19db40 con 0x7f282c1018a0 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.619+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f282800cb30 con 0x7f282c1018a0 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.619+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c108d10 con 0x7f282c1018a0 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.619+0000 7f2822ffd700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 0x7f28180712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.619+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2828014070 con 0x7f282c1018a0 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.619+0000 7f2831436700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 0x7f28180712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.620+0000 7f2831436700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 0x7f28180712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b6f0 tx=0x7f281c005940 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.624+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2828094060 con 0x7f282c1018a0 2024-04-15T21:05:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.845+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f282c105f90 con 0x7f281806ee00 2024-04-15T21:05:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.856+0000 7f2822ffd700 1 -- 172.21.15.72:0/2549175431 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f282c105f90 con 0x7f281806ee00 2024-04-15T21:05:17.848 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:05:17.848 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (9m) 37s ago 11m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:05:17.848 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (11m) 37s ago 11m 7805k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (10m) 22s ago 10m 7796k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (11m) 37s ago 11m 6665k - 18.2.0 dc2bc1663786 6b8b2bfa9713 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (10m) 22s ago 10m 6660k - 18.2.0 dc2bc1663786 b77a0bc82711 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (9m) 37s ago 11m 84.7M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (5m) 37s ago 5m 16.6M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (5m) 37s ago 5m 14.8M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (5m) 22s ago 5m 16.8M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (5m) 22s ago 5m 151M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (2m) 37s ago 12m 475M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (71s) 22s ago 10m 449M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (50s) 37s ago 13m 28.9M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (28s) 22s ago 10m 24.9M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (11m) 37s ago 11m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:05:17.849 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 22s ago 10m 16.6M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (9m) 37s ago 9m 214M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (9m) 37s ago 9m 220M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (8m) 37s ago 8m 181M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (8m) 22s ago 8m 242M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (7m) 22s ago 7m 219M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (7m) 22s ago 7m 196M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:05:17.850 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (82s) 37s ago 10m 60.0M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 msgr2=0x7f28180712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 0x7f28180712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b6f0 tx=0x7f281c005940 comp rx=0 tx=0).stop 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 msgr2=0x7f282c100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f282800e920 tx=0x7f282800ec30 comp rx=0 tx=0).stop 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 shutdown_connections 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f281806ee00 0x7f28180712b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1018a0 0x7f282c100fa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 --2- 172.21.15.72:0/2549175431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f282c1021f0 0x7f282c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 >> 172.21.15.72:0/2549175431 conn(0x7f282c0f9f10 msgr2=0x7f282c104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 shutdown_connections 2024-04-15T21:05:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.859+0000 7f2833e9b700 1 -- 172.21.15.72:0/2549175431 wait complete. 2024-04-15T21:05:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- 172.21.15.72:0/446711644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450103680 msgr2=0x7f8450105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 --2- 172.21.15.72:0/446711644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450103680 0x7f8450105a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8440009910 tx=0x7f8440009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- 172.21.15.72:0/446711644 shutdown_connections 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 --2- 172.21.15.72:0/446711644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450103680 0x7f8450105a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 --2- 172.21.15.72:0/446711644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450100d60 0x7f8450103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- 172.21.15.72:0/446711644 >> 172.21.15.72:0/446711644 conn(0x7f84500fa780 msgr2=0x7f84500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- 172.21.15.72:0/446711644 shutdown_connections 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- 172.21.15.72:0/446711644 wait complete. 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 Processor -- start 2024-04-15T21:05:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.963+0000 7f84562bc700 1 -- start start 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f84562bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f84562bc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450103680 0x7f8450196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f84562bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501965b0 con 0x7f8450100d60 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f84562bc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501966f0 con 0x7f8450103680 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44258/0 (socket says 172.21.15.72:44258) 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 -- 172.21.15.72:0/818694727 learned_addr learned my addr 172.21.15.72:0/818694727 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844f7fe700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450103680 0x7f8450196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 -- 172.21.15.72:0/818694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450103680 msgr2=0x7f8450196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450103680 0x7f8450196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 -- 172.21.15.72:0/818694727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400095f0 con 0x7f8450100d60 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844ffff700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843800c960 tx=0x7f843800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.964+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8438007a70 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.965+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8438007bd0 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.965+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845019b1b0 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.965+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8438018630 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.965+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845019b6d0 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.966+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845018fbe0 con 0x7f8450100d60 2024-04-15T21:05:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.966+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f843800f450 con 0x7f8450100d60 2024-04-15T21:05:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.966+0000 7f844d7fa700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 0x7f843c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.967+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f843808f070 con 0x7f8450100d60 2024-04-15T21:05:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.967+0000 7f844f7fe700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 0x7f843c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.967+0000 7f844f7fe700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 0x7f843c0712b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8440006010 tx=0x7f844000b580 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:17.971+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f843805b520 con 0x7f8450100d60 2024-04-15T21:05:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.266+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f845002cee0 con 0x7f8450100d60 2024-04-15T21:05:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.266+0000 7f844d7fa700 1 -- 172.21.15.72:0/818694727 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f843805b340 con 0x7f8450100d60 2024-04-15T21:05:18.258 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:05:18.259 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-04-15T21:05:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:05:18.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:05:18.260 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.268+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 msgr2=0x7f843c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.268+0000 7f84562bc700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 0x7f843c0712b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8440006010 tx=0x7f844000b580 comp rx=0 tx=0).stop 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.268+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 msgr2=0x7f8450195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.268+0000 7f84562bc700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843800c960 tx=0x7f843800cd20 comp rx=0 tx=0).stop 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 shutdown_connections 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f843c06ee00 0x7f843c0712b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8450100d60 0x7f8450195ae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 --2- 172.21.15.72:0/818694727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450103680 0x7f8450196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 >> 172.21.15.72:0/818694727 conn(0x7f84500fa780 msgr2=0x7f84500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 shutdown_connections 2024-04-15T21:05:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.269+0000 7f84562bc700 1 -- 172.21.15.72:0/818694727 wait complete. 2024-04-15T21:05:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 -- 172.21.15.72:0/1710246843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0103680 msgr2=0x7f92b0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 --2- 172.21.15.72:0/1710246843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0103680 0x7f92b0105a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009910 tx=0x7f92a4009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 -- 172.21.15.72:0/1710246843 shutdown_connections 2024-04-15T21:05:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 --2- 172.21.15.72:0/1710246843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0103680 0x7f92b0105a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 --2- 172.21.15.72:0/1710246843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0100d60 0x7f92b0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 -- 172.21.15.72:0/1710246843 >> 172.21.15.72:0/1710246843 conn(0x7f92b00fa780 msgr2=0x7f92b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 -- 172.21.15.72:0/1710246843 shutdown_connections 2024-04-15T21:05:18.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 -- 172.21.15.72:0/1710246843 wait complete. 2024-04-15T21:05:18.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.373+0000 7f92b521f700 1 Processor -- start 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92b521f700 1 -- start start 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92b521f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92b521f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0103680 0x7f92b0196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92b521f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0196640 con 0x7f92b0100d60 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92b521f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0196780 con 0x7f92b0103680 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44282/0 (socket says 172.21.15.72:44282) 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 -- 172.21.15.72:0/2753074437 learned_addr learned my addr 172.21.15.72:0/2753074437 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92ae59c700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0103680 0x7f92b0196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 -- 172.21.15.72:0/2753074437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0103680 msgr2=0x7f92b0196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0103680 0x7f92b0196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 -- 172.21.15.72:0/2753074437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40095f0 con 0x7f92b0100d60 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.374+0000 7f92aed9d700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92a000e8f0 tx=0x7f92a000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:18.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.375+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a0009790 con 0x7f92b0100d60 2024-04-15T21:05:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.375+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b019b230 con 0x7f92b0100d60 2024-04-15T21:05:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.375+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92a000c810 con 0x7f92b0100d60 2024-04-15T21:05:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.375+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a00055b0 con 0x7f92b0100d60 2024-04-15T21:05:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.375+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b019b780 con 0x7f92b0100d60 2024-04-15T21:05:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.376+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b018fbe0 con 0x7f92b0100d60 2024-04-15T21:05:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.376+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f92a0021440 con 0x7f92b0100d60 2024-04-15T21:05:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.377+0000 7f9297fff700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 0x7f92980712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.377+0000 7f92ae59c700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 0x7f92980712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.377+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f92a0014070 con 0x7f92b0100d60 2024-04-15T21:05:18.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.377+0000 7f92ae59c700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 0x7f92980712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009fd0 tx=0x7f92a4005940 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.381+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92a000c980 con 0x7f92b0100d60 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: pgmap v24: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: Reconfiguring crash.smithi149 (monmap changed)... 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: Reconfiguring daemon crash.smithi149 on smithi149 2024-04-15T21:05:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:18 smithi149 ceph-mon[67036]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:18.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.626+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92b002cc30 con 0x7f92b0100d60 2024-04-15T21:05:18.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: pgmap v24: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:18.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:18.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:18.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:18.619 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: Reconfiguring crash.smithi149 (monmap changed)... 2024-04-15T21:05:18.620 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:18.620 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:18.620 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: Reconfiguring daemon crash.smithi149 on smithi149 2024-04-15T21:05:18.620 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:18 smithi072 ceph-mon[78970]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.627+0000 7f9297fff700 1 -- 172.21.15.72:0/2753074437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f92a005b740 con 0x7f92b0100d60 2024-04-15T21:05:18.620 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:05:18.620 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:05:18.620 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:05:18.621 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:05:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:18.623 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 msgr2=0x7f92980712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 0x7f92980712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009fd0 tx=0x7f92a4005940 comp rx=0 tx=0).stop 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 msgr2=0x7f92b0195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92a000e8f0 tx=0x7f92a000ec00 comp rx=0 tx=0).stop 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 shutdown_connections 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ee00 0x7f92980712b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92b0100d60 0x7f92b0195ae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 --2- 172.21.15.72:0/2753074437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92b0103680 0x7f92b0196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 >> 172.21.15.72:0/2753074437 conn(0x7f92b00fa780 msgr2=0x7f92b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 shutdown_connections 2024-04-15T21:05:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.629+0000 7f92b521f700 1 -- 172.21.15.72:0/2753074437 wait complete. 2024-04-15T21:05:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:05:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 -- 172.21.15.72:0/1064903505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc0737b0 msgr2=0x7efddc073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 --2- 172.21.15.72:0/1064903505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc0737b0 0x7efddc073c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009910 tx=0x7efdc4009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 -- 172.21.15.72:0/1064903505 shutdown_connections 2024-04-15T21:05:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 --2- 172.21.15.72:0/1064903505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc0737b0 0x7efddc073c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 --2- 172.21.15.72:0/1064903505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc074d80 0x7efddc0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 -- 172.21.15.72:0/1064903505 >> 172.21.15.72:0/1064903505 conn(0x7efddc0fb7f0 msgr2=0x7efddc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 -- 172.21.15.72:0/1064903505 shutdown_connections 2024-04-15T21:05:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.736+0000 7efde1591700 1 -- 172.21.15.72:0/1064903505 wait complete. 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 Processor -- start 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 -- start start 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0737b0 0x7efddc19c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc19cc90 con 0x7efddc074d80 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc19cdd0 con 0x7efddc0737b0 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44304/0 (socket says 172.21.15.72:44304) 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 -- 172.21.15.72:0/2532475903 learned_addr learned my addr 172.21.15.72:0/2532475903 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efddaffd700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0737b0 0x7efddc19c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 -- 172.21.15.72:0/2532475903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0737b0 msgr2=0x7efddc19c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0737b0 0x7efddc19c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 -- 172.21.15.72:0/2532475903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40095f0 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd3fff700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efdc4006010 tx=0x7efdc400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc401d070 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efdc400f460 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.737+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc1a1820 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.738+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc4021640 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.738+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc1a1d10 con 0x7efddc074d80 2024-04-15T21:05:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.739+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc10f3f0 con 0x7efddc074d80 2024-04-15T21:05:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.740+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7efdc400fab0 con 0x7efddc074d80 2024-04-15T21:05:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.740+0000 7efdd8ff9700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 0x7efdc80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.740+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efdc40908d0 con 0x7efddc074d80 2024-04-15T21:05:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.740+0000 7efddaffd700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 0x7efdc80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.741+0000 7efddaffd700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 0x7efdc80712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006fd0 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.744+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efdc405d0b0 con 0x7efddc074d80 2024-04-15T21:05:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.975+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efddc1a2410 con 0x7efdc806ee00 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.976+0000 7efdd8ff9700 1 -- 172.21.15.72:0/2532475903 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efddc1a2410 con 0x7efdc806ee00 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:05:18.968 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:05:18.969 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:05:18.969 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "4/23 daemons upgraded", 2024-04-15T21:05:18.969 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mon daemons", 2024-04-15T21:05:18.969 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:05:18.969 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:05:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 msgr2=0x7efdc80712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 0x7efdc80712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006fd0 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 msgr2=0x7efddc19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efdc4006010 tx=0x7efdc400be20 comp rx=0 tx=0).stop 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 shutdown_connections 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efdc806ee00 0x7efdc80712b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efddc0737b0 0x7efddc19c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 --2- 172.21.15.72:0/2532475903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efddc074d80 0x7efddc19c670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 >> 172.21.15.72:0/2532475903 conn(0x7efddc0fb7f0 msgr2=0x7efddc101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 shutdown_connections 2024-04-15T21:05:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:18.978+0000 7efde1591700 1 -- 172.21.15.72:0/2532475903 wait complete. 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 -- 172.21.15.72:0/3154213421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 msgr2=0x7f7ac4101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 --2- 172.21.15.72:0/3154213421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4101580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009910 tx=0x7f7ab8009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 -- 172.21.15.72:0/3154213421 shutdown_connections 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 --2- 172.21.15.72:0/3154213421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4101580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 --2- 172.21.15.72:0/3154213421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 0x7f7ac40fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.082+0000 7f7aca985700 1 -- 172.21.15.72:0/3154213421 >> 172.21.15.72:0/3154213421 conn(0x7f7ac40f9f10 msgr2=0x7f7ac40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 -- 172.21.15.72:0/3154213421 shutdown_connections 2024-04-15T21:05:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 -- 172.21.15.72:0/3154213421 wait complete. 2024-04-15T21:05:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 Processor -- start 2024-04-15T21:05:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 -- start start 2024-04-15T21:05:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 0x7f7ac4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.083+0000 7f7aca985700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7aca985700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4196670 con 0x7f7ac40fee50 2024-04-15T21:05:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7aca985700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41967b0 con 0x7f7ac40fe500 2024-04-15T21:05:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44324/0 (socket says 172.21.15.72:44324) 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 -- 172.21.15.72:0/4107112200 learned_addr learned my addr 172.21.15.72:0/4107112200 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac3fff700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 0x7f7ac4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 -- 172.21.15.72:0/4107112200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 msgr2=0x7f7ac4195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 0x7f7ac4195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 -- 172.21.15.72:0/4107112200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80095f0 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac37fe700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800bd70 tx=0x7f7ab800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab801d070 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ab8005dc0 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac419b200 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab8021410 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.084+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac419b6f0 con 0x7f7ac40fee50 2024-04-15T21:05:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.085+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac4108d10 con 0x7f7ac40fee50 2024-04-15T21:05:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.086+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f7ab800f7b0 con 0x7f7ac40fee50 2024-04-15T21:05:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.086+0000 7f7ac17fa700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 0x7f7aac0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.086+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7ab8090390 con 0x7f7ac40fee50 2024-04-15T21:05:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.086+0000 7f7ac3fff700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 0x7f7aac0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.087+0000 7f7ac3fff700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 0x7f7aac0712b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005950 tx=0x7f7ab400b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.091+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7ab805ca50 con 0x7f7ac40fee50 2024-04-15T21:05:19.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.379+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ac4108ed0 con 0x7f7ac40fee50 2024-04-15T21:05:19.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.380+0000 7f7ac17fa700 1 -- 172.21.15.72:0/4107112200 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7ab805c5e0 con 0x7f7ac40fee50 2024-04-15T21:05:19.372 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:05:19.372 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:05:19.372 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:05:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 msgr2=0x7f7aac0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 0x7f7aac0712b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005950 tx=0x7f7ab400b410 comp rx=0 tx=0).stop 2024-04-15T21:05:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 msgr2=0x7f7ac4196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800bd70 tx=0x7f7ab800bda0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 shutdown_connections 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7aac06ee00 0x7f7aac0712b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ac40fe500 0x7f7ac4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 --2- 172.21.15.72:0/4107112200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac40fee50 0x7f7ac4196050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 >> 172.21.15.72:0/4107112200 conn(0x7f7ac40f9f10 msgr2=0x7f7ac41047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 shutdown_connections 2024-04-15T21:05:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:19.382+0000 7f7aca985700 1 -- 172.21.15.72:0/4107112200 wait complete. 2024-04-15T21:05:19.511 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:19.511 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/818694727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:19.511 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2753074437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:05:19.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:19.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:19.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:05:19.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:05:19.512 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/818694727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2753074437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.qgbaiy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-15T21:05:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: Reconfiguring mgr.smithi149.qgbaiy (monmap changed)... 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: Reconfiguring daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: pgmap v25: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/4107112200' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:05:20.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:20.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: Reconfiguring mgr.smithi149.qgbaiy (monmap changed)... 2024-04-15T21:05:20.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: Reconfiguring daemon mgr.smithi149.qgbaiy on smithi149 2024-04-15T21:05:20.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: pgmap v25: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:20.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:20.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/4107112200' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:05:20.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: Reconfiguring mon.smithi149 (monmap changed)... 2024-04-15T21:05:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:05:21.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:05:21.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:21.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:21 smithi072 ceph-mon[78970]: Reconfiguring daemon mon.smithi149 on smithi149 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: Reconfiguring mon.smithi149 (monmap changed)... 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:21.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:21 smithi149 ceph-mon[67036]: Reconfiguring daemon mon.smithi149 on smithi149 2024-04-15T21:05:22.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:22 smithi149 ceph-mon[67036]: pgmap v26: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:22.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:22.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:22.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T21:05:22.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:22 smithi072 ceph-mon[78970]: pgmap v26: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T21:05:22.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:23.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:23 smithi072 ceph-mon[78970]: Reconfiguring osd.3 (monmap changed)... 2024-04-15T21:05:23.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:23 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.3 on smithi149 2024-04-15T21:05:23.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:23 smithi149 ceph-mon[67036]: Reconfiguring osd.3 (monmap changed)... 2024-04-15T21:05:23.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:23 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.3 on smithi149 2024-04-15T21:05:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:24 smithi072 ceph-mon[78970]: pgmap v27: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T21:05:24.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:24.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:24 smithi149 ceph-mon[67036]: pgmap v27: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:24.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:24.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:24.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T21:05:24.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:25.398 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:25 smithi149 ceph-mon[67036]: Reconfiguring osd.4 (monmap changed)... 2024-04-15T21:05:25.398 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:25 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.4 on smithi149 2024-04-15T21:05:25.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:25 smithi072 ceph-mon[78970]: Reconfiguring osd.4 (monmap changed)... 2024-04-15T21:05:25.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:25 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.4 on smithi149 2024-04-15T21:05:26.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: pgmap v28: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:26.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:26.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:26.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: Reconfiguring osd.5 (monmap changed)... 2024-04-15T21:05:26.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T21:05:26.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:26.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:26 smithi149 ceph-mon[67036]: Reconfiguring daemon osd.5 on smithi149 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: pgmap v28: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: Reconfiguring osd.5 (monmap changed)... 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:26 smithi072 ceph-mon[78970]: Reconfiguring daemon osd.5 on smithi149 2024-04-15T21:05:28.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: pgmap v29: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:28.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:28.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:28.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: Reconfiguring mds.cephfs.smithi149.mflbpn (monmap changed)... 2024-04-15T21:05:28.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:28.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:28.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:28 smithi072 ceph-mon[78970]: Reconfiguring daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: pgmap v29: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: Reconfiguring mds.cephfs.smithi149.mflbpn (monmap changed)... 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:28.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:28 smithi149 ceph-mon[67036]: Reconfiguring daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: pgmap v30: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: Reconfiguring mds.cephfs.smithi149.jwobda (monmap changed)... 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:30.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:30 smithi149 ceph-mon[67036]: Reconfiguring daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: pgmap v30: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: Reconfiguring mds.cephfs.smithi149.jwobda (monmap changed)... 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:30 smithi072 ceph-mon[78970]: Reconfiguring daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all mon 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:31.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]: dispatch 2024-04-15T21:05:31.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]': finished 2024-04-15T21:05:31.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]: dispatch 2024-04-15T21:05:31.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-04-15T21:05:31.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:31 smithi072 ceph-mon[78970]: pgmap v31: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:32.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:32.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:32.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all mon 2024-04-15T21:05:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:32.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]: dispatch 2024-04-15T21:05:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]': finished 2024-04-15T21:05:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]: dispatch 2024-04-15T21:05:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-04-15T21:05:32.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:31 smithi149 ceph-mon[67036]: pgmap v31: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:33.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:33 smithi072 ceph-mon[78970]: Upgrade: Updating crash.smithi072 (1/2) 2024-04-15T21:05:33.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:33 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:33.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:33 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:33.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:33 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:33.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:33 smithi072 ceph-mon[78970]: Deploying daemon crash.smithi072 on smithi072 2024-04-15T21:05:33.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:33 smithi149 ceph-mon[67036]: Upgrade: Updating crash.smithi072 (1/2) 2024-04-15T21:05:33.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:33 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:33.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:33 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:33.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:33 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:33.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:33 smithi149 ceph-mon[67036]: Deploying daemon crash.smithi072 on smithi072 2024-04-15T21:05:34.544 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:34 smithi072 ceph-mon[78970]: pgmap v32: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:34.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:34 smithi149 ceph-mon[67036]: pgmap v32: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:35.591 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:35.840 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:36.793 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:36 smithi149 ceph-mon[67036]: pgmap v33: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:36.793 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:36.793 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:36.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:36 smithi072 ceph-mon[78970]: pgmap v33: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:36.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:36.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:38.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:38 smithi072 ceph-mon[78970]: pgmap v34: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:38.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:38.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:38.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:38.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:38 smithi149 ceph-mon[67036]: pgmap v34: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:38.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:38.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-15T21:05:38.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:39.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:39 smithi072 ceph-mon[78970]: Upgrade: Updating crash.smithi149 (2/2) 2024-04-15T21:05:39.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:39 smithi072 ceph-mon[78970]: Deploying daemon crash.smithi149 on smithi149 2024-04-15T21:05:39.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:39 smithi149 ceph-mon[67036]: Upgrade: Updating crash.smithi149 (2/2) 2024-04-15T21:05:39.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:39 smithi149 ceph-mon[67036]: Deploying daemon crash.smithi149 on smithi149 2024-04-15T21:05:40.621 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:40 smithi149 ceph-mon[67036]: pgmap v35: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:40.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:40 smithi072 ceph-mon[78970]: pgmap v35: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:42 smithi072 ceph-mon[78970]: pgmap v36: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:42.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:42.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:42 smithi149 ceph-mon[67036]: pgmap v36: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:42.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:42.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:42.802 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:44.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:44 smithi072 ceph-mon[78970]: pgmap v37: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:44.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:44 smithi149 ceph-mon[67036]: pgmap v37: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:46.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:46.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:46.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:45 smithi072 ceph-mon[78970]: pgmap v38: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:46.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:45 smithi149 ceph-mon[67036]: pgmap v38: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:47.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:47.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:47.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:48.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:48 smithi072 ceph-mon[78970]: pgmap v39: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:48 smithi149 ceph-mon[67036]: pgmap v39: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:49.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:49 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:49.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:49 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:49 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:49 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 -- 172.21.15.72:0/3448017736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 msgr2=0x7fb8ac105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 --2- 172.21.15.72:0/3448017736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac105a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009910 tx=0x7fb8a8009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 -- 172.21.15.72:0/3448017736 shutdown_connections 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 --2- 172.21.15.72:0/3448017736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac105a80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 --2- 172.21.15.72:0/3448017736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 0x7fb8ac103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 -- 172.21.15.72:0/3448017736 >> 172.21.15.72:0/3448017736 conn(0x7fb8ac0fa7a0 msgr2=0x7fb8ac0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 -- 172.21.15.72:0/3448017736 shutdown_connections 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.490+0000 7fb8b4651700 1 -- 172.21.15.72:0/3448017736 wait complete. 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 Processor -- start 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 -- start start 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 0x7fb8ac195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac196920 con 0x7fb8ac1036a0 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b4651700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac196a60 con 0x7fb8ac100d80 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b1bec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b1bec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38376/0 (socket says 172.21.15.72:38376) 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b1bec700 1 -- 172.21.15.72:0/1789408747 learned_addr learned my addr 172.21.15.72:0/1789408747 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b23ed700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 0x7fb8ac195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b1bec700 1 -- 172.21.15.72:0/1789408747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 msgr2=0x7fb8ac195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.491+0000 7fb8b1bec700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 0x7fb8ac195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8b1bec700 1 -- 172.21.15.72:0/1789408747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80095f0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8b1bec700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000c00 tx=0x7fb8a800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a801d070 con 0x7fb8ac1036a0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8a8005dc0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac19b4b0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a80226a0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.492+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac19b9a0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.493+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac18fc00 con 0x7fb8ac1036a0 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.494+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fb8a80038f0 con 0x7fb8ac1036a0 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.494+0000 7fb8a37fe700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 0x7fb8980712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.494+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb8a8090580 con 0x7fb8ac1036a0 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.494+0000 7fb8b23ed700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 0x7fb8980712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.495+0000 7fb8b23ed700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 0x7fb8980712b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac069890 tx=0x7fb89c009260 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:49.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.499+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb8a805cc40 con 0x7fb8ac1036a0 2024-04-15T21:05:49.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.725+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8ac02cf60 con 0x7fb89806ee00 2024-04-15T21:05:49.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.726+0000 7fb8a37fe700 1 -- 172.21.15.72:0/1789408747 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fb8ac02cf60 con 0x7fb89806ee00 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 msgr2=0x7fb8980712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 0x7fb8980712b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac069890 tx=0x7fb89c009260 comp rx=0 tx=0).stop 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 msgr2=0x7fb8ac196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000c00 tx=0x7fb8a800f690 comp rx=0 tx=0).stop 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 shutdown_connections 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb89806ee00 0x7fb8980712b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8ac100d80 0x7fb8ac195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 --2- 172.21.15.72:0/1789408747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac1036a0 0x7fb8ac196300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 >> 172.21.15.72:0/1789408747 conn(0x7fb8ac0fa7a0 msgr2=0x7fb8ac0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 shutdown_connections 2024-04-15T21:05:49.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.729+0000 7fb8b4651700 1 -- 172.21.15.72:0/1789408747 wait complete. 2024-04-15T21:05:49.731 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 -- 172.21.15.72:0/500473226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 msgr2=0x7fdb5c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/500473226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c0ff540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009910 tx=0x7fdb4c009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 -- 172.21.15.72:0/500473226 shutdown_connections 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/500473226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 0x7fdb5c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/500473226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c0ff540 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 -- 172.21.15.72:0/500473226 >> 172.21.15.72:0/500473226 conn(0x7fdb5c0fa780 msgr2=0x7fdb5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 -- 172.21.15.72:0/500473226 shutdown_connections 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.839+0000 7fdb60cf1700 1 -- 172.21.15.72:0/500473226 wait complete. 2024-04-15T21:05:49.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 Processor -- start 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 -- start start 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 0x7fdb5c194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c195480 con 0x7fdb5c0ff130 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb60cf1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1955c0 con 0x7fdb5c1003d0 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb5a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.840+0000 7fdb5a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38392/0 (socket says 172.21.15.72:38392) 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb5a59c700 1 -- 172.21.15.72:0/3539237202 learned_addr learned my addr 172.21.15.72:0/3539237202 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb59d9b700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 0x7fdb5c194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb5a59c700 1 -- 172.21.15.72:0/3539237202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 msgr2=0x7fdb5c194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb5a59c700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 0x7fdb5c194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb5a59c700 1 -- 172.21.15.72:0/3539237202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0095f0 con 0x7fdb5c0ff130 2024-04-15T21:05:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb5a59c700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00bd70 tx=0x7fdb4c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c01f070 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c068540 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c068a00 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdb4c005940 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.841+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c00f690 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.842+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c005320 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.843+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fdb4c00f8f0 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.843+0000 7fdb4b7fe700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 0x7fdb440712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.844+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdb4c092580 con 0x7fdb5c0ff130 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.844+0000 7fdb59d9b700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 0x7fdb440712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.844+0000 7fdb59d9b700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 0x7fdb440712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000ac50 tx=0x7fdb5000a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:49.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:49.852+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdb4c05ed90 con 0x7fdb5c0ff130 2024-04-15T21:05:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.102+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb3c000bf0 con 0x7fdb4406ee00 2024-04-15T21:05:50.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.103+0000 7fdb4b7fe700 1 -- 172.21.15.72:0/3539237202 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fdb3c000bf0 con 0x7fdb4406ee00 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 msgr2=0x7fdb440712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 0x7fdb440712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000ac50 tx=0x7fdb5000a380 comp rx=0 tx=0).stop 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 msgr2=0x7fdb5c1949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00bd70 tx=0x7fdb4c00bda0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 shutdown_connections 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdb4406ee00 0x7fdb440712b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5c0ff130 0x7fdb5c1949b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 --2- 172.21.15.72:0/3539237202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb5c1003d0 0x7fdb5c194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.105+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 >> 172.21.15.72:0/3539237202 conn(0x7fdb5c0fa780 msgr2=0x7fdb5c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.106+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 shutdown_connections 2024-04-15T21:05:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.106+0000 7fdb60cf1700 1 -- 172.21.15.72:0/3539237202 wait complete. 2024-04-15T21:05:50.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.214+0000 7f33e0c51700 1 -- 172.21.15.72:0/2698469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 msgr2=0x7f33dc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.214+0000 7f33e0c51700 1 --2- 172.21.15.72:0/2698469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc100650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009910 tx=0x7f33cc009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 -- 172.21.15.72:0/2698469986 shutdown_connections 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 --2- 172.21.15.72:0/2698469986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc101440 0x7f33dc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 --2- 172.21.15.72:0/2698469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc100650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 -- 172.21.15.72:0/2698469986 >> 172.21.15.72:0/2698469986 conn(0x7f33dc0fb7f0 msgr2=0x7f33dc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 -- 172.21.15.72:0/2698469986 shutdown_connections 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 -- 172.21.15.72:0/2698469986 wait complete. 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 Processor -- start 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.215+0000 7f33e0c51700 1 -- start start 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc101440 0x7f33dc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc073680 con 0x7f33dc100240 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0737c0 con 0x7f33dc101440 2024-04-15T21:05:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38406/0 (socket says 172.21.15.72:38406) 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 -- 172.21.15.72:0/4066256547 learned_addr learned my addr 172.21.15.72:0/4066256547 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 -- 172.21.15.72:0/4066256547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc101440 msgr2=0x7f33dc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc101440 0x7f33dc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 -- 172.21.15.72:0/4066256547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0095f0 con 0x7f33dc100240 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33da59c700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bda0 tx=0x7f33cc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33cc01d070 con 0x7f33dc100240 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc073a40 con 0x7f33dc100240 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f33cc00f460 con 0x7f33dc100240 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33cc021640 con 0x7f33dc100240 2024-04-15T21:05:50.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.216+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc073f30 con 0x7f33dc100240 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.217+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc108d90 con 0x7f33dc100240 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.218+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f33cc00fa00 con 0x7f33dc100240 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.218+0000 7f33cb7fe700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 0x7f33c40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.219+0000 7f33d9d9b700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 0x7f33c40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.219+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f33cc0903d0 con 0x7f33dc100240 2024-04-15T21:05:50.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.219+0000 7f33d9d9b700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 0x7f33c40712b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f33d0005950 tx=0x7f33d00058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.223+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f33cc05ca90 con 0x7f33dc100240 2024-04-15T21:05:50.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.444+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f33dc19df50 con 0x7f33c406ee00 2024-04-15T21:05:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.455+0000 7f33cb7fe700 1 -- 172.21.15.72:0/4066256547 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f33dc19df50 con 0x7f33c406ee00 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (10m) 3s ago 12m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (12m) 3s ago 12m 7894k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (11m) 5s ago 11m 7864k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (14s) 3s ago 12m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (9s) 5s ago 11m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (10m) 3s ago 11m 83.7M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (6m) 3s ago 6m 17.2M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (6m) 3s ago 6m 15.5M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (6m) 5s ago 6m 17.1M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:05:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (6m) 5s ago 6m 151M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (2m) 3s ago 13m 500M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (104s) 5s ago 10m 450M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (83s) 3s ago 13m 42.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (61s) 5s ago 10m 34.0M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (12m) 3s ago 12m 16.5M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 5s ago 10m 16.1M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (10m) 3s ago 10m 214M 1216M 18.2.0 dc2bc1663786 a0cb9f0d1fc8 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (9m) 3s ago 9m 221M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (9m) 3s ago 9m 183M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (8m) 5s ago 8m 242M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (8m) 5s ago 8m 220M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (7m) 5s ago 7m 197M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:05:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (115s) 3s ago 11m 66.8M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.457+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 msgr2=0x7f33c40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 0x7f33c40712b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f33d0005950 tx=0x7f33d00058e0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 msgr2=0x7f33dc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bda0 tx=0x7f33cc00be80 comp rx=0 tx=0).stop 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 shutdown_connections 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33c406ee00 0x7f33c40712b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc100240 0x7f33dc074af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 --2- 172.21.15.72:0/4066256547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc101440 0x7f33dc073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 >> 172.21.15.72:0/4066256547 conn(0x7f33dc0fb7f0 msgr2=0x7f33dc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 shutdown_connections 2024-04-15T21:05:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.458+0000 7f33e0c51700 1 -- 172.21.15.72:0/4066256547 wait complete. 2024-04-15T21:05:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/3099654960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f41002a0 msgr2=0x7ff7f4100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/3099654960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f41002a0 0x7ff7f4100710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009910 tx=0x7ff7e8009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/3099654960 shutdown_connections 2024-04-15T21:05:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/3099654960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f41002a0 0x7ff7f4100710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/3099654960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f40ff000 0x7ff7f40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/3099654960 >> 172.21.15.72:0/3099654960 conn(0x7ff7f40fa610 msgr2=0x7ff7f40fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.558 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:50 smithi072 ceph-mon[78970]: pgmap v40: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:50.558 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:50.558 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:50.558 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/3099654960 shutdown_connections 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.565+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/3099654960 wait complete. 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 Processor -- start 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 -- start start 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f41002a0 0x7ff7f4194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f41953a0 con 0x7ff7f40ff000 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7fb6f4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f41954e0 con 0x7ff7f41002a0 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7f9490700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7f9490700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38414/0 (socket says 172.21.15.72:38414) 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.566+0000 7ff7f9490700 1 -- 172.21.15.72:0/977095562 learned_addr learned my addr 172.21.15.72:0/977095562 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f9490700 1 -- 172.21.15.72:0/977095562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f41002a0 msgr2=0x7ff7f4194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f9490700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f41002a0 0x7ff7f4194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f9490700 1 -- 172.21.15.72:0/977095562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80095f0 con 0x7ff7f40ff000 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f9490700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400ba50 tx=0x7ff7e400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7e400ca00 con 0x7ff7f40ff000 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f4199f90 con 0x7ff7f40ff000 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff7e400cb60 con 0x7ff7f40ff000 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7e4007580 con 0x7ff7f40ff000 2024-04-15T21:05:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.567+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f419a500 con 0x7ff7f40ff000 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.568+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4107b60 con 0x7ff7f40ff000 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.569+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7ff7e400ccd0 con 0x7ff7f40ff000 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.569+0000 7ff7f27fc700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 0x7ff7dc0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.569+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff7e4006e40 con 0x7ff7f40ff000 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.569+0000 7ff7f8c8f700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 0x7ff7dc0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.570+0000 7ff7f8c8f700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 0x7ff7dc0712b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800b5c0 tx=0x7ff7e8005960 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.574+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff7e405ad60 con 0x7ff7f40ff000 2024-04-15T21:05:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:50 smithi149 ceph-mon[67036]: pgmap v40: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:50.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:05:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.880+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7f419aba0 con 0x7ff7f40ff000 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.881+0000 7ff7f27fc700 1 -- 172.21.15.72:0/977095562 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7ff7e405ab80 con 0x7ff7f40ff000 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:05:50.873 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:05:50.874 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:05:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 msgr2=0x7ff7dc0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 0x7ff7dc0712b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800b5c0 tx=0x7ff7e8005960 comp rx=0 tx=0).stop 2024-04-15T21:05:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 msgr2=0x7ff7f4194840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400ba50 tx=0x7ff7e400be10 comp rx=0 tx=0).stop 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 shutdown_connections 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff7dc06ee00 0x7ff7dc0712b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f40ff000 0x7ff7f4194840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 --2- 172.21.15.72:0/977095562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7f41002a0 0x7ff7f4194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 >> 172.21.15.72:0/977095562 conn(0x7ff7f40fa610 msgr2=0x7ff7f40fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 shutdown_connections 2024-04-15T21:05:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.883+0000 7ff7fb6f4700 1 -- 172.21.15.72:0/977095562 wait complete. 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- 172.21.15.72:0/2126456316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b81003d0 msgr2=0x7f82b8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 --2- 172.21.15.72:0/2126456316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b81003d0 0x7f82b8100840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009910 tx=0x7f82ac009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- 172.21.15.72:0/2126456316 shutdown_connections 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 --2- 172.21.15.72:0/2126456316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b81003d0 0x7f82b8100840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 --2- 172.21.15.72:0/2126456316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b80ff130 0x7f82b80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- 172.21.15.72:0/2126456316 >> 172.21.15.72:0/2126456316 conn(0x7f82b80fa780 msgr2=0x7f82b80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:50.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- 172.21.15.72:0/2126456316 shutdown_connections 2024-04-15T21:05:50.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- 172.21.15.72:0/2126456316 wait complete. 2024-04-15T21:05:50.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 Processor -- start 2024-04-15T21:05:50.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.991+0000 7f82be78f700 1 -- start start 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82be78f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82be78f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 0x7f82b81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82be78f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8101cf0 con 0x7f82b80ff130 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82be78f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8101e30 con 0x7f82b81003d0 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38436/0 (socket says 172.21.15.72:38436) 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 -- 172.21.15.72:0/443173798 learned_addr learned my addr 172.21.15.72:0/443173798 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b77fe700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 0x7f82b81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 -- 172.21.15.72:0/443173798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 msgr2=0x7f82b81017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 0x7f82b81017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 -- 172.21.15.72:0/443173798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0095f0 con 0x7f82b80ff130 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b77fe700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 0x7f82b81017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b7fff700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d8d0 tx=0x7f82a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.992+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a8009940 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.993+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82a8010460 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.993+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b8102110 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.993+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a800f5f0 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.993+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b819dad0 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.994+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b8107c10 con 0x7f82b80ff130 2024-04-15T21:05:50.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.994+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f82a80105d0 con 0x7f82b80ff130 2024-04-15T21:05:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.995+0000 7f82b57fa700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 0x7f82a00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.995+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f82a808f0d0 con 0x7f82b80ff130 2024-04-15T21:05:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.995+0000 7f82b77fe700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 0x7f82a00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.995+0000 7f82b77fe700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 0x7f82a00712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82ac006010 tx=0x7f82ac00b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:50.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:50.999+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f82a805b790 con 0x7f82b80ff130 2024-04-15T21:05:51.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.257+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f82b819e2d0 con 0x7f82b80ff130 2024-04-15T21:05:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.261+0000 7f82b57fa700 1 -- 172.21.15.72:0/443173798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f82a805b320 con 0x7f82b80ff130 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:05:51.254 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:05:51.255 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:51.256 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:51.257 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:05:51.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 msgr2=0x7f82a00712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 0x7f82a00712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82ac006010 tx=0x7f82ac00b540 comp rx=0 tx=0).stop 2024-04-15T21:05:51.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 msgr2=0x7f82b8103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d8d0 tx=0x7f82a800dc90 comp rx=0 tx=0).stop 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 shutdown_connections 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f82a006edf0 0x7f82a00712a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82b80ff130 0x7f82b8103160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 --2- 172.21.15.72:0/443173798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b81003d0 0x7f82b81017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 >> 172.21.15.72:0/443173798 conn(0x7f82b80fa780 msgr2=0x7f82b8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 shutdown_connections 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.264+0000 7f82be78f700 1 -- 172.21.15.72:0/443173798 wait complete. 2024-04-15T21:05:51.258 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 -- 172.21.15.72:0/985681925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 msgr2=0x7f2958105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 --2- 172.21.15.72:0/985681925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958105a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2954009910 tx=0x7f2954009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 -- 172.21.15.72:0/985681925 shutdown_connections 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 --2- 172.21.15.72:0/985681925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958105a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 --2- 172.21.15.72:0/985681925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 0x7f2958103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.379+0000 7f29600f3700 1 -- 172.21.15.72:0/985681925 >> 172.21.15.72:0/985681925 conn(0x7f29580fa780 msgr2=0x7f29580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 -- 172.21.15.72:0/985681925 shutdown_connections 2024-04-15T21:05:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 -- 172.21.15.72:0/985681925 wait complete. 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 Processor -- start 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 -- start start 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 0x7f2958195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29581966a0 con 0x7f2958103680 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.380+0000 7f29600f3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29581967e0 con 0x7f2958100d60 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38460/0 (socket says 172.21.15.72:38460) 2024-04-15T21:05:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 -- 172.21.15.72:0/4172498607 learned_addr learned my addr 172.21.15.72:0/4172498607 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295de8f700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 0x7f2958195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 -- 172.21.15.72:0/4172498607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 msgr2=0x7f2958195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 0x7f2958195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 -- 172.21.15.72:0/4172498607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540095f0 con 0x7f2958103680 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f295d68e700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2954006010 tx=0x7f295400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295401d070 con 0x7f2958103680 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f295400f460 con 0x7f2958103680 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2954021640 con 0x7f2958103680 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295819b230 con 0x7f2958103680 2024-04-15T21:05:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.381+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295819b6d0 con 0x7f2958103680 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.382+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295818fc60 con 0x7f2958103680 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.383+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f295400fab0 con 0x7f2958103680 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.384+0000 7f294effd700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 0x7f29440712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.384+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2954090440 con 0x7f2958103680 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.384+0000 7f295de8f700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 0x7f29440712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.384+0000 7f295de8f700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 0x7f29440712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2958069000 tx=0x7f2948009190 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:51.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.392+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f295405cb80 con 0x7f2958103680 2024-04-15T21:05:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.624+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2958061190 con 0x7f294406ee00 2024-04-15T21:05:51.618 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:51 smithi072 ceph-mon[78970]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.618 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:51 smithi072 ceph-mon[78970]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.618 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:51 smithi072 ceph-mon[78970]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.618 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:51 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/977095562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.626+0000 7f294effd700 1 -- 172.21.15.72:0/4172498607 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2958061190 con 0x7f294406ee00 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "6/23 daemons upgraded", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:05:51.619 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:05:51.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 msgr2=0x7f29440712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 0x7f29440712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2958069000 tx=0x7f2948009190 comp rx=0 tx=0).stop 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 msgr2=0x7f2958196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2954006010 tx=0x7f295400bd70 comp rx=0 tx=0).stop 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 shutdown_connections 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294406ee00 0x7f29440712b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2958100d60 0x7f2958195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 --2- 172.21.15.72:0/4172498607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2958103680 0x7f2958196080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.628+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 >> 172.21.15.72:0/4172498607 conn(0x7f29580fa780 msgr2=0x7f29580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.629+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 shutdown_connections 2024-04-15T21:05:51.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.629+0000 7f29600f3700 1 -- 172.21.15.72:0/4172498607 wait complete. 2024-04-15T21:05:51.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:51 smithi149 ceph-mon[67036]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:51 smithi149 ceph-mon[67036]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:51 smithi149 ceph-mon[67036]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:51.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:51 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/977095562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 -- 172.21.15.72:0/4097110664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 msgr2=0x7febd40fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 --2- 172.21.15.72:0/4097110664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd40fecd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febc4009910 tx=0x7febc4009c20 comp rx=0 tx=0).stop 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 -- 172.21.15.72:0/4097110664 shutdown_connections 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 --2- 172.21.15.72:0/4097110664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 0x7febd40fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 --2- 172.21.15.72:0/4097110664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd40fecd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 -- 172.21.15.72:0/4097110664 >> 172.21.15.72:0/4097110664 conn(0x7febd40f9f10 msgr2=0x7febd40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 -- 172.21.15.72:0/4097110664 shutdown_connections 2024-04-15T21:05:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.742+0000 7febda4a4700 1 -- 172.21.15.72:0/4097110664 wait complete. 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 Processor -- start 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 -- start start 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 0x7febd4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4196630 con 0x7febd40fe8c0 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febda4a4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4196770 con 0x7febd40ffb60 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febd3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febd3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50474/0 (socket says 172.21.15.72:50474) 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.743+0000 7febd3fff700 1 -- 172.21.15.72:0/940622380 learned_addr learned my addr 172.21.15.72:0/940622380 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:05:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd37fe700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 0x7febd4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd3fff700 1 -- 172.21.15.72:0/940622380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 msgr2=0x7febd4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd3fff700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 0x7febd4196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd3fff700 1 -- 172.21.15.72:0/940622380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40095f0 con 0x7febd40fe8c0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd3fff700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febc4006010 tx=0x7febc400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc401d070 con 0x7febd40fe8c0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7febc400f460 con 0x7febd40fe8c0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd419b1c0 con 0x7febd40fe8c0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc4017630 con 0x7febd40fe8c0 2024-04-15T21:05:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.744+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd419b6b0 con 0x7febd40fe8c0 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.745+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd41073a0 con 0x7febd40fe8c0 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.746+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7febc4003a60 con 0x7febd40fe8c0 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.746+0000 7febd17fa700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 0x7febbc0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.747+0000 7febd37fe700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 0x7febbc0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.747+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7febc4090530 con 0x7febd40fe8c0 2024-04-15T21:05:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.747+0000 7febd37fe700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 0x7febbc0712b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febc8005fd0 tx=0x7febc8005f60 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:05:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:51.751+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7febc405cc70 con 0x7febd40fe8c0 2024-04-15T21:05:52.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.062+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7febd4107560 con 0x7febd40fe8c0 2024-04-15T21:05:52.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.063+0000 7febd17fa700 1 -- 172.21.15.72:0/940622380 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7febc405c800 con 0x7febd40fe8c0 2024-04-15T21:05:52.055 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:05:52.055 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:05:52.055 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:05:52.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 msgr2=0x7febbc0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:52.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 0x7febbc0712b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febc8005fd0 tx=0x7febc8005f60 comp rx=0 tx=0).stop 2024-04-15T21:05:52.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 msgr2=0x7febd4195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:05:52.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febc4006010 tx=0x7febc400be20 comp rx=0 tx=0).stop 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 shutdown_connections 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7febbc06ee00 0x7febbc0712b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febd40fe8c0 0x7febd4195ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 --2- 172.21.15.72:0/940622380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febd40ffb60 0x7febd4196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 >> 172.21.15.72:0/940622380 conn(0x7febd40f9f10 msgr2=0x7febd40fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 shutdown_connections 2024-04-15T21:05:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:05:52.065+0000 7febda4a4700 1 -- 172.21.15.72:0/940622380 wait complete. 2024-04-15T21:05:52.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: pgmap v41: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:52.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/443173798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:05:52.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all crash 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]: dispatch 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]': finished 2024-04-15T21:05:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]: dispatch 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: Upgrade: osd.0 is safe to restart 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:52.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:52 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/940622380' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:05:52.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: pgmap v41: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:52.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/443173798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:05:52.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all crash 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]': finished 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-15T21:05:52.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-15T21:05:52.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: Upgrade: osd.0 is safe to restart 2024-04-15T21:05:52.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:05:52.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:52 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/940622380' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:05:54.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: pgmap v42: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: Upgrade: Updating osd.0 2024-04-15T21:05:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T21:05:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:54 smithi072 ceph-mon[78970]: Deploying daemon osd.0 on smithi072 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: pgmap v42: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: Upgrade: Updating osd.0 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:05:54.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:54 smithi149 ceph-mon[67036]: Deploying daemon osd.0 on smithi072 2024-04-15T21:05:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:56 smithi072 ceph-mon[78970]: pgmap v43: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:56 smithi149 ceph-mon[67036]: pgmap v43: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:56.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:56 smithi072 systemd[1]: Stopping Ceph osd.0 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:05:56.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:56 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[44046]: 2024-04-15T21:05:56.686+0000 7f536a70d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:05:56.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:56 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[44046]: 2024-04-15T21:05:56.686+0000 7f536a70d700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-15T21:05:56.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:56 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[44046]: 2024-04-15T21:05:56.686+0000 7f536a70d700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:05:57.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:57 smithi149 ceph-mon[67036]: osd.0 marked itself down and dead 2024-04-15T21:05:57.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:57 smithi072 ceph-mon[78970]: osd.0 marked itself down and dead 2024-04-15T21:05:57.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:57 smithi072 podman[85043]: 2024-04-15 21:05:57.668439969 +0000 UTC m=+1.083197558 container died a0cb9f0d1fc879cc913a2a5aaf87b560ea18af66ce59a9da35e8c16889b22f1d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-15T21:05:58.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:58 smithi072 ceph-mon[78970]: pgmap v44: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:58.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:58 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:05:58.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:58 smithi072 ceph-mon[78970]: osdmap e50: 6 total, 5 up, 6 in 2024-04-15T21:05:58.301 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85043]: 2024-04-15 21:05:58.098695822 +0000 UTC m=+1.513453399 container cleanup a0cb9f0d1fc879cc913a2a5aaf87b560ea18af66ce59a9da35e8c16889b22f1d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, RELEASE=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:05:58.302 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 bash[85043]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0 2024-04-15T21:05:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:58 smithi149 ceph-mon[67036]: pgmap v44: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:05:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:58 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:05:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:58 smithi149 ceph-mon[67036]: osdmap e50: 6 total, 5 up, 6 in 2024-04-15T21:05:58.662 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85060]: 2024-04-15 21:05:58.31002288 +0000 UTC m=+0.638121230 container remove a0cb9f0d1fc879cc913a2a5aaf87b560ea18af66ce59a9da35e8c16889b22f1d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=HEAD) 2024-04-15T21:05:58.971 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85153]: 2024-04-15 21:05:58.629743191 +0000 UTC m=+0.018795341 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:05:58.971 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85153]: 2024-04-15 21:05:58.730046293 +0000 UTC m=+0.119098430 container create 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:05:58.971 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85153]: 2024-04-15 21:05:58.976454927 +0000 UTC m=+0.365507071 container init 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:05:58.972 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:58 smithi072 podman[85153]: 2024-04-15 21:05:58.980000673 +0000 UTC m=+0.369052820 container start 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6) 2024-04-15T21:05:59.257 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:05:59 smithi072 ceph-mon[78970]: osdmap e51: 6 total, 5 up, 6 in 2024-04-15T21:05:59.257 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:59 smithi072 podman[85153]: 2024-04-15 21:05:59.085053142 +0000 UTC m=+0.474105297 container attach 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-15T21:05:59.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:05:59 smithi149 ceph-mon[67036]: osdmap e51: 6 total, 5 up, 6 in 2024-04-15T21:05:59.663 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:05:59 smithi072 podman[85153]: 2024-04-15 21:05:59.273757301 +0000 UTC m=+0.662809432 container died 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6) 2024-04-15T21:06:00.346 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:00 smithi072 ceph-mon[78970]: pgmap v47: 65 pgs: 9 stale+active+clean, 56 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:00.347 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85179]: 2024-04-15 21:06:00.102282012 +0000 UTC m=+0.818126034 container remove 8e747f40fab684a38483f6e51b45ae8845f9ebf948ac17e49c43825a1a6a1b71 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409) 2024-04-15T21:06:00.347 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-15T21:06:00.347 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 systemd[1]: Stopped Ceph osd.0 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:06:00.347 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.0.service: Consumed 49.810s CPU time. 2024-04-15T21:06:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:00 smithi149 ceph-mon[67036]: pgmap v47: 65 pgs: 9 stale+active+clean, 56 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:00.662 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 systemd[1]: Starting Ceph osd.0 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:06:00.663 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85284]: 2024-04-15 21:06:00.475736592 +0000 UTC m=+0.018243193 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:06:00.663 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85284]: 2024-04-15 21:06:00.587560863 +0000 UTC m=+0.130067439 container create 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-15T21:06:01.163 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85284]: 2024-04-15 21:06:00.827256745 +0000 UTC m=+0.369763323 container init 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-15T21:06:01.163 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85284]: 2024-04-15 21:06:00.830725414 +0000 UTC m=+0.373231990 container start 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-04-15T21:06:01.163 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:00 smithi072 podman[85284]: 2024-04-15 21:06:00.910922144 +0000 UTC m=+0.453428736 container attach 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409) 2024-04-15T21:06:01.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:01 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:01.590 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:01.590 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T21:06:01.590 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-15T21:06:01.590 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 bash[85284]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate[85299]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-15T21:06:01.591 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 podman[85284]: 2024-04-15 21:06:01.305873055 +0000 UTC m=+0.848379643 container died 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_CLEAN=True) 2024-04-15T21:06:02.165 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:01 smithi072 podman[85429]: 2024-04-15 21:06:01.920297175 +0000 UTC m=+0.608445986 container remove 0a5767618bf730123809b53a092cef497c535406e5c430ac61c81977a52876a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-15T21:06:02.166 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 podman[85497]: 2024-04-15 21:06:02.037543384 +0000 UTC m=+0.018400075 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:06:02.166 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 podman[85497]: 2024-04-15 21:06:02.138773185 +0000 UTC m=+0.119629900 container create dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-15T21:06:02.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:02 smithi149 ceph-mon[67036]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:02.486 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:02 smithi072 ceph-mon[78970]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:02.486 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 podman[85497]: 2024-04-15 21:06:02.386007813 +0000 UTC m=+0.366864482 container init dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-15T21:06:02.486 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 podman[85497]: 2024-04-15 21:06:02.38984755 +0000 UTC m=+0.370704223 container start dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-15T21:06:02.486 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 ceph-osd[85516]: -- 172.21.15.72:0/1810808187 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0f32e7680 con 0x55a0f32b0c00 2024-04-15T21:06:02.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 bash[85497]: dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a 2024-04-15T21:06:02.913 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 systemd[1]: Started Ceph osd.0 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:06:03.369 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:02 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:06:02.932+0000 7f97768547c0 -1 Falling back to public interface 2024-04-15T21:06:03.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:03.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:03.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:04.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:04 smithi072 ceph-mon[78970]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:04 smithi149 ceph-mon[67036]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:06.400 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:06 smithi149 ceph-mon[67036]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:06.400 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:06.400 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:06.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:06 smithi072 ceph-mon[78970]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-04-15T21:06:06.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:06.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:07.409 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:07 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:06:07.378+0000 7f97768547c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-04-15T21:06:08.024 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:07 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:06:07.696+0000 7f97768547c0 -1 osd.0 49 log_to_monitors true 2024-04-15T21:06:08.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-mon[78970]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 311 B/s wr, 0 op/s; 51/267 objects degraded (19.101%) 2024-04-15T21:06:08.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-mon[78970]: mgrmap e38: smithi072.wfjmmp(active, since 92s), standbys: smithi149.qgbaiy 2024-04-15T21:06:08.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-mon[78970]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-15T21:06:08.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:08.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:08 smithi149 ceph-mon[67036]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 311 B/s wr, 0 op/s; 51/267 objects degraded (19.101%) 2024-04-15T21:06:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:08 smithi149 ceph-mon[67036]: mgrmap e38: smithi072.wfjmmp(active, since 92s), standbys: smithi149.qgbaiy 2024-04-15T21:06:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:08 smithi149 ceph-mon[67036]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-15T21:06:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:09.338 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:06:08 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:06:08.957+0000 7f9763ca4700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:06:09.338 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:09 smithi072 ceph-mon[78970]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-15T21:06:09.338 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:09 smithi072 ceph-mon[78970]: osdmap e52: 6 total, 5 up, 6 in 2024-04-15T21:06:09.338 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:09 smithi072 ceph-mon[78970]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:06:09.338 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:09 smithi072 ceph-mon[78970]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' 2024-04-15T21:06:09.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:09 smithi149 ceph-mon[67036]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-15T21:06:09.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:09 smithi149 ceph-mon[67036]: osdmap e52: 6 total, 5 up, 6 in 2024-04-15T21:06:09.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:09 smithi149 ceph-mon[67036]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:06:09.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:09 smithi149 ceph-mon[67036]: from='osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995]' entity='osd.0' 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 51/267 objects degraded (19.101%) 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995] boot 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: osdmap e53: 6 total, 6 up, 6 in 2024-04-15T21:06:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 51/267 objects degraded (19.101%) 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: osd.0 [v2:172.21.15.72:6802/2753721995,v1:172.21.15.72:6803/2753721995] boot 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: osdmap e53: 6 total, 6 up, 6 in 2024-04-15T21:06:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-15T21:06:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:11 smithi072 ceph-mon[78970]: osdmap e54: 6 total, 6 up, 6 in 2024-04-15T21:06:12.232 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:11 smithi072 ceph-mon[78970]: pgmap v56: 65 pgs: 1 active, 16 activating, 3 active+undersized+degraded, 6 active+undersized, 39 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 8/267 objects degraded (2.996%) 2024-04-15T21:06:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:11 smithi149 ceph-mon[67036]: osdmap e54: 6 total, 6 up, 6 in 2024-04-15T21:06:12.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:11 smithi149 ceph-mon[67036]: pgmap v56: 65 pgs: 1 active, 16 activating, 3 active+undersized+degraded, 6 active+undersized, 39 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 8/267 objects degraded (2.996%) 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 8/267 objects degraded (2.996%), 3 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:13.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:12 smithi072 ceph-mon[78970]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 8/267 objects degraded (2.996%), 3 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:13.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:13.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:13.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:13.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:12 smithi149 ceph-mon[67036]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-04-15T21:06:14.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:13 smithi072 ceph-mon[78970]: pgmap v57: 65 pgs: 1 active, 16 activating, 3 active+undersized+degraded, 6 active+undersized, 39 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/267 objects degraded (2.996%) 2024-04-15T21:06:14.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:13 smithi149 ceph-mon[67036]: pgmap v57: 65 pgs: 1 active, 16 activating, 3 active+undersized+degraded, 6 active+undersized, 39 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/267 objects degraded (2.996%) 2024-04-15T21:06:15.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:15 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/267 objects degraded (2.996%), 3 pgs degraded) 2024-04-15T21:06:15.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:15 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/267 objects degraded (2.996%), 3 pgs degraded) 2024-04-15T21:06:16.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:16 smithi072 ceph-mon[78970]: pgmap v58: 65 pgs: 1 active, 16 activating, 48 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40 B/s, 0 objects/s recovering 2024-04-15T21:06:16.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:16 smithi149 ceph-mon[67036]: pgmap v58: 65 pgs: 1 active, 16 activating, 48 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40 B/s, 0 objects/s recovering 2024-04-15T21:06:18.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:18 smithi072 ceph-mon[78970]: pgmap v59: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 B/s, 0 objects/s recovering 2024-04-15T21:06:18.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:18 smithi149 ceph-mon[67036]: pgmap v59: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 B/s, 0 objects/s recovering 2024-04-15T21:06:20.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:20 smithi072 ceph-mon[78970]: pgmap v60: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 B/s, 0 objects/s recovering 2024-04-15T21:06:20.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:20.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:20.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:20 smithi149 ceph-mon[67036]: pgmap v60: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 B/s, 0 objects/s recovering 2024-04-15T21:06:20.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:20.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 -- 172.21.15.72:0/1475470344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 msgr2=0x7f11701038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 --2- 172.21.15.72:0/1475470344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f11701038a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1160009910 tx=0x7f1160009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 -- 172.21.15.72:0/1475470344 shutdown_connections 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 --2- 172.21.15.72:0/1475470344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f11701038a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 --2- 172.21.15.72:0/1475470344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f1170100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 -- 172.21.15.72:0/1475470344 >> 172.21.15.72:0/1475470344 conn(0x7f11700fa6d0 msgr2=0x7f11700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 -- 172.21.15.72:0/1475470344 shutdown_connections 2024-04-15T21:06:22.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 -- 172.21.15.72:0/1475470344 wait complete. 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.184+0000 7f117758f700 1 Processor -- start 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117758f700 1 -- start start 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117758f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f117019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117758f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117758f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117019cc30 con 0x7f1170101420 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117758f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117019cd70 con 0x7f11700feac0 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52500/0 (socket says 172.21.15.72:52500) 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 -- 172.21.15.72:0/280222792 learned_addr learned my addr 172.21.15.72:0/280222792 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117532b700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f117019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 -- 172.21.15.72:0/280222792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 msgr2=0x7f117019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f117019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 -- 172.21.15.72:0/280222792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600095f0 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f117532b700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f117019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f1174b2a700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1160006010 tx=0x7f116000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.185+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116001d070 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.186+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f116000f460 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.186+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11701a17c0 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.186+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1160017630 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.186+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11701a1cb0 con 0x7f1170101420 2024-04-15T21:06:22.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.187+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170196260 con 0x7f1170101420 2024-04-15T21:06:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.187+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f116000f5d0 con 0x7f1170101420 2024-04-15T21:06:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.188+0000 7f11667fc700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 0x7f115c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.188+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f11600902e0 con 0x7f1170101420 2024-04-15T21:06:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.188+0000 7f117532b700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 0x7f115c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.188+0000 7f117532b700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 0x7f115c071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f116c005950 tx=0x7f116c0058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.193+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f116005cbc0 con 0x7f1170101420 2024-04-15T21:06:22.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.414+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1170061190 con 0x7f115c06ecc0 2024-04-15T21:06:22.407 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:22 smithi072 ceph-mon[78970]: pgmap v61: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 B/s, 0 objects/s recovering 2024-04-15T21:06:22.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.416+0000 7f11667fc700 1 -- 172.21.15.72:0/280222792 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1170061190 con 0x7f115c06ecc0 2024-04-15T21:06:22.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 msgr2=0x7f115c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 0x7f115c071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f116c005950 tx=0x7f116c0058e0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 msgr2=0x7f117019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1160006010 tx=0x7f116000be20 comp rx=0 tx=0).stop 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 shutdown_connections 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f115c06ecc0 0x7f115c071170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11700feac0 0x7f117019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 --2- 172.21.15.72:0/280222792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1170101420 0x7f117019c610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 >> 172.21.15.72:0/280222792 conn(0x7f11700fa6d0 msgr2=0x7f11700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 shutdown_connections 2024-04-15T21:06:22.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.418+0000 7f117758f700 1 -- 172.21.15.72:0/280222792 wait complete. 2024-04-15T21:06:22.420 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:06:22.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:22 smithi149 ceph-mon[67036]: pgmap v61: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28 B/s, 0 objects/s recovering 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 -- 172.21.15.72:0/2899426047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 msgr2=0x7fcd5c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/2899426047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c0ff560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009910 tx=0x7fcd44009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 -- 172.21.15.72:0/2899426047 shutdown_connections 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/2899426047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/2899426047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c0ff560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 -- 172.21.15.72:0/2899426047 >> 172.21.15.72:0/2899426047 conn(0x7fcd5c0fa7a0 msgr2=0x7fcd5c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 -- 172.21.15.72:0/2899426047 shutdown_connections 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.524+0000 7fcd62c9f700 1 -- 172.21.15.72:0/2899426047 wait complete. 2024-04-15T21:06:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 Processor -- start 2024-04-15T21:06:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 -- start start 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c101d10 con 0x7fcd5c0ff150 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd62c9f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c101e50 con 0x7fcd5c1003f0 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd60a3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd60a3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52512/0 (socket says 172.21.15.72:52512) 2024-04-15T21:06:22.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.525+0000 7fcd60a3b700 1 -- 172.21.15.72:0/1912279694 learned_addr learned my addr 172.21.15.72:0/1912279694 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd5bfff700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd60a3b700 1 -- 172.21.15.72:0/1912279694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 msgr2=0x7fcd5c1017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd60a3b700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c1017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd60a3b700 1 -- 172.21.15.72:0/1912279694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440095f0 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd5bfff700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd60a3b700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400bd70 tx=0x7fcd4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4401d070 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd44022470 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4400f650 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c1020d0 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.526+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c1025c0 con 0x7fcd5c0ff150 2024-04-15T21:06:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.527+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c068ab0 con 0x7fcd5c0ff150 2024-04-15T21:06:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.528+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcd44004b10 con 0x7fcd5c0ff150 2024-04-15T21:06:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.528+0000 7fcd59ffb700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 0x7fcd48071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.528+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcd440905e0 con 0x7fcd5c0ff150 2024-04-15T21:06:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.528+0000 7fcd5bfff700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 0x7fcd48071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.529+0000 7fcd5bfff700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 0x7fcd48071170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007eb0 tx=0x7fcd4c0073c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.533+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcd4405cf70 con 0x7fcd5c0ff150 2024-04-15T21:06:22.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.754+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd5c0694e0 con 0x7fcd4806ecc0 2024-04-15T21:06:22.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.755+0000 7fcd59ffb700 1 -- 172.21.15.72:0/1912279694 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcd5c0694e0 con 0x7fcd4806ecc0 2024-04-15T21:06:22.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 msgr2=0x7fcd48071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 0x7fcd48071170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007eb0 tx=0x7fcd4c0073c0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 msgr2=0x7fcd5c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400bd70 tx=0x7fcd4400be50 comp rx=0 tx=0).stop 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 shutdown_connections 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd4806ecc0 0x7fcd48071170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c0ff150 0x7fcd5c103180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 --2- 172.21.15.72:0/1912279694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd5c1003f0 0x7fcd5c1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 >> 172.21.15.72:0/1912279694 conn(0x7fcd5c0fa7a0 msgr2=0x7fcd5c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 shutdown_connections 2024-04-15T21:06:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.758+0000 7fcd62c9f700 1 -- 172.21.15.72:0/1912279694 wait complete. 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 -- 172.21.15.72:0/4159542068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 msgr2=0x7f64c0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 --2- 172.21.15.72:0/4159542068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0101890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009910 tx=0x7f64b4009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 -- 172.21.15.72:0/4159542068 shutdown_connections 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 --2- 172.21.15.72:0/4159542068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0101890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 --2- 172.21.15.72:0/4159542068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 0x7f64c0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 -- 172.21.15.72:0/4159542068 >> 172.21.15.72:0/4159542068 conn(0x7f64c00fb7f0 msgr2=0x7f64c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 -- 172.21.15.72:0/4159542068 shutdown_connections 2024-04-15T21:06:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 -- 172.21.15.72:0/4159542068 wait complete. 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.863+0000 7f64c4d28700 1 Processor -- start 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64c4d28700 1 -- start start 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64c4d28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 0x7f64c0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64c4d28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64c4d28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c01965f0 con 0x7f64c0101440 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64c4d28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0196730 con 0x7f64c0100240 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52526/0 (socket says 172.21.15.72:52526) 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 -- 172.21.15.72:0/302483760 learned_addr learned my addr 172.21.15.72:0/302483760 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64be59c700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 0x7f64c0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 -- 172.21.15.72:0/302483760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 msgr2=0x7f64c0195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 0x7f64c0195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 -- 172.21.15.72:0/302483760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40095f0 con 0x7f64c0101440 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64bdd9b700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64b4006010 tx=0x7f64b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.864+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b401d070 con 0x7f64c0101440 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.865+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c019b180 con 0x7f64c0101440 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.865+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64b400f460 con 0x7f64c0101440 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.865+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b4021640 con 0x7f64c0101440 2024-04-15T21:06:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.865+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c019b670 con 0x7f64c0101440 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.865+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c0108d90 con 0x7f64c0101440 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.866+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f64b400fab0 con 0x7f64c0101440 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.866+0000 7f64af7fe700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 0x7f64a8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.866+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f64b40901e0 con 0x7f64c0101440 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.867+0000 7f64be59c700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 0x7f64a8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:22.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.867+0000 7f64be59c700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 0x7f64a8071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64c01012a0 tx=0x7f64b000a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:22.871+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f64b405cac0 con 0x7f64c0101440 2024-04-15T21:06:23.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.082+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64c0105d90 con 0x7f64a806ecc0 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.093+0000 7f64af7fe700 1 -- 172.21.15.72:0/302483760 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f64c0105d90 con 0x7f64a806ecc0 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (10m) 15s ago 12m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (12m) 15s ago 12m 7918k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (11m) 38s ago 11m 7864k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (47s) 15s ago 12m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:06:23.085 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (41s) 38s ago 11m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (10m) 15s ago 12m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (6m) 15s ago 6m 17.3M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (6m) 15s ago 6m 15.6M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (6m) 38s ago 6m 17.1M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (6m) 38s ago 6m 151M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (3m) 15s ago 14m 502M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (2m) 38s ago 11m 450M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (116s) 15s ago 14m 43.6M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (93s) 38s ago 11m 34.0M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (12m) 15s ago 12m 16.6M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (11m) 38s ago 11m 16.1M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (21s) 15s ago 10m 11.9M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (10m) 15s ago 10m 222M 1216M 18.2.0 dc2bc1663786 ae06e65629f1 2024-04-15T21:06:23.086 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (9m) 15s ago 9m 183M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:06:23.087 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (9m) 38s ago 9m 242M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:06:23.087 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (8m) 38s ago 8m 220M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:06:23.087 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (8m) 38s ago 8m 197M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:06:23.087 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (2m) 15s ago 11m 66.9M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:06:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 msgr2=0x7f64a8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 0x7f64a8071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64c01012a0 tx=0x7f64b000a380 comp rx=0 tx=0).stop 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 msgr2=0x7f64c0195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64b4006010 tx=0x7f64b400bd70 comp rx=0 tx=0).stop 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 shutdown_connections 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.095+0000 7f64c4d28700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f64a806ecc0 0x7f64a8071170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.096+0000 7f64c4d28700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64c0100240 0x7f64c0195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.096+0000 7f64c4d28700 1 --2- 172.21.15.72:0/302483760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c0101440 0x7f64c0195fd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.096+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 >> 172.21.15.72:0/302483760 conn(0x7f64c00fb7f0 msgr2=0x7f64c0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.096+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 shutdown_connections 2024-04-15T21:06:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.096+0000 7f64c4d28700 1 -- 172.21.15.72:0/302483760 wait complete. 2024-04-15T21:06:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.198+0000 7f4bfb229700 1 -- 172.21.15.72:0/3591319479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 msgr2=0x7f4bf4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.198+0000 7f4bfb229700 1 --2- 172.21.15.72:0/3591319479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4100650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009910 tx=0x7f4be8009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- 172.21.15.72:0/3591319479 shutdown_connections 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 --2- 172.21.15.72:0/3591319479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 0x7f4bf4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 --2- 172.21.15.72:0/3591319479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4100650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- 172.21.15.72:0/3591319479 >> 172.21.15.72:0/3591319479 conn(0x7f4bf40fb7f0 msgr2=0x7f4bf40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- 172.21.15.72:0/3591319479 shutdown_connections 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- 172.21.15.72:0/3591319479 wait complete. 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 Processor -- start 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- start start 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 0x7f4bf4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4196630 con 0x7f4bf4100240 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.199+0000 7f4bfb229700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4196770 con 0x7f4bf4101440 2024-04-15T21:06:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52554/0 (socket says 172.21.15.72:52554) 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 -- 172.21.15.72:0/1505416183 learned_addr learned my addr 172.21.15.72:0/1505416183 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf3fff700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 0x7f4bf4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 -- 172.21.15.72:0/1505416183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 msgr2=0x7f4bf4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 0x7f4bf4196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 -- 172.21.15.72:0/1505416183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80095f0 con 0x7f4bf4100240 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf8fc5700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4be800bda0 tx=0x7f4be800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be801d070 con 0x7f4bf4100240 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf419b1c0 con 0x7f4bf4100240 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4be800f460 con 0x7f4bf4100240 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be8021620 con 0x7f4bf4100240 2024-04-15T21:06:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.200+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf419b6b0 con 0x7f4bf4100240 2024-04-15T21:06:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.201+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf4108d90 con 0x7f4bf4100240 2024-04-15T21:06:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.202+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4be800f5d0 con 0x7f4bf4100240 2024-04-15T21:06:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.202+0000 7f4bf1ffb700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 0x7f4be4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.202+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4be8090170 con 0x7f4bf4100240 2024-04-15T21:06:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.202+0000 7f4bf3fff700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 0x7f4be4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.203+0000 7f4bf3fff700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 0x7f4be4071170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4be0005950 tx=0x7f4be000b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.207+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4be805ca50 con 0x7f4bf4100240 2024-04-15T21:06:23.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:23 smithi072 ceph-mon[78970]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:23.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:23 smithi149 ceph-mon[67036]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:23.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.496+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4bf419bdb0 con 0x7f4bf4100240 2024-04-15T21:06:23.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.496+0000 7f4bf1ffb700 1 -- 172.21.15.72:0/1505416183 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f4be805c5e0 con 0x7f4bf4100240 2024-04-15T21:06:23.488 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 1 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:06:23.489 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-04-15T21:06:23.490 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 5 2024-04-15T21:06:23.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:06:23.490 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 msgr2=0x7f4be4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 0x7f4be4071170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4be0005950 tx=0x7f4be000b410 comp rx=0 tx=0).stop 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 msgr2=0x7f4bf4195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4be800bda0 tx=0x7f4be800bdd0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 shutdown_connections 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4be406ecc0 0x7f4be4071170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf4100240 0x7f4bf4195ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 --2- 172.21.15.72:0/1505416183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf4101440 0x7f4bf4196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.498+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 >> 172.21.15.72:0/1505416183 conn(0x7f4bf40fb7f0 msgr2=0x7f4bf4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.499+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 shutdown_connections 2024-04-15T21:06:23.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.499+0000 7f4bfb229700 1 -- 172.21.15.72:0/1505416183 wait complete. 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 -- 172.21.15.72:0/2613119923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c100340 msgr2=0x7fea3c100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 --2- 172.21.15.72:0/2613119923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c100340 0x7fea3c100790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea30009910 tx=0x7fea30009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 -- 172.21.15.72:0/2613119923 shutdown_connections 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 --2- 172.21.15.72:0/2613119923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c100340 0x7fea3c100790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 --2- 172.21.15.72:0/2613119923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c0ff140 0x7fea3c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 -- 172.21.15.72:0/2613119923 >> 172.21.15.72:0/2613119923 conn(0x7fea3c0fa6d0 msgr2=0x7fea3c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 -- 172.21.15.72:0/2613119923 shutdown_connections 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.604+0000 7fea41985700 1 -- 172.21.15.72:0/2613119923 wait complete. 2024-04-15T21:06:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 Processor -- start 2024-04-15T21:06:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 -- start start 2024-04-15T21:06:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c100340 0x7fea3c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c196690 con 0x7fea3c0ff140 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea41985700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1967d0 con 0x7fea3c100340 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.605+0000 7fea3affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52578/0 (socket says 172.21.15.72:52578) 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 -- 172.21.15.72:0/1758882503 learned_addr learned my addr 172.21.15.72:0/1758882503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3a7fc700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c100340 0x7fea3c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 -- 172.21.15.72:0/1758882503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c100340 msgr2=0x7fea3c196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c100340 0x7fea3c196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 -- 172.21.15.72:0/1758882503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300095f0 con 0x7fea3c0ff140 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea3affd700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00b480 tx=0x7fea2c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c0118c0 con 0x7fea3c0ff140 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea2c010380 con 0x7fea3c0ff140 2024-04-15T21:06:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c19b280 con 0x7fea3c0ff140 2024-04-15T21:06:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c00f4f0 con 0x7fea3c0ff140 2024-04-15T21:06:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.606+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c19b7d0 con 0x7fea3c0ff140 2024-04-15T21:06:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.607+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c107d30 con 0x7fea3c0ff140 2024-04-15T21:06:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.608+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fea2c011a20 con 0x7fea3c0ff140 2024-04-15T21:06:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.608+0000 7fea40983700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 0x7fea24071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.608+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fea2c08eae0 con 0x7fea3c0ff140 2024-04-15T21:06:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.608+0000 7fea3a7fc700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 0x7fea24071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.609+0000 7fea3a7fc700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 0x7fea24071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea300059d0 tx=0x7fea30005920 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.613+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fea2c05b3c0 con 0x7fea3c0ff140 2024-04-15T21:06:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.862+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea3c107f50 con 0x7fea3c0ff140 2024-04-15T21:06:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.862+0000 7fea40983700 1 -- 172.21.15.72:0/1758882503 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fea2c05af50 con 0x7fea3c0ff140 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:06:23.855 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:06:23.856 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:23.857 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.864+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 msgr2=0x7fea24071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.864+0000 7fea41985700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 0x7fea24071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea300059d0 tx=0x7fea30005920 comp rx=0 tx=0).stop 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.864+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 msgr2=0x7fea3c195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.864+0000 7fea41985700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00b480 tx=0x7fea2c00b840 comp rx=0 tx=0).stop 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 shutdown_connections 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fea2406ecc0 0x7fea24071170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c0ff140 0x7fea3c195b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 --2- 172.21.15.72:0/1758882503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3c100340 0x7fea3c196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 >> 172.21.15.72:0/1758882503 conn(0x7fea3c0fa6d0 msgr2=0x7fea3c068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 shutdown_connections 2024-04-15T21:06:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.865+0000 7fea41985700 1 -- 172.21.15.72:0/1758882503 wait complete. 2024-04-15T21:06:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 -- 172.21.15.72:0/3617504787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fee50 msgr2=0x7f3eac101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3617504787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fee50 0x7f3eac101580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009910 tx=0x7f3ea8009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 -- 172.21.15.72:0/3617504787 shutdown_connections 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3617504787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fee50 0x7f3eac101580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3617504787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eac0fe500 0x7f3eac0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 -- 172.21.15.72:0/3617504787 >> 172.21.15.72:0/3617504787 conn(0x7f3eac0f9f10 msgr2=0x7f3eac0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:23.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 -- 172.21.15.72:0/3617504787 shutdown_connections 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.971+0000 7f3eb452d700 1 -- 172.21.15.72:0/3617504787 wait complete. 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 Processor -- start 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 -- start start 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eac0fee50 0x7f3eac196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac1965e0 con 0x7f3eac0fe500 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb452d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac196720 con 0x7f3eac0fee50 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52594/0 (socket says 172.21.15.72:52594) 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 -- 172.21.15.72:0/3986575945 learned_addr learned my addr 172.21.15.72:0/3986575945 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 -- 172.21.15.72:0/3986575945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eac0fee50 msgr2=0x7f3eac196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eac0fee50 0x7f3eac196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:23.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 -- 172.21.15.72:0/3986575945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80095f0 con 0x7f3eac0fe500 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.972+0000 7f3eb22c9700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00c930 tx=0x7f3e9c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.973+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c007ad0 con 0x7f3eac0fe500 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.973+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e9c007c30 con 0x7f3eac0fe500 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.973+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac19b1e0 con 0x7f3eac0fe500 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.973+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c018630 con 0x7f3eac0fe500 2024-04-15T21:06:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.973+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac19b700 con 0x7f3eac0fe500 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.974+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac108d10 con 0x7f3eac0fe500 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.974+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3e9c00f450 con 0x7f3eac0fe500 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.975+0000 7f3ea37fe700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 0x7f3e98071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.975+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3e9c08ef50 con 0x7f3eac0fe500 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.975+0000 7f3eb1ac8700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 0x7f3e98071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.975+0000 7f3eb1ac8700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 0x7f3e98071170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800b5c0 tx=0x7f3ea8005fd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:23.979+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3e9c0c3ff0 con 0x7f3eac0fe500 2024-04-15T21:06:24.162 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:24 smithi072 ceph-mon[78970]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:24.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:24 smithi072 ceph-mon[78970]: pgmap v62: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-04-15T21:06:24.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:24 smithi072 ceph-mon[78970]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:24.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:24 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1505416183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:24.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:24 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1758882503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:06:24.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.203+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eac105ed0 con 0x7f3e9806ecc0 2024-04-15T21:06:24.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.204+0000 7f3ea37fe700 1 -- 172.21.15.72:0/3986575945 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3eac105ed0 con 0x7f3e9806ecc0 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "7/23 daemons upgraded", 2024-04-15T21:06:24.197 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:06:24.198 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:06:24.198 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 msgr2=0x7f3e98071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 0x7f3e98071170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800b5c0 tx=0x7f3ea8005fd0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 msgr2=0x7f3eac195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00c930 tx=0x7f3e9c00ccf0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 shutdown_connections 2024-04-15T21:06:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3e9806ecc0 0x7f3e98071170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0fe500 0x7f3eac195b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 --2- 172.21.15.72:0/3986575945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eac0fee50 0x7f3eac196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 >> 172.21.15.72:0/3986575945 conn(0x7f3eac0f9f10 msgr2=0x7f3eac1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 shutdown_connections 2024-04-15T21:06:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.207+0000 7f3eb452d700 1 -- 172.21.15.72:0/3986575945 wait complete. 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 -- 172.21.15.72:0/2529170732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 msgr2=0x7fab900fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 --2- 172.21.15.72:0/2529170732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab900fe910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab80009910 tx=0x7fab80009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 -- 172.21.15.72:0/2529170732 shutdown_connections 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 --2- 172.21.15.72:0/2529170732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab900fee50 0x7fab90101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 --2- 172.21.15.72:0/2529170732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab900fe910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 -- 172.21.15.72:0/2529170732 >> 172.21.15.72:0/2529170732 conn(0x7fab900f9f10 msgr2=0x7fab900fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 -- 172.21.15.72:0/2529170732 shutdown_connections 2024-04-15T21:06:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.312+0000 7fab97bad700 1 -- 172.21.15.72:0/2529170732 wait complete. 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 Processor -- start 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 -- start start 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab900fee50 0x7fab900ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900ffa70 con 0x7fab900fe500 2024-04-15T21:06:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab97bad700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900ffbb0 con 0x7fab900fee50 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52606/0 (socket says 172.21.15.72:52606) 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 -- 172.21.15.72:0/211610104 learned_addr learned my addr 172.21.15.72:0/211610104 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 -- 172.21.15.72:0/211610104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab900fee50 msgr2=0x7fab900ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab900fee50 0x7fab900ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 -- 172.21.15.72:0/211610104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800095f0 con 0x7fab900fe500 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.313+0000 7fab95949700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab8000bd70 tx=0x7fab8000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.314+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8001d070 con 0x7fab900fe500 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.314+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900ffe30 con 0x7fab900fe500 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.314+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab80022470 con 0x7fab900fe500 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.314+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8000f650 con 0x7fab900fe500 2024-04-15T21:06:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.314+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90100320 con 0x7fab900fe500 2024-04-15T21:06:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.315+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90108db0 con 0x7fab900fe500 2024-04-15T21:06:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.315+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fab80004b10 con 0x7fab900fe500 2024-04-15T21:06:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.316+0000 7fab86ffd700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 0x7fab7c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.316+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fab80090600 con 0x7fab900fe500 2024-04-15T21:06:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.316+0000 7fab95148700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 0x7fab7c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.316+0000 7fab95148700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 0x7fab7c071170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab90068200 tx=0x7fab8c006d20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.320+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fab8005cf90 con 0x7fab900fe500 2024-04-15T21:06:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:24 smithi149 ceph-mon[67036]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:24 smithi149 ceph-mon[67036]: pgmap v62: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-04-15T21:06:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:24 smithi149 ceph-mon[67036]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:24 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1505416183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:24 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1758882503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:06:24.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.630+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fab90108fa0 con 0x7fab900fe500 2024-04-15T21:06:24.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.631+0000 7fab86ffd700 1 -- 172.21.15.72:0/211610104 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fab8005cb20 con 0x7fab900fe500 2024-04-15T21:06:24.623 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:06:24.623 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:06:24.623 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:06:24.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 msgr2=0x7fab7c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 0x7fab7c071170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab90068200 tx=0x7fab8c006d20 comp rx=0 tx=0).stop 2024-04-15T21:06:24.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 msgr2=0x7fab90100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab8000bd70 tx=0x7fab8000be50 comp rx=0 tx=0).stop 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 shutdown_connections 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab7c06ecc0 0x7fab7c071170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab900fe500 0x7fab90100ee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 --2- 172.21.15.72:0/211610104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab900fee50 0x7fab900ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 >> 172.21.15.72:0/211610104 conn(0x7fab900f9f10 msgr2=0x7fab901047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 shutdown_connections 2024-04-15T21:06:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:24.633+0000 7fab97bad700 1 -- 172.21.15.72:0/211610104 wait complete. 2024-04-15T21:06:25.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:25 smithi072 ceph-mon[78970]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:25.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:25 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/211610104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:06:25.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:25 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:25.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:25 smithi149 ceph-mon[67036]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:25.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:25 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/211610104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:06:25.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:25 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:26.361 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:26 smithi149 ceph-mon[67036]: pgmap v63: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-04-15T21:06:26.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:26 smithi072 ceph-mon[78970]: pgmap v63: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 B/s, 0 objects/s recovering 2024-04-15T21:06:28.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:28 smithi072 ceph-mon[78970]: pgmap v64: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:28.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:28.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:28 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:28.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:28 smithi072 ceph-mon[78970]: Upgrade: osd.1 is safe to restart 2024-04-15T21:06:28.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:28 smithi149 ceph-mon[67036]: pgmap v64: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:28.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:28.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:28 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-15T21:06:28.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:28 smithi149 ceph-mon[67036]: Upgrade: osd.1 is safe to restart 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: Upgrade: Updating osd.1 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: pgmap v65: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:29 smithi072 ceph-mon[78970]: Deploying daemon osd.1 on smithi072 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: Upgrade: Updating osd.1 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: pgmap v65: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:30.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:29 smithi149 ceph-mon[67036]: Deploying daemon osd.1 on smithi072 2024-04-15T21:06:32.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:31 smithi072 ceph-mon[78970]: pgmap v66: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:32.307 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:32 smithi072 systemd[1]: Stopping Ceph osd.1 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:06:32.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:31 smithi149 ceph-mon[67036]: pgmap v66: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:32.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:32 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[49671]: 2024-04-15T21:06:32.412+0000 7f8a8a10d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:06:32.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:32 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[49671]: 2024-04-15T21:06:32.412+0000 7f8a8a10d700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-15T21:06:32.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:32 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[49671]: 2024-04-15T21:06:32.412+0000 7f8a8a10d700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:06:33.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:33 smithi072 ceph-mon[78970]: osd.1 marked itself down and dead 2024-04-15T21:06:33.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:32 smithi149 ceph-mon[67036]: osd.1 marked itself down and dead 2024-04-15T21:06:33.700 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:33 smithi072 podman[88396]: 2024-04-15 21:06:33.434671178 +0000 UTC m=+1.128158891 container died ae06e65629f19dfa955cec6a967d476e0571d13ab4d4feb6337ba80bf625021f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, org.label-schema.schema-version=1.0) 2024-04-15T21:06:33.990 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:33 smithi072 podman[88396]: 2024-04-15 21:06:33.791568119 +0000 UTC m=+1.485055823 container cleanup ae06e65629f19dfa955cec6a967d476e0571d13ab4d4feb6337ba80bf625021f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-04-15T21:06:33.991 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:33 smithi072 bash[88396]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1 2024-04-15T21:06:34.394 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:33 smithi072 ceph-mon[78970]: pgmap v67: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:34.394 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:33 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:06:34.394 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:33 smithi072 ceph-mon[78970]: osdmap e55: 6 total, 5 up, 6 in 2024-04-15T21:06:34.394 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88415]: 2024-04-15 21:06:34.086638574 +0000 UTC m=+0.648488006 container remove ae06e65629f19dfa955cec6a967d476e0571d13ab4d4feb6337ba80bf625021f (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-15T21:06:34.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:33 smithi149 ceph-mon[67036]: pgmap v67: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:34.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:34 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:06:34.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:34 smithi149 ceph-mon[67036]: osdmap e55: 6 total, 5 up, 6 in 2024-04-15T21:06:34.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.305592595 +0000 UTC m=+0.017867324 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:06:34.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.406467385 +0000 UTC m=+0.118742091 container create 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-15T21:06:34.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.635859888 +0000 UTC m=+0.348134605 container init 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-15T21:06:34.663 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.639361874 +0000 UTC m=+0.351636581 container start 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS) 2024-04-15T21:06:35.000 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.736798004 +0000 UTC m=+0.449072711 container attach 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-15T21:06:35.000 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:34 smithi072 podman[88505]: 2024-04-15 21:06:34.928398423 +0000 UTC m=+0.640673134 container died 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:06:35.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:35 smithi072 ceph-mon[78970]: osdmap e56: 6 total, 5 up, 6 in 2024-04-15T21:06:35.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:35 smithi149 ceph-mon[67036]: osdmap e56: 6 total, 5 up, 6 in 2024-04-15T21:06:35.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 podman[88531]: 2024-04-15 21:06:35.470744974 +0000 UTC m=+0.536942499 container remove 127e2e3cefbdbf8ef315d5558b722e8e4b5d733bfddbdbeb2161c97156dfc7bd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-04-15T21:06:35.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-15T21:06:35.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 systemd[1]: Stopped Ceph osd.1 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:06:35.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.1.service: Consumed 55.260s CPU time. 2024-04-15T21:06:35.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 systemd[1]: Starting Ceph osd.1 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:06:36.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-mon[78970]: pgmap v70: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:36.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-mon[78970]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:06:36.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:36.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:36.163 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 podman[88630]: 2024-04-15 21:06:35.823189918 +0000 UTC m=+0.019039146 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:06:36.164 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:35 smithi072 podman[88630]: 2024-04-15 21:06:35.922617966 +0000 UTC m=+0.118467194 container create 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_CLEAN=True, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-15T21:06:36.164 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 podman[88630]: 2024-04-15 21:06:36.145941773 +0000 UTC m=+0.341791006 container init 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409) 2024-04-15T21:06:36.164 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 podman[88630]: 2024-04-15 21:06:36.149533891 +0000 UTC m=+0.345383117 container start 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0) 2024-04-15T21:06:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:36 smithi149 ceph-mon[67036]: pgmap v70: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:36 smithi149 ceph-mon[67036]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:06:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:36.589 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 podman[88630]: 2024-04-15 21:06:36.229302911 +0000 UTC m=+0.425152158 container attach 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-15T21:06:36.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T21:06:36.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 bash[88630]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate[88645]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-15T21:06:36.914 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:36 smithi072 podman[88630]: 2024-04-15 21:06:36.62283976 +0000 UTC m=+0.818688990 container died 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:06:37.204 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:37 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 32/267 objects degraded (11.985%), 11 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:37.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:37 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 32/267 objects degraded (11.985%), 11 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:37.524 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 podman[88774]: 2024-04-15 21:06:37.213110734 +0000 UTC m=+0.583903976 container remove 23ea83ada120df11ed04656c4225562a6855435996841f349a4f4b793ef5b5a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-15T21:06:37.524 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 podman[88838]: 2024-04-15 21:06:37.423240603 +0000 UTC m=+0.111611909 container create 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6) 2024-04-15T21:06:37.524 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 podman[88838]: 2024-04-15 21:06:37.329480969 +0000 UTC m=+0.017852283 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:06:37.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 podman[88838]: 2024-04-15 21:06:37.627524537 +0000 UTC m=+0.315895840 container init 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:06:37.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 podman[88838]: 2024-04-15 21:06:37.630697431 +0000 UTC m=+0.319068734 container start 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:06:37.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 ceph-osd[88858]: -- 172.21.15.72:0/869671931 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604c225b680 con 0x5604c2225000 2024-04-15T21:06:37.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 bash[88838]: 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 2024-04-15T21:06:37.913 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:37 smithi072 systemd[1]: Started Ceph osd.1 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:06:38.413 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:38 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:06:38.168+0000 7f4e77c237c0 -1 Falling back to public interface 2024-04-15T21:06:38.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:38 smithi072 ceph-mon[78970]: pgmap v71: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/267 objects degraded (11.985%) 2024-04-15T21:06:38.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:38.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:38.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:38.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:38 smithi149 ceph-mon[67036]: pgmap v71: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/267 objects degraded (11.985%) 2024-04-15T21:06:38.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:38.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:38.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:39.385 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:39 smithi072 ceph-mon[78970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:06:39.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:39 smithi149 ceph-mon[67036]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:06:40.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:40 smithi072 ceph-mon[78970]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:40.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:40 smithi149 ceph-mon[67036]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:42.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:42 smithi072 ceph-mon[78970]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:42.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:42 smithi149 ceph-mon[67036]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:42.912 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:42 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:06:42.652+0000 7f4e77c237c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-04-15T21:06:43.412 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:43 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:06:43.052+0000 7f4e77c237c0 -1 osd.1 54 log_to_monitors true 2024-04-15T21:06:43.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:43 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 34/267 objects degraded (12.734%), 13 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:43.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:43.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:43.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:43 smithi072 ceph-mon[78970]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-15T21:06:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:43 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 34/267 objects degraded (12.734%), 13 pgs degraded (PG_DEGRADED) 2024-04-15T21:06:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:43 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:43 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:43.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:43 smithi149 ceph-mon[67036]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-15T21:06:44.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:44 smithi072 ceph-mon[78970]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:44 smithi072 ceph-mon[78970]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-15T21:06:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:44 smithi072 ceph-mon[78970]: osdmap e57: 6 total, 5 up, 6 in 2024-04-15T21:06:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:44 smithi072 ceph-mon[78970]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:06:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:44 smithi149 ceph-mon[67036]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:44 smithi149 ceph-mon[67036]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-15T21:06:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:44 smithi149 ceph-mon[67036]: osdmap e57: 6 total, 5 up, 6 in 2024-04-15T21:06:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:44 smithi149 ceph-mon[67036]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:06:45.286 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:06:44 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:06:44.987+0000 7f4e65073700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:06:45.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:45.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:45.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:45 smithi072 ceph-mon[78970]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' 2024-04-15T21:06:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:45.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:45 smithi149 ceph-mon[67036]: from='osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279]' entity='osd.1' 2024-04-15T21:06:46.386 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:46 smithi072 ceph-mon[78970]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:46.386 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:46 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:06:46.386 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:46 smithi072 ceph-mon[78970]: osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279] boot 2024-04-15T21:06:46.387 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:46 smithi072 ceph-mon[78970]: osdmap e58: 6 total, 6 up, 6 in 2024-04-15T21:06:46.387 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:06:46.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:46 smithi149 ceph-mon[67036]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:46.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:46 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:06:46.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:46 smithi149 ceph-mon[67036]: osd.1 [v2:172.21.15.72:6810/2300338279,v1:172.21.15.72:6811/2300338279] boot 2024-04-15T21:06:46.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:46 smithi149 ceph-mon[67036]: osdmap e58: 6 total, 6 up, 6 in 2024-04-15T21:06:46.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-15T21:06:48.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: osdmap e59: 6 total, 6 up, 6 in 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:06:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: osdmap e59: 6 total, 6 up, 6 in 2024-04-15T21:06:48.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:48.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:06:49.383 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:49 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:06:49.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:49 smithi072 ceph-mon[78970]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-15T21:06:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:49 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:06:49.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:49 smithi149 ceph-mon[67036]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-15T21:06:50.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:50 smithi072 ceph-mon[78970]: pgmap v80: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:50.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:50 smithi149 ceph-mon[67036]: pgmap v80: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/267 objects degraded (12.734%) 2024-04-15T21:06:51.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:51 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:51.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:51 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:51.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:51 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:06:51.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:51 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:06:52.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:52 smithi072 ceph-mon[78970]: pgmap v81: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:52.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:52 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/267 objects degraded (12.734%), 13 pgs degraded) 2024-04-15T21:06:52.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:52 smithi149 ceph-mon[67036]: pgmap v81: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:52.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:52 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/267 objects degraded (12.734%), 13 pgs degraded) 2024-04-15T21:06:54.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:54 smithi072 ceph-mon[78970]: pgmap v82: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:54.440 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:54 smithi149 ceph-mon[67036]: pgmap v82: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 -- 172.21.15.72:0/2421442753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 msgr2=0x7efc841004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 --2- 172.21.15.72:0/2421442753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841004a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc7400b0a0 tx=0x7efc7400b3b0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 -- 172.21.15.72:0/2421442753 shutdown_connections 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 --2- 172.21.15.72:0/2421442753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 0x7efc841016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 --2- 172.21.15.72:0/2421442753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841004a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 -- 172.21.15.72:0/2421442753 >> 172.21.15.72:0/2421442753 conn(0x7efc840fb620 msgr2=0x7efc840fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 -- 172.21.15.72:0/2421442753 shutdown_connections 2024-04-15T21:06:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.753+0000 7efc89a01700 1 -- 172.21.15.72:0/2421442753 wait complete. 2024-04-15T21:06:54.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.754+0000 7efc89a01700 1 Processor -- start 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.754+0000 7efc89a01700 1 -- start start 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.754+0000 7efc89a01700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.754+0000 7efc89a01700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 0x7efc84195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.754+0000 7efc89a01700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc84196400 con 0x7efc84100090 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc89a01700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc84196540 con 0x7efc84101290 2024-04-15T21:06:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36930/0 (socket says 172.21.15.72:36930) 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 -- 172.21.15.72:0/2150361364 learned_addr learned my addr 172.21.15.72:0/2150361364 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc827fc700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 0x7efc84195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 -- 172.21.15.72:0/2150361364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 msgr2=0x7efc84195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 0x7efc84195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 -- 172.21.15.72:0/2150361364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009d00 con 0x7efc84100090 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc82ffd700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efc740077b0 tx=0x7efc74003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc7400e040 con 0x7efc84100090 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8419af90 con 0x7efc84100090 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc7400ce60 con 0x7efc84100090 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8419b480 con 0x7efc84100090 2024-04-15T21:06:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.755+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc7401db10 con 0x7efc84100090 2024-04-15T21:06:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.756+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc84108be0 con 0x7efc84100090 2024-04-15T21:06:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.757+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efc7401dd50 con 0x7efc84100090 2024-04-15T21:06:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.757+0000 7efc889ff700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 0x7efc70071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:54.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.758+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efc74090990 con 0x7efc84100090 2024-04-15T21:06:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.758+0000 7efc827fc700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 0x7efc70071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.758+0000 7efc827fc700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 0x7efc70071170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc6c005fd0 tx=0x7efc6c00a560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:54.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.762+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efc7405d270 con 0x7efc84100090 2024-04-15T21:06:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.992+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc8419bbd0 con 0x7efc7006ecc0 2024-04-15T21:06:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.993+0000 7efc889ff700 1 -- 172.21.15.72:0/2150361364 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efc8419bbd0 con 0x7efc7006ecc0 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 msgr2=0x7efc70071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 0x7efc70071170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc6c005fd0 tx=0x7efc6c00a560 comp rx=0 tx=0).stop 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 msgr2=0x7efc841958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efc740077b0 tx=0x7efc74003ce0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 shutdown_connections 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7efc7006ecc0 0x7efc70071170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84100090 0x7efc841958a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 --2- 172.21.15.72:0/2150361364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc84101290 0x7efc84195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.995+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 >> 172.21.15.72:0/2150361364 conn(0x7efc840fb620 msgr2=0x7efc841044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.996+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 shutdown_connections 2024-04-15T21:06:54.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:54.996+0000 7efc89a01700 1 -- 172.21.15.72:0/2150361364 wait complete. 2024-04-15T21:06:55.000 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:06:55.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 -- 172.21.15.72:0/2428152193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f00ff130 msgr2=0x7f33f00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 --2- 172.21.15.72:0/2428152193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f00ff130 0x7f33f00ff540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009910 tx=0x7f33e0009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 -- 172.21.15.72:0/2428152193 shutdown_connections 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 --2- 172.21.15.72:0/2428152193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f01003d0 0x7f33f0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 --2- 172.21.15.72:0/2428152193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f00ff130 0x7f33f00ff540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 -- 172.21.15.72:0/2428152193 >> 172.21.15.72:0/2428152193 conn(0x7f33f00fa780 msgr2=0x7f33f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 -- 172.21.15.72:0/2428152193 shutdown_connections 2024-04-15T21:06:55.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.105+0000 7f33f69f9700 1 -- 172.21.15.72:0/2428152193 wait complete. 2024-04-15T21:06:55.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 Processor -- start 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 -- start start 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f00ff130 0x7f33f0194a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0195560 con 0x7f33f01003d0 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33f69f9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01956a0 con 0x7f33f00ff130 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36946/0 (socket says 172.21.15.72:36946) 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.106+0000 7f33ef7fe700 1 -- 172.21.15.72:0/1909975785 learned_addr learned my addr 172.21.15.72:0/1909975785 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33effff700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f00ff130 0x7f33f0194a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ef7fe700 1 -- 172.21.15.72:0/1909975785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f00ff130 msgr2=0x7f33f0194a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ef7fe700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f00ff130 0x7f33f0194a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ef7fe700 1 -- 172.21.15.72:0/1909975785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00095f0 con 0x7f33f01003d0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ef7fe700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b4b0 tx=0x7f33e400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e4011800 con 0x7f33f01003d0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f33e4011e10 con 0x7f33f01003d0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f019a150 con 0x7f33f01003d0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e400f2e0 con 0x7f33f01003d0 2024-04-15T21:06:55.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.107+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f019a6a0 con 0x7f33f01003d0 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.108+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f0107c90 con 0x7f33f01003d0 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.108+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f33e4010380 con 0x7f33f01003d0 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.109+0000 7f33ed7fa700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 0x7f33d8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.109+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f33e408eac0 con 0x7f33f01003d0 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.109+0000 7f33effff700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 0x7f33d8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.109+0000 7f33effff700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 0x7f33d8071170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33e0006010 tx=0x7f33e000b580 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.114+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f33e405b380 con 0x7f33f01003d0 2024-04-15T21:06:55.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.333+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33f019a2e0 con 0x7f33d806ecc0 2024-04-15T21:06:55.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.334+0000 7f33ed7fa700 1 -- 172.21.15.72:0/1909975785 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f33f019a2e0 con 0x7f33d806ecc0 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 msgr2=0x7f33d8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 0x7f33d8071170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33e0006010 tx=0x7f33e000b580 comp rx=0 tx=0).stop 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 msgr2=0x7f33f0194f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b4b0 tx=0x7f33e400b870 comp rx=0 tx=0).stop 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 shutdown_connections 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f33d806ecc0 0x7f33d8071170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f00ff130 0x7f33f0194a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 --2- 172.21.15.72:0/1909975785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33f01003d0 0x7f33f0194f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 >> 172.21.15.72:0/1909975785 conn(0x7f33f00fa780 msgr2=0x7f33f0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:55.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 shutdown_connections 2024-04-15T21:06:55.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.337+0000 7f33f69f9700 1 -- 172.21.15.72:0/1909975785 wait complete. 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 -- 172.21.15.72:0/853241020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 msgr2=0x7f6f18100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/853241020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18100860 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009910 tx=0x7f6f00009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 -- 172.21.15.72:0/853241020 shutdown_connections 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/853241020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18100860 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/853241020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 0x7f6f180ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 -- 172.21.15.72:0/853241020 >> 172.21.15.72:0/853241020 conn(0x7f6f180fa7a0 msgr2=0x7f6f180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 -- 172.21.15.72:0/853241020 shutdown_connections 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.441+0000 7f6f1dddc700 1 -- 172.21.15.72:0/853241020 wait complete. 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 Processor -- start 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 -- start start 2024-04-15T21:06:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 0x7f6f18198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18198bb0 con 0x7f6f181003f0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f1dddc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18198cf0 con 0x7f6f180ff150 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36972/0 (socket says 172.21.15.72:36972) 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.442+0000 7f6f0ffff700 1 -- 172.21.15.72:0/533959528 learned_addr learned my addr 172.21.15.72:0/533959528 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f177fe700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 0x7f6f18198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f0ffff700 1 -- 172.21.15.72:0/533959528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 msgr2=0x7f6f18198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f0ffff700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 0x7f6f18198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f0ffff700 1 -- 172.21.15.72:0/533959528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000095f0 con 0x7f6f181003f0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f0ffff700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000bd70 tx=0x7f6f0000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f0001d070 con 0x7f6f181003f0 2024-04-15T21:06:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f00022470 con 0x7f6f181003f0 2024-04-15T21:06:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f0000f650 con 0x7f6f181003f0 2024-04-15T21:06:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1819d740 con 0x7f6f181003f0 2024-04-15T21:06:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.443+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1819dc30 con 0x7f6f181003f0 2024-04-15T21:06:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.444+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18068ab0 con 0x7f6f181003f0 2024-04-15T21:06:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.444+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6f00004b10 con 0x7f6f181003f0 2024-04-15T21:06:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.445+0000 7f6f157fa700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 0x7f6f04071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.445+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6f00090600 con 0x7f6f181003f0 2024-04-15T21:06:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.445+0000 7f6f177fe700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 0x7f6f04071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.445+0000 7f6f177fe700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 0x7f6f04071170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009910 tx=0x7f6f08008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.450+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6f0005cf90 con 0x7f6f181003f0 2024-04-15T21:06:55.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.665+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f180694e0 con 0x7f6f0406ecc0 2024-04-15T21:06:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.677+0000 7f6f157fa700 1 -- 172.21.15.72:0/533959528 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6f180694e0 con 0x7f6f0406ecc0 2024-04-15T21:06:55.670 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:06:55.670 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (11m) 12s ago 13m 25.1M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:06:55.670 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (13m) 12s ago 13m 8006k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:06:55.670 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (12m) 70s ago 12m 7864k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (79s) 12s ago 13m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (74s) 70s ago 12m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (11m) 12s ago 12m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (7m) 12s ago 7m 17.6M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (7m) 12s ago 7m 15.9M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (7m) 70s ago 7m 17.1M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (7m) 70s ago 7m 151M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (3m) 12s ago 14m 504M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (2m) 70s ago 11m 450M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (2m) 12s ago 14m 46.2M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:06:55.671 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (2m) 70s ago 11m 34.0M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (13m) 12s ago 13m 16.2M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (12m) 70s ago 12m 16.1M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (53s) 12s ago 11m 89.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (18s) 12s ago 10m 12.4M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (10m) 12s ago 10m 182M 1216M 18.2.0 dc2bc1663786 48909307b27c 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (9m) 70s ago 9m 242M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (9m) 70s ago 9m 220M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (8m) 70s ago 8m 197M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:06:55.672 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 12s ago 12m 71.9M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 msgr2=0x7f6f04071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 0x7f6f04071170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009910 tx=0x7f6f08008040 comp rx=0 tx=0).stop 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 msgr2=0x7f6f18198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000bd70 tx=0x7f6f0000be50 comp rx=0 tx=0).stop 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 shutdown_connections 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f6f0406ecc0 0x7f6f04071170 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f180ff150 0x7f6f18198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 --2- 172.21.15.72:0/533959528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f181003f0 0x7f6f18198590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 >> 172.21.15.72:0/533959528 conn(0x7f6f180fa7a0 msgr2=0x7f6f18068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.679+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 shutdown_connections 2024-04-15T21:06:55.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.680+0000 7f6f1dddc700 1 -- 172.21.15.72:0/533959528 wait complete. 2024-04-15T21:06:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 -- 172.21.15.72:0/1017228070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 msgr2=0x7fd164100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 --2- 172.21.15.72:0/1017228070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164100790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd158009910 tx=0x7fd158009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 -- 172.21.15.72:0/1017228070 shutdown_connections 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 --2- 172.21.15.72:0/1017228070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164100790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 --2- 172.21.15.72:0/1017228070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1640ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 -- 172.21.15.72:0/1017228070 >> 172.21.15.72:0/1017228070 conn(0x7fd1640fa6d0 msgr2=0x7fd1640fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 -- 172.21.15.72:0/1017228070 shutdown_connections 2024-04-15T21:06:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.784+0000 7fd16ba79700 1 -- 172.21.15.72:0/1017228070 wait complete. 2024-04-15T21:06:55.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 Processor -- start 2024-04-15T21:06:55.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 -- start start 2024-04-15T21:06:55.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1641949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1641954a0 con 0x7fd164100340 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd16ba79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1641955e0 con 0x7fd1640ff140 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd169014700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd169014700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36990/0 (socket says 172.21.15.72:36990) 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.785+0000 7fd169014700 1 -- 172.21.15.72:0/2243153789 learned_addr learned my addr 172.21.15.72:0/2243153789 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169815700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1641949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169014700 1 -- 172.21.15.72:0/2243153789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 msgr2=0x7fd1641949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169014700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1641949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169014700 1 -- 172.21.15.72:0/2243153789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580095f0 con 0x7fd164100340 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169815700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1641949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:06:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd169014700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd15800bd70 tx=0x7fd15800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15801d070 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16419a040 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd158022470 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15800f670 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.786+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16419a500 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.787+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd164107c90 con 0x7fd164100340 2024-04-15T21:06:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.787+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd158022a50 con 0x7fd164100340 2024-04-15T21:06:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.788+0000 7fd162ffd700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 0x7fd14c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.788+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd1580904e0 con 0x7fd164100340 2024-04-15T21:06:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.788+0000 7fd169815700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 0x7fd14c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.788+0000 7fd169815700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 0x7fd14c071170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1641001a0 tx=0x7fd154009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:55.792+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd15805ce70 con 0x7fd164100340 2024-04-15T21:06:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.081+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd164107e50 con 0x7fd164100340 2024-04-15T21:06:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.081+0000 7fd162ffd700 1 -- 172.21.15.72:0/2243153789 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fd15805ca00 con 0x7fd164100340 2024-04-15T21:06:56.074 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:06:56.074 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:06:56.074 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:06:56.075 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:06:56.076 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-04-15T21:06:56.076 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:06:56.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:06:56.076 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 msgr2=0x7fd14c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 0x7fd14c071170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1641001a0 tx=0x7fd154009040 comp rx=0 tx=0).stop 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 msgr2=0x7fd164194f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd15800bd70 tx=0x7fd15800be50 comp rx=0 tx=0).stop 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 shutdown_connections 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd14c06ecc0 0x7fd14c071170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1640ff140 0x7fd1641949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 --2- 172.21.15.72:0/2243153789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd164100340 0x7fd164194f10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 >> 172.21.15.72:0/2243153789 conn(0x7fd1640fa6d0 msgr2=0x7fd164103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 shutdown_connections 2024-04-15T21:06:56.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.084+0000 7fd16ba79700 1 -- 172.21.15.72:0/2243153789 wait complete. 2024-04-15T21:06:56.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2903166900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 msgr2=0x7fd6f8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2903166900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8100840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009910 tx=0x7fd6e0009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:56.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2903166900 shutdown_connections 2024-04-15T21:06:56.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2903166900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8100840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2903166900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2903166900 >> 172.21.15.72:0/2903166900 conn(0x7fd6f80fa780 msgr2=0x7fd6f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2903166900 shutdown_connections 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.189+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2903166900 wait complete. 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 Processor -- start 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 -- start start 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f8195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81965c0 con 0x7fd6f81003d0 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6fdab7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8196700 con 0x7fd6f80ff130 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37006/0 (socket says 172.21.15.72:37006) 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6eeffd700 1 -- 172.21.15.72:0/2849332583 learned_addr learned my addr 172.21.15.72:0/2849332583 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:56.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.190+0000 7fd6f77fe700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f8195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6eeffd700 1 -- 172.21.15.72:0/2849332583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 msgr2=0x7fd6f8195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6eeffd700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f8195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6eeffd700 1 -- 172.21.15.72:0/2849332583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00095f0 con 0x7fd6f81003d0 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6f77fe700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f8195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6eeffd700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e001d070 con 0x7fd6f81003d0 2024-04-15T21:06:56.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f819b150 con 0x7fd6f81003d0 2024-04-15T21:06:56.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6e000f460 con 0x7fd6f81003d0 2024-04-15T21:06:56.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e0021640 con 0x7fd6f81003d0 2024-04-15T21:06:56.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.191+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f819b640 con 0x7fd6f81003d0 2024-04-15T21:06:56.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.192+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f8107c10 con 0x7fd6f81003d0 2024-04-15T21:06:56.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.192+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd6e0004b20 con 0x7fd6f81003d0 2024-04-15T21:06:56.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.193+0000 7fd6f57fa700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 0x7fd6e4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.193+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd6e0090290 con 0x7fd6f81003d0 2024-04-15T21:06:56.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.193+0000 7fd6f77fe700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 0x7fd6e4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.193+0000 7fd6f77fe700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 0x7fd6e4071170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005950 tx=0x7fd6e8005f50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.198+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd6e005cb70 con 0x7fd6f81003d0 2024-04-15T21:06:56.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:56 smithi072 ceph-mon[78970]: pgmap v83: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:56 smithi072 ceph-mon[78970]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:56 smithi072 ceph-mon[78970]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:56 smithi072 ceph-mon[78970]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.443+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6f819bf60 con 0x7fd6f81003d0 2024-04-15T21:06:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:56 smithi149 ceph-mon[67036]: pgmap v83: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:56 smithi149 ceph-mon[67036]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:56 smithi149 ceph-mon[67036]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:56 smithi149 ceph-mon[67036]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.443+0000 7fd6f57fa700 1 -- 172.21.15.72:0/2849332583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fd6e005c700 con 0x7fd6f81003d0 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:06:56.442 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:06:56.443 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:56.444 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.445+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 msgr2=0x7fd6e4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.445+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 0x7fd6e4071170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005950 tx=0x7fd6e8005f50 comp rx=0 tx=0).stop 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.445+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 msgr2=0x7fd6f8195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.445+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006010 tx=0x7fd6e000be20 comp rx=0 tx=0).stop 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 shutdown_connections 2024-04-15T21:06:56.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd6e406ecc0 0x7fd6e4071170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6f80ff130 0x7fd6f8195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 --2- 172.21.15.72:0/2849332583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f81003d0 0x7fd6f8195fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 >> 172.21.15.72:0/2849332583 conn(0x7fd6f80fa780 msgr2=0x7fd6f8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 shutdown_connections 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.446+0000 7fd6fdab7700 1 -- 172.21.15.72:0/2849332583 wait complete. 2024-04-15T21:06:56.446 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- 172.21.15.72:0/1607320729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1268100060 msgr2=0x7f12681004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 --2- 172.21.15.72:0/1607320729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1268100060 0x7f12681004d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1258009910 tx=0x7f1258009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- 172.21.15.72:0/1607320729 shutdown_connections 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 --2- 172.21.15.72:0/1607320729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1268100060 0x7f12681004d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 --2- 172.21.15.72:0/1607320729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f12680ff710 0x7f12680ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- 172.21.15.72:0/1607320729 >> 172.21.15.72:0/1607320729 conn(0x7f12680f9f10 msgr2=0x7f12680fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- 172.21.15.72:0/1607320729 shutdown_connections 2024-04-15T21:06:56.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- 172.21.15.72:0/1607320729 wait complete. 2024-04-15T21:06:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 Processor -- start 2024-04-15T21:06:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.552+0000 7f126f7ea700 1 -- start start 2024-04-15T21:06:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1268100060 0x7f1268196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1268196680 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12681967c0 con 0x7f1268100060 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37022/0 (socket says 172.21.15.72:37022) 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 -- 172.21.15.72:0/3856000264 learned_addr learned my addr 172.21.15.72:0/3856000264 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126cd85700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1268100060 0x7f1268196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 -- 172.21.15.72:0/3856000264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1268100060 msgr2=0x7f1268196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1268100060 0x7f1268196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 -- 172.21.15.72:0/3856000264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580095f0 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126d586700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f126400b4b0 tx=0x7f126400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1264011800 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1264011e10 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126819b270 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126400f2e0 con 0x7f12680ff710 2024-04-15T21:06:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.553+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126819b7c0 con 0x7f12680ff710 2024-04-15T21:06:56.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.554+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1268107c90 con 0x7f12680ff710 2024-04-15T21:06:56.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.555+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1264010380 con 0x7f12680ff710 2024-04-15T21:06:56.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.555+0000 7f125e7fc700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 0x7f1254071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.555+0000 7f126cd85700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 0x7f1254071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.556+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f126408ea00 con 0x7f12680ff710 2024-04-15T21:06:56.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.556+0000 7f126cd85700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 0x7f1254071170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f125800b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.561+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f126405b2e0 con 0x7f12680ff710 2024-04-15T21:06:56.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.782+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12680feab0 con 0x7f125406ecc0 2024-04-15T21:06:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.784+0000 7f125e7fc700 1 -- 172.21.15.72:0/3856000264 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f12680feab0 con 0x7f125406ecc0 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "8/23 daemons upgraded", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:06:56.777 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:06:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 msgr2=0x7f1254071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 0x7f1254071170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f125800b540 comp rx=0 tx=0).stop 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 msgr2=0x7f1268195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f126400b4b0 tx=0x7f126400b7c0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 shutdown_connections 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f125406ecc0 0x7f1254071170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12680ff710 0x7f1268195b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 --2- 172.21.15.72:0/3856000264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1268100060 0x7f1268196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 >> 172.21.15.72:0/3856000264 conn(0x7f12680f9f10 msgr2=0x7f12680fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 shutdown_connections 2024-04-15T21:06:56.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.786+0000 7f126f7ea700 1 -- 172.21.15.72:0/3856000264 wait complete. 2024-04-15T21:06:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 -- 172.21.15.72:0/2984559472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 msgr2=0x7f43180ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 --2- 172.21.15.72:0/2984559472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f43180ff560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f430c009910 tx=0x7f430c009c20 comp rx=0 tx=0).stop 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 -- 172.21.15.72:0/2984559472 shutdown_connections 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 --2- 172.21.15.72:0/2984559472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 0x7f4318100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 --2- 172.21.15.72:0/2984559472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f43180ff560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 -- 172.21.15.72:0/2984559472 >> 172.21.15.72:0/2984559472 conn(0x7f43180fa7a0 msgr2=0x7f43180fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 -- 172.21.15.72:0/2984559472 shutdown_connections 2024-04-15T21:06:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.892+0000 7f431eabf700 1 -- 172.21.15.72:0/2984559472 wait complete. 2024-04-15T21:06:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 Processor -- start 2024-04-15T21:06:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 -- start start 2024-04-15T21:06:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 0x7f4318198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318198bb0 con 0x7f43180ff150 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431eabf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318198cf0 con 0x7f43181003f0 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431c85b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431c85b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37046/0 (socket says 172.21.15.72:37046) 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.893+0000 7f431c85b700 1 -- 172.21.15.72:0/1873300967 learned_addr learned my addr 172.21.15.72:0/1873300967 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431c85b700 1 -- 172.21.15.72:0/1873300967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 msgr2=0x7f4318198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f4317fff700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 0x7f4318198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431c85b700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 0x7f4318198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431c85b700 1 -- 172.21.15.72:0/1873300967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0095f0 con 0x7f43180ff150 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431c85b700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f430c006010 tx=0x7f430c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c01d070 con 0x7f43180ff150 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431819d740 con 0x7f43180ff150 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f430c00f460 con 0x7f43180ff150 2024-04-15T21:06:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c021640 con 0x7f43180ff150 2024-04-15T21:06:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.894+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431819dc30 con 0x7f43180ff150 2024-04-15T21:06:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.895+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4318068ab0 con 0x7f43180ff150 2024-04-15T21:06:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.896+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f430c00fab0 con 0x7f43180ff150 2024-04-15T21:06:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.896+0000 7f4315ffb700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 0x7f4308071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:06:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.896+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f430c090350 con 0x7f43180ff150 2024-04-15T21:06:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.896+0000 7f4317fff700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 0x7f4308071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:06:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.897+0000 7f4317fff700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 0x7f4308071170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4304006fd0 tx=0x7f4304008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:06:56.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:56.901+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f430c05cc30 con 0x7f43180ff150 2024-04-15T21:06:57.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.191+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f431819e2f0 con 0x7f43180ff150 2024-04-15T21:06:57.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.191+0000 7f4315ffb700 1 -- 172.21.15.72:0/1873300967 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f430c05c7c0 con 0x7f43180ff150 2024-04-15T21:06:57.184 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:06:57.184 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:06:57.184 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 msgr2=0x7f4308071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 0x7f4308071170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4304006fd0 tx=0x7f4304008040 comp rx=0 tx=0).stop 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 msgr2=0x7f4318198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f430c006010 tx=0x7f430c00be20 comp rx=0 tx=0).stop 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 shutdown_connections 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f430806ecc0 0x7f4308071170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43180ff150 0x7f4318198050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:57.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 --2- 172.21.15.72:0/1873300967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43181003f0 0x7f4318198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:06:57.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 >> 172.21.15.72:0/1873300967 conn(0x7f43180fa7a0 msgr2=0x7f4318068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:06:57.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 shutdown_connections 2024-04-15T21:06:57.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:06:57.194+0000 7f431eabf700 1 -- 172.21.15.72:0/1873300967 wait complete. 2024-04-15T21:06:57.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:57 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2243153789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:57.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:57 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2849332583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:06:57.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:57 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2243153789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:06:57.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:57 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2849332583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:06:58.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:58 smithi072 ceph-mon[78970]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:58.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:58 smithi072 ceph-mon[78970]: pgmap v84: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:58.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:06:58 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1873300967' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:06:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:58 smithi149 ceph-mon[67036]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:06:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:58 smithi149 ceph-mon[67036]: pgmap v84: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:06:58.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:06:58 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1873300967' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:07:00.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:00 smithi072 ceph-mon[78970]: pgmap v85: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:00.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:00 smithi149 ceph-mon[67036]: pgmap v85: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:00.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:02.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:02 smithi072 ceph-mon[78970]: pgmap v86: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:02.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:02 smithi149 ceph-mon[67036]: pgmap v86: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:03.369 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:07:03.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:07:04.373 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:04 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:07:04.373 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:04 smithi072 ceph-mon[78970]: Upgrade: osd.2 is safe to restart 2024-04-15T21:07:04.373 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:04 smithi072 ceph-mon[78970]: pgmap v87: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:04 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-15T21:07:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:04 smithi149 ceph-mon[67036]: Upgrade: osd.2 is safe to restart 2024-04-15T21:07:04.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:04 smithi149 ceph-mon[67036]: pgmap v87: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: Upgrade: Updating osd.2 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: Deploying daemon osd.2 on smithi072 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:05.763 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: Upgrade: Updating osd.2 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: Deploying daemon osd.2 on smithi072 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:05.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:06.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:06 smithi072 ceph-mon[78970]: pgmap v88: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:06.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:06 smithi149 ceph-mon[67036]: pgmap v88: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:07.913 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:07 smithi072 systemd[1]: Stopping Ceph osd.2 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:07:08.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:07 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T21:07:07.946+0000 7f034fd92700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:07:08.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:07 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T21:07:07.946+0000 7f034fd92700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-15T21:07:08.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:07 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[55153]: 2024-04-15T21:07:07.946+0000 7f034fd92700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:07:08.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:08 smithi072 ceph-mon[78970]: pgmap v89: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:08.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:08 smithi072 ceph-mon[78970]: osd.2 marked itself down and dead 2024-04-15T21:07:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:08 smithi149 ceph-mon[67036]: pgmap v89: 65 pgs: 65 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:08.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:08 smithi149 ceph-mon[67036]: osd.2 marked itself down and dead 2024-04-15T21:07:09.233 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:08 smithi072 podman[91677]: 2024-04-15 21:07:08.956633768 +0000 UTC m=+1.114337609 container died 48909307b27c0138e25795232bcff71a88099b6eddde0063ce5af1c7c8d29814 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20231212, io.buildah.version=1.29.1) 2024-04-15T21:07:09.522 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:09 smithi072 podman[91677]: 2024-04-15 21:07:09.341695816 +0000 UTC m=+1.499399648 container cleanup 48909307b27c0138e25795232bcff71a88099b6eddde0063ce5af1c7c8d29814 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, io.buildah.version=1.29.1) 2024-04-15T21:07:09.522 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:09 smithi072 bash[91677]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2 2024-04-15T21:07:09.912 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:09 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:07:09.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:09 smithi072 ceph-mon[78970]: osdmap e60: 6 total, 5 up, 6 in 2024-04-15T21:07:09.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:09 smithi072 ceph-mon[78970]: osdmap e61: 6 total, 5 up, 6 in 2024-04-15T21:07:09.913 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:09 smithi072 podman[91695]: 2024-04-15 21:07:09.619776789 +0000 UTC m=+0.659674217 container remove 48909307b27c0138e25795232bcff71a88099b6eddde0063ce5af1c7c8d29814 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, ceph=True, RELEASE=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-04-15T21:07:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:09 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:07:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:09 smithi149 ceph-mon[67036]: osdmap e60: 6 total, 5 up, 6 in 2024-04-15T21:07:09.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:09 smithi149 ceph-mon[67036]: osdmap e61: 6 total, 5 up, 6 in 2024-04-15T21:07:10.261 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:09 smithi072 podman[91789]: 2024-04-15 21:07:09.866512499 +0000 UTC m=+0.017636537 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:10.261 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:09 smithi072 podman[91789]: 2024-04-15 21:07:09.980118241 +0000 UTC m=+0.131242307 container create ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:10.261 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:10 smithi072 podman[91789]: 2024-04-15 21:07:10.177675976 +0000 UTC m=+0.328799999 container init ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-15T21:07:10.261 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:10 smithi072 podman[91789]: 2024-04-15 21:07:10.181035709 +0000 UTC m=+0.332159738 container start ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6) 2024-04-15T21:07:10.261 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:10 smithi072 podman[91789]: 2024-04-15 21:07:10.269617334 +0000 UTC m=+0.420741355 container attach ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-87dbfb6, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:10.523 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:10 smithi072 podman[91789]: 2024-04-15 21:07:10.472968543 +0000 UTC m=+0.624092574 container died ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-15T21:07:10.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:10 smithi072 ceph-mon[78970]: pgmap v91: 65 pgs: 9 stale+active+clean, 56 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:10.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:10 smithi149 ceph-mon[67036]: pgmap v91: 65 pgs: 9 stale+active+clean, 56 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:11.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91814]: 2024-04-15 21:07:11.070612034 +0000 UTC m=+0.592300599 container remove ab951bd18afb29aa74eb034c88fe456507a5ff53b4e3e9e8868f98d084ba8b4d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-15T21:07:11.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-15T21:07:11.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 systemd[1]: Stopped Ceph osd.2 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:07:11.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.2.service: Consumed 44.897s CPU time. 2024-04-15T21:07:11.413 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 systemd[1]: Starting Ceph osd.2 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:07:11.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:11 smithi072 ceph-mon[78970]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-15T21:07:11.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:11 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 5 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:11.829 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91919]: 2024-04-15 21:07:11.421051366 +0000 UTC m=+0.017886081 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:11.829 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91919]: 2024-04-15 21:07:11.52249455 +0000 UTC m=+0.119329247 container create 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-04-15T21:07:11.829 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91919]: 2024-04-15 21:07:11.753620758 +0000 UTC m=+0.350455455 container init 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-15T21:07:11.829 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91919]: 2024-04-15 21:07:11.756919944 +0000 UTC m=+0.353754645 container start 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-15T21:07:11.829 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:11 smithi072 podman[91919]: 2024-04-15 21:07:11.837325864 +0000 UTC m=+0.434160581 container attach 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-15T21:07:11.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:11 smithi149 ceph-mon[67036]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-15T21:07:11.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:11 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 5 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:12.525 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T21:07:12.525 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-15T21:07:12.525 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T21:07:12.525 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-15T21:07:12.525 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 bash[91919]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate[91934]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-15T21:07:12.526 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 podman[91919]: 2024-04-15 21:07:12.235851798 +0000 UTC m=+0.832686495 container died 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-15T21:07:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:12 smithi072 ceph-mon[78970]: pgmap v93: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/267 objects degraded (3.745%) 2024-04-15T21:07:12.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:12 smithi149 ceph-mon[67036]: pgmap v93: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/267 objects degraded (3.745%) 2024-04-15T21:07:13.162 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:12 smithi072 podman[92074]: 2024-04-15 21:07:12.838177953 +0000 UTC m=+0.596348233 container remove 94b782619baf29ca7463b335705bf535f449a026a9ae56a8c1861be767b07ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-15T21:07:13.162 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 podman[92138]: 2024-04-15 21:07:12.95990768 +0000 UTC m=+0.018266586 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:13.162 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 podman[92138]: 2024-04-15 21:07:13.073614222 +0000 UTC m=+0.131973160 container create 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:07:13.497 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 podman[92138]: 2024-04-15 21:07:13.277686368 +0000 UTC m=+0.336045263 container init 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-15T21:07:13.497 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 podman[92138]: 2024-04-15 21:07:13.28092091 +0000 UTC m=+0.339279809 container start 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:07:13.497 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 ceph-osd[92157]: -- 172.21.15.72:0/3562000388 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f72107680 con 0x564f720d1000 2024-04-15T21:07:13.497 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 bash[92138]: 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e 2024-04-15T21:07:13.497 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 systemd[1]: Started Ceph osd.2 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:07:14.162 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:13 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:07:13.838+0000 7f0192eaa7c0 -1 Falling back to public interface 2024-04-15T21:07:14.677 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:14 smithi072 ceph-mon[78970]: pgmap v94: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/267 objects degraded (3.745%) 2024-04-15T21:07:14.678 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:14.678 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:14.678 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:14.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:14 smithi149 ceph-mon[67036]: pgmap v94: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/267 objects degraded (3.745%) 2024-04-15T21:07:14.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:14.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:14.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:15.611 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:15 smithi072 ceph-mon[78970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-15T21:07:15.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:15 smithi149 ceph-mon[67036]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-15T21:07:16.730 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:16 smithi072 ceph-mon[78970]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:16.841 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:16 smithi149 ceph-mon[67036]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:17.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:17 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:17.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:17 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:18.265 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:18 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:07:18.002+0000 7f0192eaa7c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-04-15T21:07:18.265 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:18 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:07:18.272+0000 7f0192eaa7c0 -1 osd.2 59 log_to_monitors true 2024-04-15T21:07:18.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:18 smithi072 ceph-mon[78970]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:18.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:18 smithi072 ceph-mon[78970]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-15T21:07:18.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:18 smithi149 ceph-mon[67036]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:18.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:18 smithi149 ceph-mon[67036]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-15T21:07:19.662 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:07:19.434+0000 7f01802fa700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: osdmap e62: 6 total, 5 up, 6 in 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:19.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:19 smithi072 ceph-mon[78970]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: osdmap e62: 6 total, 5 up, 6 in 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:19.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:19 smithi149 ceph-mon[67036]: from='osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997]' entity='osd.2' 2024-04-15T21:07:20.773 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:20.773 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.773 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997] boot 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: osdmap e63: 6 total, 6 up, 6 in 2024-04-15T21:07:20.774 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: osd.2 [v2:172.21.15.72:6818/3535754997,v1:172.21.15.72:6819/3535754997] boot 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: osdmap e63: 6 total, 6 up, 6 in 2024-04-15T21:07:20.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-15T21:07:22.690 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:22 smithi149 ceph-mon[67036]: pgmap v100: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/267 objects degraded (9.738%) 2024-04-15T21:07:22.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:22 smithi149 ceph-mon[67036]: osdmap e64: 6 total, 6 up, 6 in 2024-04-15T21:07:22.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:22 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 26/267 objects degraded (9.738%), 8 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:22.777 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:22 smithi072 ceph-mon[78970]: pgmap v100: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/267 objects degraded (9.738%) 2024-04-15T21:07:22.777 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:22 smithi072 ceph-mon[78970]: osdmap e64: 6 total, 6 up, 6 in 2024-04-15T21:07:22.777 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:22 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 26/267 objects degraded (9.738%), 8 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: pgmap v102: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/267 objects degraded (9.738%) 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:24.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:24.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:24 smithi072 ceph-mon[78970]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: pgmap v102: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/267 objects degraded (9.738%) 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:24.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:24.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:24.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:24.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:24 smithi149 ceph-mon[67036]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-15T21:07:25.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:25 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/267 objects degraded (9.738%), 8 pgs degraded) 2024-04-15T21:07:25.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:25 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/267 objects degraded (9.738%), 8 pgs degraded) 2024-04-15T21:07:26.592 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:26 smithi149 ceph-mon[67036]: pgmap v103: 65 pgs: 10 peering, 55 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:26.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:26 smithi072 ceph-mon[78970]: pgmap v103: 65 pgs: 10 peering, 55 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:27.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 -- 172.21.15.72:0/1071202415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 msgr2=0x7f979c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 --2- 172.21.15.72:0/1071202415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0ff540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f978c009910 tx=0x7f978c009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 -- 172.21.15.72:0/1071202415 shutdown_connections 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 --2- 172.21.15.72:0/1071202415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 0x7f979c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 --2- 172.21.15.72:0/1071202415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0ff540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 -- 172.21.15.72:0/1071202415 >> 172.21.15.72:0/1071202415 conn(0x7f979c0fa780 msgr2=0x7f979c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 -- 172.21.15.72:0/1071202415 shutdown_connections 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.308+0000 7f97a37e3700 1 -- 172.21.15.72:0/1071202415 wait complete. 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 Processor -- start 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 -- start start 2024-04-15T21:07:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 0x7f979c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1965f0 con 0x7f979c0ff130 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a37e3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c19d150 con 0x7f979c1003d0 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a157f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a157f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51300/0 (socket says 172.21.15.72:51300) 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a157f700 1 -- 172.21.15.72:0/738086235 learned_addr learned my addr 172.21.15.72:0/738086235 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.309+0000 7f97a0d7e700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 0x7f979c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a157f700 1 -- 172.21.15.72:0/738086235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 msgr2=0x7f979c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a157f700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 0x7f979c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a157f700 1 -- 172.21.15.72:0/738086235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0095f0 con 0x7f979c0ff130 2024-04-15T21:07:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a157f700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f978c00bda0 tx=0x7f978c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c01d070 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f978c00f460 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c021640 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c19d350 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.310+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c19d810 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.311+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c107c10 con 0x7f979c0ff130 2024-04-15T21:07:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.312+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f978c00f5d0 con 0x7f979c0ff130 2024-04-15T21:07:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.312+0000 7f97927fc700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 0x7f9788071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.312+0000 7f97a0d7e700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 0x7f9788071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.312+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f978c090100 con 0x7f979c0ff130 2024-04-15T21:07:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.313+0000 7f97a0d7e700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 0x7f9788071170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f979c069620 tx=0x7f979800a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.317+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f978c05ca60 con 0x7f979c0ff130 2024-04-15T21:07:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.540+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f979c104d20 con 0x7f978806ecc0 2024-04-15T21:07:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.542+0000 7f97927fc700 1 -- 172.21.15.72:0/738086235 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f979c104d20 con 0x7f978806ecc0 2024-04-15T21:07:27.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 msgr2=0x7f9788071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 0x7f9788071170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f979c069620 tx=0x7f979800a380 comp rx=0 tx=0).stop 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 msgr2=0x7f979c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f978c00bda0 tx=0x7f978c00bdd0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 shutdown_connections 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f978806ecc0 0x7f9788071170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c0ff130 0x7f979c0690a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 --2- 172.21.15.72:0/738086235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979c1003d0 0x7f979c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 >> 172.21.15.72:0/738086235 conn(0x7f979c0fa780 msgr2=0x7f979c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 shutdown_connections 2024-04-15T21:07:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.544+0000 7f97a37e3700 1 -- 172.21.15.72:0/738086235 wait complete. 2024-04-15T21:07:27.547 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 -- 172.21.15.72:0/3151894256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 msgr2=0x7f7f70101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 --2- 172.21.15.72:0/3151894256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70101890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009910 tx=0x7f7f64009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 -- 172.21.15.72:0/3151894256 shutdown_connections 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 --2- 172.21.15.72:0/3151894256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70101890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 --2- 172.21.15.72:0/3151894256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 0x7f7f70100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 -- 172.21.15.72:0/3151894256 >> 172.21.15.72:0/3151894256 conn(0x7f7f700fb7f0 msgr2=0x7f7f700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 -- 172.21.15.72:0/3151894256 shutdown_connections 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.651+0000 7f7f75a83700 1 -- 172.21.15.72:0/3151894256 wait complete. 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 Processor -- start 2024-04-15T21:07:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 -- start start 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 0x7f7f70195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701965f0 con 0x7f7f70101440 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.652+0000 7f7f75a83700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70196730 con 0x7f7f70100240 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51318/0 (socket says 172.21.15.72:51318) 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 -- 172.21.15.72:0/2734823259 learned_addr learned my addr 172.21.15.72:0/2734823259 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6f7fe700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 0x7f7f70195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 -- 172.21.15.72:0/2734823259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 msgr2=0x7f7f70195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 0x7f7f70195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 -- 172.21.15.72:0/2734823259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640095f0 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6effd700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006010 tx=0x7f7f6400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6401d070 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f6400f460 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7019b180 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f64021620 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.653+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7019b670 con 0x7f7f70101440 2024-04-15T21:07:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.654+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f70108d90 con 0x7f7f70101440 2024-04-15T21:07:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.655+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7f6400fad0 con 0x7f7f70101440 2024-04-15T21:07:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.656+0000 7f7f6cff9700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 0x7f7f58071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.656+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7f640900c0 con 0x7f7f70101440 2024-04-15T21:07:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.656+0000 7f7f6f7fe700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 0x7f7f58071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.656+0000 7f7f6f7fe700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 0x7f7f58071170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f701012a0 tx=0x7f7f6000a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.661+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7f6405ca20 con 0x7f7f70101440 2024-04-15T21:07:27.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.882+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f70105d90 con 0x7f7f5806ecc0 2024-04-15T21:07:27.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.883+0000 7f7f6cff9700 1 -- 172.21.15.72:0/2734823259 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7f70105d90 con 0x7f7f5806ecc0 2024-04-15T21:07:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 msgr2=0x7f7f58071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 0x7f7f58071170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f701012a0 tx=0x7f7f6000a380 comp rx=0 tx=0).stop 2024-04-15T21:07:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 msgr2=0x7f7f70195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006010 tx=0x7f7f6400bd70 comp rx=0 tx=0).stop 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 shutdown_connections 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7f5806ecc0 0x7f7f58071170 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f70100240 0x7f7f70195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 --2- 172.21.15.72:0/2734823259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70101440 0x7f7f70195fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 >> 172.21.15.72:0/2734823259 conn(0x7f7f700fb7f0 msgr2=0x7f7f70104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 shutdown_connections 2024-04-15T21:07:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.886+0000 7f7f75a83700 1 -- 172.21.15.72:0/2734823259 wait complete. 2024-04-15T21:07:27.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 -- 172.21.15.72:0/1681665262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 msgr2=0x7fb9bc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 --2- 172.21.15.72:0/1681665262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc100650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009910 tx=0x7fb9ac009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:27.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 -- 172.21.15.72:0/1681665262 shutdown_connections 2024-04-15T21:07:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 --2- 172.21.15.72:0/1681665262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 --2- 172.21.15.72:0/1681665262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc100650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 -- 172.21.15.72:0/1681665262 >> 172.21.15.72:0/1681665262 conn(0x7fb9bc0fb7f0 msgr2=0x7fb9bc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 -- 172.21.15.72:0/1681665262 shutdown_connections 2024-04-15T21:07:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.993+0000 7fb9c120f700 1 -- 172.21.15.72:0/1681665262 wait complete. 2024-04-15T21:07:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 Processor -- start 2024-04-15T21:07:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 -- start start 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc196580 con 0x7fb9bc100240 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9c120f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1966c0 con 0x7fb9bc101440 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9bad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9bad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51322/0 (socket says 172.21.15.72:51322) 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9bad9d700 1 -- 172.21.15.72:0/3878455166 learned_addr learned my addr 172.21.15.72:0/3878455166 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9ba59c700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9bad9d700 1 -- 172.21.15.72:0/3878455166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 msgr2=0x7fb9bc195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.994+0000 7fb9bad9d700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9bad9d700 1 -- 172.21.15.72:0/3878455166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0095f0 con 0x7fb9bc100240 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9ba59c700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:07:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9bad9d700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00bda0 tx=0x7fb9ac00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac01d070 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9ac004c50 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc19b120 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac00f690 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.995+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc19b5e0 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.996+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc108d90 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.996+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb9ac022a20 con 0x7fb9bc100240 2024-04-15T21:07:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.997+0000 7fb9a3fff700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 0x7fb9a4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.997+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb9ac090530 con 0x7fb9bc100240 2024-04-15T21:07:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.997+0000 7fb9ba59c700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 0x7fb9a4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:27.997+0000 7fb9ba59c700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 0x7fb9a4071170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0005fd0 tx=0x7fb9b0005e20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.001+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb9ac05cec0 con 0x7fb9bc100240 2024-04-15T21:07:28.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.211+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9bc105d90 con 0x7fb9a406ecc0 2024-04-15T21:07:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.222+0000 7fb9a3fff700 1 -- 172.21.15.72:0/3878455166 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb9bc105d90 con 0x7fb9a406ecc0 2024-04-15T21:07:28.214 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:07:28.214 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (12m) 9s ago 13m 25.4M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (14m) 9s ago 13m 8270k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (12m) 103s ago 12m 7864k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (112s) 9s ago 13m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (106s) 103s ago 12m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (11m) 9s ago 13m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (7m) 9s ago 7m 17.8M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (7m) 9s ago 7m 16.1M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (7m) 103s ago 7m 17.1M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (7m) 103s ago 7m 151M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (4m) 9s ago 15m 505M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (3m) 103s ago 12m 450M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (3m) 9s ago 15m 47.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (2m) 103s ago 12m 34.0M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:07:28.215 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (13m) 9s ago 13m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (12m) 103s ago 12m 16.1M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (86s) 9s ago 11m 91.2M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (50s) 9s ago 11m 92.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (15s) 9s ago 10m 11.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (10m) 103s ago 10m 242M 4096M 18.2.0 dc2bc1663786 66ac1f9b3202 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (9m) 103s ago 9m 220M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (9m) 103s ago 9m 197M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:07:28.216 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 9s ago 13m 72.3M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 msgr2=0x7fb9a4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 0x7fb9a4071170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0005fd0 tx=0x7fb9b0005e20 comp rx=0 tx=0).stop 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 msgr2=0x7fb9bc195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00bda0 tx=0x7fb9ac00be80 comp rx=0 tx=0).stop 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 shutdown_connections 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb9a406ecc0 0x7fb9a4071170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9bc100240 0x7fb9bc195ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 --2- 172.21.15.72:0/3878455166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9bc101440 0x7fb9bc195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 >> 172.21.15.72:0/3878455166 conn(0x7fb9bc0fb7f0 msgr2=0x7fb9bc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:28.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 shutdown_connections 2024-04-15T21:07:28.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.225+0000 7fb9c120f700 1 -- 172.21.15.72:0/3878455166 wait complete. 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- 172.21.15.72:0/2340386350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff110069270 msgr2=0x7ff110102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 --2- 172.21.15.72:0/2340386350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff110069270 0x7ff110102dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff100009910 tx=0x7ff100009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- 172.21.15.72:0/2340386350 shutdown_connections 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 --2- 172.21.15.72:0/2340386350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 0x7ff110105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 --2- 172.21.15.72:0/2340386350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff110069270 0x7ff110102dd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- 172.21.15.72:0/2340386350 >> 172.21.15.72:0/2340386350 conn(0x7ff1100fa780 msgr2=0x7ff1100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:28.321 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:28 smithi072 ceph-mon[78970]: pgmap v104: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:28.321 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:28 smithi072 ceph-mon[78970]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- 172.21.15.72:0/2340386350 shutdown_connections 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- 172.21.15.72:0/2340386350 wait complete. 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 Processor -- start 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.328+0000 7ff117ff1700 1 -- start start 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 0x7ff110100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100ff720 con 0x7ff1100fed70 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100ff890 con 0x7ff110103310 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51336/0 (socket says 172.21.15.72:51336) 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 -- 172.21.15.72:0/644373280 learned_addr learned my addr 172.21.15.72:0/644373280 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff115d8d700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 0x7ff110100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 -- 172.21.15.72:0/644373280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 msgr2=0x7ff110100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 0x7ff110100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 -- 172.21.15.72:0/644373280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000095f0 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff11558c700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e920 tx=0x7ff10c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c00c9d0 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1100ffb70 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff10c010430 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c018650 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.329+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11019dd40 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.331+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11018fbd0 con 0x7ff1100fed70 2024-04-15T21:07:28.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.331+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff10c0105a0 con 0x7ff1100fed70 2024-04-15T21:07:28.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.332+0000 7ff106ffd700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 0x7ff0fc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.332+0000 7ff115d8d700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 0x7ff0fc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.332+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff10c014070 con 0x7ff1100fed70 2024-04-15T21:07:28.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.332+0000 7ff115d8d700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 0x7ff0fc071170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff10000b6f0 tx=0x7ff100005940 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:28.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.336+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff10c053ff0 con 0x7ff1100fed70 2024-04-15T21:07:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.627+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff110069270 con 0x7ff1100fed70 2024-04-15T21:07:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.627+0000 7ff106ffd700 1 -- 172.21.15.72:0/644373280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7ff10c05ba10 con 0x7ff1100fed70 2024-04-15T21:07:28.619 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:07:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 3 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:07:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:07:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-04-15T21:07:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 7 2024-04-15T21:07:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:07:28.621 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:07:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 msgr2=0x7ff0fc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 0x7ff0fc071170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff10000b6f0 tx=0x7ff100005940 comp rx=0 tx=0).stop 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 msgr2=0x7ff1100ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e920 tx=0x7ff10c00ec30 comp rx=0 tx=0).stop 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 shutdown_connections 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0fc06ecc0 0x7ff0fc071170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff110103310 0x7ff110100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 --2- 172.21.15.72:0/644373280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1100fed70 0x7ff1100ff1e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.629+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 >> 172.21.15.72:0/644373280 conn(0x7ff1100fa780 msgr2=0x7ff1100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.630+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 shutdown_connections 2024-04-15T21:07:28.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.630+0000 7ff117ff1700 1 -- 172.21.15.72:0/644373280 wait complete. 2024-04-15T21:07:28.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:28 smithi149 ceph-mon[67036]: pgmap v104: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:28.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:28 smithi149 ceph-mon[67036]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 -- 172.21.15.72:0/2986223144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b80ff150 msgr2=0x7fd7b80ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 --2- 172.21.15.72:0/2986223144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b80ff150 0x7fd7b80ff560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009910 tx=0x7fd7a8009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 -- 172.21.15.72:0/2986223144 shutdown_connections 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 --2- 172.21.15.72:0/2986223144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b81003f0 0x7fd7b8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 --2- 172.21.15.72:0/2986223144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b80ff150 0x7fd7b80ff560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 -- 172.21.15.72:0/2986223144 >> 172.21.15.72:0/2986223144 conn(0x7fd7b80fa7a0 msgr2=0x7fd7b80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 -- 172.21.15.72:0/2986223144 shutdown_connections 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.734+0000 7fd7be834700 1 -- 172.21.15.72:0/2986223144 wait complete. 2024-04-15T21:07:28.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 Processor -- start 2024-04-15T21:07:28.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 -- start start 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b80ff150 0x7fd7b8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8198af0 con 0x7fd7b81003f0 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7be834700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8198c30 con 0x7fd7b80ff150 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51358/0 (socket says 172.21.15.72:51358) 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.735+0000 7fd7b77fe700 1 -- 172.21.15.72:0/1147411836 learned_addr learned my addr 172.21.15.72:0/1147411836 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b7fff700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b80ff150 0x7fd7b8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b77fe700 1 -- 172.21.15.72:0/1147411836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b80ff150 msgr2=0x7fd7b8197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b77fe700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b80ff150 0x7fd7b8197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b77fe700 1 -- 172.21.15.72:0/1147411836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80095f0 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b77fe700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00d8d0 tx=0x7fd7ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac009940 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b819d6e0 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd7ac010460 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac00f5f0 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.736+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b819dc30 con 0x7fd7b81003f0 2024-04-15T21:07:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.737+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b8068ab0 con 0x7fd7b81003f0 2024-04-15T21:07:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.738+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd7ac0105d0 con 0x7fd7b81003f0 2024-04-15T21:07:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.738+0000 7fd7b57fa700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 0x7fd7a0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.738+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd7ac08eef0 con 0x7fd7b81003f0 2024-04-15T21:07:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.738+0000 7fd7b7fff700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 0x7fd7a0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.739+0000 7fd7b7fff700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 0x7fd7a0071170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8006010 tx=0x7fd7a800b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.743+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd7ac05b730 con 0x7fd7b81003f0 2024-04-15T21:07:28.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.992+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7b819df10 con 0x7fd7b81003f0 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.993+0000 7fd7b57fa700 1 -- 172.21.15.72:0/1147411836 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fd7ac05b2c0 con 0x7fd7b81003f0 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:07:28.985 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:07:28.986 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:07:28.987 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:07:28.988 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 msgr2=0x7fd7a0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 0x7fd7a0071170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8006010 tx=0x7fd7a800b540 comp rx=0 tx=0).stop 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 msgr2=0x7fd7b81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00d8d0 tx=0x7fd7ac00dc90 comp rx=0 tx=0).stop 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 shutdown_connections 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fd7a006ecc0 0x7fd7a0071170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7b80ff150 0x7fd7b8197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 --2- 172.21.15.72:0/1147411836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b81003f0 0x7fd7b81984d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 >> 172.21.15.72:0/1147411836 conn(0x7fd7b80fa7a0 msgr2=0x7fd7b8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:28.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 shutdown_connections 2024-04-15T21:07:28.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:28.995+0000 7fd7be834700 1 -- 172.21.15.72:0/1147411836 wait complete. 2024-04-15T21:07:28.990 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 -- 172.21.15.72:0/3866939872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 msgr2=0x7f99840ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 --2- 172.21.15.72:0/3866939872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f99840ff560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9974009910 tx=0x7f9974009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 -- 172.21.15.72:0/3866939872 shutdown_connections 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 --2- 172.21.15.72:0/3866939872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99841003f0 0x7f9984100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 --2- 172.21.15.72:0/3866939872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f99840ff560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 -- 172.21.15.72:0/3866939872 >> 172.21.15.72:0/3866939872 conn(0x7f99840fa7a0 msgr2=0x7f99840fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 -- 172.21.15.72:0/3866939872 shutdown_connections 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.102+0000 7f9989d0c700 1 -- 172.21.15.72:0/3866939872 wait complete. 2024-04-15T21:07:29.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 Processor -- start 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 -- start start 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99841003f0 0x7f9984196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984196970 con 0x7f99840ff150 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f9989d0c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984196ab0 con 0x7f99841003f0 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51366/0 (socket says 172.21.15.72:51366) 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 -- 172.21.15.72:0/2834960722 learned_addr learned my addr 172.21.15.72:0/2834960722 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 -- 172.21.15.72:0/2834960722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99841003f0 msgr2=0x7f9984196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99841003f0 0x7f9984196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.103+0000 7f99837fe700 1 -- 172.21.15.72:0/2834960722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740095f0 con 0x7f99840ff150 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f99837fe700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997400b5c0 tx=0x7f997400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f997401d070 con 0x7f99840ff150 2024-04-15T21:07:29.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9974022470 con 0x7f99840ff150 2024-04-15T21:07:29.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998419b500 con 0x7f99840ff150 2024-04-15T21:07:29.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f997400f690 con 0x7f99840ff150 2024-04-15T21:07:29.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.104+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998419b9f0 con 0x7f99840ff150 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.105+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984068ab0 con 0x7f99840ff150 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.105+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9974004b70 con 0x7f99840ff150 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.106+0000 7f99817fa700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 0x7f9970071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.106+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f99740904a0 con 0x7f99840ff150 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.106+0000 7f997bfff700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 0x7f9970071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:29.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.106+0000 7f997bfff700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 0x7f9970071170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f996c00a990 tx=0x7f996c005c80 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:29.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.110+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f997405ceb0 con 0x7f99840ff150 2024-04-15T21:07:29.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.334+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99840694e0 con 0x7f997006ecc0 2024-04-15T21:07:29.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:29 smithi072 ceph-mon[78970]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:29.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:29 smithi072 ceph-mon[78970]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:29.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:29 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/644373280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:29.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:29 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1147411836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:07:29.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.335+0000 7f99817fa700 1 -- 172.21.15.72:0/2834960722 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f99840694e0 con 0x7f997006ecc0 2024-04-15T21:07:29.327 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:07:29.327 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:07:29.327 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "9/23 daemons upgraded", 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:07:29.328 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 msgr2=0x7f9970071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 0x7f9970071170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f996c00a990 tx=0x7f996c005c80 comp rx=0 tx=0).stop 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 msgr2=0x7f9984195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997400b5c0 tx=0x7f997400be20 comp rx=0 tx=0).stop 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 shutdown_connections 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f997006ecc0 0x7f9970071170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99840ff150 0x7f9984195e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 --2- 172.21.15.72:0/2834960722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99841003f0 0x7f9984196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.337+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 >> 172.21.15.72:0/2834960722 conn(0x7f99840fa7a0 msgr2=0x7f9984068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:29.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.338+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 shutdown_connections 2024-04-15T21:07:29.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.338+0000 7f9989d0c700 1 -- 172.21.15.72:0/2834960722 wait complete. 2024-04-15T21:07:29.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 -- 172.21.15.72:0/3979936598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40101440 msgr2=0x7f7e40101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 --2- 172.21.15.72:0/3979936598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40101440 0x7f7e40101890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009910 tx=0x7f7e34009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:29.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 -- 172.21.15.72:0/3979936598 shutdown_connections 2024-04-15T21:07:29.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 --2- 172.21.15.72:0/3979936598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40101440 0x7f7e40101890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 --2- 172.21.15.72:0/3979936598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40100240 0x7f7e40100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 -- 172.21.15.72:0/3979936598 >> 172.21.15.72:0/3979936598 conn(0x7f7e400fb7f0 msgr2=0x7f7e400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:29.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 -- 172.21.15.72:0/3979936598 shutdown_connections 2024-04-15T21:07:29.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.444+0000 7f7e46715700 1 -- 172.21.15.72:0/3979936598 wait complete. 2024-04-15T21:07:29.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 Processor -- start 2024-04-15T21:07:29.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 -- start start 2024-04-15T21:07:29.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40101440 0x7f7e40195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401965f0 con 0x7f7e40100240 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e46715700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40196730 con 0x7f7e40101440 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51382/0 (socket says 172.21.15.72:51382) 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e3ffff700 1 -- 172.21.15.72:0/913052383 learned_addr learned my addr 172.21.15.72:0/913052383 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.445+0000 7f7e3f7fe700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40101440 0x7f7e40195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3ffff700 1 -- 172.21.15.72:0/913052383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40101440 msgr2=0x7f7e40195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3ffff700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40101440 0x7f7e40195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3ffff700 1 -- 172.21.15.72:0/913052383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340095f0 con 0x7f7e40100240 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3ffff700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d900 tx=0x7f7e3000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e300041f0 con 0x7f7e40100240 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e30004350 con 0x7f7e40100240 2024-04-15T21:07:29.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4019b1e0 con 0x7f7e40100240 2024-04-15T21:07:29.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e30003d20 con 0x7f7e40100240 2024-04-15T21:07:29.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.446+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4019b730 con 0x7f7e40100240 2024-04-15T21:07:29.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.447+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e40108d90 con 0x7f7e40100240 2024-04-15T21:07:29.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.448+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7e30009730 con 0x7f7e40100240 2024-04-15T21:07:29.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.449+0000 7f7e3d7fa700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 0x7f7e28071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:29.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.449+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7e3008ed30 con 0x7f7e40100240 2024-04-15T21:07:29.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.449+0000 7f7e3f7fe700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 0x7f7e28071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:29.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.449+0000 7f7e3f7fe700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 0x7f7e28071170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006010 tx=0x7f7e3400b560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:29.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.454+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7e3005b610 con 0x7f7e40100240 2024-04-15T21:07:29.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:29 smithi149 ceph-mon[67036]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:29.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:29 smithi149 ceph-mon[67036]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:29.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:29 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/644373280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:29.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:29 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1147411836' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:07:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.741+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7e40108f50 con 0x7f7e40100240 2024-04-15T21:07:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.741+0000 7f7e3d7fa700 1 -- 172.21.15.72:0/913052383 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7e3005b1a0 con 0x7f7e40100240 2024-04-15T21:07:29.734 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:07:29.734 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:07:29.734 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:07:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.743+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 msgr2=0x7f7e28071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.743+0000 7f7e46715700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 0x7f7e28071170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006010 tx=0x7f7e3400b560 comp rx=0 tx=0).stop 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.743+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 msgr2=0x7f7e40195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.743+0000 7f7e46715700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d900 tx=0x7f7e3000dc10 comp rx=0 tx=0).stop 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 shutdown_connections 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f7e2806ecc0 0x7f7e28071170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e40100240 0x7f7e40195a90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 --2- 172.21.15.72:0/913052383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e40101440 0x7f7e40195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 >> 172.21.15.72:0/913052383 conn(0x7f7e400fb7f0 msgr2=0x7f7e40104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 shutdown_connections 2024-04-15T21:07:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:29.744+0000 7f7e46715700 1 -- 172.21.15.72:0/913052383 wait complete. 2024-04-15T21:07:30.412 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:30 smithi072 ceph-mon[78970]: pgmap v105: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:30 smithi072 ceph-mon[78970]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:30.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:30 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/913052383' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:07:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:30 smithi149 ceph-mon[67036]: pgmap v105: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:30 smithi149 ceph-mon[67036]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:07:30.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:30 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/913052383' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:07:32.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:32 smithi149 ceph-mon[67036]: pgmap v106: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:32.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:32 smithi072 ceph-mon[78970]: pgmap v106: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:34.662 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:34 smithi072 ceph-mon[78970]: pgmap v107: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:34.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:34 smithi149 ceph-mon[67036]: pgmap v107: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:36.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:36 smithi072 ceph-mon[78970]: pgmap v108: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:36.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:36.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:36.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:36 smithi149 ceph-mon[67036]: pgmap v108: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:36.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:38.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:38 smithi072 ceph-mon[78970]: pgmap v109: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:38.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:38 smithi149 ceph-mon[67036]: pgmap v109: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:39 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:39 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:39.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:39 smithi149 ceph-mon[67036]: Upgrade: osd.3 is safe to restart 2024-04-15T21:07:39.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:39 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:39.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:39 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-15T21:07:39.384 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:39 smithi072 ceph-mon[78970]: Upgrade: osd.3 is safe to restart 2024-04-15T21:07:40.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:40 smithi072 ceph-mon[78970]: pgmap v110: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:40.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:40.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T21:07:40.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:40.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:40 smithi149 ceph-mon[67036]: pgmap v110: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:40.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:40 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:40.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:40 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-15T21:07:40.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:40 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:41.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:41 smithi149 ceph-mon[67036]: Upgrade: Updating osd.3 2024-04-15T21:07:41.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:41 smithi149 ceph-mon[67036]: Deploying daemon osd.3 on smithi149 2024-04-15T21:07:41.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:41 smithi072 ceph-mon[78970]: Upgrade: Updating osd.3 2024-04-15T21:07:41.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:41 smithi072 ceph-mon[78970]: Deploying daemon osd.3 on smithi149 2024-04-15T21:07:42.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:42 smithi149 ceph-mon[67036]: pgmap v111: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:42.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:42 smithi072 ceph-mon[78970]: pgmap v111: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:43.942 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:43 smithi149 systemd[1]: Stopping Ceph osd.3 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:07:43.942 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[42076]: 2024-04-15T21:07:43.822+0000 7f66cd1e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:07:43.942 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[42076]: 2024-04-15T21:07:43.822+0000 7f66cd1e1700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-15T21:07:43.942 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[42076]: 2024-04-15T21:07:43.822+0000 7f66cd1e1700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:07:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:44 smithi072 ceph-mon[78970]: pgmap v112: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:44.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:44 smithi072 ceph-mon[78970]: osd.3 marked itself down and dead 2024-04-15T21:07:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:44 smithi149 ceph-mon[67036]: pgmap v112: 65 pgs: 65 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:44.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:44 smithi149 ceph-mon[67036]: osd.3 marked itself down and dead 2024-04-15T21:07:44.873 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:44 smithi149 podman[71858]: 2024-04-15 21:07:44.48822077 +0000 UTC m=+0.761193794 container died 66ac1f9b3202e73db1d008f987897ccbe0e8042ad9f8631f14ed46508efe5388 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212) 2024-04-15T21:07:44.873 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:44 smithi149 podman[71858]: 2024-04-15 21:07:44.881783231 +0000 UTC m=+1.154756252 container cleanup 66ac1f9b3202e73db1d008f987897ccbe0e8042ad9f8631f14ed46508efe5388 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:45.150 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:44 smithi149 bash[71858]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3 2024-04-15T21:07:45.150 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:45 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:07:45.150 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:45 smithi149 ceph-mon[67036]: osdmap e65: 6 total, 5 up, 6 in 2024-04-15T21:07:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:45 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:07:45.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:45 smithi072 ceph-mon[78970]: osdmap e65: 6 total, 5 up, 6 in 2024-04-15T21:07:45.441 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71875]: 2024-04-15 21:07:45.158236218 +0000 UTC m=+0.659573051 container remove 66ac1f9b3202e73db1d008f987897ccbe0e8042ad9f8631f14ed46508efe5388 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-15T21:07:45.719 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71968]: 2024-04-15 21:07:45.378653647 +0000 UTC m=+0.018013995 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:45.720 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71968]: 2024-04-15 21:07:45.500733521 +0000 UTC m=+0.140093851 container create 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:07:45.720 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71968]: 2024-04-15 21:07:45.728311362 +0000 UTC m=+0.367671685 container init 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6) 2024-04-15T21:07:46.041 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71968]: 2024-04-15 21:07:45.732099603 +0000 UTC m=+0.371459927 container start 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-15T21:07:46.041 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:45 smithi149 podman[71968]: 2024-04-15 21:07:45.811644664 +0000 UTC m=+0.451004988 container attach 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-15T21:07:46.323 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 podman[71968]: 2024-04-15 21:07:46.050338784 +0000 UTC m=+0.689699123 container died 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-15T21:07:46.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:46 smithi149 ceph-mon[67036]: pgmap v114: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:46.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:46 smithi149 ceph-mon[67036]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-15T21:07:46.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:46 smithi149 ceph-mon[67036]: osdmap e66: 6 total, 5 up, 6 in 2024-04-15T21:07:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:46 smithi072 ceph-mon[78970]: pgmap v114: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:07:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:46 smithi072 ceph-mon[78970]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-15T21:07:46.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:46 smithi072 ceph-mon[78970]: osdmap e66: 6 total, 5 up, 6 in 2024-04-15T21:07:46.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 podman[71994]: 2024-04-15 21:07:46.623855894 +0000 UTC m=+0.567631065 container remove 9c42271ce3433d95592330cc4f379d0c0ba8ac38a4e2c1ca86d1f39980011c54 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:46.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-15T21:07:46.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 systemd[1]: Stopped Ceph osd.3 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:07:46.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.3.service: Consumed 1min 6.747s CPU time. 2024-04-15T21:07:46.942 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:46 smithi149 systemd[1]: Starting Ceph osd.3 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:07:47.377 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 31/267 objects degraded (11.610%), 8 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:47.377 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:46.976064571 +0000 UTC m=+0.018474257 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:47.377 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:47.091493893 +0000 UTC m=+0.133903551 container create be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:47.377 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:47.294128148 +0000 UTC m=+0.336537807 container init be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=) 2024-04-15T21:07:47.377 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:47.297765672 +0000 UTC m=+0.340175338 container start be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:07:47.377 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:47.385676467 +0000 UTC m=+0.428086124 container attach be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6) 2024-04-15T21:07:47.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:47 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 31/267 objects degraded (11.610%), 8 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:48.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:48 smithi149 ceph-mon[67036]: pgmap v116: 65 pgs: 8 active+undersized+degraded, 9 peering, 4 stale+active+clean, 10 active+undersized, 34 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/267 objects degraded (11.610%) 2024-04-15T21:07:48.192 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T21:07:48.192 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-15T21:07:48.192 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T21:07:48.192 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 bash[72094]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-15T21:07:48.193 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-15T21:07:48.194 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-15T21:07:48.194 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T21:07:48.194 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate[72109]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-15T21:07:48.194 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:47 smithi149 podman[72094]: 2024-04-15 21:07:47.94627179 +0000 UTC m=+0.988681458 container died be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:07:48.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:48 smithi072 ceph-mon[78970]: pgmap v116: 65 pgs: 8 active+undersized+degraded, 9 peering, 4 stale+active+clean, 10 active+undersized, 34 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/267 objects degraded (11.610%) 2024-04-15T21:07:48.790 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:48 smithi149 podman[72230]: 2024-04-15 21:07:48.539662967 +0000 UTC m=+0.587935817 container remove be47234ba0c1e67a47857c7cee0969958677a8fca54f104900b74240faf6bd82 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-activate, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6) 2024-04-15T21:07:48.790 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:48 smithi149 podman[72290]: 2024-04-15 21:07:48.662380917 +0000 UTC m=+0.018424103 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:07:48.790 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:48 smithi149 podman[72290]: 2024-04-15 21:07:48.798868365 +0000 UTC m=+0.154911524 container create 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-15T21:07:49.191 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:49 smithi149 podman[72290]: 2024-04-15 21:07:49.034662862 +0000 UTC m=+0.390706019 container init 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:07:49.191 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:49 smithi149 podman[72290]: 2024-04-15 21:07:49.037824923 +0000 UTC m=+0.393868084 container start 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-15T21:07:49.629 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:49 smithi149 bash[72290]: 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d 2024-04-15T21:07:49.629 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:49 smithi149 systemd[1]: Started Ceph osd.3 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:07:49.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:49 smithi149 ceph-osd[72310]: -- 172.21.15.149:0/3566627162 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dfa6931680 con 0x55dfa68fac00 2024-04-15T21:07:50.441 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:07:50.180+0000 7f09ecd1c7c0 -1 Falling back to public interface 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: pgmap v117: 65 pgs: 13 active+undersized+degraded, 9 peering, 16 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: pgmap v117: 65 pgs: 13 active+undersized+degraded, 9 peering, 16 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/267 objects degraded (16.479%) 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:50.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:07:51.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:51 smithi149 ceph-mon[67036]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-15T21:07:51.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:51 smithi072 ceph-mon[78970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-15T21:07:52.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:52 smithi149 ceph-mon[67036]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:52.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:52.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:52 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:52.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:52 smithi072 ceph-mon[78970]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:52.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:52.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:52 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:53.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:53 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:53.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:53 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:54.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:54 smithi072 ceph-mon[78970]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:54.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:54.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:54.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:54 smithi149 ceph-mon[67036]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:54.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:54.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:55.067 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:07:54.794+0000 7f09ecd1c7c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-04-15T21:07:55.941 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:55 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:07:55.805+0000 7f09ecd1c7c0 -1 osd.3 64 log_to_monitors true 2024-04-15T21:07:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:56 smithi072 ceph-mon[78970]: pgmap v120: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:56 smithi072 ceph-mon[78970]: from='osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T21:07:56.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:56 smithi072 ceph-mon[78970]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T21:07:56.677 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:07:56 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:07:56.448+0000 7f09de174700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:07:56.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:56 smithi149 ceph-mon[67036]: pgmap v120: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:56.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:56 smithi149 ceph-mon[67036]: from='osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T21:07:56.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:56 smithi149 ceph-mon[67036]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-15T21:07:57.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-15T21:07:57.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: osdmap e67: 6 total, 5 up, 6 in 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:07:57.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: osdmap e67: 6 total, 5 up, 6 in 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:07:57.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:07:58.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:07:58.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-15T21:07:58.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: pgmap v122: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:58.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:07:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626] boot 2024-04-15T21:07:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: osdmap e68: 6 total, 6 up, 6 in 2024-04-15T21:07:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:07:58.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:58 smithi072 ceph-mon[78970]: osdmap e69: 6 total, 6 up, 6 in 2024-04-15T21:07:58.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:07:58.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-15T21:07:58.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: pgmap v122: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-04-15T21:07:58.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:07:58.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: osd.3 [v2:172.21.15.149:6800/1868623626,v1:172.21.15.149:6801/1868623626] boot 2024-04-15T21:07:58.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: osdmap e68: 6 total, 6 up, 6 in 2024-04-15T21:07:58.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-15T21:07:58.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:58 smithi149 ceph-mon[67036]: osdmap e69: 6 total, 6 up, 6 in 2024-04-15T21:07:59.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:07:59 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 52/267 objects degraded (19.476%), 15 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:59.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:07:59 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 52/267 objects degraded (19.476%), 15 pgs degraded (PG_DEGRADED) 2024-04-15T21:07:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 -- 172.21.15.72:0/788226113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad540ff130 msgr2=0x7fad540ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 --2- 172.21.15.72:0/788226113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad540ff130 0x7fad540ff540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fad48009910 tx=0x7fad48009c20 comp rx=0 tx=0).stop 2024-04-15T21:07:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 -- 172.21.15.72:0/788226113 shutdown_connections 2024-04-15T21:07:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 --2- 172.21.15.72:0/788226113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad541003d0 0x7fad54100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 --2- 172.21.15.72:0/788226113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad540ff130 0x7fad540ff540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 -- 172.21.15.72:0/788226113 >> 172.21.15.72:0/788226113 conn(0x7fad540fa780 msgr2=0x7fad540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 -- 172.21.15.72:0/788226113 shutdown_connections 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.864+0000 7fad5ae51700 1 -- 172.21.15.72:0/788226113 wait complete. 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 Processor -- start 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 -- start start 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad540ff130 0x7fad540690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5419ade0 con 0x7fad541003d0 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad5ae51700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5419af20 con 0x7fad540ff130 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad53fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad53fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60344/0 (socket says 172.21.15.72:60344) 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad53fff700 1 -- 172.21.15.72:0/3740538209 learned_addr learned my addr 172.21.15.72:0/3740538209 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.865+0000 7fad58bed700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad540ff130 0x7fad540690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad53fff700 1 -- 172.21.15.72:0/3740538209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad540ff130 msgr2=0x7fad540690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad53fff700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad540ff130 0x7fad540690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad53fff700 1 -- 172.21.15.72:0/3740538209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480095f0 con 0x7fad541003d0 2024-04-15T21:07:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad53fff700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad4000e920 tx=0x7fad4000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4000c9d0 con 0x7fad541003d0 2024-04-15T21:07:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad40010430 con 0x7fad541003d0 2024-04-15T21:07:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5419b200 con 0x7fad541003d0 2024-04-15T21:07:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40018650 con 0x7fad541003d0 2024-04-15T21:07:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.866+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5419b750 con 0x7fad541003d0 2024-04-15T21:07:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.867+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad54107c10 con 0x7fad541003d0 2024-04-15T21:07:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.868+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fad400105a0 con 0x7fad541003d0 2024-04-15T21:07:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.868+0000 7fad51ffb700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 0x7fad44071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:07:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.868+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fad40014070 con 0x7fad541003d0 2024-04-15T21:07:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.869+0000 7fad58bed700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 0x7fad44071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:07:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.869+0000 7fad58bed700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 0x7fad44071170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b6f0 tx=0x7fad48005a90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:07:59.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:07:59.873+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fad40053ff0 con 0x7fad541003d0 2024-04-15T21:08:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.094+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad54104d20 con 0x7fad4406ecc0 2024-04-15T21:08:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.096+0000 7fad51ffb700 1 -- 172.21.15.72:0/3740538209 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fad54104d20 con 0x7fad4406ecc0 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 msgr2=0x7fad44071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 0x7fad44071170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b6f0 tx=0x7fad48005a90 comp rx=0 tx=0).stop 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 msgr2=0x7fad5419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad4000e920 tx=0x7fad4000ec30 comp rx=0 tx=0).stop 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 shutdown_connections 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fad4406ecc0 0x7fad44071170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad540ff130 0x7fad540690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 --2- 172.21.15.72:0/3740538209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad541003d0 0x7fad5419a810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 >> 172.21.15.72:0/3740538209 conn(0x7fad540fa780 msgr2=0x7fad54103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 shutdown_connections 2024-04-15T21:08:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.098+0000 7fad5ae51700 1 -- 172.21.15.72:0/3740538209 wait complete. 2024-04-15T21:08:00.101 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:08:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 -- 172.21.15.72:0/4292077222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 msgr2=0x7f5128100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 --2- 172.21.15.72:0/4292077222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f5128100860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f511c009910 tx=0x7f511c009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 -- 172.21.15.72:0/4292077222 shutdown_connections 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 --2- 172.21.15.72:0/4292077222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f5128100860 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 --2- 172.21.15.72:0/4292077222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 0x7f51280ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 -- 172.21.15.72:0/4292077222 >> 172.21.15.72:0/4292077222 conn(0x7f51280fa7a0 msgr2=0x7f51280fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 -- 172.21.15.72:0/4292077222 shutdown_connections 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.204+0000 7f512f64a700 1 -- 172.21.15.72:0/4292077222 wait complete. 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 Processor -- start 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 -- start start 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 0x7f5128069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512819b100 con 0x7f51281003f0 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512f64a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512819b240 con 0x7f51280ff150 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512cbe5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512cbe5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60356/0 (socket says 172.21.15.72:60356) 2024-04-15T21:08:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512cbe5700 1 -- 172.21.15.72:0/1940497608 learned_addr learned my addr 172.21.15.72:0/1940497608 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.205+0000 7f512d3e6700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 0x7f5128069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512cbe5700 1 -- 172.21.15.72:0/1940497608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 msgr2=0x7f5128069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512cbe5700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 0x7f5128069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512cbe5700 1 -- 172.21.15.72:0/1940497608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0095f0 con 0x7f51281003f0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512cbe5700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f511c006010 tx=0x7f511c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511c01d070 con 0x7f51281003f0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f511c00f460 con 0x7f51281003f0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512819b4c0 con 0x7f51281003f0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511c017630 con 0x7f51281003f0 2024-04-15T21:08:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.206+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512819b9b0 con 0x7f51281003f0 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.207+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128068ab0 con 0x7f51281003f0 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.207+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f511c00f5d0 con 0x7f51281003f0 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.208+0000 7f511a7fc700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 0x7f5114071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.208+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f511c0903c0 con 0x7f51281003f0 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.208+0000 7f512d3e6700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 0x7f5114071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.208+0000 7f512d3e6700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 0x7f5114071170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5124005950 tx=0x7f51240058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.213+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f511c05cca0 con 0x7f51281003f0 2024-04-15T21:08:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.434+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5128104e40 con 0x7f511406ecc0 2024-04-15T21:08:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.435+0000 7f511a7fc700 1 -- 172.21.15.72:0/1940497608 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5128104e40 con 0x7f511406ecc0 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 msgr2=0x7f5114071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 0x7f5114071170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5124005950 tx=0x7f51240058e0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 msgr2=0x7f512819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f511c006010 tx=0x7f511c00be20 comp rx=0 tx=0).stop 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 shutdown_connections 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f511406ecc0 0x7f5114071170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51280ff150 0x7f5128069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 --2- 172.21.15.72:0/1940497608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51281003f0 0x7f512819ab30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 >> 172.21.15.72:0/1940497608 conn(0x7f51280fa7a0 msgr2=0x7f51281036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 shutdown_connections 2024-04-15T21:08:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.438+0000 7f512f64a700 1 -- 172.21.15.72:0/1940497608 wait complete. 2024-04-15T21:08:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 -- 172.21.15.72:0/997694531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 msgr2=0x7f2194100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 --2- 172.21.15.72:0/997694531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194100790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f217c009910 tx=0x7f217c009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 -- 172.21.15.72:0/997694531 shutdown_connections 2024-04-15T21:08:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 --2- 172.21.15.72:0/997694531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194100790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 --2- 172.21.15.72:0/997694531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 0x7f21940ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 -- 172.21.15.72:0/997694531 >> 172.21.15.72:0/997694531 conn(0x7f21940fa6d0 msgr2=0x7f21940fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.550 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:00 smithi072 ceph-mon[78970]: pgmap v125: 65 pgs: 4 peering, 15 active+undersized+degraded, 16 active+undersized, 30 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/267 objects degraded (19.476%) 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 -- 172.21.15.72:0/997694531 shutdown_connections 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.556+0000 7f2199477700 1 -- 172.21.15.72:0/997694531 wait complete. 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 Processor -- start 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 -- start start 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 0x7f2194195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21941965f0 con 0x7f2194100340 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.557+0000 7f2199477700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2194196730 con 0x7f21940ff140 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60378/0 (socket says 172.21.15.72:60378) 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 -- 172.21.15.72:0/3284216733 learned_addr learned my addr 172.21.15.72:0/3284216733 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f2192ffd700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 0x7f2194195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 -- 172.21.15.72:0/3284216733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 msgr2=0x7f2194195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 0x7f2194195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 -- 172.21.15.72:0/3284216733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c0095f0 con 0x7f2194100340 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f21927fc700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f217c006010 tx=0x7f217c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f217c01d070 con 0x7f2194100340 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f217c00f460 con 0x7f2194100340 2024-04-15T21:08:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f217c017630 con 0x7f2194100340 2024-04-15T21:08:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219419b180 con 0x7f2194100340 2024-04-15T21:08:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.558+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219419b670 con 0x7f2194100340 2024-04-15T21:08:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.559+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2194107c90 con 0x7f2194100340 2024-04-15T21:08:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.560+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f217c003a60 con 0x7f2194100340 2024-04-15T21:08:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.561+0000 7f218bfff700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 0x7f2180071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.561+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f217c090240 con 0x7f2194100340 2024-04-15T21:08:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.561+0000 7f2192ffd700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 0x7f2180071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.562+0000 7f2192ffd700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 0x7f2180071170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2184005950 tx=0x7f21840058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.566+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f217c05cba0 con 0x7f2194100340 2024-04-15T21:08:00.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:00 smithi149 ceph-mon[67036]: pgmap v125: 65 pgs: 4 peering, 15 active+undersized+degraded, 16 active+undersized, 30 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/267 objects degraded (19.476%) 2024-04-15T21:08:00.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.778+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21940694e0 con 0x7f218006ecc0 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.788+0000 7f218bfff700 1 -- 172.21.15.72:0/3284216733 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f21940694e0 con 0x7f218006ecc0 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (12m) 41s ago 14m 25.4M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (14m) 41s ago 14m 8270k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (13m) 8s ago 13m 8032k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (2m) 41s ago 14m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:08:00.781 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (2m) 8s ago 13m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (12m) 41s ago 13m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (8m) 41s ago 8m 17.8M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (8m) 41s ago 8m 16.1M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (8m) 8s ago 8m 18.0M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (8m) 8s ago 8m 150M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (4m) 41s ago 15m 505M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (3m) 8s ago 13m 451M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (3m) 41s ago 15m 47.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (3m) 8s ago 12m 38.3M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (14m) 41s ago 14m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 8s ago 13m 17.0M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (118s) 41s ago 12m 91.2M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:08:00.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (83s) 41s ago 11m 92.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:08:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (47s) 41s ago 11m 11.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:08:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (12s) 8s ago 10m 10.4M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:08:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (10m) 8s ago 10m 222M 4096M 18.2.0 dc2bc1663786 6a3d8539301a 2024-04-15T21:08:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (9m) 8s ago 9m 199M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:08:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 41s ago 13m 72.3M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 msgr2=0x7f2180071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 0x7f2180071170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2184005950 tx=0x7f21840058e0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 msgr2=0x7f2194195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f217c006010 tx=0x7f217c00be20 comp rx=0 tx=0).stop 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 shutdown_connections 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f218006ecc0 0x7f2180071170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21940ff140 0x7f2194195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 --2- 172.21.15.72:0/3284216733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2194100340 0x7f2194195fd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 >> 172.21.15.72:0/3284216733 conn(0x7f21940fa6d0 msgr2=0x7f2194068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 shutdown_connections 2024-04-15T21:08:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.791+0000 7f2199477700 1 -- 172.21.15.72:0/3284216733 wait complete. 2024-04-15T21:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/772673311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4101440 msgr2=0x7fa1f4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/772673311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4101440 0x7fa1f4101890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009910 tx=0x7fa1e8009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/772673311 shutdown_connections 2024-04-15T21:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/772673311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4101440 0x7fa1f4101890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/772673311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4100240 0x7fa1f4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/772673311 >> 172.21.15.72:0/772673311 conn(0x7fa1f40fb7f0 msgr2=0x7fa1f40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/772673311 shutdown_connections 2024-04-15T21:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.895+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/772673311 wait complete. 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.896+0000 7fa1f8dc3700 1 Processor -- start 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.896+0000 7fa1f8dc3700 1 -- start start 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.896+0000 7fa1f8dc3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.896+0000 7fa1f8dc3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4101440 0x7fa1f4196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.896+0000 7fa1f8dc3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41966b0 con 0x7fa1f4100240 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f8dc3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41967f0 con 0x7fa1f4101440 2024-04-15T21:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60398/0 (socket says 172.21.15.72:60398) 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 -- 172.21.15.72:0/615874524 learned_addr learned my addr 172.21.15.72:0/615874524 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f1d9b700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4101440 0x7fa1f4196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 -- 172.21.15.72:0/615874524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4101440 msgr2=0x7fa1f4196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4101440 0x7fa1f4196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 -- 172.21.15.72:0/615874524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80095f0 con 0x7fa1f4100240 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f259c700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400b480 tx=0x7fa1e400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e4011800 con 0x7fa1f4100240 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f419b2a0 con 0x7fa1f4100240 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1e4011e10 con 0x7fa1f4100240 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.897+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f419b7f0 con 0x7fa1f4100240 2024-04-15T21:08:00.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.898+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e4010ea0 con 0x7fa1f4100240 2024-04-15T21:08:00.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.898+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4005320 con 0x7fa1f4100240 2024-04-15T21:08:00.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.899+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa1e4011960 con 0x7fa1f4100240 2024-04-15T21:08:00.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.899+0000 7fa1e37fe700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 0x7fa1dc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:00.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.900+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa1e408e890 con 0x7fa1f4100240 2024-04-15T21:08:00.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.900+0000 7fa1f1d9b700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 0x7fa1dc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:00.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.900+0000 7fa1f1d9b700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 0x7fa1dc071170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800b5c0 tx=0x7fa1e80052a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:00.904+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa1e405b1f0 con 0x7fa1f4100240 2024-04-15T21:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.195+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa1d4006200 con 0x7fa1f4100240 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.195+0000 7fa1e37fe700 1 -- 172.21.15.72:0/615874524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fa1e405ad80 con 0x7fa1f4100240 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:08:01.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 8 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:08:01.189 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 msgr2=0x7fa1dc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 0x7fa1dc071170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800b5c0 tx=0x7fa1e80052a0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 msgr2=0x7fa1f4195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400b480 tx=0x7fa1e400b790 comp rx=0 tx=0).stop 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 shutdown_connections 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1dc06ecc0 0x7fa1dc071170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1f4100240 0x7fa1f4195b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 --2- 172.21.15.72:0/615874524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1f4101440 0x7fa1f4196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 >> 172.21.15.72:0/615874524 conn(0x7fa1f40fb7f0 msgr2=0x7fa1f4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 shutdown_connections 2024-04-15T21:08:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.197+0000 7fa1f8dc3700 1 -- 172.21.15.72:0/615874524 wait complete. 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 -- 172.21.15.72:0/4020656556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8103390 msgr2=0x7f03c81057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 --2- 172.21.15.72:0/4020656556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8103390 0x7f03c81057b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009910 tx=0x7f03b4009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 -- 172.21.15.72:0/4020656556 shutdown_connections 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 --2- 172.21.15.72:0/4020656556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8103390 0x7f03c81057b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 --2- 172.21.15.72:0/4020656556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8069aa0 0x7f03c8102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.302+0000 7f03ceb83700 1 -- 172.21.15.72:0/4020656556 >> 172.21.15.72:0/4020656556 conn(0x7f03c80fa7a0 msgr2=0x7f03c80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 -- 172.21.15.72:0/4020656556 shutdown_connections 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 -- 172.21.15.72:0/4020656556 wait complete. 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 Processor -- start 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 -- start start 2024-04-15T21:08:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 0x7f03c81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8196900 con 0x7f03c8069aa0 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03ceb83700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8196a40 con 0x7f03c8103390 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03cc91f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03cc91f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60418/0 (socket says 172.21.15.72:60418) 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.303+0000 7f03cc91f700 1 -- 172.21.15.72:0/2357663940 learned_addr learned my addr 172.21.15.72:0/2357663940 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03c7fff700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 0x7f03c81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03cc91f700 1 -- 172.21.15.72:0/2357663940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 msgr2=0x7f03c81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03cc91f700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 0x7f03c81962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03cc91f700 1 -- 172.21.15.72:0/2357663940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40095f0 con 0x7f03c8069aa0 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03c7fff700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 0x7f03c81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:08:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03cc91f700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d900 tx=0x7f03bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03bc0041f0 con 0x7f03c8069aa0 2024-04-15T21:08:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03bc004350 con 0x7f03c8069aa0 2024-04-15T21:08:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c819b4f0 con 0x7f03c8069aa0 2024-04-15T21:08:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03bc003da0 con 0x7f03c8069aa0 2024-04-15T21:08:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.304+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c819ba40 con 0x7f03c8069aa0 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.305+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c818fbf0 con 0x7f03c8069aa0 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.306+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f03bc009730 con 0x7f03c8069aa0 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.306+0000 7f03c5ffb700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 0x7f03b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.306+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f03bc08efb0 con 0x7f03c8069aa0 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.306+0000 7f03c7fff700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 0x7f03b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.306+0000 7f03c7fff700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 0x7f03b8071170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b4005b40 tx=0x7f03b4005a90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:01.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.311+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f03bc05b890 con 0x7f03c8069aa0 2024-04-15T21:08:01.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.560+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03c8061960 con 0x7f03c8069aa0 2024-04-15T21:08:01.553 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:01 smithi072 ceph-mon[78970]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:01.553 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:01 smithi072 ceph-mon[78970]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:01.553 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:01 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/615874524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.560+0000 7f03c5ffb700 1 -- 172.21.15.72:0/2357663940 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f03bc05b420 con 0x7f03c8069aa0 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:08:01.554 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:08:01.555 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:01.557 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:08:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:01.557 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:01.557 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:01.557 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 msgr2=0x7f03b8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 0x7f03b8071170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b4005b40 tx=0x7f03b4005a90 comp rx=0 tx=0).stop 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 msgr2=0x7f03c8195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d900 tx=0x7f03bc00dcc0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 shutdown_connections 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f03b806ecc0 0x7f03b8071170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c8069aa0 0x7f03c8195da0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 --2- 172.21.15.72:0/2357663940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8103390 0x7f03c81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 >> 172.21.15.72:0/2357663940 conn(0x7f03c80fa7a0 msgr2=0x7f03c80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 shutdown_connections 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.564+0000 7f03ceb83700 1 -- 172.21.15.72:0/2357663940 wait complete. 2024-04-15T21:08:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.670+0000 7f48b3b5d700 1 -- 172.21.15.72:0/652354712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0fe8c0 msgr2=0x7f48ac0fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.670+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/652354712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac0fecd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009910 tx=0x7f48a8009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 -- 172.21.15.72:0/652354712 shutdown_connections 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/652354712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0ffb60 0x7f48ac0fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/652354712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac0fecd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 -- 172.21.15.72:0/652354712 >> 172.21.15.72:0/652354712 conn(0x7f48ac0f9f10 msgr2=0x7f48ac0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 -- 172.21.15.72:0/652354712 shutdown_connections 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 -- 172.21.15.72:0/652354712 wait complete. 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 Processor -- start 2024-04-15T21:08:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.671+0000 7f48b3b5d700 1 -- start start 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac1949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac195490 con 0x7f48ac0ffb60 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1955d0 con 0x7f48ac0fe8c0 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51078/0 (socket says 172.21.15.72:51078) 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 -- 172.21.15.72:0/2269827625 learned_addr learned my addr 172.21.15.72:0/2269827625 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b18f9700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac1949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 -- 172.21.15.72:0/2269827625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 msgr2=0x7f48ac1949c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac1949c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 -- 172.21.15.72:0/2269827625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80095f0 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b18f9700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac1949c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b10f8700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f489c00c930 tx=0x7f489c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c007ad0 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f489c007c30 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac19a090 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.672+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac19a5b0 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.673+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f489c004a00 con 0x7f48ac0ffb60 2024-04-15T21:08:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.673+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac1073a0 con 0x7f48ac0ffb60 2024-04-15T21:08:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.674+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f489c004be0 con 0x7f48ac0ffb60 2024-04-15T21:08:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.674+0000 7f48a2ffd700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 0x7f4898071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.674+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f489c08f030 con 0x7f48ac0ffb60 2024-04-15T21:08:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.674+0000 7f48b18f9700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 0x7f4898071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.675+0000 7f48b18f9700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 0x7f4898071170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48a8006010 tx=0x7f48a800b560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:01.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.679+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f489c05b910 con 0x7f48ac0ffb60 2024-04-15T21:08:01.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:01 smithi149 ceph-mon[67036]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:01.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:01 smithi149 ceph-mon[67036]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:01.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:01 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/615874524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:01.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.900+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48ac103ea0 con 0x7f489806ecc0 2024-04-15T21:08:01.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.901+0000 7f48a2ffd700 1 -- 172.21.15.72:0/2269827625 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f48ac103ea0 con 0x7f489806ecc0 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "10/23 daemons upgraded", 2024-04-15T21:08:01.894 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:08:01.895 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:08:01.895 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 msgr2=0x7f4898071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 0x7f4898071170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48a8006010 tx=0x7f48a800b560 comp rx=0 tx=0).stop 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 msgr2=0x7f48ac194f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f489c00c930 tx=0x7f489c00ccf0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 shutdown_connections 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f489806ecc0 0x7f4898071170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48ac0fe8c0 0x7f48ac1949c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 --2- 172.21.15.72:0/2269827625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac0ffb60 0x7f48ac194f00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 >> 172.21.15.72:0/2269827625 conn(0x7f48ac0f9f10 msgr2=0x7f48ac0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:01.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 shutdown_connections 2024-04-15T21:08:01.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:01.903+0000 7f48b3b5d700 1 -- 172.21.15.72:0/2269827625 wait complete. 2024-04-15T21:08:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/897297633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68103660 msgr2=0x7f3c68105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/897297633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68103660 0x7f3c68105a40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009910 tx=0x7f3c50009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/897297633 shutdown_connections 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/897297633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68103660 0x7f3c68105a40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/897297633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68100d40 0x7f3c68103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/897297633 >> 172.21.15.72:0/897297633 conn(0x7f3c680fa700 msgr2=0x7f3c680fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/897297633 shutdown_connections 2024-04-15T21:08:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.008+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/897297633 wait complete. 2024-04-15T21:08:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 Processor -- start 2024-04-15T21:08:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 -- start start 2024-04-15T21:08:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68103660 0x7f3c68196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68196680 con 0x7f3c68100d40 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6ce9b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681967c0 con 0x7f3c68103660 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51090/0 (socket says 172.21.15.72:51090) 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 -- 172.21.15.72:0/1093780362 learned_addr learned my addr 172.21.15.72:0/1093780362 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c5ffff700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68103660 0x7f3c68196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 -- 172.21.15.72:0/1093780362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68103660 msgr2=0x7f3c68196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68103660 0x7f3c68196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 -- 172.21.15.72:0/1093780362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500095f0 con 0x7f3c68100d40 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.009+0000 7f3c6659c700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b4b0 tx=0x7f3c5800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.010+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c58011800 con 0x7f3c68100d40 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.010+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6819b270 con 0x7f3c68100d40 2024-04-15T21:08:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.010+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c58011e10 con 0x7f3c68100d40 2024-04-15T21:08:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.010+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5800f2e0 con 0x7f3c68100d40 2024-04-15T21:08:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.010+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6819b7c0 con 0x7f3c68100d40 2024-04-15T21:08:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.011+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6818fcf0 con 0x7f3c68100d40 2024-04-15T21:08:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.011+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3c58010380 con 0x7f3c68100d40 2024-04-15T21:08:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.012+0000 7f3c5f7fe700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 0x7f3c54071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.012+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3c5808eaa0 con 0x7f3c68100d40 2024-04-15T21:08:02.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.012+0000 7f3c5ffff700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 0x7f3c54071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.012+0000 7f3c5ffff700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 0x7f3c54071170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c500059d0 tx=0x7f3c50005920 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:02.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.016+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3c5805b380 con 0x7f3c68100d40 2024-04-15T21:08:02.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.303+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3c6802cc30 con 0x7f3c68100d40 2024-04-15T21:08:02.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.303+0000 7f3c5f7fe700 1 -- 172.21.15.72:0/1093780362 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+871 (secure 0 0 0) 0x7f3c58015380 con 0x7f3c68100d40 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 29/267 objects degraded (10.861%), 9 pgs degraded 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/267 objects degraded (10.861%), 9 pgs degraded 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-15T21:08:02.296 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-15T21:08:02.297 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-04-15T21:08:02.297 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 msgr2=0x7f3c54071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 0x7f3c54071170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c500059d0 tx=0x7f3c50005920 comp rx=0 tx=0).stop 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 msgr2=0x7f3c68195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b4b0 tx=0x7f3c5800b870 comp rx=0 tx=0).stop 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 shutdown_connections 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3c5406ecc0 0x7f3c54071170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c68100d40 0x7f3c68195b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 --2- 172.21.15.72:0/1093780362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c68103660 0x7f3c68196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 >> 172.21.15.72:0/1093780362 conn(0x7f3c680fa700 msgr2=0x7f3c680fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 shutdown_connections 2024-04-15T21:08:02.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:02.305+0000 7f3c6ce9b700 1 -- 172.21.15.72:0/1093780362 wait complete. 2024-04-15T21:08:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:02 smithi072 ceph-mon[78970]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:02 smithi072 ceph-mon[78970]: pgmap v126: 65 pgs: 4 peering, 9 active+undersized+degraded, 7 active+undersized, 45 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/267 objects degraded (10.861%) 2024-04-15T21:08:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:02 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2357663940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:08:02.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:02 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1093780362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:08:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:02 smithi149 ceph-mon[67036]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:02 smithi149 ceph-mon[67036]: pgmap v126: 65 pgs: 4 peering, 9 active+undersized+degraded, 7 active+undersized, 45 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/267 objects degraded (10.861%) 2024-04-15T21:08:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:02 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2357663940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:08:02.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:02 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1093780362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:08:03.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:03 smithi072 ceph-mon[78970]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:03.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:03 smithi149 ceph-mon[67036]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:04.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:04 smithi072 ceph-mon[78970]: pgmap v127: 65 pgs: 4 peering, 61 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:04.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:04 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/267 objects degraded (10.861%), 9 pgs degraded) 2024-04-15T21:08:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:04 smithi149 ceph-mon[67036]: pgmap v127: 65 pgs: 4 peering, 61 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:04.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:04 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/267 objects degraded (10.861%), 9 pgs degraded) 2024-04-15T21:08:06.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:06 smithi072 ceph-mon[78970]: pgmap v128: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:06.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:06.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:06.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:06 smithi149 ceph-mon[67036]: pgmap v128: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:06.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:06.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:08.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:08 smithi072 ceph-mon[78970]: pgmap v129: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:08.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:08 smithi149 ceph-mon[67036]: pgmap v129: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:10.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:10 smithi072 ceph-mon[78970]: pgmap v130: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:10.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:10 smithi149 ceph-mon[67036]: pgmap v130: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:11.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:11.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:12.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:12 smithi149 ceph-mon[67036]: pgmap v131: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:12.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:12 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:08:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:12 smithi072 ceph-mon[78970]: pgmap v131: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:12.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:12 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:08:13.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:13 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:08:13.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:13 smithi149 ceph-mon[67036]: Upgrade: osd.4 is safe to restart 2024-04-15T21:08:13.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:13 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-15T21:08:13.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:13 smithi072 ceph-mon[78970]: Upgrade: osd.4 is safe to restart 2024-04-15T21:08:14.900 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: pgmap v132: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:14.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: Upgrade: Updating osd.4 2024-04-15T21:08:14.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:14.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T21:08:14.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:14.901 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:14 smithi149 ceph-mon[67036]: Deploying daemon osd.4 on smithi149 2024-04-15T21:08:14.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: pgmap v132: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: Upgrade: Updating osd.4 2024-04-15T21:08:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-15T21:08:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:14.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:14 smithi072 ceph-mon[78970]: Deploying daemon osd.4 on smithi149 2024-04-15T21:08:16.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:16 smithi072 ceph-mon[78970]: pgmap v133: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:16.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:16 smithi149 ceph-mon[67036]: pgmap v133: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:16.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:16 smithi149 systemd[1]: Stopping Ceph osd.4 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:08:17.425 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:17 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[46769]: 2024-04-15T21:08:17.086+0000 7fc67b063700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:08:17.425 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:17 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[46769]: 2024-04-15T21:08:17.086+0000 7fc67b063700 -1 osd.4 69 *** Got signal Terminated *** 2024-04-15T21:08:17.425 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:17 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[46769]: 2024-04-15T21:08:17.086+0000 7fc67b063700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:08:17.691 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:17 smithi149 ceph-mon[67036]: osd.4 marked itself down and dead 2024-04-15T21:08:17.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:17 smithi072 ceph-mon[78970]: osd.4 marked itself down and dead 2024-04-15T21:08:18.480 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:18 smithi149 podman[74792]: 2024-04-15 21:08:18.199934232 +0000 UTC m=+1.204814884 container died 6a3d8539301a0bfed7a097dabe578216d0bcb8ed0f6a8b3e67b1a466c6988b04 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0) 2024-04-15T21:08:18.888 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:18 smithi149 ceph-mon[67036]: pgmap v134: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:18.889 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:18 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:08:18.889 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:18 smithi149 ceph-mon[67036]: osdmap e70: 6 total, 5 up, 6 in 2024-04-15T21:08:18.889 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:18 smithi149 podman[74792]: 2024-04-15 21:08:18.578402973 +0000 UTC m=+1.583283624 container cleanup 6a3d8539301a0bfed7a097dabe578216d0bcb8ed0f6a8b3e67b1a466c6988b04 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-15T21:08:18.889 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:18 smithi149 bash[74792]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4 2024-04-15T21:08:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:18 smithi072 ceph-mon[78970]: pgmap v134: 65 pgs: 65 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:18.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:18 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:08:18.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:18 smithi072 ceph-mon[78970]: osdmap e70: 6 total, 5 up, 6 in 2024-04-15T21:08:19.192 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:18 smithi149 podman[74812]: 2024-04-15 21:08:18.896481206 +0000 UTC m=+0.682129224 container remove 6a3d8539301a0bfed7a097dabe578216d0bcb8ed0f6a8b3e67b1a466c6988b04 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, ceph=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-15T21:08:19.576 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.15906969 +0000 UTC m=+0.017804516 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:19.576 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.264003757 +0000 UTC m=+0.122738581 container create 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:08:19.576 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.501612897 +0000 UTC m=+0.360347720 container init 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD) 2024-04-15T21:08:19.576 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.5051155 +0000 UTC m=+0.363850325 container start 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:08:19.576 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.583482373 +0000 UTC m=+0.442217214 container attach 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-87dbfb6) 2024-04-15T21:08:19.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:19 smithi072 ceph-mon[78970]: osdmap e71: 6 total, 5 up, 6 in 2024-04-15T21:08:19.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:19 smithi149 ceph-mon[67036]: osdmap e71: 6 total, 5 up, 6 in 2024-04-15T21:08:19.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:19 smithi149 podman[74904]: 2024-04-15 21:08:19.802032447 +0000 UTC m=+0.660767273 container died 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_CLEAN=True, RELEASE=main-87dbfb6) 2024-04-15T21:08:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:20 smithi149 ceph-mon[67036]: pgmap v137: 65 pgs: 10 peering, 3 stale+active+clean, 52 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:20 smithi149 ceph-mon[67036]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:08:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:20.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:20.692 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 podman[74930]: 2024-04-15 21:08:20.437365885 +0000 UTC m=+0.629705458 container remove 9017dfda15dabb458b66c5bfdc16ce8f793661ead08eb9fefe595e1c151c759e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240409) 2024-04-15T21:08:20.692 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-15T21:08:20.692 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 systemd[1]: Stopped Ceph osd.4 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:08:20.693 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.4.service: Consumed 56.321s CPU time. 2024-04-15T21:08:20.693 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 systemd[1]: Starting Ceph osd.4 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:08:20.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:20 smithi072 ceph-mon[78970]: pgmap v137: 65 pgs: 10 peering, 3 stale+active+clean, 52 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:20 smithi072 ceph-mon[78970]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:08:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:20.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:21.143 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 podman[75033]: 2024-04-15 21:08:20.782216827 +0000 UTC m=+0.018752564 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:21.143 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:20 smithi149 podman[75033]: 2024-04-15 21:08:20.896645036 +0000 UTC m=+0.133180762 container create 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:08:21.143 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 podman[75033]: 2024-04-15 21:08:21.150602634 +0000 UTC m=+0.387138371 container init 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-15T21:08:21.441 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 podman[75033]: 2024-04-15 21:08:21.154383092 +0000 UTC m=+0.390918829 container start 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, GIT_CLEAN=True) 2024-04-15T21:08:21.442 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 podman[75033]: 2024-04-15 21:08:21.232596561 +0000 UTC m=+0.469132294 container attach 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-15T21:08:21.936 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 14/267 objects degraded (5.243%), 6 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-15T21:08:21.936 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 bash[75033]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate[75047]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-15T21:08:21.937 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:21 smithi149 podman[75033]: 2024-04-15 21:08:21.63386276 +0000 UTC m=+0.870398488 container died 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240409) 2024-04-15T21:08:22.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:21 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 14/267 objects degraded (5.243%), 6 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:22.595 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 podman[75184]: 2024-04-15 21:08:22.263348239 +0000 UTC m=+0.623761676 container remove 2681f01c5159ca063dda58605eec0431baf2c2c680f95f98840293b2eeab1eb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-15T21:08:22.595 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 podman[75246]: 2024-04-15 21:08:22.382822558 +0000 UTC m=+0.018064801 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:22.595 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 podman[75246]: 2024-04-15 21:08:22.497550598 +0000 UTC m=+0.132792831 container create 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-15T21:08:22.941 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:22 smithi149 ceph-mon[67036]: pgmap v138: 65 pgs: 6 active+undersized+degraded, 10 peering, 1 stale+active+clean, 7 active+undersized, 41 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/267 objects degraded (5.243%) 2024-04-15T21:08:22.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 podman[75246]: 2024-04-15 21:08:22.717635275 +0000 UTC m=+0.352877509 container init 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-15T21:08:22.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 podman[75246]: 2024-04-15 21:08:22.72107025 +0000 UTC m=+0.356312484 container start 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-87dbfb6) 2024-04-15T21:08:22.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 ceph-osd[75265]: -- 172.21.15.149:0/2994189936 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648c1f1b680 con 0x5648c1ee4c00 2024-04-15T21:08:22.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 bash[75246]: 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd 2024-04-15T21:08:22.942 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:22 smithi149 systemd[1]: Started Ceph osd.4 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:08:23.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:22 smithi072 ceph-mon[78970]: pgmap v138: 65 pgs: 6 active+undersized+degraded, 10 peering, 1 stale+active+clean, 7 active+undersized, 41 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/267 objects degraded (5.243%) 2024-04-15T21:08:23.683 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:23 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:08:23.267+0000 7f0c14d137c0 -1 Falling back to public interface 2024-04-15T21:08:23.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:23 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:23.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:23 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:23.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:23 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:23.937 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:23 smithi149 ceph-mon[67036]: pgmap v139: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/267 objects degraded (13.483%) 2024-04-15T21:08:24.163 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:23 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:24.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:23 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:24.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:23 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:24.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:23 smithi072 ceph-mon[78970]: pgmap v139: 65 pgs: 11 active+undersized+degraded, 10 peering, 13 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/267 objects degraded (13.483%) 2024-04-15T21:08:25.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:25 smithi072 ceph-mon[78970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:08:25.441 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:25 smithi149 ceph-mon[67036]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:08:26.362 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:26 smithi149 ceph-mon[67036]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:26.362 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:26.362 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:26.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:26 smithi072 ceph-mon[78970]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:26.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:26.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:28.192 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:27 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:08:27.858+0000 7f0c14d137c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-04-15T21:08:28.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:28 smithi149 ceph-mon[67036]: pgmap v141: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:28.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:28.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:28 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:28.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:28 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 47/267 objects degraded (17.603%), 15 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:28.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:28 smithi072 ceph-mon[78970]: pgmap v141: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:28.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:28.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:28 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:28.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:28 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 47/267 objects degraded (17.603%), 15 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:28.691 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:28 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:08:28.225+0000 7f0c14d137c0 -1 osd.4 69 log_to_monitors true 2024-04-15T21:08:29.385 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:29 smithi072 ceph-mon[78970]: from='osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T21:08:29.386 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:29 smithi072 ceph-mon[78970]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T21:08:29.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:29 smithi149 ceph-mon[67036]: from='osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T21:08:29.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:29 smithi149 ceph-mon[67036]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-15T21:08:30.160 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:08:30.000+0000 7f0c02163700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: osdmap e72: 6 total, 5 up, 6 in 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: from='osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:08:30.160 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:30 smithi149 ceph-mon[67036]: from='osd.4 ' entity='osd.4' 2024-04-15T21:08:30.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:30.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-15T21:08:30.390 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: osdmap e72: 6 total, 5 up, 6 in 2024-04-15T21:08:30.391 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: from='osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:08:30.391 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:08:30.391 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:30 smithi072 ceph-mon[78970]: from='osd.4 ' entity='osd.4' 2024-04-15T21:08:31.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:31.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:08:31.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:31.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:08:31.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761] boot 2024-04-15T21:08:31.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: osdmap e73: 6 total, 6 up, 6 in 2024-04-15T21:08:31.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: osd.4 [v2:172.21.15.149:6808/2131908761,v1:172.21.15.149:6809/2131908761] boot 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: osdmap e73: 6 total, 6 up, 6 in 2024-04-15T21:08:31.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 -- 172.21.15.72:0/2008345534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 msgr2=0x7f7374101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 --2- 172.21.15.72:0/2008345534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374101890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f735c009910 tx=0x7f735c009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 -- 172.21.15.72:0/2008345534 shutdown_connections 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 --2- 172.21.15.72:0/2008345534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374101890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 --2- 172.21.15.72:0/2008345534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 0x7f7374100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 -- 172.21.15.72:0/2008345534 >> 172.21.15.72:0/2008345534 conn(0x7f73740fb7f0 msgr2=0x7f73740fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 -- 172.21.15.72:0/2008345534 shutdown_connections 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.426+0000 7f737a609700 1 -- 172.21.15.72:0/2008345534 wait complete. 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 Processor -- start 2024-04-15T21:08:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 -- start start 2024-04-15T21:08:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 0x7f7374195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741965f0 con 0x7f7374101440 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f737a609700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7374196730 con 0x7f7374100240 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f736bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f736bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49330/0 (socket says 172.21.15.72:49330) 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f736bfff700 1 -- 172.21.15.72:0/3738710709 learned_addr learned my addr 172.21.15.72:0/3738710709 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.427+0000 7f7373fff700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 0x7f7374195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f736bfff700 1 -- 172.21.15.72:0/3738710709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 msgr2=0x7f7374195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f736bfff700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 0x7f7374195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f736bfff700 1 -- 172.21.15.72:0/3738710709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0095f0 con 0x7f7374101440 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f736bfff700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f735c01d070 con 0x7f7374101440 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f735c00f460 con 0x7f7374101440 2024-04-15T21:08:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737419b180 con 0x7f7374101440 2024-04-15T21:08:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f735c021640 con 0x7f7374101440 2024-04-15T21:08:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.428+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737419b670 con 0x7f7374101440 2024-04-15T21:08:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.429+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374108d90 con 0x7f7374101440 2024-04-15T21:08:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.430+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f735c00fab0 con 0x7f7374101440 2024-04-15T21:08:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.430+0000 7f7371ffb700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 0x7f7360071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.430+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f735c0900d0 con 0x7f7374101440 2024-04-15T21:08:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.430+0000 7f7373fff700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 0x7f7360071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.431+0000 7f7373fff700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 0x7f7360071170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73741012a0 tx=0x7f7364007400 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.435+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f735c05c990 con 0x7f7374101440 2024-04-15T21:08:32.584 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:32 smithi149 ceph-mon[67036]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:32.585 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:32 smithi149 ceph-mon[67036]: osdmap e74: 6 total, 6 up, 6 in 2024-04-15T21:08:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.660+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7374105d90 con 0x7f736006ecc0 2024-04-15T21:08:32.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:32 smithi072 ceph-mon[78970]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 47/267 objects degraded (17.603%) 2024-04-15T21:08:32.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:32 smithi072 ceph-mon[78970]: osdmap e74: 6 total, 6 up, 6 in 2024-04-15T21:08:32.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.661+0000 7f7371ffb700 1 -- 172.21.15.72:0/3738710709 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7374105d90 con 0x7f736006ecc0 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 msgr2=0x7f7360071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 0x7f7360071170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73741012a0 tx=0x7f7364007400 comp rx=0 tx=0).stop 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 msgr2=0x7f7374195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c00bd70 comp rx=0 tx=0).stop 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 shutdown_connections 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f736006ecc0 0x7f7360071170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7374100240 0x7f7374195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 --2- 172.21.15.72:0/3738710709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7374101440 0x7f7374195fd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 >> 172.21.15.72:0/3738710709 conn(0x7f73740fb7f0 msgr2=0x7f7374104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 shutdown_connections 2024-04-15T21:08:32.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.663+0000 7f737a609700 1 -- 172.21.15.72:0/3738710709 wait complete. 2024-04-15T21:08:32.667 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:08:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 -- 172.21.15.72:0/3642523752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 msgr2=0x7fe8e40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/3642523752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e40ff540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009910 tx=0x7fe8d4009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 -- 172.21.15.72:0/3642523752 shutdown_connections 2024-04-15T21:08:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/3642523752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 0x7fe8e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/3642523752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e40ff540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 -- 172.21.15.72:0/3642523752 >> 172.21.15.72:0/3642523752 conn(0x7fe8e40fa780 msgr2=0x7fe8e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 -- 172.21.15.72:0/3642523752 shutdown_connections 2024-04-15T21:08:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.771+0000 7fe8e8c07700 1 -- 172.21.15.72:0/3642523752 wait complete. 2024-04-15T21:08:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 Processor -- start 2024-04-15T21:08:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 -- start start 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 0x7fe8e4194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4195510 con 0x7fe8e40ff130 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e8c07700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4195650 con 0x7fe8e41003d0 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49342/0 (socket says 172.21.15.72:49342) 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 -- 172.21.15.72:0/1930462115 learned_addr learned my addr 172.21.15.72:0/1930462115 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8dbfff700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 0x7fe8e4194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 -- 172.21.15.72:0/1930462115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 msgr2=0x7fe8e4194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 0x7fe8e4194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 -- 172.21.15.72:0/1930462115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40095f0 con 0x7fe8e40ff130 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.772+0000 7fe8e259c700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400bd70 tx=0x7fe8d400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.773+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d401d070 con 0x7fe8e40ff130 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.773+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e419a0a0 con 0x7fe8e40ff130 2024-04-15T21:08:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.773+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8d4005dc0 con 0x7fe8e40ff130 2024-04-15T21:08:32.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.773+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d4021410 con 0x7fe8e40ff130 2024-04-15T21:08:32.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.773+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e419a590 con 0x7fe8e40ff130 2024-04-15T21:08:32.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.774+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4107c10 con 0x7fe8e40ff130 2024-04-15T21:08:32.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.774+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe8d400f7d0 con 0x7fe8e40ff130 2024-04-15T21:08:32.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.775+0000 7fe8db7fe700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 0x7fe8d0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:32.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.775+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe8d408ff90 con 0x7fe8e40ff130 2024-04-15T21:08:32.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.775+0000 7fe8dbfff700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 0x7fe8d0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:32.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.775+0000 7fe8dbfff700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 0x7fe8d0071170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc005950 tx=0x7fe8cc00b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:32.779+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe8d405c920 con 0x7fe8e40ff130 2024-04-15T21:08:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.000+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e419ac20 con 0x7fe8d006ecc0 2024-04-15T21:08:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.001+0000 7fe8db7fe700 1 -- 172.21.15.72:0/1930462115 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe8e419ac20 con 0x7fe8d006ecc0 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 msgr2=0x7fe8d0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 0x7fe8d0071170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc005950 tx=0x7fe8cc00b410 comp rx=0 tx=0).stop 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 msgr2=0x7fe8e41949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400bd70 tx=0x7fe8d400bda0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 shutdown_connections 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe8d006ecc0 0x7fe8d0071170 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40ff130 0x7fe8e41949b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 --2- 172.21.15.72:0/1930462115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8e41003d0 0x7fe8e4194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 >> 172.21.15.72:0/1930462115 conn(0x7fe8e40fa780 msgr2=0x7fe8e4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 shutdown_connections 2024-04-15T21:08:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.004+0000 7fe8e8c07700 1 -- 172.21.15.72:0/1930462115 wait complete. 2024-04-15T21:08:33.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 -- 172.21.15.72:0/1597028066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 msgr2=0x7f7808100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 --2- 172.21.15.72:0/1597028066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f7808100860 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009910 tx=0x7f77f8009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 -- 172.21.15.72:0/1597028066 shutdown_connections 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 --2- 172.21.15.72:0/1597028066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f7808100860 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 --2- 172.21.15.72:0/1597028066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78080ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 -- 172.21.15.72:0/1597028066 >> 172.21.15.72:0/1597028066 conn(0x7f78080fa7a0 msgr2=0x7f78080fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 -- 172.21.15.72:0/1597028066 shutdown_connections 2024-04-15T21:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.109+0000 7f780e19f700 1 -- 172.21.15.72:0/1597028066 wait complete. 2024-04-15T21:08:33.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 Processor -- start 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 -- start start 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78081071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808105d30 con 0x7f78081003f0 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f780e19f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808105e70 con 0x7f78080ff150 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49356/0 (socket says 172.21.15.72:49356) 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.110+0000 7f7806ffd700 1 -- 172.21.15.72:0/113349010 learned_addr learned my addr 172.21.15.72:0/113349010 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f78077fe700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78081071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7806ffd700 1 -- 172.21.15.72:0/113349010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 msgr2=0x7f78081071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7806ffd700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78081071a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7806ffd700 1 -- 172.21.15.72:0/113349010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80095f0 con 0x7f78081003f0 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f78077fe700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78081071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:08:33.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7806ffd700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bd70 tx=0x7f77f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f801d070 con 0x7f78081003f0 2024-04-15T21:08:33.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78081060f0 con 0x7f78081003f0 2024-04-15T21:08:33.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f8022470 con 0x7f78081003f0 2024-04-15T21:08:33.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f800f670 con 0x7f78081003f0 2024-04-15T21:08:33.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.111+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78081065e0 con 0x7f78081003f0 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.112+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7808068ab0 con 0x7f78081003f0 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.113+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f77f8004b70 con 0x7f78081003f0 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.113+0000 7f7804ff9700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 0x7f77f0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.113+0000 7f78077fe700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 0x7f77f0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.113+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f77f8090510 con 0x7f78081003f0 2024-04-15T21:08:33.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.114+0000 7f78077fe700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 0x7f77f0071170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005fd0 tx=0x7f77fc005e20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.118+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f77f805cea0 con 0x7f78081003f0 2024-04-15T21:08:33.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.331+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7808104e40 con 0x7f77f006ecc0 2024-04-15T21:08:33.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:33 smithi072 ceph-mon[78970]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:33.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.342+0000 7f7804ff9700 1 -- 172.21.15.72:0/113349010 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f7808104e40 con 0x7f77f006ecc0 2024-04-15T21:08:33.335 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:08:33.335 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (13m) 74s ago 14m 25.4M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:08:33.335 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (15m) 74s ago 15m 8270k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:08:33.335 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (13m) 7s ago 13m 8312k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (2m) 74s ago 15m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (2m) 7s ago 13m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (12m) 74s ago 14m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (8m) 74s ago 8m 17.8M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (9m) 74s ago 9m 16.1M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (8m) 7s ago 8m 18.2M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (9m) 7s ago 9m 150M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (5m) 74s ago 16m 505M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (4m) 7s ago 13m 452M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (4m) 74s ago 16m 47.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (3m) 7s ago 13m 39.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (14m) 74s ago 14m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 7s ago 13m 16.2M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:08:33.336 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (2m) 74s ago 12m 91.2M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (116s) 74s ago 12m 92.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (80s) 74s ago 11m 11.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (44s) 7s ago 11m 86.6M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (10s) 7s ago 10m 11.7M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (10m) 7s ago 10m 200M 4096M 18.2.0 dc2bc1663786 b19c5ce6f8d5 2024-04-15T21:08:33.337 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 74s ago 14m 72.3M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 msgr2=0x7f77f0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 0x7f77f0071170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005fd0 tx=0x7f77fc005e20 comp rx=0 tx=0).stop 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 msgr2=0x7f78081057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bd70 tx=0x7f77f800be50 comp rx=0 tx=0).stop 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 shutdown_connections 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77f006ecc0 0x7f77f0071170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78080ff150 0x7f78081071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 --2- 172.21.15.72:0/113349010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78081003f0 0x7f78081057f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 >> 172.21.15.72:0/113349010 conn(0x7f78080fa7a0 msgr2=0x7f7808103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 shutdown_connections 2024-04-15T21:08:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.344+0000 7f780e19f700 1 -- 172.21.15.72:0/113349010 wait complete. 2024-04-15T21:08:33.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.448+0000 7f855e43a700 1 -- 172.21.15.72:0/3679984237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 msgr2=0x7f85580ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.448+0000 7f855e43a700 1 --2- 172.21.15.72:0/3679984237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f85580ff540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f854c009910 tx=0x7f854c009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:33.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.448+0000 7f855e43a700 1 -- 172.21.15.72:0/3679984237 shutdown_connections 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 --2- 172.21.15.72:0/3679984237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 0x7f8558100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 --2- 172.21.15.72:0/3679984237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f85580ff540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 -- 172.21.15.72:0/3679984237 >> 172.21.15.72:0/3679984237 conn(0x7f85580fa780 msgr2=0x7f85580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 -- 172.21.15.72:0/3679984237 shutdown_connections 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 -- 172.21.15.72:0/3679984237 wait complete. 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 Processor -- start 2024-04-15T21:08:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.449+0000 7f855e43a700 1 -- start start 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f855e43a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f855e43a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 0x7f855819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f855e43a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855819adc0 con 0x7f85580ff130 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f855e43a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855819af00 con 0x7f85581003d0 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49366/0 (socket says 172.21.15.72:49366) 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 -- 172.21.15.72:0/3874516949 learned_addr learned my addr 172.21.15.72:0/3874516949 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f85577fe700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 0x7f855819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 -- 172.21.15.72:0/3874516949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 msgr2=0x7f855819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 0x7f855819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 -- 172.21.15.72:0/3874516949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0095f0 con 0x7f85580ff130 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f8557fff700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f854c006010 tx=0x7f854c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.450+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c01d070 con 0x7f85580ff130 2024-04-15T21:08:33.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.451+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f854c00f460 con 0x7f85580ff130 2024-04-15T21:08:33.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.451+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855819b180 con 0x7f85580ff130 2024-04-15T21:08:33.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.451+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c017630 con 0x7f85580ff130 2024-04-15T21:08:33.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.451+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855819b670 con 0x7f85580ff130 2024-04-15T21:08:33.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.452+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8558107c30 con 0x7f85580ff130 2024-04-15T21:08:33.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.452+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f854c003a60 con 0x7f85580ff130 2024-04-15T21:08:33.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.452+0000 7f85557fa700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 0x7f8540071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.453+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f854c090270 con 0x7f85580ff130 2024-04-15T21:08:33.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.453+0000 7f85577fe700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 0x7f8540071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.453+0000 7f85577fe700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 0x7f8540071170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8548005950 tx=0x7f85480058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.457+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f854c05cbd0 con 0x7f85580ff130 2024-04-15T21:08:33.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:33 smithi149 ceph-mon[67036]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.747+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f855819bd00 con 0x7f85580ff130 2024-04-15T21:08:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.747+0000 7f85557fa700 1 -- 172.21.15.72:0/3874516949 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f854c05c760 con 0x7f85580ff130 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 5 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:08:33.741 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 9 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:08:33.742 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 msgr2=0x7f8540071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 0x7f8540071170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8548005950 tx=0x7f85480058e0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 msgr2=0x7f8558069100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f854c006010 tx=0x7f854c00be20 comp rx=0 tx=0).stop 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 shutdown_connections 2024-04-15T21:08:33.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f854006ecc0 0x7f8540071170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85580ff130 0x7f8558069100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 --2- 172.21.15.72:0/3874516949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85581003d0 0x7f855819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 >> 172.21.15.72:0/3874516949 conn(0x7f85580fa780 msgr2=0x7f8558103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:33.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 shutdown_connections 2024-04-15T21:08:33.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.750+0000 7f855e43a700 1 -- 172.21.15.72:0/3874516949 wait complete. 2024-04-15T21:08:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 -- 172.21.15.72:0/3178971872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 msgr2=0x7f8b1c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 --2- 172.21.15.72:0/3178971872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c101890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009910 tx=0x7f8b04009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 -- 172.21.15.72:0/3178971872 shutdown_connections 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 --2- 172.21.15.72:0/3178971872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c101890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 --2- 172.21.15.72:0/3178971872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 -- 172.21.15.72:0/3178971872 >> 172.21.15.72:0/3178971872 conn(0x7f8b1c0fb7f0 msgr2=0x7f8b1c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 -- 172.21.15.72:0/3178971872 shutdown_connections 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.856+0000 7f8b21c60700 1 -- 172.21.15.72:0/3178971872 wait complete. 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 Processor -- start 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 -- start start 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1988a0 con 0x7f8b1c101440 2024-04-15T21:08:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b21c60700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1989e0 con 0x7f8b1c100240 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49382/0 (socket says 172.21.15.72:49382) 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b13fff700 1 -- 172.21.15.72:0/1846467867 learned_addr learned my addr 172.21.15.72:0/1846467867 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.857+0000 7f8b1b7fe700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b13fff700 1 -- 172.21.15.72:0/1846467867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 msgr2=0x7f8b1c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b13fff700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b13fff700 1 -- 172.21.15.72:0/1846467867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040095f0 con 0x7f8b1c101440 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b1b7fe700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b13fff700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b04006010 tx=0x7f8b0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b0401d070 con 0x7f8b1c101440 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8b0400f460 con 0x7f8b1c101440 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b04021640 con 0x7f8b1c101440 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c19d430 con 0x7f8b1c101440 2024-04-15T21:08:33.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.858+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c19d8d0 con 0x7f8b1c101440 2024-04-15T21:08:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.859+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c105520 con 0x7f8b1c101440 2024-04-15T21:08:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.859+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8b0400fab0 con 0x7f8b1c101440 2024-04-15T21:08:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.860+0000 7f8b197fa700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 0x7f8b08071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.860+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8b04090350 con 0x7f8b1c101440 2024-04-15T21:08:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.860+0000 7f8b1b7fe700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 0x7f8b08071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.860+0000 7f8b1b7fe700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 0x7f8b08071170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c1012a0 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:33.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:33.865+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8b0405cc30 con 0x7f8b1c101440 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.111+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b1c061960 con 0x7f8b1c101440 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.112+0000 7f8b197fa700 1 -- 172.21.15.72:0/1846467867 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f8b0405c7c0 con 0x7f8b1c101440 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:08:34.106 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:34.107 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:08:34.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 msgr2=0x7f8b08071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 0x7f8b08071170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c1012a0 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 msgr2=0x7f8b1c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b04006010 tx=0x7f8b0400be20 comp rx=0 tx=0).stop 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 shutdown_connections 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8b0806ecc0 0x7f8b08071170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b1c100240 0x7f8b1c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 --2- 172.21.15.72:0/1846467867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b1c101440 0x7f8b1c198280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 >> 172.21.15.72:0/1846467867 conn(0x7f8b1c0fb7f0 msgr2=0x7f8b1c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 shutdown_connections 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.115+0000 7f8b21c60700 1 -- 172.21.15.72:0/1846467867 wait complete. 2024-04-15T21:08:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 -- 172.21.15.72:0/637505025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 msgr2=0x7fa340101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 --2- 172.21.15.72:0/637505025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340101890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa330009910 tx=0x7fa330009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 -- 172.21.15.72:0/637505025 shutdown_connections 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 --2- 172.21.15.72:0/637505025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340101890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 --2- 172.21.15.72:0/637505025 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 0x7fa340100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.220+0000 7fa348554700 1 -- 172.21.15.72:0/637505025 >> 172.21.15.72:0/637505025 conn(0x7fa3400fb7f0 msgr2=0x7fa3400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 -- 172.21.15.72:0/637505025 shutdown_connections 2024-04-15T21:08:34.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 -- 172.21.15.72:0/637505025 wait complete. 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 Processor -- start 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 -- start start 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 0x7fa340195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3401965f0 con 0x7fa340101440 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa348554700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa340196730 con 0x7fa340100240 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa345aef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa345aef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49410/0 (socket says 172.21.15.72:49410) 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.221+0000 7fa345aef700 1 -- 172.21.15.72:0/1643867004 learned_addr learned my addr 172.21.15.72:0/1643867004 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa3462f0700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 0x7fa340195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa345aef700 1 -- 172.21.15.72:0/1643867004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 msgr2=0x7fa340195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa345aef700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 0x7fa340195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa345aef700 1 -- 172.21.15.72:0/1643867004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300095f0 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa345aef700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa330006010 tx=0x7fa33000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33001d070 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34019b180 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa33000f460 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa330017630 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.222+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34019b670 con 0x7fa340101440 2024-04-15T21:08:34.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.223+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa340108d90 con 0x7fa340101440 2024-04-15T21:08:34.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.224+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa330003a60 con 0x7fa340101440 2024-04-15T21:08:34.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.224+0000 7fa3377fe700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 0x7fa32c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.224+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa330090350 con 0x7fa340101440 2024-04-15T21:08:34.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.224+0000 7fa3462f0700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 0x7fa32c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.225+0000 7fa3462f0700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 0x7fa32c071170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa33c005950 tx=0x7fa33c0058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:34.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.229+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa33005cc30 con 0x7fa340101440 2024-04-15T21:08:34.413 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: pgmap v147: 65 pgs: 10 peering, 10 active+undersized+degraded, 14 active+undersized, 31 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/267 objects degraded (9.363%) 2024-04-15T21:08:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 25/267 objects degraded (9.363%), 10 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3874516949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:34.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:34 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1846467867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:08:34.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.453+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa340105d90 con 0x7fa32c06ecc0 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.454+0000 7fa3377fe700 1 -- 172.21.15.72:0/1643867004 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa340105d90 con 0x7fa32c06ecc0 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:08:34.447 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:08:34.448 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "11/23 daemons upgraded", 2024-04-15T21:08:34.448 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-04-15T21:08:34.448 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:08:34.448 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 msgr2=0x7fa32c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 0x7fa32c071170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa33c005950 tx=0x7fa33c0058e0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 msgr2=0x7fa340195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa330006010 tx=0x7fa33000be20 comp rx=0 tx=0).stop 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 shutdown_connections 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa32c06ecc0 0x7fa32c071170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa340100240 0x7fa340195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 --2- 172.21.15.72:0/1643867004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa340101440 0x7fa340195fd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 >> 172.21.15.72:0/1643867004 conn(0x7fa3400fb7f0 msgr2=0x7fa340104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:34.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 shutdown_connections 2024-04-15T21:08:34.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.456+0000 7fa348554700 1 -- 172.21.15.72:0/1643867004 wait complete. 2024-04-15T21:08:34.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.563+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/343154784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 msgr2=0x7f9cdc100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.563+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/343154784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc100b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009910 tx=0x7f9cd0009c20 comp rx=0 tx=0).stop 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/343154784 shutdown_connections 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/343154784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 0x7f9cdc0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/343154784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc100b60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/343154784 >> 172.21.15.72:0/343154784 conn(0x7f9cdc0f9e50 msgr2=0x7f9cdc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/343154784 shutdown_connections 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/343154784 wait complete. 2024-04-15T21:08:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 Processor -- start 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- start start 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 0x7f9cdc0fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc19ae20 con 0x7f9cdc100750 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.564+0000 7f9ce2bf1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc19af60 con 0x7f9cdc0ff3b0 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49432/0 (socket says 172.21.15.72:49432) 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 -- 172.21.15.72:0/2318952108 learned_addr learned my addr 172.21.15.72:0/2318952108 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9ce098d700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 0x7f9cdc0fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 -- 172.21.15.72:0/2318952108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 msgr2=0x7f9cdc0fee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 0x7f9cdc0fee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 -- 172.21.15.72:0/2318952108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00095f0 con 0x7f9cdc100750 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cdbfff700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800d8d0 tx=0x7f9cc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc8009940 con 0x7f9cdc100750 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cc8010460 con 0x7f9cdc100750 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc19b240 con 0x7f9cdc100750 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc800f5d0 con 0x7f9cdc100750 2024-04-15T21:08:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.565+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc19b790 con 0x7f9cdc100750 2024-04-15T21:08:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.566+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc107ca0 con 0x7f9cdc100750 2024-04-15T21:08:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.567+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9cc80105d0 con 0x7f9cdc100750 2024-04-15T21:08:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.567+0000 7f9cd9ffb700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 0x7f9ccc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:08:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.567+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9cc808ed30 con 0x7f9cdc100750 2024-04-15T21:08:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.567+0000 7f9ce098d700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 0x7f9ccc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:08:34.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.568+0000 7f9ce098d700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 0x7f9ccc071170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0006010 tx=0x7f9cd0005a90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:08:34.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.572+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9cc805b690 con 0x7f9cdc100750 2024-04-15T21:08:34.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:34.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: pgmap v147: 65 pgs: 10 peering, 10 active+undersized+degraded, 14 active+undersized, 31 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/267 objects degraded (9.363%) 2024-04-15T21:08:34.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 25/267 objects degraded (9.363%), 10 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:34.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:34.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3874516949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:08:34.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:34 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1846467867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:08:34.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.858+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9cdc19be20 con 0x7f9cdc100750 2024-04-15T21:08:34.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.858+0000 7f9cd9ffb700 1 -- 172.21.15.72:0/2318952108 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+928 (secure 0 0 0) 0x7f9cc80163b0 con 0x7f9cdc100750 2024-04-15T21:08:34.851 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 25/267 objects degraded (9.363%), 10 pgs degraded 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 25/267 objects degraded (9.363%), 10 pgs degraded 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-15T21:08:34.852 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.860+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 msgr2=0x7f9ccc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.860+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 0x7f9ccc071170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0006010 tx=0x7f9cd0005a90 comp rx=0 tx=0).stop 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 msgr2=0x7f9cdc19a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800d8d0 tx=0x7f9cc800dc90 comp rx=0 tx=0).stop 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 shutdown_connections 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9ccc06ecc0 0x7f9ccc071170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cdc0ff3b0 0x7f9cdc0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 --2- 172.21.15.72:0/2318952108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc100750 0x7f9cdc19a850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:08:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 >> 172.21.15.72:0/2318952108 conn(0x7f9cdc0f9e50 msgr2=0x7f9cdc1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:08:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 shutdown_connections 2024-04-15T21:08:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:08:34.861+0000 7f9ce2bf1700 1 -- 172.21.15.72:0/2318952108 wait complete. 2024-04-15T21:08:35.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:35 smithi072 ceph-mon[78970]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:35.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:35 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2318952108' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:08:35.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:35.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:35.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:35 smithi149 ceph-mon[67036]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:08:35.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:35 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2318952108' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:08:35.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:35.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:36.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:36 smithi072 ceph-mon[78970]: pgmap v148: 65 pgs: 10 peering, 1 active+undersized+degraded, 3 active+undersized, 51 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/267 objects degraded (1.873%) 2024-04-15T21:08:36.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:36 smithi149 ceph-mon[67036]: pgmap v148: 65 pgs: 10 peering, 1 active+undersized+degraded, 3 active+undersized, 51 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/267 objects degraded (1.873%) 2024-04-15T21:08:37.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:37 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/267 objects degraded (1.873%), 1 pg degraded) 2024-04-15T21:08:37.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:37 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/267 objects degraded (1.873%), 1 pg degraded) 2024-04-15T21:08:38.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:38 smithi072 ceph-mon[78970]: pgmap v149: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:38.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:38 smithi149 ceph-mon[67036]: pgmap v149: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:40.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:40 smithi072 ceph-mon[78970]: pgmap v150: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:40.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:40 smithi149 ceph-mon[67036]: pgmap v150: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:42.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:42 smithi072 ceph-mon[78970]: pgmap v151: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:42.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:42 smithi149 ceph-mon[67036]: pgmap v151: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:44.664 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:44 smithi072 ceph-mon[78970]: pgmap v152: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:44.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:44 smithi149 ceph-mon[67036]: pgmap v152: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:46.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:46 smithi149 ceph-mon[67036]: pgmap v153: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:46.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:46.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:46.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:46 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:46.321 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:46 smithi149 ceph-mon[67036]: Upgrade: osd.5 is safe to restart 2024-04-15T21:08:46.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:46 smithi072 ceph-mon[78970]: pgmap v153: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:46.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:46.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:46.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:46 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-15T21:08:46.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:46 smithi072 ceph-mon[78970]: Upgrade: osd.5 is safe to restart 2024-04-15T21:08:48.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: pgmap v154: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:48.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: Upgrade: Updating osd.5 2024-04-15T21:08:48.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:48.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T21:08:48.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:48.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:48 smithi149 ceph-mon[67036]: Deploying daemon osd.5 on smithi149 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: pgmap v154: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: Upgrade: Updating osd.5 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:08:48.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:48 smithi072 ceph-mon[78970]: Deploying daemon osd.5 on smithi149 2024-04-15T21:08:50.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-mon[67036]: pgmap v155: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:50.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:50.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:50 smithi072 ceph-mon[78970]: pgmap v155: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:50.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:08:50.513 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:50 smithi149 systemd[1]: Stopping Ceph osd.5 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:08:50.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[51434]: 2024-04-15T21:08:50.517+0000 7f0e3278c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:08:50.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[51434]: 2024-04-15T21:08:50.517+0000 7f0e3278c700 -1 osd.5 74 *** Got signal Terminated *** 2024-04-15T21:08:50.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:50 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[51434]: 2024-04-15T21:08:50.517+0000 7f0e3278c700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:08:51.390 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:51 smithi149 ceph-mon[67036]: osd.5 marked itself down and dead 2024-04-15T21:08:51.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:51 smithi072 ceph-mon[78970]: osd.5 marked itself down and dead 2024-04-15T21:08:51.676 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:51 smithi149 podman[77758]: 2024-04-15 21:08:51.397483244 +0000 UTC m=+1.012498128 container died b19c5ce6f8d568cf76f21556be334f466ca825a016c777778ae6e5613d8121b6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:08:51.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:51 smithi149 podman[77758]: 2024-04-15 21:08:51.80128832 +0000 UTC m=+1.416303159 container cleanup b19c5ce6f8d568cf76f21556be334f466ca825a016c777778ae6e5613d8121b6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-15T21:08:51.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:51 smithi149 bash[77758]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5 2024-04-15T21:08:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:52 smithi072 ceph-mon[78970]: pgmap v156: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:52 smithi072 ceph-mon[78970]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:08:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:52 smithi072 ceph-mon[78970]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-15T21:08:52.308 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:52 smithi072 ceph-mon[78970]: osdmap e75: 6 total, 5 up, 6 in 2024-04-15T21:08:52.375 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:52 smithi149 ceph-mon[67036]: pgmap v156: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:52.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:52 smithi149 ceph-mon[67036]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-15T21:08:52.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:52 smithi149 ceph-mon[67036]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-15T21:08:52.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:52 smithi149 ceph-mon[67036]: osdmap e75: 6 total, 5 up, 6 in 2024-04-15T21:08:52.376 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77776]: 2024-04-15 21:08:52.07750819 +0000 UTC m=+0.670958176 container remove b19c5ce6f8d568cf76f21556be334f466ca825a016c777778ae6e5613d8121b6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=-18.2.0) 2024-04-15T21:08:52.648 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.285846058 +0000 UTC m=+0.018225338 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:52.649 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.429045195 +0000 UTC m=+0.161424461 container create f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-15T21:08:52.649 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.656096458 +0000 UTC m=+0.388475728 container init f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6) 2024-04-15T21:08:52.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.659446002 +0000 UTC m=+0.391825279 container start f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-15T21:08:52.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.755903419 +0000 UTC m=+0.488282687 container attach f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-15T21:08:53.235 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:53 smithi149 ceph-mon[67036]: osdmap e76: 6 total, 5 up, 6 in 2024-04-15T21:08:53.235 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:52 smithi149 podman[77870]: 2024-04-15 21:08:52.960614245 +0000 UTC m=+0.692993505 container died f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:08:53.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:53 smithi072 ceph-mon[78970]: osdmap e76: 6 total, 5 up, 6 in 2024-04-15T21:08:53.489 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 podman[77896]: 2024-04-15 21:08:53.484701072 +0000 UTC m=+0.518430104 container remove f80f5d4f1d9775c1239f1eb4e6d6e7e6cccdc1ef391150cf2b8e769cf8b4dea9 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-87dbfb6) 2024-04-15T21:08:53.926 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-15T21:08:53.926 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 systemd[1]: Stopped Ceph osd.5 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:08:53.926 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.5.service: Consumed 55.772s CPU time. 2024-04-15T21:08:53.926 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 systemd[1]: Starting Ceph osd.5 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:08:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-mon[67036]: pgmap v159: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:54.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-mon[67036]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:08:54.192 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 podman[77999]: 2024-04-15 21:08:53.835722628 +0000 UTC m=+0.018364940 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:54.192 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:53 smithi149 podman[77999]: 2024-04-15 21:08:53.944167963 +0000 UTC m=+0.126810271 container create 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-15T21:08:54.193 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 podman[77999]: 2024-04-15 21:08:54.146648137 +0000 UTC m=+0.329290442 container init 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-15T21:08:54.193 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 podman[77999]: 2024-04-15 21:08:54.150438784 +0000 UTC m=+0.333081093 container start 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-15T21:08:54.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:54 smithi072 ceph-mon[78970]: pgmap v159: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:08:54.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:54 smithi072 ceph-mon[78970]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-15T21:08:54.602 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 podman[77999]: 2024-04-15 21:08:54.229923852 +0000 UTC m=+0.412566176 container attach 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True) 2024-04-15T21:08:54.940 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T21:08:54.940 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-15T21:08:54.940 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 bash[77999]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-15T21:08:54.941 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T21:08:54.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate[78014]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-15T21:08:54.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:54 smithi149 podman[77999]: 2024-04-15 21:08:54.635269227 +0000 UTC m=+0.817911533 container died 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-15T21:08:55.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:55 smithi149 ceph-mon[67036]: Health check failed: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:55.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:55 smithi072 ceph-mon[78970]: Health check failed: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded (PG_DEGRADED) 2024-04-15T21:08:55.507 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 podman[78150]: 2024-04-15 21:08:55.200159005 +0000 UTC m=+0.559422603 container remove 56bcd6b3433b779a7e8044c513b24d8a04351051228a0f1611faa83d3f52e49b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, ceph=True) 2024-04-15T21:08:55.507 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 podman[78213]: 2024-04-15 21:08:55.40152307 +0000 UTC m=+0.099225042 container create de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409) 2024-04-15T21:08:55.508 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 podman[78213]: 2024-04-15 21:08:55.320637815 +0000 UTC m=+0.018339748 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:08:55.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 podman[78213]: 2024-04-15 21:08:55.603628869 +0000 UTC m=+0.301330799 container init de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2) 2024-04-15T21:08:55.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 podman[78213]: 2024-04-15 21:08:55.606787293 +0000 UTC m=+0.304489224 container start de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6) 2024-04-15T21:08:55.942 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 ceph-osd[78232]: -- 172.21.15.149:0/1091535495 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d985f3680 con 0x562d985bcc00 2024-04-15T21:08:55.943 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 bash[78213]: de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b 2024-04-15T21:08:55.943 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:55 smithi149 systemd[1]: Started Ceph osd.5 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:08:56.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:56 smithi072 ceph-mon[78970]: pgmap v160: 65 pgs: 7 active+undersized+degraded, 10 peering, 11 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/267 objects degraded (6.367%) 2024-04-15T21:08:56.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:56.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:56.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:56.442 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:08:56 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:08:56.149+0000 7f50be3427c0 -1 Falling back to public interface 2024-04-15T21:08:56.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:56 smithi149 ceph-mon[67036]: pgmap v160: 65 pgs: 7 active+undersized+degraded, 10 peering, 11 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/267 objects degraded (6.367%) 2024-04-15T21:08:56.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:56.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:56.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:08:57.410 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:57 smithi149 ceph-mon[67036]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:08:57.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:57 smithi072 ceph-mon[78970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-15T21:08:58.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:58 smithi072 ceph-mon[78970]: pgmap v161: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:08:58.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:58 smithi149 ceph-mon[67036]: pgmap v161: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:08:59.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:59.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:08:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:59.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:08:59.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:08:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:00.410 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:09:00.080+0000 7f50be3427c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-04-15T21:09:00.411 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:09:00.416+0000 7f50be3427c0 -1 osd.5 74 log_to_monitors true 2024-04-15T21:09:00.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-mon[67036]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:00.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:00.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:00.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-mon[67036]: from='osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T21:09:00.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-mon[67036]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T21:09:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:00 smithi072 ceph-mon[78970]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:00.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:00 smithi072 ceph-mon[78970]: from='osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T21:09:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:00 smithi072 ceph-mon[78970]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-15T21:09:01.192 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:09:00 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:09:00.876+0000 7f50af79a700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T21:09:02.038 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:01 smithi149 ceph-mon[67036]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-15T21:09:02.038 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:01 smithi149 ceph-mon[67036]: osdmap e77: 6 total, 5 up, 6 in 2024-04-15T21:09:02.038 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:01 smithi149 ceph-mon[67036]: from='osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:09:02.038 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:01 smithi149 ceph-mon[67036]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:09:02.039 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:01 smithi149 ceph-mon[67036]: pgmap v164: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:02.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:01 smithi072 ceph-mon[78970]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-15T21:09:02.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:01 smithi072 ceph-mon[78970]: osdmap e77: 6 total, 5 up, 6 in 2024-04-15T21:09:02.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:01 smithi072 ceph-mon[78970]: from='osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:09:02.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:01 smithi072 ceph-mon[78970]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-04-15T21:09:02.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:01 smithi072 ceph-mon[78970]: pgmap v164: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:03.114 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:02 smithi149 ceph-mon[67036]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:09:03.115 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:02 smithi149 ceph-mon[67036]: osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514] boot 2024-04-15T21:09:03.115 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:02 smithi149 ceph-mon[67036]: osdmap e78: 6 total, 6 up, 6 in 2024-04-15T21:09:03.115 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:02 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:09:03.115 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:02 smithi149 ceph-mon[67036]: Health check update: Degraded data redundancy: 41/267 objects degraded (15.356%), 13 pgs degraded (PG_DEGRADED) 2024-04-15T21:09:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:02 smithi072 ceph-mon[78970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-15T21:09:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:02 smithi072 ceph-mon[78970]: osd.5 [v2:172.21.15.149:6816/185623514,v1:172.21.15.149:6817/185623514] boot 2024-04-15T21:09:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:02 smithi072 ceph-mon[78970]: osdmap e78: 6 total, 6 up, 6 in 2024-04-15T21:09:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:02 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-15T21:09:03.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:02 smithi072 ceph-mon[78970]: Health check update: Degraded data redundancy: 41/267 objects degraded (15.356%), 13 pgs degraded (PG_DEGRADED) 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: osdmap e79: 6 total, 6 up, 6 in 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: pgmap v167: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all osd 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-15T21:09:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: Upgrade: Setting require_osd_release to 19 squid 2024-04-15T21:09:04.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:03 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: osdmap e79: 6 total, 6 up, 6 in 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: pgmap v167: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/267 objects degraded (15.356%) 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:04.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all osd 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-15T21:09:04.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: Upgrade: Setting require_osd_release to 19 squid 2024-04-15T21:09:04.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:03 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-15T21:09:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- 172.21.15.72:0/3907205001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 msgr2=0x7f9a78105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 --2- 172.21.15.72:0/3907205001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a78105a60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009910 tx=0x7f9a6c009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- 172.21.15.72:0/3907205001 shutdown_connections 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 --2- 172.21.15.72:0/3907205001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a78105a60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 --2- 172.21.15.72:0/3907205001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a78103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- 172.21.15.72:0/3907205001 >> 172.21.15.72:0/3907205001 conn(0x7f9a780fa780 msgr2=0x7f9a780fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- 172.21.15.72:0/3907205001 shutdown_connections 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- 172.21.15.72:0/3907205001 wait complete. 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 Processor -- start 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.971+0000 7f9a7e480700 1 -- start start 2024-04-15T21:09:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a7e480700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a781006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a7e480700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a7e480700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780ff250 con 0x7f9a78103680 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a7e480700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780ff390 con 0x7f9a78100d60 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51586/0 (socket says 172.21.15.72:51586) 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 -- 172.21.15.72:0/705599330 learned_addr learned my addr 172.21.15.72:0/705599330 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a77fff700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a781006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 -- 172.21.15.72:0/705599330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 msgr2=0x7f9a781006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a781006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 -- 172.21.15.72:0/705599330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0095f0 con 0x7f9a78103680 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a77fff700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a781006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:09:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a777fe700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b5c0 tx=0x7f9a6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c01d070 con 0x7f9a78103680 2024-04-15T21:09:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c00f460 con 0x7f9a78103680 2024-04-15T21:09:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.972+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c021640 con 0x7f9a78103680 2024-04-15T21:09:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.973+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a780ff610 con 0x7f9a78103680 2024-04-15T21:09:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.973+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a780ffab0 con 0x7f9a78103680 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.974+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7818fbe0 con 0x7f9a78103680 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.974+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9a6c00f5d0 con 0x7f9a78103680 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.974+0000 7f9a757fa700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 0x7f9a60071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.975+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9a6c090230 con 0x7f9a78103680 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.975+0000 7f9a77fff700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 0x7f9a60071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.975+0000 7f9a77fff700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 0x7f9a60071170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005fd0 tx=0x7f9a68005ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:04.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:04.979+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9a6c05cb10 con 0x7f9a78103680 2024-04-15T21:09:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:04 smithi072 ceph-mon[78970]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-15T21:09:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-15T21:09:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:04 smithi072 ceph-mon[78970]: osdmap e80: 6 total, 6 up, 6 in 2024-04-15T21:09:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.zkrubp"]}]: dispatch 2024-04-15T21:09:05.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:04 smithi072 ceph-mon[78970]: Upgrade: It appears safe to stop mds.cephfs.smithi072.zkrubp 2024-04-15T21:09:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:04 smithi149 ceph-mon[67036]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-15T21:09:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-15T21:09:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:04 smithi149 ceph-mon[67036]: osdmap e80: 6 total, 6 up, 6 in 2024-04-15T21:09:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.zkrubp"]}]: dispatch 2024-04-15T21:09:05.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:04 smithi149 ceph-mon[67036]: Upgrade: It appears safe to stop mds.cephfs.smithi072.zkrubp 2024-04-15T21:09:05.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.226+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a78061190 con 0x7f9a6006ecc0 2024-04-15T21:09:05.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.227+0000 7f9a757fa700 1 -- 172.21.15.72:0/705599330 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9a78061190 con 0x7f9a6006ecc0 2024-04-15T21:09:05.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 msgr2=0x7f9a60071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 0x7f9a60071170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005fd0 tx=0x7f9a68005ee0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 msgr2=0x7f9a780fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b5c0 tx=0x7f9a6c00be20 comp rx=0 tx=0).stop 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 shutdown_connections 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9a6006ecc0 0x7f9a60071170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a78100d60 0x7f9a781006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 --2- 172.21.15.72:0/705599330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a78103680 0x7f9a780fed10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 >> 172.21.15.72:0/705599330 conn(0x7f9a780fa780 msgr2=0x7f9a780fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 shutdown_connections 2024-04-15T21:09:05.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.230+0000 7f9a7e480700 1 -- 172.21.15.72:0/705599330 wait complete. 2024-04-15T21:09:05.234 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 -- 172.21.15.72:0/650251080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 msgr2=0x7ffa9c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 --2- 172.21.15.72:0/650251080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c0ff560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009910 tx=0x7ffa8c009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 -- 172.21.15.72:0/650251080 shutdown_connections 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 --2- 172.21.15.72:0/650251080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 0x7ffa9c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 --2- 172.21.15.72:0/650251080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c0ff560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 -- 172.21.15.72:0/650251080 >> 172.21.15.72:0/650251080 conn(0x7ffa9c0fa700 msgr2=0x7ffa9c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 -- 172.21.15.72:0/650251080 shutdown_connections 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.341+0000 7ffaa290c700 1 -- 172.21.15.72:0/650251080 wait complete. 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 Processor -- start 2024-04-15T21:09:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 -- start start 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 0x7ffa9c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1966b0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffaa290c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c19d180 con 0x7ffa9c100350 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51598/0 (socket says 172.21.15.72:51598) 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 -- 172.21.15.72:0/547640777 learned_addr learned my addr 172.21.15.72:0/547640777 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa93fff700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 0x7ffa9c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 -- 172.21.15.72:0/547640777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 msgr2=0x7ffa9c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 0x7ffa9c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 -- 172.21.15.72:0/547640777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0095f0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.342+0000 7ffa9bfff700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00bdd0 tx=0x7ffa8c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.343+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8c01d070 con 0x7ffa9c0ff150 2024-04-15T21:09:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.343+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa8c004c50 con 0x7ffa9c0ff150 2024-04-15T21:09:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.343+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c19d3d0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.343+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8c021640 con 0x7ffa9c0ff150 2024-04-15T21:09:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.343+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c19d8c0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.344+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c107ca0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.344+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffa8c00fa10 con 0x7ffa9c0ff150 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.345+0000 7ffa99ffb700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 0x7ffa88071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.345+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffa8c0901d0 con 0x7ffa9c0ff150 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.345+0000 7ffa93fff700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 0x7ffa88071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.345+0000 7ffa93fff700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 0x7ffa88071170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa84005fd0 tx=0x7ffa8400a560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.349+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ffa8c05cb30 con 0x7ffa9c0ff150 2024-04-15T21:09:05.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.575+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa9c104ca0 con 0x7ffa8806ecc0 2024-04-15T21:09:05.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.576+0000 7ffa99ffb700 1 -- 172.21.15.72:0/547640777 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffa9c104ca0 con 0x7ffa8806ecc0 2024-04-15T21:09:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 msgr2=0x7ffa88071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 0x7ffa88071170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa84005fd0 tx=0x7ffa8400a560 comp rx=0 tx=0).stop 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 msgr2=0x7ffa9c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00bdd0 tx=0x7ffa8c00beb0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 shutdown_connections 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ffa8806ecc0 0x7ffa88071170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa9c0ff150 0x7ffa9c069930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 --2- 172.21.15.72:0/547640777 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9c100350 0x7ffa9c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.578+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 >> 172.21.15.72:0/547640777 conn(0x7ffa9c0fa700 msgr2=0x7ffa9c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.579+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 shutdown_connections 2024-04-15T21:09:05.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.579+0000 7ffaa290c700 1 -- 172.21.15.72:0/547640777 wait complete. 2024-04-15T21:09:05.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 -- 172.21.15.72:0/1303836320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 msgr2=0x7fbf540fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/1303836320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf540fe340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009910 tx=0x7fbf3c009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 -- 172.21.15.72:0/1303836320 shutdown_connections 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/1303836320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf540fe340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/1303836320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 0x7fbf54101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 -- 172.21.15.72:0/1303836320 >> 172.21.15.72:0/1303836320 conn(0x7fbf540f9f10 msgr2=0x7fbf540fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 -- 172.21.15.72:0/1303836320 shutdown_connections 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.685+0000 7fbf5a5de700 1 -- 172.21.15.72:0/1303836320 wait complete. 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 Processor -- start 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 -- start start 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 0x7fbf54195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54196640 con 0x7fbf54102210 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf5a5de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54196780 con 0x7fbf541018c0 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51616/0 (socket says 172.21.15.72:51616) 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 -- 172.21.15.72:0/2425699854 learned_addr learned my addr 172.21.15.72:0/2425699854 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf53fff700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 0x7fbf54195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 -- 172.21.15.72:0/2425699854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 msgr2=0x7fbf54195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 0x7fbf54195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 -- 172.21.15.72:0/2425699854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0095f0 con 0x7fbf54102210 2024-04-15T21:09:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.686+0000 7fbf4bfff700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00bd70 tx=0x7fbf3c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.687+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c01d070 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.687+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf3c00f460 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.687+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5419b1d0 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.687+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c021640 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.687+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5419b6c0 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.688+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf54108d30 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.688+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbf3c00fab0 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.689+0000 7fbf51ffb700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 0x7fbf40071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.689+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbf3c090260 con 0x7fbf54102210 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.689+0000 7fbf53fff700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 0x7fbf40071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.689+0000 7fbf53fff700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 0x7fbf40071170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005fd0 tx=0x7fbf4400a560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:05.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.693+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbf3c05cb40 con 0x7fbf54102210 2024-04-15T21:09:05.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.907+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf54105fb0 con 0x7fbf4006ecc0 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.918+0000 7fbf51ffb700 1 -- 172.21.15.72:0/2425699854 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbf54105fb0 con 0x7fbf4006ecc0 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (13m) 107s ago 15m 25.4M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (15m) 107s ago 15m 8270k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (14m) 7s ago 14m 8548k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (3m) 107s ago 15m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (3m) 7s ago 14m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (13m) 107s ago 14m 84.1M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:09:05.912 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (9m) 107s ago 9m 17.8M - 18.2.0 dc2bc1663786 f4e789c8f867 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (9m) 107s ago 9m 16.1M - 18.2.0 dc2bc1663786 bf7ff83b03e3 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (9m) 7s ago 9m 18.5M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (9m) 7s ago 9m 150M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (5m) 107s ago 16m 505M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (4m) 7s ago 14m 452M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (4m) 107s ago 16m 47.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (4m) 7s ago 14m 40.7M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (15m) 107s ago 15m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 7s ago 14m 16.7M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (3m) 107s ago 13m 91.2M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (2m) 107s ago 12m 92.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (112s) 107s ago 12m 11.7M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (77s) 7s ago 11m 88.4M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:09:05.913 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (43s) 7s ago 11m 91.4M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:09:05.914 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (10s) 7s ago 11m 14.9M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:09:05.914 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (5m) 107s ago 14m 72.3M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 msgr2=0x7fbf40071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 0x7fbf40071170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005fd0 tx=0x7fbf4400a560 comp rx=0 tx=0).stop 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 msgr2=0x7fbf54196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00bd70 tx=0x7fbf3c00be50 comp rx=0 tx=0).stop 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 shutdown_connections 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fbf4006ecc0 0x7fbf40071170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf541018c0 0x7fbf54195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 --2- 172.21.15.72:0/2425699854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf54102210 0x7fbf54196020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.920+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 >> 172.21.15.72:0/2425699854 conn(0x7fbf540f9f10 msgr2=0x7fbf54104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.921+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 shutdown_connections 2024-04-15T21:09:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:05.921+0000 7fbf5a5de700 1 -- 172.21.15.72:0/2425699854 wait complete. 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 -- 172.21.15.72:0/605132998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688074d20 msgr2=0x7f7688073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 --2- 172.21.15.72:0/605132998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688074d20 0x7f7688073180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7678009910 tx=0x7f7678009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 -- 172.21.15.72:0/605132998 shutdown_connections 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 --2- 172.21.15.72:0/605132998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688073750 0x7f7688073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 --2- 172.21.15.72:0/605132998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688074d20 0x7f7688073180 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 -- 172.21.15.72:0/605132998 >> 172.21.15.72:0/605132998 conn(0x7f76880fb7f0 msgr2=0x7f76880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.025+0000 7f769075c700 1 -- 172.21.15.72:0/605132998 shutdown_connections 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 -- 172.21.15.72:0/605132998 wait complete. 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 Processor -- start 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 -- start start 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688074d20 0x7f7688198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688198840 con 0x7f7688073750 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f769075c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768819d250 con 0x7f7688074d20 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f768e4f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f768e4f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51644/0 (socket says 172.21.15.72:51644) 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.026+0000 7f768e4f8700 1 -- 172.21.15.72:0/1268210572 learned_addr learned my addr 172.21.15.72:0/1268210572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f768dcf7700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688074d20 0x7f7688198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f768e4f8700 1 -- 172.21.15.72:0/1268210572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688074d20 msgr2=0x7f7688198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f768e4f8700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688074d20 0x7f7688198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f768e4f8700 1 -- 172.21.15.72:0/1268210572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780095f0 con 0x7f7688073750 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f768e4f8700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f767800b5c0 tx=0x7f767800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f767801d070 con 0x7f7688073750 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f767800f460 con 0x7f7688073750 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768819d3f0 con 0x7f7688073750 2024-04-15T21:09:06.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7678021640 con 0x7f7688073750 2024-04-15T21:09:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.027+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768819d8b0 con 0x7f7688073750 2024-04-15T21:09:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.028+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768810af80 con 0x7f7688073750 2024-04-15T21:09:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.029+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f767800f5d0 con 0x7f7688073750 2024-04-15T21:09:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.029+0000 7f767f7fe700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 0x7f7674071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.029+0000 7f768dcf7700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 0x7f7674071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.029+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7678090140 con 0x7f7688073750 2024-04-15T21:09:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.030+0000 7f768dcf7700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 0x7f7674071170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7684005950 tx=0x7f76840058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.034+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7678058f70 con 0x7f7688073750 2024-04-15T21:09:06.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:06 smithi072 ceph-mon[78970]: pgmap v169: 65 pgs: 9 active+undersized+degraded, 11 active+undersized, 45 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/267 objects degraded (11.985%) 2024-04-15T21:09:06.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:06.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:06.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:06 smithi072 ceph-mon[78970]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:06.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:06 smithi072 ceph-mon[78970]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:06.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.349+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f768810b140 con 0x7f7688073750 2024-04-15T21:09:06.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.349+0000 7f767f7fe700 1 -- 172.21.15.72:0/1268210572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7f767805c630 con 0x7f7688073750 2024-04-15T21:09:06.343 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:09:06.343 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 10 2024-04-15T21:09:06.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:09:06.345 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 msgr2=0x7f7674071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 0x7f7674071170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7684005950 tx=0x7f76840058e0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 msgr2=0x7f7688197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f767800b5c0 tx=0x7f767800be20 comp rx=0 tx=0).stop 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 shutdown_connections 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f767406ecc0 0x7f7674071170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7688073750 0x7f7688197ce0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 --2- 172.21.15.72:0/1268210572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7688074d20 0x7f7688198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 >> 172.21.15.72:0/1268210572 conn(0x7f76880fb7f0 msgr2=0x7f7688106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:06.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 shutdown_connections 2024-04-15T21:09:06.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.352+0000 7f769075c700 1 -- 172.21.15.72:0/1268210572 wait complete. 2024-04-15T21:09:06.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:06 smithi149 ceph-mon[67036]: pgmap v169: 65 pgs: 9 active+undersized+degraded, 11 active+undersized, 45 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/267 objects degraded (11.985%) 2024-04-15T21:09:06.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:06.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:06.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:06 smithi149 ceph-mon[67036]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:06.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:06 smithi149 ceph-mon[67036]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 -- 172.21.15.72:0/3532503204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 msgr2=0x7f92d4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 --2- 172.21.15.72:0/3532503204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d4100840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009910 tx=0x7f92c0009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 -- 172.21.15.72:0/3532503204 shutdown_connections 2024-04-15T21:09:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 --2- 172.21.15.72:0/3532503204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d4100840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 --2- 172.21.15.72:0/3532503204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 0x7f92d40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 -- 172.21.15.72:0/3532503204 >> 172.21.15.72:0/3532503204 conn(0x7f92d40fa780 msgr2=0x7f92d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 -- 172.21.15.72:0/3532503204 shutdown_connections 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.461+0000 7f92dade6700 1 -- 172.21.15.72:0/3532503204 wait complete. 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 Processor -- start 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 -- start start 2024-04-15T21:09:06.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 0x7f92d40690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d419ad90 con 0x7f92d41003d0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92dade6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d419aed0 con 0x7f92d40ff130 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51672/0 (socket says 172.21.15.72:51672) 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 -- 172.21.15.72:0/170041990 learned_addr learned my addr 172.21.15.72:0/170041990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d8b82700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 0x7f92d40690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 -- 172.21.15.72:0/170041990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 msgr2=0x7f92d40690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 0x7f92d40690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.462+0000 7f92d3fff700 1 -- 172.21.15.72:0/170041990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00095f0 con 0x7f92d41003d0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92d3fff700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f92c0006010 tx=0x7f92c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c001d070 con 0x7f92d41003d0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d419b150 con 0x7f92d41003d0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92c000f460 con 0x7f92d41003d0 2024-04-15T21:09:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c0021640 con 0x7f92d41003d0 2024-04-15T21:09:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.463+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d419b640 con 0x7f92d41003d0 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.464+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d4107c10 con 0x7f92d41003d0 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.465+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92c0003a60 con 0x7f92d41003d0 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.466+0000 7f92d1ffb700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 0x7f92c4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.466+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f92c008ff90 con 0x7f92d41003d0 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.466+0000 7f92d8b82700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 0x7f92c4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.466+0000 7f92d8b82700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 0x7f92c4071170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005950 tx=0x7f92c800b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.475+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92c005c8f0 con 0x7f92d41003d0 2024-04-15T21:09:06.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.742+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92d4107e30 con 0x7f92d41003d0 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.743+0000 7f92d1ffb700 1 -- 172.21.15.72:0/170041990 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f92c005c480 con 0x7f92d41003d0 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:09:06.737 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:09:06.738 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:09:06.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:06.740 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:14484} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.72:6828/4081954875,v1:172.21.15.72:6829/4081954875] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:06.740 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/3963533271,v1:172.21.15.72:6827/3963533271] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:06.740 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:06.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 msgr2=0x7f92c4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 0x7f92c4071170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005950 tx=0x7f92c800b410 comp rx=0 tx=0).stop 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 msgr2=0x7f92d419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f92c0006010 tx=0x7f92c000bd70 comp rx=0 tx=0).stop 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 shutdown_connections 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f92c406ecc0 0x7f92c4071170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92d40ff130 0x7f92d40690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 --2- 172.21.15.72:0/170041990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92d41003d0 0x7f92d419a7c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 >> 172.21.15.72:0/170041990 conn(0x7f92d40fa780 msgr2=0x7f92d4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 shutdown_connections 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.745+0000 7f92dade6700 1 -- 172.21.15.72:0/170041990 wait complete. 2024-04-15T21:09:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 -- 172.21.15.72:0/959529854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 msgr2=0x7f88d00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/959529854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d00ff560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009910 tx=0x7f88cc009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 -- 172.21.15.72:0/959529854 shutdown_connections 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/959529854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/959529854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d00ff560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 -- 172.21.15.72:0/959529854 >> 172.21.15.72:0/959529854 conn(0x7f88d00fa700 msgr2=0x7f88d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 -- 172.21.15.72:0/959529854 shutdown_connections 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.858+0000 7f88d7dd2700 1 -- 172.21.15.72:0/959529854 wait complete. 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 Processor -- start 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 -- start start 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d019ae10 con 0x7f88d00ff150 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d019af50 con 0x7f88d0100350 2024-04-15T21:09:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51680/0 (socket says 172.21.15.72:51680) 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 -- 172.21.15.72:0/1057740556 learned_addr learned my addr 172.21.15.72:0/1057740556 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d536d700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 -- 172.21.15.72:0/1057740556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 msgr2=0x7f88d019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 -- 172.21.15.72:0/1057740556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0095f0 con 0x7f88d00ff150 2024-04-15T21:09:06.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d536d700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d5b6e700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00bda0 tx=0x7f88cc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc01d070 con 0x7f88d00ff150 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88cc00f460 con 0x7f88d00ff150 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc021640 con 0x7f88d00ff150 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.859+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d019b1d0 con 0x7f88d00ff150 2024-04-15T21:09:06.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.860+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d019b6c0 con 0x7f88d00ff150 2024-04-15T21:09:06.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.860+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0107ca0 con 0x7f88d00ff150 2024-04-15T21:09:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.861+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f88cc00fa00 con 0x7f88d00ff150 2024-04-15T21:09:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.861+0000 7f88c6ffd700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 0x7f88bc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.861+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f88cc090140 con 0x7f88d00ff150 2024-04-15T21:09:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.862+0000 7f88d536d700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 0x7f88bc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.862+0000 7f88d536d700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 0x7f88bc071170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005950 tx=0x7f88c00058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:06.866+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f88cc05ca20 con 0x7f88d00ff150 2024-04-15T21:09:07.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.095+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88d0104ca0 con 0x7f88bc06ecc0 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.096+0000 7f88c6ffd700 1 -- 172.21.15.72:0/1057740556 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88d0104ca0 con 0x7f88bc06ecc0 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:09:07.090 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:09:07.091 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "12/23 daemons upgraded", 2024-04-15T21:09:07.091 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-04-15T21:09:07.091 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:09:07.091 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:09:07.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 msgr2=0x7f88bc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 0x7f88bc071170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005950 tx=0x7f88c00058e0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 msgr2=0x7f88d0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00bda0 tx=0x7f88cc00be80 comp rx=0 tx=0).stop 2024-04-15T21:09:07.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 shutdown_connections 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f88bc06ecc0 0x7f88bc071170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88d00ff150 0x7f88d0069930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 --2- 172.21.15.72:0/1057740556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88d0100350 0x7f88d019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.098+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 >> 172.21.15.72:0/1057740556 conn(0x7f88d00fa700 msgr2=0x7f88d0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.099+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 shutdown_connections 2024-04-15T21:09:07.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.099+0000 7f88d7dd2700 1 -- 172.21.15.72:0/1057740556 wait complete. 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1379298157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 msgr2=0x7f40c4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1379298157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4100650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009910 tx=0x7f40b4009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1379298157 shutdown_connections 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1379298157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 0x7f40c4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1379298157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4100650 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1379298157 >> 172.21.15.72:0/1379298157 conn(0x7f40c40fb7f0 msgr2=0x7f40c40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: Upgrade: Updating mds.cephfs.smithi072.zkrubp 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: Deploying daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1268210572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:07.199 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:07 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/170041990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:09:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1379298157 shutdown_connections 2024-04-15T21:09:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.204+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1379298157 wait complete. 2024-04-15T21:09:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 Processor -- start 2024-04-15T21:09:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 -- start start 2024-04-15T21:09:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 0x7f40c4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4196630 con 0x7f40c4100240 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c8aa3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4196770 con 0x7f40c4101440 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51702/0 (socket says 172.21.15.72:51702) 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 -- 172.21.15.72:0/1743305503 learned_addr learned my addr 172.21.15.72:0/1743305503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c1d9b700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 0x7f40c4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 -- 172.21.15.72:0/1743305503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 msgr2=0x7f40c4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 0x7f40c4196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.205+0000 7f40c259c700 1 -- 172.21.15.72:0/1743305503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40095f0 con 0x7f40c4100240 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40c259c700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40b400bda0 tx=0x7f40b400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b401d070 con 0x7f40c4100240 2024-04-15T21:09:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f40b400f460 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c419b1c0 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b4021620 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.206+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c419b6b0 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.207+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c4108d90 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.208+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f40b400f5d0 con 0x7f40c4100240 2024-04-15T21:09:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.208+0000 7f40b37fe700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 0x7f40ac071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.208+0000 7f40c1d9b700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 0x7f40ac071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.208+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f40b4090050 con 0x7f40c4100240 2024-04-15T21:09:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.209+0000 7f40c1d9b700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 0x7f40ac071170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40b8005950 tx=0x7f40b800b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.213+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f40b405c9b0 con 0x7f40c4100240 2024-04-15T21:09:07.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: Upgrade: Updating mds.cephfs.smithi072.zkrubp 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.zkrubp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: Deploying daemon mds.cephfs.smithi072.zkrubp on smithi072 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1268210572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:07.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:07 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/170041990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:09:07.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.506+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f40c419c0a0 con 0x7f40c4100240 2024-04-15T21:09:07.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.507+0000 7f40b37fe700 1 -- 172.21.15.72:0/1743305503 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f40b405c540 con 0x7f40c4100240 2024-04-15T21:09:07.501 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:09:07.501 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:09:07.501 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 msgr2=0x7f40ac071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 0x7f40ac071170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40b8005950 tx=0x7f40b800b410 comp rx=0 tx=0).stop 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 msgr2=0x7f40c4195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40b400bda0 tx=0x7f40b400bdd0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 shutdown_connections 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f40ac06ecc0 0x7f40ac071170 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40c4100240 0x7f40c4195ad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 --2- 172.21.15.72:0/1743305503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40c4101440 0x7f40c4196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 >> 172.21.15.72:0/1743305503 conn(0x7f40c40fb7f0 msgr2=0x7f40c4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 shutdown_connections 2024-04-15T21:09:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:07.509+0000 7f40c8aa3700 1 -- 172.21.15.72:0/1743305503 wait complete. 2024-04-15T21:09:08.259 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:08 smithi072 ceph-mon[78970]: pgmap v170: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:08.259 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:08 smithi072 ceph-mon[78970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/267 objects degraded (11.985%), 9 pgs degraded) 2024-04-15T21:09:08.259 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:08 smithi072 ceph-mon[78970]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:08.259 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:08 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1743305503' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:09:08.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:08 smithi149 ceph-mon[67036]: pgmap v170: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:08.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:08 smithi149 ceph-mon[67036]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/267 objects degraded (11.985%), 9 pgs degraded) 2024-04-15T21:09:08.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:08 smithi149 ceph-mon[67036]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:08.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:08 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1743305503' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:09:10.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:10 smithi072 ceph-mon[78970]: pgmap v171: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:10.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:10 smithi072 ceph-mon[78970]: osdmap e81: 6 total, 6 up, 6 in 2024-04-15T21:09:10.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:10 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 2 up:standby 2024-04-15T21:09:10.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:10 smithi149 ceph-mon[67036]: pgmap v171: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:10.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:10 smithi149 ceph-mon[67036]: osdmap e81: 6 total, 6 up, 6 in 2024-04-15T21:09:10.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:10 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 2 up:standby 2024-04-15T21:09:11.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:11 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:09:11.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:11 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:09:12.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:12 smithi072 ceph-mon[78970]: pgmap v173: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:12.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:12 smithi149 ceph-mon[67036]: pgmap v173: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:14.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:14 smithi072 ceph-mon[78970]: pgmap v174: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:14.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:14 smithi149 ceph-mon[67036]: pgmap v174: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:15.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:boot 2024-04-15T21:09:15.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:09:15.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:09:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:15.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:boot 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:15.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:16.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:16 smithi149 ceph-mon[67036]: pgmap v175: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:16.543 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:16 smithi072 ceph-mon[78970]: pgmap v175: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:18.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:18 smithi072 ceph-mon[78970]: pgmap v176: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:18.442 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:18 smithi149 ceph-mon[67036]: pgmap v176: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:20.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:20 smithi072 ceph-mon[78970]: pgmap v177: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:20.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:20.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:20 smithi149 ceph-mon[67036]: pgmap v177: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:20.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:20.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:21.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:21.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:21.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:21.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:22.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:22 smithi072 ceph-mon[78970]: pgmap v178: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:22.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:22 smithi149 ceph-mon[67036]: pgmap v178: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:24.884 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: pgmap v179: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:24.884 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.884 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.884 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:24.884 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.885 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.pbknte"]}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: pgmap v179: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:24.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.pbknte"]}]: dispatch 2024-04-15T21:09:25.888 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:25 smithi072 ceph-mon[78970]: Detected new or changed devices on smithi072 2024-04-15T21:09:25.888 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:25 smithi072 ceph-mon[78970]: Upgrade: It appears safe to stop mds.cephfs.smithi072.pbknte 2024-04-15T21:09:25.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:25 smithi149 ceph-mon[67036]: Detected new or changed devices on smithi072 2024-04-15T21:09:25.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:25 smithi149 ceph-mon[67036]: Upgrade: It appears safe to stop mds.cephfs.smithi072.pbknte 2024-04-15T21:09:26.908 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:26 smithi072 ceph-mon[78970]: pgmap v180: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:26.908 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:26.908 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:26.908 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:26.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:26 smithi149 ceph-mon[67036]: pgmap v180: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:26.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:26.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.pbknte", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:26.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:27.909 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:27 smithi072 ceph-mon[78970]: Upgrade: Updating mds.cephfs.smithi072.pbknte 2024-04-15T21:09:27.909 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:27 smithi072 ceph-mon[78970]: Deploying daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T21:09:27.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:27 smithi149 ceph-mon[67036]: Upgrade: Updating mds.cephfs.smithi072.pbknte 2024-04-15T21:09:27.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:27 smithi149 ceph-mon[67036]: Deploying daemon mds.cephfs.smithi072.pbknte on smithi072 2024-04-15T21:09:28.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:28 smithi072 ceph-mon[78970]: pgmap v181: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:28.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:28 smithi149 ceph-mon[67036]: pgmap v181: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:29.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:29 smithi072 ceph-mon[78970]: osdmap e82: 6 total, 6 up, 6 in 2024-04-15T21:09:29.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:29 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 2 up:standby 2024-04-15T21:09:29.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:29 smithi149 ceph-mon[67036]: osdmap e82: 6 total, 6 up, 6 in 2024-04-15T21:09:29.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:29 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 2 up:standby 2024-04-15T21:09:30.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:30 smithi072 ceph-mon[78970]: pgmap v183: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:30.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:30 smithi149 ceph-mon[67036]: pgmap v183: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:31.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:31 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:09:31.942 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:31 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:09:32.799 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:32 smithi072 ceph-mon[78970]: pgmap v184: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:32.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:32 smithi149 ceph-mon[67036]: pgmap v184: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: pgmap v185: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] up:boot 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:34.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:34 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:34.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: pgmap v185: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:34.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] up:boot 2024-04-15T21:09:34.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.mflbpn=up:active} 3 up:standby 2024-04-15T21:09:34.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:09:34.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:34.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:34.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:34 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:35.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:36.069 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:36.793 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:36 smithi072 ceph-mon[78970]: pgmap v186: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:36.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:36 smithi149 ceph-mon[67036]: pgmap v186: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 -- 172.21.15.72:0/2647220843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 msgr2=0x7fe070105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 --2- 172.21.15.72:0/2647220843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070105a80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe060009910 tx=0x7fe060009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 -- 172.21.15.72:0/2647220843 shutdown_connections 2024-04-15T21:09:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 --2- 172.21.15.72:0/2647220843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070105a80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 --2- 172.21.15.72:0/2647220843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 0x7fe070103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 -- 172.21.15.72:0/2647220843 >> 172.21.15.72:0/2647220843 conn(0x7fe0700fa7a0 msgr2=0x7fe0700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 -- 172.21.15.72:0/2647220843 shutdown_connections 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.626+0000 7fe077f0e700 1 -- 172.21.15.72:0/2647220843 wait complete. 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 Processor -- start 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 -- start start 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 0x7fe070195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070196890 con 0x7fe0701036a0 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe077f0e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0701969d0 con 0x7fe070100d80 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe0754a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe0754a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60506/0 (socket says 172.21.15.72:60506) 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe0754a9700 1 -- 172.21.15.72:0/3618002983 learned_addr learned my addr 172.21.15.72:0/3618002983 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe075caa700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 0x7fe070195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe0754a9700 1 -- 172.21.15.72:0/3618002983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 msgr2=0x7fe070195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.627+0000 7fe0754a9700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 0x7fe070195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe0754a9700 1 -- 172.21.15.72:0/3618002983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600095f0 con 0x7fe0701036a0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe0754a9700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe06000bd70 tx=0x7fe06000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06001d070 con 0x7fe0701036a0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe060022470 con 0x7fe0701036a0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07019b430 con 0x7fe0701036a0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06000f670 con 0x7fe0701036a0 2024-04-15T21:09:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.628+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07019b8f0 con 0x7fe0701036a0 2024-04-15T21:09:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.629+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07018fc00 con 0x7fe0701036a0 2024-04-15T21:09:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.630+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe060022a50 con 0x7fe0701036a0 2024-04-15T21:09:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.630+0000 7fe066ffd700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 0x7fe05c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.630+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe060090520 con 0x7fe0701036a0 2024-04-15T21:09:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.630+0000 7fe075caa700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 0x7fe05c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.631+0000 7fe075caa700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 0x7fe05c071170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe06c005ea0 tx=0x7fe06c005e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:37.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.636+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe06005d050 con 0x7fe0701036a0 2024-04-15T21:09:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.863+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe07002cfa0 con 0x7fe05c06ecc0 2024-04-15T21:09:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.865+0000 7fe066ffd700 1 -- 172.21.15.72:0/3618002983 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe07002cfa0 con 0x7fe05c06ecc0 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.867+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 msgr2=0x7fe05c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.867+0000 7fe077f0e700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 0x7fe05c071170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe06c005ea0 tx=0x7fe06c005e30 comp rx=0 tx=0).stop 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.867+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 msgr2=0x7fe070196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.867+0000 7fe077f0e700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe06000bd70 tx=0x7fe06000be50 comp rx=0 tx=0).stop 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 shutdown_connections 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe05c06ecc0 0x7fe05c071170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe070100d80 0x7fe070195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 --2- 172.21.15.72:0/3618002983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0701036a0 0x7fe070196300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 >> 172.21.15.72:0/3618002983 conn(0x7fe0700fa7a0 msgr2=0x7fe0700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:37.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 shutdown_connections 2024-04-15T21:09:37.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.868+0000 7fe077f0e700 1 -- 172.21.15.72:0/3618002983 wait complete. 2024-04-15T21:09:37.872 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:09:37.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 -- 172.21.15.72:0/79909677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc0ff150 msgr2=0x7f00cc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 --2- 172.21.15.72:0/79909677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc0ff150 0x7f00cc0ff560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009910 tx=0x7f00bc009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 -- 172.21.15.72:0/79909677 shutdown_connections 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 --2- 172.21.15.72:0/79909677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc1003f0 0x7f00cc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 --2- 172.21.15.72:0/79909677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc0ff150 0x7f00cc0ff560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 -- 172.21.15.72:0/79909677 >> 172.21.15.72:0/79909677 conn(0x7f00cc0fa7a0 msgr2=0x7f00cc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 -- 172.21.15.72:0/79909677 shutdown_connections 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.975+0000 7f00d209a700 1 -- 172.21.15.72:0/79909677 wait complete. 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 Processor -- start 2024-04-15T21:09:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 -- start start 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc0ff150 0x7f00cc069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc19b0e0 con 0x7f00cc1003f0 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00d209a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc19b250 con 0x7f00cc0ff150 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60516/0 (socket says 172.21.15.72:60516) 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 -- 172.21.15.72:0/1701353132 learned_addr learned my addr 172.21.15.72:0/1701353132 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00cb7fe700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc0ff150 0x7f00cc069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 -- 172.21.15.72:0/1701353132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc0ff150 msgr2=0x7f00cc069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc0ff150 0x7f00cc069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.976+0000 7f00c3fff700 1 -- 172.21.15.72:0/1701353132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0095f0 con 0x7f00cc1003f0 2024-04-15T21:09:37.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00c3fff700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00b400d900 tx=0x7f00b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b4004a00 con 0x7f00cc1003f0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f00b40054d0 con 0x7f00cc1003f0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc19b530 con 0x7f00cc1003f0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b4009d00 con 0x7f00cc1003f0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.977+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc19ba80 con 0x7f00cc1003f0 2024-04-15T21:09:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.978+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc068ab0 con 0x7f00cc1003f0 2024-04-15T21:09:37.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.978+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00b4005020 con 0x7f00cc1003f0 2024-04-15T21:09:37.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.979+0000 7f00c97fa700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 0x7f00b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:37.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.979+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f00b408edd0 con 0x7f00cc1003f0 2024-04-15T21:09:37.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.979+0000 7f00cb7fe700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 0x7f00b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:37.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.979+0000 7f00cb7fe700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 0x7f00b8071170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00bc006010 tx=0x7f00bc00b560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:37.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:37.983+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f00b405b6b0 con 0x7f00cc1003f0 2024-04-15T21:09:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.213+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00cc104de0 con 0x7f00b806ecc0 2024-04-15T21:09:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.215+0000 7f00c97fa700 1 -- 172.21.15.72:0/1701353132 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f00cc104de0 con 0x7f00b806ecc0 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 msgr2=0x7f00b8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 0x7f00b8071170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00bc006010 tx=0x7f00bc00b560 comp rx=0 tx=0).stop 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 msgr2=0x7f00cc19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00b400d900 tx=0x7f00b400dc10 comp rx=0 tx=0).stop 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 shutdown_connections 2024-04-15T21:09:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f00b806ecc0 0x7f00b8071170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00cc0ff150 0x7f00cc069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 --2- 172.21.15.72:0/1701353132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc1003f0 0x7f00cc19ab10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 >> 172.21.15.72:0/1701353132 conn(0x7f00cc0fa7a0 msgr2=0x7f00cc103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 shutdown_connections 2024-04-15T21:09:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.217+0000 7f00d209a700 1 -- 172.21.15.72:0/1701353132 wait complete. 2024-04-15T21:09:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 -- 172.21.15.72:0/419871775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff8074d80 msgr2=0x7fcff80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 --2- 172.21.15.72:0/419871775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff8074d80 0x7fcff80731e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009910 tx=0x7fcff4009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 -- 172.21.15.72:0/419871775 shutdown_connections 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 --2- 172.21.15.72:0/419871775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff80737b0 0x7fcff8073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 --2- 172.21.15.72:0/419871775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff8074d80 0x7fcff80731e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 -- 172.21.15.72:0/419871775 >> 172.21.15.72:0/419871775 conn(0x7fcff80fb7f0 msgr2=0x7fcff80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 -- 172.21.15.72:0/419871775 shutdown_connections 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.338+0000 7fd0001d7700 1 -- 172.21.15.72:0/419871775 wait complete. 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 Processor -- start 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 -- start start 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff8074d80 0x7fcff819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff819cbf0 con 0x7fcff80737b0 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fd0001d7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff819cd30 con 0x7fcff8074d80 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60534/0 (socket says 172.21.15.72:60534) 2024-04-15T21:09:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 -- 172.21.15.72:0/1160152796 learned_addr learned my addr 172.21.15.72:0/1160152796 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffd772700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff8074d80 0x7fcff819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 -- 172.21.15.72:0/1160152796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff8074d80 msgr2=0x7fcff819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff8074d80 0x7fcff819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.339+0000 7fcffdf73700 1 -- 172.21.15.72:0/1160152796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40095f0 con 0x7fcff80737b0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fcffdf73700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006010 tx=0x7fcff400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff401d070 con 0x7fcff80737b0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcff400f460 con 0x7fcff80737b0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff81a1780 con 0x7fcff80737b0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff4021640 con 0x7fcff80737b0 2024-04-15T21:09:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.340+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff81a1c70 con 0x7fcff80737b0 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.341+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff810f370 con 0x7fcff80737b0 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.341+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcff400fab0 con 0x7fcff80737b0 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.342+0000 7fcfeeffd700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 0x7fcfe4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.342+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcff40900b0 con 0x7fcff80737b0 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.342+0000 7fcffd772700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 0x7fcfe4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.342+0000 7fcffd772700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 0x7fcfe4071170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005950 tx=0x7fcfe800b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.346+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcff405c990 con 0x7fcff80737b0 2024-04-15T21:09:38.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.566+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcff81032f0 con 0x7fcfe406ecc0 2024-04-15T21:09:38.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.576+0000 7fcfeeffd700 1 -- 172.21.15.72:0/1160152796 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fcff81032f0 con 0x7fcfe406ecc0 2024-04-15T21:09:38.571 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:09:38.571 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (14m) 19s ago 15m 25.9M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:09:38.571 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (16m) 19s ago 16m 8610k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:09:38.571 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (14m) 39s ago 14m 8548k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (4m) 19s ago 16m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (3m) 39s ago 14m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (14m) 19s ago 15m 85.0M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 starting - - - - 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (24s) 19s ago 10m 14.9M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (9m) 39s ago 9m 18.5M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (10m) 39s ago 10m 150M - 18.2.0 dc2bc1663786 9a889f60ff75 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (6m) 19s ago 17m 509M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (5m) 39s ago 14m 452M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (5m) 19s ago 17m 50.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (4m) 39s ago 14m 40.7M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (16m) 19s ago 16m 16.3M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 39s ago 14m 16.7M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (3m) 19s ago 13m 94.4M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:09:38.572 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (3m) 19s ago 13m 95.3M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (2m) 19s ago 12m 84.8M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (109s) 39s ago 12m 88.4M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (76s) 39s ago 12m 91.4M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (43s) 39s ago 11m 14.9M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (5m) 19s ago 15m 80.4M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:09:38.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 msgr2=0x7fcfe4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 0x7fcfe4071170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005950 tx=0x7fcfe800b410 comp rx=0 tx=0).stop 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 msgr2=0x7fcff819c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006010 tx=0x7fcff400bd70 comp rx=0 tx=0).stop 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 shutdown_connections 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfe406ecc0 0x7fcfe4071170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80737b0 0x7fcff819c090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 --2- 172.21.15.72:0/1160152796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff8074d80 0x7fcff819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 >> 172.21.15.72:0/1160152796 conn(0x7fcff80fb7f0 msgr2=0x7fcff8101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 shutdown_connections 2024-04-15T21:09:38.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.579+0000 7fd0001d7700 1 -- 172.21.15.72:0/1160152796 wait complete. 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 -- 172.21.15.72:0/470871511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90101440 msgr2=0x7f2c90101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 --2- 172.21.15.72:0/470871511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90101440 0x7f2c90101890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009910 tx=0x7f2c84009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 -- 172.21.15.72:0/470871511 shutdown_connections 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 --2- 172.21.15.72:0/470871511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90101440 0x7f2c90101890 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 --2- 172.21.15.72:0/470871511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90100240 0x7f2c90100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 -- 172.21.15.72:0/470871511 >> 172.21.15.72:0/470871511 conn(0x7f2c900fb7f0 msgr2=0x7f2c900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 -- 172.21.15.72:0/470871511 shutdown_connections 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.689+0000 7f2c95d91700 1 -- 172.21.15.72:0/470871511 wait complete. 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 Processor -- start 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 -- start start 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90101440 0x7f2c90195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c901965f0 con 0x7f2c90100240 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.690+0000 7f2c95d91700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90196730 con 0x7f2c90101440 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60560/0 (socket says 172.21.15.72:60560) 2024-04-15T21:09:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 -- 172.21.15.72:0/2728177160 learned_addr learned my addr 172.21.15.72:0/2728177160 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8effd700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90101440 0x7f2c90195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 -- 172.21.15.72:0/2728177160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90101440 msgr2=0x7f2c90195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90101440 0x7f2c90195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 -- 172.21.15.72:0/2728177160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840095f0 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8f7fe700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000d900 tx=0x7f2c8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8000b920 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c80010460 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9019b1e0 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8000f590 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.691+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9019b730 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.692+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c90108d90 con 0x7f2c90100240 2024-04-15T21:09:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.693+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2c800105d0 con 0x7f2c90100240 2024-04-15T21:09:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.693+0000 7f2c8cff9700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 0x7f2c78071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.693+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2c8008ea50 con 0x7f2c90100240 2024-04-15T21:09:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.693+0000 7f2c8effd700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 0x7f2c78071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.694+0000 7f2c8effd700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 0x7f2c78071170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b5c0 tx=0x7f2c84005ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.698+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2c8005b330 con 0x7f2c90100240 2024-04-15T21:09:38.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:38 smithi072 ceph-mon[78970]: pgmap v187: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:38.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:38 smithi149 ceph-mon[67036]: pgmap v187: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.993+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c9019bd70 con 0x7f2c90100240 2024-04-15T21:09:38.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.993+0000 7f2c8cff9700 1 -- 172.21.15.72:0/2728177160 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f2c8005aec0 con 0x7f2c90100240 2024-04-15T21:09:38.988 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:38.989 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:09:38.990 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:09:38.991 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-15T21:09:38.992 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 12 2024-04-15T21:09:38.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:09:38.992 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:09:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 msgr2=0x7f2c78071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 0x7f2c78071170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b5c0 tx=0x7f2c84005ee0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 msgr2=0x7f2c90195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000d900 tx=0x7f2c8000dc10 comp rx=0 tx=0).stop 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 shutdown_connections 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c7806ecc0 0x7f2c78071170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c90100240 0x7f2c90195a90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 --2- 172.21.15.72:0/2728177160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c90101440 0x7f2c90195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 >> 172.21.15.72:0/2728177160 conn(0x7f2c900fb7f0 msgr2=0x7f2c90104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 shutdown_connections 2024-04-15T21:09:38.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:38.996+0000 7f2c95d91700 1 -- 172.21.15.72:0/2728177160 wait complete. 2024-04-15T21:09:39.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/2190499986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 msgr2=0x7f2a641018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/2190499986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a641018a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009910 tx=0x7f2a58009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:39.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/2190499986 shutdown_connections 2024-04-15T21:09:39.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/2190499986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a641018a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/2190499986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/2190499986 >> 172.21.15.72:0/2190499986 conn(0x7f2a640fb7e0 msgr2=0x7f2a640fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/2190499986 shutdown_connections 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.126+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/2190499986 wait complete. 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.127+0000 7f2a6a5bf700 1 Processor -- start 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.127+0000 7f2a6a5bf700 1 -- start start 2024-04-15T21:09:39.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.127+0000 7f2a6a5bf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a6a5bf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a64073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a6a5bf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64073680 con 0x7f2a64101450 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a6a5bf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640737c0 con 0x7f2a64100250 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.72:48972/0 (socket says 172.21.15.72:48972) 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 -- 172.21.15.72:0/908234847 learned_addr learned my addr 172.21.15.72:0/908234847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:39.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a637fe700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a64073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 -- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 msgr2=0x7f2a64073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a64073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.128+0000 7f2a63fff700 1 -- 172.21.15.72:0/908234847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580095f0 con 0x7f2a64100250 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a63fff700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c8f0 tx=0x7f2a5400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a540078e0 con 0x7f2a64100250 2024-04-15T21:09:39.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a5400f450 con 0x7f2a64100250 2024-04-15T21:09:39.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a54018610 con 0x7f2a64100250 2024-04-15T21:09:39.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a64073aa0 con 0x7f2a64100250 2024-04-15T21:09:39.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.129+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a64073f90 con 0x7f2a64100250 2024-04-15T21:09:39.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.130+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a64108da0 con 0x7f2a64100250 2024-04-15T21:09:39.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.131+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2a5400f5c0 con 0x7f2a64100250 2024-04-15T21:09:39.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.131+0000 7f2a617fa700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 0x7f2a4c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.131+0000 7f2a637fe700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 0x7f2a4c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.131+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2a5408ecb0 con 0x7f2a64100250 2024-04-15T21:09:39.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.132+0000 7f2a637fe700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 0x7f2a4c071170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a58006010 tx=0x7f2a5800b560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.137+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2a5405b5b0 con 0x7f2a64100250 2024-04-15T21:09:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.412+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a6419e040 con 0x7f2a64100250 2024-04-15T21:09:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.413+0000 7f2a617fa700 1 -- 172.21.15.72:0/908234847 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f2a5405b140 con 0x7f2a64100250 2024-04-15T21:09:39.408 INFO:teuthology.orchestra.run.smithi072.stdout:e18 2024-04-15T21:09:39.408 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:09:39.408 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:09:39.409 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:09:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:39.409 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T20:59:43.360239+0000 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:09:39.410 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 46 2024-04-15T21:09:39.411 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24257} 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:09:39.412 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:09:39.413 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:09:39.413 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:09:39.413 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.149:6824/2041346775,v1:172.21.15.149:6825/2041346775] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:24261} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] compat {c=[1],r=[1],i=[7ff]}] 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:09:39.415 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:09:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 msgr2=0x7f2a4c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 0x7f2a4c071170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a58006010 tx=0x7f2a5800b560 comp rx=0 tx=0).stop 2024-04-15T21:09:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 msgr2=0x7f2a64074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c8f0 tx=0x7f2a5400cc00 comp rx=0 tx=0).stop 2024-04-15T21:09:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 shutdown_connections 2024-04-15T21:09:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2a4c06ecc0 0x7f2a4c071170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64100250 0x7f2a64074af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.416+0000 7f2a6a5bf700 1 --2- 172.21.15.72:0/908234847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64101450 0x7f2a64073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.417+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 >> 172.21.15.72:0/908234847 conn(0x7f2a640fb7e0 msgr2=0x7f2a64104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.417+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 shutdown_connections 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.417+0000 7f2a6a5bf700 1 -- 172.21.15.72:0/908234847 wait complete. 2024-04-15T21:09:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-04-15T21:09:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/1396829172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 msgr2=0x7fc1a41004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/1396829172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a41004d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc194009910 tx=0x7fc194009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/1396829172 shutdown_connections 2024-04-15T21:09:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/1396829172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a41004d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/1396829172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 0x7fc1a40ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.531+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/1396829172 >> 172.21.15.72:0/1396829172 conn(0x7fc1a40f9f10 msgr2=0x7fc1a40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.532+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/1396829172 shutdown_connections 2024-04-15T21:09:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.532+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/1396829172 wait complete. 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 Processor -- start 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 -- start start 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 0x7fc1a4194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4195570 con 0x7fc1a4100060 2024-04-15T21:09:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1ab9cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a41956b0 con 0x7fc1a40ff710 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60592/0 (socket says 172.21.15.72:60592) 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 -- 172.21.15.72:0/534343211 learned_addr learned my addr 172.21.15.72:0/534343211 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a9769700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 0x7fc1a4194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 -- 172.21.15.72:0/534343211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 msgr2=0x7fc1a4194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 0x7fc1a4194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.533+0000 7fc1a8f68700 1 -- 172.21.15.72:0/534343211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1940095f0 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc1a8f68700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc19400bd70 tx=0x7fc19400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19401d070 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a419a100 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc194005940 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc194021430 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.534+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a419a5f0 con 0x7fc1a4100060 2024-04-15T21:09:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.535+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4107c90 con 0x7fc1a4100060 2024-04-15T21:09:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.536+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc19400f860 con 0x7fc1a4100060 2024-04-15T21:09:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.536+0000 7fc19a7fc700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 0x7fc190071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.536+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc1940902b0 con 0x7fc1a4100060 2024-04-15T21:09:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.536+0000 7fc1a9769700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 0x7fc190071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.537+0000 7fc1a9769700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 0x7fc190071170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009a10 tx=0x7fc1a0009190 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.541+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc19405cb90 con 0x7fc1a4100060 2024-04-15T21:09:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.771+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1a4104e10 con 0x7fc19006ecc0 2024-04-15T21:09:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.772+0000 7fc19a7fc700 1 -- 172.21.15.72:0/534343211 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc1a4104e10 con 0x7fc19006ecc0 2024-04-15T21:09:39.767 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:09:39.767 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:09:39.767 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:09:39.767 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:09:39.767 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:09:39.768 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "14/23 daemons upgraded", 2024-04-15T21:09:39.769 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-04-15T21:09:39.769 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:09:39.769 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:09:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 msgr2=0x7fc190071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 0x7fc190071170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009a10 tx=0x7fc1a0009190 comp rx=0 tx=0).stop 2024-04-15T21:09:39.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 msgr2=0x7fc1a4194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc19400bd70 tx=0x7fc19400bda0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 shutdown_connections 2024-04-15T21:09:39.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc19006ecc0 0x7fc190071170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a40ff710 0x7fc1a4194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 --2- 172.21.15.72:0/534343211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1a4100060 0x7fc1a4194f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 >> 172.21.15.72:0/534343211 conn(0x7fc1a40f9f10 msgr2=0x7fc1a41036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 shutdown_connections 2024-04-15T21:09:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.775+0000 7fc1ab9cd700 1 -- 172.21.15.72:0/534343211 wait complete. 2024-04-15T21:09:39.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 -- 172.21.15.72:0/130163374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 msgr2=0x7f29c01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/130163374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c01007a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009910 tx=0x7f29b0009c20 comp rx=0 tx=0).stop 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 -- 172.21.15.72:0/130163374 shutdown_connections 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/130163374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c01007a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/130163374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 0x7f29c00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 -- 172.21.15.72:0/130163374 >> 172.21.15.72:0/130163374 conn(0x7f29c00fa700 msgr2=0x7f29c00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 -- 172.21.15.72:0/130163374 shutdown_connections 2024-04-15T21:09:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.886+0000 7f29c7ec3700 1 -- 172.21.15.72:0/130163374 wait complete. 2024-04-15T21:09:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 Processor -- start 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 -- start start 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 0x7f29c0069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c019ad20 con 0x7f29c0100350 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c7ec3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c019ae90 con 0x7f29c00ff150 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c545e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c545e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60616/0 (socket says 172.21.15.72:60616) 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.887+0000 7f29c545e700 1 -- 172.21.15.72:0/3373241769 learned_addr learned my addr 172.21.15.72:0/3373241769 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c5c5f700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 0x7f29c0069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c545e700 1 -- 172.21.15.72:0/3373241769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 msgr2=0x7f29c0069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c545e700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 0x7f29c0069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c545e700 1 -- 172.21.15.72:0/3373241769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00095f0 con 0x7f29c0100350 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c545e700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29b000bd70 tx=0x7f29b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b001d070 con 0x7f29c0100350 2024-04-15T21:09:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c019b110 con 0x7f29c0100350 2024-04-15T21:09:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29b0022470 con 0x7f29c0100350 2024-04-15T21:09:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b000f670 con 0x7f29c0100350 2024-04-15T21:09:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.888+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c019b600 con 0x7f29c0100350 2024-04-15T21:09:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.890+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0107ca0 con 0x7f29c0100350 2024-04-15T21:09:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.890+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f29b0022a50 con 0x7f29c0100350 2024-04-15T21:09:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.890+0000 7f29b6ffd700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 0x7f29ac071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:09:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.890+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f29b00904e0 con 0x7f29c0100350 2024-04-15T21:09:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.890+0000 7f29c5c5f700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 0x7f29ac071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:09:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.891+0000 7f29c5c5f700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 0x7f29ac071170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005fd0 tx=0x7f29bc005e50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:09:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:39.895+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f29b005ce70 con 0x7f29c0100350 2024-04-15T21:09:39.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:39.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:39.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:39.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2728177160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:39.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:39.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:39.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:39 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/908234847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2728177160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:40.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:39 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/908234847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:09:40.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.206+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f29c019bc40 con 0x7f29c0100350 2024-04-15T21:09:40.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.207+0000 7f29b6ffd700 1 -- 172.21.15.72:0/3373241769 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f29b005ca00 con 0x7f29c0100350 2024-04-15T21:09:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:09:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:09:40.202 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:09:40.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 msgr2=0x7f29ac071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:40.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 0x7f29ac071170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005fd0 tx=0x7f29bc005e50 comp rx=0 tx=0).stop 2024-04-15T21:09:40.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 msgr2=0x7f29c019a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29b000bd70 tx=0x7f29b000be50 comp rx=0 tx=0).stop 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 shutdown_connections 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f29ac06ecc0 0x7f29ac071170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29c00ff150 0x7f29c0069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 --2- 172.21.15.72:0/3373241769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c0100350 0x7f29c019a7e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 >> 172.21.15.72:0/3373241769 conn(0x7f29c00fa700 msgr2=0x7f29c0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:09:40.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 shutdown_connections 2024-04-15T21:09:40.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:09:40.209+0000 7f29c7ec3700 1 -- 172.21.15.72:0/3373241769 wait complete. 2024-04-15T21:09:40.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:40 smithi149 ceph-mon[67036]: pgmap v188: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:40.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:40 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3373241769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:09:40.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:40 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:40.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:40 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:41.064 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:40 smithi072 ceph-mon[78970]: pgmap v188: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:41.064 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:40 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3373241769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:09:41.064 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:41.064 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:40 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:41.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:41 smithi149 ceph-mon[67036]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:42.036 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:41 smithi072 ceph-mon[78970]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:09:42.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:42 smithi149 ceph-mon[67036]: pgmap v189: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:43.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:42 smithi072 ceph-mon[78970]: pgmap v189: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: pgmap v190: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:45.016 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.017 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.mflbpn"]}]: dispatch 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: pgmap v190: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:09:45.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:09:45.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.mflbpn"]}]: dispatch 2024-04-15T21:09:46.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:45 smithi072 ceph-mon[78970]: Upgrade: It appears safe to stop mds.cephfs.smithi149.mflbpn 2024-04-15T21:09:46.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:45 smithi149 ceph-mon[67036]: Upgrade: It appears safe to stop mds.cephfs.smithi149.mflbpn 2024-04-15T21:09:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:46 smithi072 ceph-mon[78970]: pgmap v191: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:46 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:46.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:46 smithi149 ceph-mon[67036]: pgmap v191: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:46.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:46.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.mflbpn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:09:46.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:46 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:09:47.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:47 smithi149 ceph-mon[67036]: Upgrade: Updating mds.cephfs.smithi149.mflbpn 2024-04-15T21:09:47.940 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:47 smithi149 ceph-mon[67036]: Deploying daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T21:09:48.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:47 smithi072 ceph-mon[78970]: Upgrade: Updating mds.cephfs.smithi149.mflbpn 2024-04-15T21:09:48.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:47 smithi072 ceph-mon[78970]: Deploying daemon mds.cephfs.smithi149.mflbpn on smithi149 2024-04-15T21:09:48.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:47 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[78966]: 2024-04-15T21:09:47.946+0000 7f52cee39700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: pgmap v192: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: osdmap e83: 6 total, 6 up, 6 in 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: Standby daemon mds.cephfs.smithi149.jwobda assigned to filesystem cephfs as rank 0 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-15T21:09:49.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:48 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:replay} 2 up:standby 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: pgmap v192: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: osdmap e83: 6 total, 6 up, 6 in 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: Standby daemon mds.cephfs.smithi149.jwobda assigned to filesystem cephfs as rank 0 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T21:09:49.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-15T21:09:49.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:48 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:replay} 2 up:standby 2024-04-15T21:09:51.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:50 smithi072 ceph-mon[78970]: pgmap v194: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 532 KiB/s rd, 0 op/s 2024-04-15T21:09:51.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:51.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:51.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:50 smithi149 ceph-mon[67036]: pgmap v194: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 532 KiB/s rd, 0 op/s 2024-04-15T21:09:51.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:51.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:09:53.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:52 smithi072 ceph-mon[78970]: pgmap v195: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-04-15T21:09:53.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:52 smithi149 ceph-mon[67036]: pgmap v195: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-04-15T21:09:55.034 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:54 smithi149 ceph-mon[67036]: pgmap v196: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-04-15T21:09:55.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:54 smithi072 ceph-mon[78970]: pgmap v196: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-04-15T21:09:56.845 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:56 smithi149 ceph-mon[67036]: pgmap v197: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-15T21:09:56.845 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:56.845 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:56.845 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:56 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:56.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:56 smithi072 ceph-mon[78970]: pgmap v197: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-15T21:09:56.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:56.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:56.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:56 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:09:57.907 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:57 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] up:boot 2024-04-15T21:09:57.907 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:57 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:replay} 3 up:standby 2024-04-15T21:09:57.907 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:57 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:09:57.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:57 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] up:boot 2024-04-15T21:09:57.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:57 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:replay} 3 up:standby 2024-04-15T21:09:57.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:57 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:09:58.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:58 smithi072 ceph-mon[78970]: pgmap v198: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-15T21:09:58.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:58 smithi072 ceph-mon[78970]: reconnect by client.24305 192.168.0.1:0/108029171 after 0.00099998 2024-04-15T21:09:58.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:58 smithi072 ceph-mon[78970]: reconnect by client.14532 192.168.0.1:0/2863142207 after 0.00099998 2024-04-15T21:09:58.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:58 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:reconnect 2024-04-15T21:09:58.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:58 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:reconnect} 3 up:standby 2024-04-15T21:09:58.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:58 smithi149 ceph-mon[67036]: pgmap v198: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-15T21:09:58.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:58 smithi149 ceph-mon[67036]: reconnect by client.24305 192.168.0.1:0/108029171 after 0.00099998 2024-04-15T21:09:58.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:58 smithi149 ceph-mon[67036]: reconnect by client.14532 192.168.0.1:0/2863142207 after 0.00099998 2024-04-15T21:09:58.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:58 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:reconnect 2024-04-15T21:09:58.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:58 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:reconnect} 3 up:standby 2024-04-15T21:09:59.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:59 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:rejoin 2024-04-15T21:09:59.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:59 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:rejoin} 3 up:standby 2024-04-15T21:09:59.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:59 smithi072 ceph-mon[78970]: daemon mds.cephfs.smithi149.jwobda is now active in filesystem cephfs as rank 0 2024-04-15T21:09:59.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:59.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:09:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:59.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:59 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:rejoin 2024-04-15T21:09:59.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:59 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi149.jwobda=up:rejoin} 3 up:standby 2024-04-15T21:09:59.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:59 smithi149 ceph-mon[67036]: daemon mds.cephfs.smithi149.jwobda is now active in filesystem cephfs as rank 0 2024-04-15T21:09:59.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:09:59.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:09:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: pgmap v199: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T21:10:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:active 2024-04-15T21:10:00.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi149.jwobda=up:active} 3 up:standby 2024-04-15T21:10:00.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:00.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:00.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:00 smithi072 ceph-mon[78970]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:00.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: pgmap v199: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:00.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T21:10:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.149:6826/725234987,v1:172.21.15.149:6827/725234987] up:active 2024-04-15T21:10:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi149.jwobda=up:active} 3 up:standby 2024-04-15T21:10:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:00 smithi149 ceph-mon[67036]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:02.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:02 smithi072 ceph-mon[78970]: pgmap v200: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-04-15T21:10:02.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:02 smithi149 ceph-mon[67036]: pgmap v200: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-04-15T21:10:04.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:04 smithi072 ceph-mon[78970]: pgmap v201: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-15T21:10:04.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:04 smithi149 ceph-mon[67036]: pgmap v201: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-15T21:10:06.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:06.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:06.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:06 smithi149 ceph-mon[67036]: pgmap v202: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-15T21:10:06.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:06.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:06.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:06 smithi072 ceph-mon[78970]: pgmap v202: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-15T21:10:08.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:08 smithi149 ceph-mon[67036]: pgmap v203: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-15T21:10:08.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:08 smithi072 ceph-mon[78970]: pgmap v203: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: Detected new or changed devices on smithi149 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.jwobda"]}]: dispatch 2024-04-15T21:10:09.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:09 smithi072 ceph-mon[78970]: Upgrade: It appears safe to stop mds.cephfs.smithi149.jwobda 2024-04-15T21:10:09.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: Detected new or changed devices on smithi149 2024-04-15T21:10:09.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.jwobda"]}]: dispatch 2024-04-15T21:10:09.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:09 smithi149 ceph-mon[67036]: Upgrade: It appears safe to stop mds.cephfs.smithi149.jwobda 2024-04-15T21:10:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 -- 172.21.15.72:0/427301824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 msgr2=0x7fe0a0103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 --2- 172.21.15.72:0/427301824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0103140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b0a0 tx=0x7fe09000b3b0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 -- 172.21.15.72:0/427301824 shutdown_connections 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 --2- 172.21.15.72:0/427301824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 0x7fe0a0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 --2- 172.21.15.72:0/427301824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0103140 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 -- 172.21.15.72:0/427301824 >> 172.21.15.72:0/427301824 conn(0x7fe0a00fa780 msgr2=0x7fe0a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.331+0000 7fe0a5288700 1 -- 172.21.15.72:0/427301824 shutdown_connections 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 -- 172.21.15.72:0/427301824 wait complete. 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 Processor -- start 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 -- start start 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 0x7fe0a0195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0196610 con 0x7fe0a0100d60 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.332+0000 7fe0a5288700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0196750 con 0x7fe0a0103680 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45772/0 (socket says 172.21.15.72:45772) 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 -- 172.21.15.72:0/2381147330 learned_addr learned my addr 172.21.15.72:0/2381147330 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09e7fc700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 0x7fe0a0195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 -- 172.21.15.72:0/2381147330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 msgr2=0x7fe0a0195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 0x7fe0a0195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 -- 172.21.15.72:0/2381147330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090009d00 con 0x7fe0a0100d60 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe09effd700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b780 tx=0x7fe090003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe09000e040 con 0x7fe0a0100d60 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a019b1a0 con 0x7fe0a0100d60 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a019b690 con 0x7fe0a0100d60 2024-04-15T21:10:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe09000bdc0 con 0x7fe0a0100d60 2024-04-15T21:10:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.333+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe09001d8b0 con 0x7fe0a0100d60 2024-04-15T21:10:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.335+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a018fbc0 con 0x7fe0a0100d60 2024-04-15T21:10:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.335+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe09001da30 con 0x7fe0a0100d60 2024-04-15T21:10:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.335+0000 7fe097fff700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 0x7fe08c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.335+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe090090940 con 0x7fe0a0100d60 2024-04-15T21:10:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.335+0000 7fe09e7fc700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 0x7fe08c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.336+0000 7fe09e7fc700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 0x7fe08c071170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe088009c60 tx=0x7fe088009260 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.340+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe09005d1d0 con 0x7fe0a0100d60 2024-04-15T21:10:10.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:10 smithi149 ceph-mon[67036]: pgmap v204: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:10.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:10.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:10:10.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:10 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.562+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a0061190 con 0x7fe08c06ecc0 2024-04-15T21:10:10.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:10 smithi072 ceph-mon[78970]: pgmap v204: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:10.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:10.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.jwobda", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-15T21:10:10.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:10 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.564+0000 7fe097fff700 1 -- 172.21.15.72:0/2381147330 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe0a0061190 con 0x7fe08c06ecc0 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 msgr2=0x7fe08c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 0x7fe08c071170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe088009c60 tx=0x7fe088009260 comp rx=0 tx=0).stop 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 msgr2=0x7fe0a0195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe09000b780 tx=0x7fe090003c30 comp rx=0 tx=0).stop 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 shutdown_connections 2024-04-15T21:10:10.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe08c06ecc0 0x7fe08c071170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0100d60 0x7fe0a0195ab0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 --2- 172.21.15.72:0/2381147330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0a0103680 0x7fe0a0195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 >> 172.21.15.72:0/2381147330 conn(0x7fe0a00fa780 msgr2=0x7fe0a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 shutdown_connections 2024-04-15T21:10:10.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.566+0000 7fe0a5288700 1 -- 172.21.15.72:0/2381147330 wait complete. 2024-04-15T21:10:10.571 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:10:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 -- 172.21.15.72:0/3299710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34880fef20 msgr2=0x7f34880ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 --2- 172.21.15.72:0/3299710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34880fef20 0x7f34880ff330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3478009910 tx=0x7f3478009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 -- 172.21.15.72:0/3299710822 shutdown_connections 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 --2- 172.21.15.72:0/3299710822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3488100080 0x7f34881004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 --2- 172.21.15.72:0/3299710822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34880fef20 0x7f34880ff330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 -- 172.21.15.72:0/3299710822 >> 172.21.15.72:0/3299710822 conn(0x7f34880fa4d0 msgr2=0x7f34880fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 -- 172.21.15.72:0/3299710822 shutdown_connections 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.672+0000 7f348e9a2700 1 -- 172.21.15.72:0/3299710822 wait complete. 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 Processor -- start 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 -- start start 2024-04-15T21:10:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34880fef20 0x7f34880690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348819ab20 con 0x7f3488100080 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348e9a2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348819ac60 con 0x7f34880fef20 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45792/0 (socket says 172.21.15.72:45792) 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 -- 172.21.15.72:0/1220427156 learned_addr learned my addr 172.21.15.72:0/1220427156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d9a0700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34880fef20 0x7f34880690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 -- 172.21.15.72:0/1220427156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34880fef20 msgr2=0x7f34880690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34880fef20 0x7f34880690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 -- 172.21.15.72:0/1220427156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780095f0 con 0x7f3488100080 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.673+0000 7f348d19f700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f348400d8d0 tx=0x7f348400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.674+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34840098a0 con 0x7f3488100080 2024-04-15T21:10:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.674+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3484010460 con 0x7f3488100080 2024-04-15T21:10:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.674+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348819af40 con 0x7f3488100080 2024-04-15T21:10:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.674+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348400f5f0 con 0x7f3488100080 2024-04-15T21:10:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.674+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348819b460 con 0x7f3488100080 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.675+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34881079f0 con 0x7f3488100080 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.675+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3484009a00 con 0x7f3488100080 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.676+0000 7f347effd700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 0x7f3474071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.676+0000 7f348d9a0700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 0x7f3474071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.676+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f348408edc0 con 0x7f3488100080 2024-04-15T21:10:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.676+0000 7f348d9a0700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 0x7f3474071170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3478006010 tx=0x7f347800b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.681+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3484092030 con 0x7f3488100080 2024-04-15T21:10:10.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.904+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3488104a60 con 0x7f347406ecc0 2024-04-15T21:10:10.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.905+0000 7f347effd700 1 -- 172.21.15.72:0/1220427156 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3488104a60 con 0x7f347406ecc0 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 msgr2=0x7f3474071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 0x7f3474071170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3478006010 tx=0x7f347800b540 comp rx=0 tx=0).stop 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 msgr2=0x7f348819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f348400d8d0 tx=0x7f348400dbe0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 shutdown_connections 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f347406ecc0 0x7f3474071170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34880fef20 0x7f34880690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 --2- 172.21.15.72:0/1220427156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3488100080 0x7f348819a550 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:10.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 >> 172.21.15.72:0/1220427156 conn(0x7f34880fa4d0 msgr2=0x7f3488103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:10.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 shutdown_connections 2024-04-15T21:10:10.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:10.908+0000 7f348e9a2700 1 -- 172.21.15.72:0/1220427156 wait complete. 2024-04-15T21:10:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 -- 172.21.15.72:0/351230211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48100240 msgr2=0x7f4b48100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 --2- 172.21.15.72:0/351230211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48100240 0x7f4b48100650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009910 tx=0x7f4b3c009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 -- 172.21.15.72:0/351230211 shutdown_connections 2024-04-15T21:10:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 --2- 172.21.15.72:0/351230211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48101440 0x7f4b48101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 --2- 172.21.15.72:0/351230211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48100240 0x7f4b48100650 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.013+0000 7f4b4f152700 1 -- 172.21.15.72:0/351230211 >> 172.21.15.72:0/351230211 conn(0x7f4b480fb7f0 msgr2=0x7f4b480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 -- 172.21.15.72:0/351230211 shutdown_connections 2024-04-15T21:10:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 -- 172.21.15.72:0/351230211 wait complete. 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 Processor -- start 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 -- start start 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 0x7f4b48074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48073680 con 0x7f4b48101440 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b4f152700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480737c0 con 0x7f4b48100240 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45812/0 (socket says 172.21.15.72:45812) 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.014+0000 7f4b47fff700 1 -- 172.21.15.72:0/2129614839 learned_addr learned my addr 172.21.15.72:0/2129614839 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b4ceee700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 0x7f4b48074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b47fff700 1 -- 172.21.15.72:0/2129614839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 msgr2=0x7f4b48074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b47fff700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 0x7f4b48074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b47fff700 1 -- 172.21.15.72:0/2129614839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0095f0 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b4ceee700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 0x7f4b48074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b47fff700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b4b0 tx=0x7f4b3400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b34011800 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b34011e10 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b3400f2e0 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b48073aa0 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.015+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4819dbc0 con 0x7f4b48101440 2024-04-15T21:10:11.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.016+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b48108e10 con 0x7f4b48101440 2024-04-15T21:10:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.017+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4b34010380 con 0x7f4b48101440 2024-04-15T21:10:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.017+0000 7f4b45ffb700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 0x7f4b38071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.017+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4b3408ea40 con 0x7f4b48101440 2024-04-15T21:10:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.017+0000 7f4b4ceee700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 0x7f4b38071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.018+0000 7f4b4ceee700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 0x7f4b38071170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c006010 tx=0x7f4b3c005920 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.022+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4b3405b350 con 0x7f4b48101440 2024-04-15T21:10:11.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.234+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b48105d90 con 0x7f4b3806ecc0 2024-04-15T21:10:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.245+0000 7f4b45ffb700 1 -- 172.21.15.72:0/2129614839 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4b48105d90 con 0x7f4b3806ecc0 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (14m) 31s ago 16m 25.9M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (16m) 31s ago 16m 8648k - 18.2.0 dc2bc1663786 2cc507453963 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (15m) 12s ago 15m 8887k - 18.2.0 dc2bc1663786 10096370a632 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (4m) 31s ago 16m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (4m) 12s ago 15m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (14m) 31s ago 16m 85.0M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (37s) 31s ago 10m 12.6M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (57s) 31s ago 10m 15.9M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (10m) 12s ago 10m 246M - 18.2.0 dc2bc1663786 4159d3d69768 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (16s) 12s ago 10m 11.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:10:11.240 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (6m) 31s ago 17m 510M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (6m) 12s ago 15m 452M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (5m) 31s ago 18m 51.6M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (5m) 12s ago 15m 43.8M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (16m) 31s ago 16m 16.5M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (15m) 12s ago 15m 16.8M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (4m) 31s ago 14m 94.5M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (3m) 31s ago 13m 95.5M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (2m) 31s ago 13m 84.9M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (2m) 12s ago 12m 98.5M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (108s) 12s ago 12m 95.0M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (75s) 12s ago 12m 87.2M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:10:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 31s ago 15m 80.4M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:10:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 msgr2=0x7f4b38071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 0x7f4b38071170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c006010 tx=0x7f4b3c005920 comp rx=0 tx=0).stop 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 msgr2=0x7f4b48073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b4b0 tx=0x7f4b3400b870 comp rx=0 tx=0).stop 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 shutdown_connections 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b3806ecc0 0x7f4b38071170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b48100240 0x7f4b48074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 --2- 172.21.15.72:0/2129614839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b48101440 0x7f4b48073140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 >> 172.21.15.72:0/2129614839 conn(0x7f4b480fb7f0 msgr2=0x7f4b48104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 shutdown_connections 2024-04-15T21:10:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.248+0000 7f4b4f152700 1 -- 172.21.15.72:0/2129614839 wait complete. 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 -- 172.21.15.72:0/2962203663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 msgr2=0x7f76c4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 --2- 172.21.15.72:0/2962203663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c4100ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009910 tx=0x7f76c0009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 -- 172.21.15.72:0/2962203663 shutdown_connections 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 --2- 172.21.15.72:0/2962203663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 0x7f76c41038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 --2- 172.21.15.72:0/2962203663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c4100ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 -- 172.21.15.72:0/2962203663 >> 172.21.15.72:0/2962203663 conn(0x7f76c40fa6d0 msgr2=0x7f76c40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 -- 172.21.15.72:0/2962203663 shutdown_connections 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 -- 172.21.15.72:0/2962203663 wait complete. 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.353+0000 7f76cc23d700 1 Processor -- start 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 -- start start 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 0x7f76c419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419cce0 con 0x7f76c40feac0 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419ce20 con 0x7f76c4101420 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45818/0 (socket says 172.21.15.72:45818) 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 -- 172.21.15.72:0/3982170839 learned_addr learned my addr 172.21.15.72:0/3982170839 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c97d8700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 0x7f76c419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 -- 172.21.15.72:0/3982170839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 msgr2=0x7f76c419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 0x7f76c419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 -- 172.21.15.72:0/3982170839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00095f0 con 0x7f76c40feac0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76c9fd9700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c00092e0 tx=0x7f76c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c001d070 con 0x7f76c40feac0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41a1870 con 0x7f76c40feac0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76c000f460 con 0x7f76c40feac0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.354+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c0021620 con 0x7f76c40feac0 2024-04-15T21:10:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.355+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c41a1d60 con 0x7f76c40feac0 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.355+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c41962e0 con 0x7f76c40feac0 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.356+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f76c000fa90 con 0x7f76c40feac0 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.356+0000 7f76baffd700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 0x7f76b0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.357+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f76c0090230 con 0x7f76c40feac0 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.357+0000 7f76c97d8700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 0x7f76b0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.357+0000 7f76c97d8700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 0x7f76b0071170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009a10 tx=0x7f76b4009190 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.361+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f76c005cac0 con 0x7f76c40feac0 2024-04-15T21:10:11.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:11 smithi149 ceph-mon[67036]: Upgrade: Updating mds.cephfs.smithi149.jwobda 2024-04-15T21:10:11.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:11 smithi149 ceph-mon[67036]: Deploying daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T21:10:11.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:11 smithi149 ceph-mon[67036]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:11.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.651+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76c402cc30 con 0x7f76c40feac0 2024-04-15T21:10:11.646 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:11 smithi072 ceph-mon[78970]: Upgrade: Updating mds.cephfs.smithi149.jwobda 2024-04-15T21:10:11.646 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:11 smithi072 ceph-mon[78970]: Deploying daemon mds.cephfs.smithi149.jwobda on smithi149 2024-04-15T21:10:11.646 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:11 smithi072 ceph-mon[78970]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:11.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.651+0000 7f76baffd700 1 -- 172.21.15.72:0/3982170839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f76c005c650 con 0x7f76c40feac0 2024-04-15T21:10:11.646 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 3 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:10:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-15T21:10:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 13 2024-04-15T21:10:11.648 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:10:11.648 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:10:11.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 msgr2=0x7f76b0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 0x7f76b0071170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009a10 tx=0x7f76b4009190 comp rx=0 tx=0).stop 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 msgr2=0x7f76c419c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c00092e0 tx=0x7f76c000bd70 comp rx=0 tx=0).stop 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 shutdown_connections 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f76b006ecc0 0x7f76b0071170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76c40feac0 0x7f76c419c180 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 --2- 172.21.15.72:0/3982170839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c4101420 0x7f76c419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 >> 172.21.15.72:0/3982170839 conn(0x7f76c40fa6d0 msgr2=0x7f76c40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 shutdown_connections 2024-04-15T21:10:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.653+0000 7f76cc23d700 1 -- 172.21.15.72:0/3982170839 wait complete. 2024-04-15T21:10:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2828357826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f400ff130 msgr2=0x7f3f400ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2828357826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f400ff130 0x7f3f400ff540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009910 tx=0x7f3f34009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2828357826 shutdown_connections 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2828357826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f401003d0 0x7f3f40100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2828357826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f400ff130 0x7f3f400ff540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2828357826 >> 172.21.15.72:0/2828357826 conn(0x7f3f400fa780 msgr2=0x7f3f400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2828357826 shutdown_connections 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2828357826 wait complete. 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 Processor -- start 2024-04-15T21:10:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.759+0000 7f3f46c9f700 1 -- start start 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f46c9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400ff130 0x7f3f40103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f46c9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f46c9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40101cf0 con 0x7f3f401003d0 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f46c9f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40101e30 con 0x7f3f400ff130 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60096/0 (socket says 172.21.15.72:60096) 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 -- 172.21.15.72:0/2283835751 learned_addr learned my addr 172.21.15.72:0/2283835751 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f44a3b700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400ff130 0x7f3f40103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 -- 172.21.15.72:0/2283835751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400ff130 msgr2=0x7f3f40103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400ff130 0x7f3f40103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 -- 172.21.15.72:0/2283835751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340095f0 con 0x7f3f401003d0 2024-04-15T21:10:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d8d0 tx=0x7f3f2c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2c0098a0 con 0x7f3f401003d0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40102110 con 0x7f3f401003d0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f2c010460 con 0x7f3f401003d0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.760+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2c00f5f0 con 0x7f3f401003d0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.761+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4019db00 con 0x7f3f401003d0 2024-04-15T21:10:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.761+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40107c10 con 0x7f3f401003d0 2024-04-15T21:10:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.762+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3f2c009a00 con 0x7f3f401003d0 2024-04-15T21:10:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.762+0000 7f3f3dffb700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 0x7f3f30071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.762+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3f2c08ede0 con 0x7f3f401003d0 2024-04-15T21:10:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.762+0000 7f3f44a3b700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 0x7f3f30071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.763+0000 7f3f44a3b700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 0x7f3f30071170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f34006010 tx=0x7f3f3400b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:11.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:11.767+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3f2c05b610 con 0x7f3f401003d0 2024-04-15T21:10:11.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:11 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[78966]: 2024-04-15T21:10:11.893+0000 7f52cee39700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:10:12.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.045+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f4019e2c0 con 0x7f3f401003d0 2024-04-15T21:10:12.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.046+0000 7f3f3dffb700 1 -- 172.21.15.72:0/2283835751 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1746 (secure 0 0 0) 0x7f3f2c05b1a0 con 0x7f3f401003d0 2024-04-15T21:10:12.040 INFO:teuthology.orchestra.run.smithi072.stdout:e26 2024-04-15T21:10:12.040 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 26 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T21:10:11.898325+0000 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:10:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 84 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34402} 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:10:12.042 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 0 members: 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{0:34402} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:12.043 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:12.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 msgr2=0x7f3f30071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 0x7f3f30071170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f34006010 tx=0x7f3f3400b540 comp rx=0 tx=0).stop 2024-04-15T21:10:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 msgr2=0x7f3f401017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d8d0 tx=0x7f3f2c00dbe0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 shutdown_connections 2024-04-15T21:10:12.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3f3006ecc0 0x7f3f30071170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f400ff130 0x7f3f40103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 --2- 172.21.15.72:0/2283835751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f401003d0 0x7f3f401017b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 >> 172.21.15.72:0/2283835751 conn(0x7f3f400fa780 msgr2=0x7f3f40068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 shutdown_connections 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.048+0000 7f3f46c9f700 1 -- 172.21.15.72:0/2283835751 wait complete. 2024-04-15T21:10:12.046 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 -- 172.21.15.72:0/2659046221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd8069270 msgr2=0x7f4bd8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/2659046221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd8069270 0x7f4bd8102dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009910 tx=0x7f4bc8009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 -- 172.21.15.72:0/2659046221 shutdown_connections 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/2659046221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 0x7f4bd8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/2659046221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd8069270 0x7f4bd8102dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 -- 172.21.15.72:0/2659046221 >> 172.21.15.72:0/2659046221 conn(0x7f4bd80fa780 msgr2=0x7f4bd80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 -- 172.21.15.72:0/2659046221 shutdown_connections 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.158+0000 7f4bdddb0700 1 -- 172.21.15.72:0/2659046221 wait complete. 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 Processor -- start 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 -- start start 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 0x7f4bd8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ff720 con 0x7f4bd80fed70 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bdddb0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ff890 con 0x7f4bd8103310 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60118/0 (socket says 172.21.15.72:60118) 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bd6ffd700 1 -- 172.21.15.72:0/1133375824 learned_addr learned my addr 172.21.15.72:0/1133375824 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.159+0000 7f4bd77fe700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 0x7f4bd8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd6ffd700 1 -- 172.21.15.72:0/1133375824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 msgr2=0x7f4bd8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd6ffd700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 0x7f4bd8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd6ffd700 1 -- 172.21.15.72:0/1133375824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80095f0 con 0x7f4bd80fed70 2024-04-15T21:10:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd6ffd700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d8d0 tx=0x7f4bcc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc0098a0 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd80ffb70 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bcc010460 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc00f5f0 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.160+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd819dd40 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.161+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd818fbd0 con 0x7f4bd80fed70 2024-04-15T21:10:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.162+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4bcc009a00 con 0x7f4bd80fed70 2024-04-15T21:10:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.163+0000 7f4bd4ff9700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 0x7f4bc0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.163+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4bcc08edd0 con 0x7f4bd80fed70 2024-04-15T21:10:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.163+0000 7f4bd77fe700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 0x7f4bc0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.163+0000 7f4bd77fe700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 0x7f4bc0071170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8006010 tx=0x7f4bc8005ec0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.171+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4bcc05b610 con 0x7f4bd80fed70 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: pgmap v205: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3982170839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: osdmap e84: 6 total, 6 up, 6 in 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: Standby daemon mds.cephfs.smithi072.zkrubp assigned to filesystem cephfs as rank 0 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-15T21:10:12.309 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:replay} 2 up:standby 2024-04-15T21:10:12.310 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:12 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2283835751' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:10:12.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.424+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bd802cf80 con 0x7f4bc006ecc0 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.425+0000 7f4bd4ff9700 1 -- 172.21.15.72:0/1133375824 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4bd802cf80 con 0x7f4bc006ecc0 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-04-15T21:10:12.420 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:10:12.421 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "15/23 daemons upgraded", 2024-04-15T21:10:12.421 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-04-15T21:10:12.421 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:10:12.421 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:10:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 msgr2=0x7f4bc0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 0x7f4bc0071170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8006010 tx=0x7f4bc8005ec0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 msgr2=0x7f4bd80ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d8d0 tx=0x7f4bcc00dbe0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 shutdown_connections 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4bc006ecc0 0x7f4bc0071170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bd8103310 0x7f4bd8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 --2- 172.21.15.72:0/1133375824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bd80fed70 0x7f4bd80ff1e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 >> 172.21.15.72:0/1133375824 conn(0x7f4bd80fa780 msgr2=0x7f4bd80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 shutdown_connections 2024-04-15T21:10:12.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.428+0000 7f4bdddb0700 1 -- 172.21.15.72:0/1133375824 wait complete. 2024-04-15T21:10:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 -- 172.21.15.72:0/1581550940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 msgr2=0x7f9e10103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 --2- 172.21.15.72:0/1581550940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10103140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009910 tx=0x7f9e00009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 -- 172.21.15.72:0/1581550940 shutdown_connections 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 --2- 172.21.15.72:0/1581550940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 --2- 172.21.15.72:0/1581550940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10103140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 -- 172.21.15.72:0/1581550940 >> 172.21.15.72:0/1581550940 conn(0x7f9e100fa780 msgr2=0x7f9e100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 -- 172.21.15.72:0/1581550940 shutdown_connections 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.534+0000 7f9e15986700 1 -- 172.21.15.72:0/1581550940 wait complete. 2024-04-15T21:10:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 Processor -- start 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 -- start start 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10196610 con 0x7f9e10100d60 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.535+0000 7f9e15986700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10196750 con 0x7f9e10103680 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60140/0 (socket says 172.21.15.72:60140) 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 -- 172.21.15.72:0/1784456575 learned_addr learned my addr 172.21.15.72:0/1784456575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0e7fc700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 -- 172.21.15.72:0/1784456575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 msgr2=0x7f9e10195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 -- 172.21.15.72:0/1784456575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000095f0 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0e7fc700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e0effd700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000c00 tx=0x7f9e0000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0001d070 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e100feb50 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e00005dc0 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.536+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e100ff040 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.537+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e00022470 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.538+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1018fbc0 con 0x7f9e10100d60 2024-04-15T21:10:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.538+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9e00003810 con 0x7f9e10100d60 2024-04-15T21:10:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.540+0000 7f9e14984700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 0x7f9df8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.540+0000 7f9e0e7fc700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 0x7f9df8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.540+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f9e000904b0 con 0x7f9e10100d60 2024-04-15T21:10:12.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.540+0000 7f9e0e7fc700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 0x7f9df8071170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009730 tx=0x7f9e04012040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:12.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.544+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9e0005cc70 con 0x7f9e10100d60 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: pgmap v205: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3982170839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: osdmap e84: 6 total, 6 up, 6 in 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: Standby daemon mds.cephfs.smithi072.zkrubp assigned to filesystem cephfs as rank 0 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-15T21:10:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-15T21:10:12.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:replay} 2 up:standby 2024-04-15T21:10:12.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:12 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2283835751' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.845+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e10100430 con 0x7f9e10100d60 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.845+0000 7f9e14984700 1 -- 172.21.15.72:0/1784456575 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f9e0005c800 con 0x7f9e10100d60 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs is degraded 2024-04-15T21:10:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:12.841 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 msgr2=0x7f9df8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 0x7f9df8071170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009730 tx=0x7f9e04012040 comp rx=0 tx=0).stop 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 msgr2=0x7f9e10195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000c00 tx=0x7f9e0000f690 comp rx=0 tx=0).stop 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 shutdown_connections 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f9df806ecc0 0x7f9df8071170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10100d60 0x7f9e10195ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 --2- 172.21.15.72:0/1784456575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e10103680 0x7f9e10195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 >> 172.21.15.72:0/1784456575 conn(0x7f9e100fa780 msgr2=0x7f9e100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 shutdown_connections 2024-04-15T21:10:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:12.849+0000 7f9e15986700 1 -- 172.21.15.72:0/1784456575 wait complete. 2024-04-15T21:10:13.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:13 smithi072 ceph-mon[78970]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:13.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:13 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1784456575' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:10:13.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:13 smithi149 ceph-mon[67036]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:13.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:13 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1784456575' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:10:14.565 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:14 smithi072 ceph-mon[78970]: pgmap v207: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-04-15T21:10:14.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:14 smithi149 ceph-mon[67036]: pgmap v207: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-04-15T21:10:16.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:16 smithi072 ceph-mon[78970]: pgmap v208: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.9 KiB/s wr, 4 op/s 2024-04-15T21:10:16.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:16 smithi149 ceph-mon[67036]: pgmap v208: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 4.9 KiB/s wr, 4 op/s 2024-04-15T21:10:18.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:18 smithi072 ceph-mon[78970]: pgmap v209: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-04-15T21:10:18.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:18 smithi149 ceph-mon[67036]: pgmap v209: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-04-15T21:10:20.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:20 smithi149 ceph-mon[67036]: pgmap v210: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T21:10:20.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:20.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:20.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:20 smithi072 ceph-mon[78970]: pgmap v210: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 0 B/s wr, 5 op/s 2024-04-15T21:10:20.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:20.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:22.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: pgmap v211: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:22.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: reconnect by client.14532 192.168.0.1:0/2863142207 after 0.000999979 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: reconnect by client.24305 192.168.0.1:0/108029171 after 0.000999979 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:reconnect 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:reconnect} 2 up:standby 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:22.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:22 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:22.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: pgmap v211: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:22.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: reconnect by client.14532 192.168.0.1:0/2863142207 after 0.000999979 2024-04-15T21:10:22.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: reconnect by client.24305 192.168.0.1:0/108029171 after 0.000999979 2024-04-15T21:10:22.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:reconnect 2024-04-15T21:10:22.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:reconnect} 2 up:standby 2024-04-15T21:10:22.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:22.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:22.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:22 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:23.599 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:23 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:rejoin 2024-04-15T21:10:23.599 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:23 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] up:boot 2024-04-15T21:10:23.600 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:23 smithi149 ceph-mon[67036]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:rejoin} 3 up:standby 2024-04-15T21:10:23.600 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:23 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:10:23.600 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:23 smithi149 ceph-mon[67036]: daemon mds.cephfs.smithi072.zkrubp is now active in filesystem cephfs as rank 0 2024-04-15T21:10:23.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:23 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:rejoin 2024-04-15T21:10:23.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:23 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] up:boot 2024-04-15T21:10:23.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:23 smithi072 ceph-mon[78970]: fsmap cephfs:1/1 {0=cephfs.smithi072.zkrubp=up:rejoin} 3 up:standby 2024-04-15T21:10:23.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:23 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:10:23.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:23 smithi072 ceph-mon[78970]: daemon mds.cephfs.smithi072.zkrubp is now active in filesystem cephfs as rank 0 2024-04-15T21:10:24.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:24 smithi072 ceph-mon[78970]: pgmap v212: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:24.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:24 smithi072 ceph-mon[78970]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T21:10:24.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:24 smithi072 ceph-mon[78970]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:active 2024-04-15T21:10:24.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:24 smithi072 ceph-mon[78970]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T21:10:24.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:24 smithi149 ceph-mon[67036]: pgmap v212: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-04-15T21:10:24.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:24 smithi149 ceph-mon[67036]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-15T21:10:24.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:24 smithi149 ceph-mon[67036]: mds.? [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] up:active 2024-04-15T21:10:24.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:24 smithi149 ceph-mon[67036]: fsmap cephfs:1 {0=cephfs.smithi072.zkrubp=up:active} 3 up:standby 2024-04-15T21:10:25.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:25 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:25.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:25 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:25.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:25 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:25.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:25 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:26.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:26 smithi149 ceph-mon[67036]: pgmap v213: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 8 op/s 2024-04-15T21:10:26.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:26.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:26 smithi072 ceph-mon[78970]: pgmap v213: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 8 op/s 2024-04-15T21:10:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:26.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:28.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:28 smithi149 ceph-mon[67036]: pgmap v214: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-15T21:10:28.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:28 smithi072 ceph-mon[78970]: pgmap v214: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: pgmap v215: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all mds 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.pbknte"}]': finished 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.zkrubp"}]': finished 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:10:30.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.jwobda"}]': finished 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.mflbpn"}]': finished 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all rgw 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all rbd-mirror 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:29 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:30.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: pgmap v215: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.1 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all mds 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.pbknte"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.pbknte"}]': finished 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.zkrubp"}]: dispatch 2024-04-15T21:10:30.445 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.zkrubp"}]': finished 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.jwobda"}]: dispatch 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.jwobda"}]': finished 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.mflbpn"}]: dispatch 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.mflbpn"}]': finished 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all rgw 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all rbd-mirror 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:30.446 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:29 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:33.165 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: pgmap v216: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-15T21:10:33.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: Upgrade: Updating ceph-exporter.smithi072 (1/2) 2024-04-15T21:10:33.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:33.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:10:33.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:33.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:32 smithi072 ceph-mon[78970]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-04-15T21:10:33.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: pgmap v216: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-15T21:10:33.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: Upgrade: Updating ceph-exporter.smithi072 (1/2) 2024-04-15T21:10:33.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:33.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:10:33.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:33.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:32 smithi149 ceph-mon[67036]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-04-15T21:10:34.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:34 smithi072 ceph-mon[78970]: pgmap v217: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:35.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:34 smithi149 ceph-mon[67036]: pgmap v217: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:36.287 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:36.287 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:36.287 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:36 smithi149 ceph-mon[67036]: pgmap v218: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 737 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:36.287 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:36.288 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:36 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:36.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:36.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:36.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:36 smithi072 ceph-mon[78970]: pgmap v218: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 737 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-15T21:10:36.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:36.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:36 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: pgmap v219: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:38.625 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:38 smithi149 ceph-mon[67036]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-04-15T21:10:38.665 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: pgmap v219: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-15T21:10:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-04-15T21:10:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-15T21:10:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:38 smithi072 ceph-mon[78970]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-04-15T21:10:40.608 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:40 smithi149 ceph-mon[67036]: pgmap v220: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 918 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-04-15T21:10:40.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:40 smithi072 ceph-mon[78970]: pgmap v220: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 918 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-04-15T21:10:42.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:42.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:42.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:42.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:42 smithi149 ceph-mon[67036]: pgmap v221: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:42.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:42.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:42.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:42.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:42 smithi072 ceph-mon[78970]: pgmap v221: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.973+0000 7fc463a43700 1 -- 172.21.15.72:0/3014616588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c100240 msgr2=0x7fc45c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.973+0000 7fc463a43700 1 --2- 172.21.15.72:0/3014616588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c100240 0x7fc45c100650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc45400b0a0 tx=0x7fc45400b3b0 comp rx=0 tx=0).stop 2024-04-15T21:10:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- 172.21.15.72:0/3014616588 shutdown_connections 2024-04-15T21:10:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 --2- 172.21.15.72:0/3014616588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c101440 0x7fc45c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 --2- 172.21.15.72:0/3014616588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c100240 0x7fc45c100650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- 172.21.15.72:0/3014616588 >> 172.21.15.72:0/3014616588 conn(0x7fc45c0fb7f0 msgr2=0x7fc45c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- 172.21.15.72:0/3014616588 shutdown_connections 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- 172.21.15.72:0/3014616588 wait complete. 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 Processor -- start 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- start start 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c100240 0x7fc45c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c196610 con 0x7fc45c101440 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.974+0000 7fc463a43700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c196750 con 0x7fc45c100240 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54106/0 (socket says 172.21.15.72:54106) 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 -- 172.21.15.72:0/3633020988 learned_addr learned my addr 172.21.15.72:0/3633020988 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc4617df700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c100240 0x7fc45c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 -- 172.21.15.72:0/3633020988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c100240 msgr2=0x7fc45c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c100240 0x7fc45c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 -- 172.21.15.72:0/3633020988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009d00 con 0x7fc45c101440 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc460fde700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d900 tx=0x7fc45000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4500041f0 con 0x7fc45c101440 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc450004ce0 con 0x7fc45c101440 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c19b200 con 0x7fc45c101440 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45000b750 con 0x7fc45c101440 2024-04-15T21:10:42.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.975+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c19b750 con 0x7fc45c101440 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.977+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c108d90 con 0x7fc45c101440 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.977+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc450004e50 con 0x7fc45c101440 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.978+0000 7fc45a7fc700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 0x7fc444071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.978+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc45008eda0 con 0x7fc45c101440 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.978+0000 7fc4617df700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 0x7fc444071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.978+0000 7fc4617df700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 0x7fc444071170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc45400b830 tx=0x7fc4540060c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:42.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:42.982+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc45005b5e0 con 0x7fc45c101440 2024-04-15T21:10:43.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.203+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc45c105d90 con 0x7fc44406ecc0 2024-04-15T21:10:43.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.204+0000 7fc45a7fc700 1 -- 172.21.15.72:0/3633020988 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc45c105d90 con 0x7fc44406ecc0 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.206+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 msgr2=0x7fc444071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.206+0000 7fc463a43700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 0x7fc444071170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc45400b830 tx=0x7fc4540060c0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.206+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 msgr2=0x7fc45c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.206+0000 7fc463a43700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d900 tx=0x7fc45000dc10 comp rx=0 tx=0).stop 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 shutdown_connections 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fc44406ecc0 0x7fc444071170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc45c100240 0x7fc45c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 --2- 172.21.15.72:0/3633020988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45c101440 0x7fc45c195ff0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 >> 172.21.15.72:0/3633020988 conn(0x7fc45c0fb7f0 msgr2=0x7fc45c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 shutdown_connections 2024-04-15T21:10:43.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.207+0000 7fc463a43700 1 -- 172.21.15.72:0/3633020988 wait complete. 2024-04-15T21:10:43.212 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 -- 172.21.15.72:0/56008478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c100240 msgr2=0x7fb84c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 --2- 172.21.15.72:0/56008478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c100240 0x7fb84c100650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009910 tx=0x7fb83c009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 -- 172.21.15.72:0/56008478 shutdown_connections 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 --2- 172.21.15.72:0/56008478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c101440 0x7fb84c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 --2- 172.21.15.72:0/56008478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c100240 0x7fb84c100650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 -- 172.21.15.72:0/56008478 >> 172.21.15.72:0/56008478 conn(0x7fb84c0fb7f0 msgr2=0x7fb84c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 -- 172.21.15.72:0/56008478 shutdown_connections 2024-04-15T21:10:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.312+0000 7fb8511da700 1 -- 172.21.15.72:0/56008478 wait complete. 2024-04-15T21:10:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.313+0000 7fb8511da700 1 Processor -- start 2024-04-15T21:10:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.313+0000 7fb8511da700 1 -- start start 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 0x7fb84c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c073680 con 0x7fb84c101440 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c0737c0 con 0x7fb84c100240 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54118/0 (socket says 172.21.15.72:54118) 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 -- 172.21.15.72:0/1188917355 learned_addr learned my addr 172.21.15.72:0/1188917355 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84ad9d700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 0x7fb84c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 -- 172.21.15.72:0/1188917355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 msgr2=0x7fb84c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 0x7fb84c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 -- 172.21.15.72:0/1188917355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0095f0 con 0x7fb84c101440 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84ad9d700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 0x7fb84c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb84a59c700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb84000d900 tx=0x7fb84000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb840004a00 con 0x7fb84c101440 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8400054d0 con 0x7fb84c101440 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c073aa0 con 0x7fb84c101440 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb840009d60 con 0x7fb84c101440 2024-04-15T21:10:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.314+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c19db30 con 0x7fb84c101440 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.315+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c108db0 con 0x7fb84c101440 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.316+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb840005020 con 0x7fb84c101440 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.316+0000 7fb833fff700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 0x7fb834071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.317+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb84008eff0 con 0x7fb84c101440 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.317+0000 7fb84ad9d700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 0x7fb834071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.317+0000 7fb84ad9d700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 0x7fb834071170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb83c006010 tx=0x7fb83c00b580 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.321+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb84005b8b0 con 0x7fb84c101440 2024-04-15T21:10:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.550+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb84c105d90 con 0x7fb83406ecc0 2024-04-15T21:10:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.556+0000 7fb833fff700 1 -- 172.21.15.72:0/1188917355 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb84c105d90 con 0x7fb83406ecc0 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 msgr2=0x7fb834071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 0x7fb834071170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb83c006010 tx=0x7fb83c00b580 comp rx=0 tx=0).stop 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 msgr2=0x7fb84c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb84000d900 tx=0x7fb84000dcc0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 shutdown_connections 2024-04-15T21:10:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb83406ecc0 0x7fb834071170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb84c100240 0x7fb84c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 --2- 172.21.15.72:0/1188917355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb84c101440 0x7fb84c073140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 >> 172.21.15.72:0/1188917355 conn(0x7fb84c0fb7f0 msgr2=0x7fb84c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:43.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 shutdown_connections 2024-04-15T21:10:43.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.559+0000 7fb8511da700 1 -- 172.21.15.72:0/1188917355 wait complete. 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3960269162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 msgr2=0x7fe6041057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3960269162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6041057b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009910 tx=0x7fe5f4009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3960269162 shutdown_connections 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3960269162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6041057b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3960269162 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 0x7fe604102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3960269162 >> 172.21.15.72:0/3960269162 conn(0x7fe6040fa4d0 msgr2=0x7fe6040fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3960269162 shutdown_connections 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.667+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3960269162 wait complete. 2024-04-15T21:10:43.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 Processor -- start 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 -- start start 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 0x7fe604100410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040fefa0 con 0x7fe6041033d0 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60a7a1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040ff0e0 con 0x7fe604100ab0 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54132/0 (socket says 172.21.15.72:54132) 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 -- 172.21.15.72:0/3957440824 learned_addr learned my addr 172.21.15.72:0/3957440824 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe60979f700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 0x7fe604100410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 -- 172.21.15.72:0/3957440824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 msgr2=0x7fe604100410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 0x7fe604100410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.668+0000 7fe608f9e700 1 -- 172.21.15.72:0/3957440824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40095f0 con 0x7fe6041033d0 2024-04-15T21:10:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe608f9e700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4006010 tx=0x7fe5f400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f401d070 con 0x7fe6041033d0 2024-04-15T21:10:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe5f400f460 con 0x7fe6041033d0 2024-04-15T21:10:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6040ff360 con 0x7fe6041033d0 2024-04-15T21:10:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f4021640 con 0x7fe6041033d0 2024-04-15T21:10:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.669+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6040ff850 con 0x7fe6041033d0 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.670+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60418fa40 con 0x7fe6041033d0 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.670+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe5f400fab0 con 0x7fe6041033d0 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.671+0000 7fe5fa7fc700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 0x7fe5f0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.671+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe5f4090150 con 0x7fe6041033d0 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.671+0000 7fe60979f700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 0x7fe5f0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.671+0000 7fe60979f700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 0x7fe5f0071170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe600005950 tx=0x7fe60000b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:43.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.676+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe5f405c9d0 con 0x7fe6041033d0 2024-04-15T21:10:43.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.888+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe604061190 con 0x7fe5f006ecc0 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.899+0000 7fe5fa7fc700 1 -- 172.21.15.72:0/3957440824 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe604061190 con 0x7fe5f006ecc0 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (15m) 64s ago 16m 25.9M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 starting - - - - 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (3s) 0s ago 15m 6933k - 19.0.0-3084-g87dbfb63 a452a57266c7 dcd81a36431f 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (5m) 64s ago 17m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (5m) 0s ago 15m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:10:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (15m) 64s ago 16m 85.0M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:10:43.895 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (70s) 64s ago 11m 12.6M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:10:43.895 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (90s) 64s ago 11m 15.9M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:10:43.895 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (22s) 0s ago 11m 12.6M - 19.0.0-3084-g87dbfb63 a452a57266c7 23acf6b85560 2024-04-15T21:10:43.897 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (49s) 0s ago 11m 14.1M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:10:43.897 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (7m) 64s ago 18m 510M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:10:43.897 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (6m) 0s ago 15m 453M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:10:43.897 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (6m) 64s ago 18m 51.6M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (5m) 0s ago 15m 44.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (17m) 64s ago 17m 16.5M - 1.5.0 0da6a335fe13 bf8ecb95f102 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (15m) 0s ago 15m 16.7M - 1.5.0 0da6a335fe13 fc36c2b6ba74 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (4m) 64s ago 14m 94.5M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 64s ago 14m 95.5M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (3m) 64s ago 13m 84.9M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (2m) 0s ago 13m 101M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (2m) 0s ago 13m 98.6M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (108s) 0s ago 12m 87.6M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:10:43.898 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 64s ago 16m 80.4M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 msgr2=0x7fe5f0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 0x7fe5f0071170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe600005950 tx=0x7fe60000b410 comp rx=0 tx=0).stop 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 msgr2=0x7fe6040fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4006010 tx=0x7fe5f400bd70 comp rx=0 tx=0).stop 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 shutdown_connections 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5f006ecc0 0x7fe5f0071170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe604100ab0 0x7fe604100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 --2- 172.21.15.72:0/3957440824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6041033d0 0x7fe6040fea60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:43.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 >> 172.21.15.72:0/3957440824 conn(0x7fe6040fa4d0 msgr2=0x7fe6040fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:43.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 shutdown_connections 2024-04-15T21:10:43.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:43.902+0000 7fe60a7a1700 1 -- 172.21.15.72:0/3957440824 wait complete. 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 -- 172.21.15.72:0/2386097027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2960100d80 msgr2=0x7f2960103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 --2- 172.21.15.72:0/2386097027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2960100d80 0x7f2960103160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2950009910 tx=0x7f2950009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 -- 172.21.15.72:0/2386097027 shutdown_connections 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 --2- 172.21.15.72:0/2386097027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29601036a0 0x7f2960105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 --2- 172.21.15.72:0/2386097027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2960100d80 0x7f2960103160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 -- 172.21.15.72:0/2386097027 >> 172.21.15.72:0/2386097027 conn(0x7f29600fa7a0 msgr2=0x7f29600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 -- 172.21.15.72:0/2386097027 shutdown_connections 2024-04-15T21:10:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.006+0000 7f29651f4700 1 -- 172.21.15.72:0/2386097027 wait complete. 2024-04-15T21:10:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.007+0000 7f29651f4700 1 Processor -- start 2024-04-15T21:10:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.007+0000 7f29651f4700 1 -- start start 2024-04-15T21:10:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.007+0000 7f29651f4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2960100d80 0x7f2960198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.007+0000 7f29651f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f29651f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960198b70 con 0x7f29601036a0 2024-04-15T21:10:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f29651f4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960198cb0 con 0x7f2960100d80 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54152/0 (socket says 172.21.15.72:54152) 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 -- 172.21.15.72:0/1209650386 learned_addr learned my addr 172.21.15.72:0/1209650386 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295ed9d700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2960100d80 0x7f2960198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 -- 172.21.15.72:0/1209650386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2960100d80 msgr2=0x7f2960198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2960100d80 0x7f2960198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 -- 172.21.15.72:0/1209650386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500095f0 con 0x7f29601036a0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f295e59c700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f295400d900 tx=0x7f295400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29540041f0 con 0x7f29601036a0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2954004ce0 con 0x7f29601036a0 2024-04-15T21:10:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296019d760 con 0x7f29601036a0 2024-04-15T21:10:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295400b750 con 0x7f29601036a0 2024-04-15T21:10:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.008+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296019dcb0 con 0x7f29601036a0 2024-04-15T21:10:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.009+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960068ab0 con 0x7f29601036a0 2024-04-15T21:10:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.010+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2954004e50 con 0x7f29601036a0 2024-04-15T21:10:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.010+0000 7f2947fff700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 0x7f2948071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.010+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f295408ee00 con 0x7f29601036a0 2024-04-15T21:10:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.010+0000 7f295ed9d700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 0x7f2948071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.011+0000 7f295ed9d700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 0x7f2948071170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f295000b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.015+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f295405b640 con 0x7f29601036a0 2024-04-15T21:10:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.331+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f296019ded0 con 0x7f29601036a0 2024-04-15T21:10:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.331+0000 7f2947fff700 1 -- 172.21.15.72:0/1209650386 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f295405b1d0 con 0x7f29601036a0 2024-04-15T21:10:44.326 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:10:44.327 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 14 2024-04-15T21:10:44.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:10:44.328 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.333+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 msgr2=0x7f2948071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.333+0000 7f29651f4700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 0x7f2948071170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2950006010 tx=0x7f295000b540 comp rx=0 tx=0).stop 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 msgr2=0x7f2960198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f295400d900 tx=0x7f295400dc10 comp rx=0 tx=0).stop 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 shutdown_connections 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f294806ecc0 0x7f2948071170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2960100d80 0x7f2960198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 --2- 172.21.15.72:0/1209650386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29601036a0 0x7f2960198550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 >> 172.21.15.72:0/1209650386 conn(0x7f29600fa7a0 msgr2=0x7f29600ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:44.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 shutdown_connections 2024-04-15T21:10:44.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.334+0000 7f29651f4700 1 -- 172.21.15.72:0/1209650386 wait complete. 2024-04-15T21:10:44.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- 172.21.15.72:0/1058458965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 msgr2=0x7fb098100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 --2- 172.21.15.72:0/1058458965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098100840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb088009910 tx=0x7fb088009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- 172.21.15.72:0/1058458965 shutdown_connections 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 --2- 172.21.15.72:0/1058458965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098100840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 --2- 172.21.15.72:0/1058458965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 0x7fb0980ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- 172.21.15.72:0/1058458965 >> 172.21.15.72:0/1058458965 conn(0x7fb0980fa780 msgr2=0x7fb0980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- 172.21.15.72:0/1058458965 shutdown_connections 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- 172.21.15.72:0/1058458965 wait complete. 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 Processor -- start 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.438+0000 7fb09f883700 1 -- start start 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 0x7fb098195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981965d0 con 0x7fb0981003d0 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098196710 con 0x7fb0980ff130 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54164/0 (socket says 172.21.15.72:54164) 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 -- 172.21.15.72:0/2173748309 learned_addr learned my addr 172.21.15.72:0/2173748309 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09d61f700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 0x7fb098195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 -- 172.21.15.72:0/2173748309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 msgr2=0x7fb098195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 0x7fb098195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 -- 172.21.15.72:0/2173748309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880095f0 con 0x7fb0981003d0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09ce1e700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb08800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08801d070 con 0x7fb0981003d0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb088005dc0 con 0x7fb0981003d0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0880226a0 con 0x7fb0981003d0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09819b160 con 0x7fb0981003d0 2024-04-15T21:10:44.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.439+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09819b650 con 0x7fb0981003d0 2024-04-15T21:10:44.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.440+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb098107c10 con 0x7fb0981003d0 2024-04-15T21:10:44.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.441+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb0880038f0 con 0x7fb0981003d0 2024-04-15T21:10:44.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.441+0000 7fb08e7fc700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 0x7fb084071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.441+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb088090480 con 0x7fb0981003d0 2024-04-15T21:10:44.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.441+0000 7fb09d61f700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 0x7fb084071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.442+0000 7fb09d61f700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 0x7fb084071170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb094009c60 tx=0x7fb094009260 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.446+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb08805ccc0 con 0x7fb0981003d0 2024-04-15T21:10:44.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.695+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb09819bd50 con 0x7fb0981003d0 2024-04-15T21:10:44.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.695+0000 7fb08e7fc700 1 -- 172.21.15.72:0/2173748309 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1935 (secure 0 0 0) 0x7fb09819bd50 con 0x7fb0981003d0 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:e29 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 29 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T21:10:23.323049+0000 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:10:44.691 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 84 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34402} 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:10:44.692 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 34402 members: 34402 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:10:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 msgr2=0x7fb084071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 0x7fb084071170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb094009c60 tx=0x7fb094009260 comp rx=0 tx=0).stop 2024-04-15T21:10:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 msgr2=0x7fb098195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb08800f690 comp rx=0 tx=0).stop 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 shutdown_connections 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb08406ecc0 0x7fb084071170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0980ff130 0x7fb098195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 --2- 172.21.15.72:0/2173748309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0981003d0 0x7fb098195fb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 >> 172.21.15.72:0/2173748309 conn(0x7fb0980fa780 msgr2=0x7fb098068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.697+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 shutdown_connections 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.698+0000 7fb09f883700 1 -- 172.21.15.72:0/2173748309 wait complete. 2024-04-15T21:10:44.695 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.805+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/3485176032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 msgr2=0x7ff0cc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.805+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/3485176032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc0ff560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009910 tx=0x7ff0bc009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/3485176032 shutdown_connections 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/3485176032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/3485176032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc0ff560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/3485176032 >> 172.21.15.72:0/3485176032 conn(0x7ff0cc0fa7a0 msgr2=0x7ff0cc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:44.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/3485176032 shutdown_connections 2024-04-15T21:10:44.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/3485176032 wait complete. 2024-04-15T21:10:44.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 Processor -- start 2024-04-15T21:10:44.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.806+0000 7ff0d3dbe700 1 -- start start 2024-04-15T21:10:44.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc195870 con 0x7ff0cc0ff150 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc19a280 con 0x7ff0cc1003f0 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54184/0 (socket says 172.21.15.72:54184) 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 -- 172.21.15.72:0/1118677618 learned_addr learned my addr 172.21.15.72:0/1118677618 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1359700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 -- 172.21.15.72:0/1118677618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 msgr2=0x7ff0cc195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 -- 172.21.15.72:0/1118677618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0095f0 con 0x7ff0cc0ff150 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1359700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d1b5a700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc01d070 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc19a420 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0bc00f460 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc017630 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.807+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc19a8e0 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.808+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc068ab0 con 0x7ff0cc0ff150 2024-04-15T21:10:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.809+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff0bc00f5d0 con 0x7ff0cc0ff150 2024-04-15T21:10:44.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.809+0000 7ff0c2ffd700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 0x7ff0b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:44.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.809+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff0bc090390 con 0x7ff0cc0ff150 2024-04-15T21:10:44.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.809+0000 7ff0d1359700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 0x7ff0b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:44.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.810+0000 7ff0d1359700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 0x7ff0b8071170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005950 tx=0x7ff0c80058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:44.814+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff0bc0590a0 con 0x7ff0cc0ff150 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: pgmap v222: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:44 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1209650386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: pgmap v222: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:44.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:44 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1209650386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:45.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.034+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0cc104e20 con 0x7ff0b806ecc0 2024-04-15T21:10:45.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.036+0000 7ff0c2ffd700 1 -- 172.21.15.72:0/1118677618 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ff0cc104e20 con 0x7ff0b806ecc0 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "mon", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: "mds" 2024-04-15T21:10:45.031 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:10:45.032 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "17/23 daemons upgraded", 2024-04-15T21:10:45.032 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-04-15T21:10:45.032 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:10:45.032 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:10:45.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 msgr2=0x7ff0b8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 0x7ff0b8071170 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005950 tx=0x7ff0c80058e0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 msgr2=0x7ff0cc194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc00be20 comp rx=0 tx=0).stop 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 shutdown_connections 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff0b806ecc0 0x7ff0b8071170 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0cc0ff150 0x7ff0cc194d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 --2- 172.21.15.72:0/1118677618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0cc1003f0 0x7ff0cc195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 >> 172.21.15.72:0/1118677618 conn(0x7ff0cc0fa7a0 msgr2=0x7ff0cc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 shutdown_connections 2024-04-15T21:10:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.038+0000 7ff0d3dbe700 1 -- 172.21.15.72:0/1118677618 wait complete. 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 -- 172.21.15.72:0/3881044045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 msgr2=0x7fdbf0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3881044045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0100650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009910 tx=0x7fdbd8009c20 comp rx=0 tx=0).stop 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 -- 172.21.15.72:0/3881044045 shutdown_connections 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3881044045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 0x7fdbf0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3881044045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0100650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 -- 172.21.15.72:0/3881044045 >> 172.21.15.72:0/3881044045 conn(0x7fdbf00fb7f0 msgr2=0x7fdbf00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 -- 172.21.15.72:0/3881044045 shutdown_connections 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 -- 172.21.15.72:0/3881044045 wait complete. 2024-04-15T21:10:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.143+0000 7fdbf564a700 1 Processor -- start 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbf564a700 1 -- start start 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbf564a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbf564a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 0x7fdbf0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbf564a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0073680 con 0x7fdbf0100240 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbf564a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00737c0 con 0x7fdbf0101440 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54200/0 (socket says 172.21.15.72:54200) 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 -- 172.21.15.72:0/3883775872 learned_addr learned my addr 172.21.15.72:0/3883775872 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbee7fc700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 0x7fdbf0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 -- 172.21.15.72:0/3883775872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 msgr2=0x7fdbf0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 0x7fdbf0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 -- 172.21.15.72:0/3883775872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80095f0 con 0x7fdbf0100240 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbeeffd700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800bd70 tx=0x7fdbd800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.144+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd801d070 con 0x7fdbf0100240 2024-04-15T21:10:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.145+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdbd800f460 con 0x7fdbf0100240 2024-04-15T21:10:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.145+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0073a40 con 0x7fdbf0100240 2024-04-15T21:10:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.145+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8021640 con 0x7fdbf0100240 2024-04-15T21:10:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.145+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf0073f30 con 0x7fdbf0100240 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.145+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf0108d90 con 0x7fdbf0100240 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.146+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdbd800fab0 con 0x7fdbf0100240 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.146+0000 7fdbe7fff700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 0x7fdbdc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.147+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fdbd8090100 con 0x7fdbf0100240 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.147+0000 7fdbee7fc700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 0x7fdbdc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:10:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.147+0000 7fdbee7fc700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 0x7fdbdc071170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007be0 tx=0x7fdbe00073d0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:10:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.151+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdbd805c940 con 0x7fdbf0100240 2024-04-15T21:10:45.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.445+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdbf0108f80 con 0x7fdbf0100240 2024-04-15T21:10:45.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.446+0000 7fdbe7fff700 1 -- 172.21.15.72:0/3883775872 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fdbd805c4d0 con 0x7fdbf0100240 2024-04-15T21:10:45.441 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:45.441 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:10:45.441 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:10:45.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 msgr2=0x7fdbdc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 0x7fdbdc071170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007be0 tx=0x7fdbe00073d0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 msgr2=0x7fdbf0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800bd70 tx=0x7fdbd800bda0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 shutdown_connections 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdbdc06ecc0 0x7fdbdc071170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbf0100240 0x7fdbf0074af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 --2- 172.21.15.72:0/3883775872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf0101440 0x7fdbf0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 >> 172.21.15.72:0/3883775872 conn(0x7fdbf00fb7f0 msgr2=0x7fdbf0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 shutdown_connections 2024-04-15T21:10:45.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:10:45.448+0000 7fdbf564a700 1 -- 172.21.15.72:0/3883775872 wait complete. 2024-04-15T21:10:45.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:45 smithi072 ceph-mon[78970]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:45.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:45 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2173748309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:10:45.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:45.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:45 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:45.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:45 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3883775872' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:10:45.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:45 smithi149 ceph-mon[67036]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:45.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:45 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2173748309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:10:45.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:45.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:45 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:45.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:45 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3883775872' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:10:46.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:46 smithi072 ceph-mon[78970]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:46.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:46 smithi072 ceph-mon[78970]: pgmap v223: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:46.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:46 smithi149 ceph-mon[67036]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:10:46.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:46 smithi149 ceph-mon[67036]: pgmap v223: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:48.869 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:48 smithi072 ceph-mon[78970]: pgmap v224: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:48.870 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:48.870 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:48 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:49.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:48 smithi149 ceph-mon[67036]: pgmap v224: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:49.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:49.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:48 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:50.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:50 smithi072 ceph-mon[78970]: pgmap v225: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:50.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:50.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:50.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:50 smithi149 ceph-mon[67036]: pgmap v225: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:50.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:10:51.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:51 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:51.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:51 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:51.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:51 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:51.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:51 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:52.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:52 smithi072 ceph-mon[78970]: pgmap v226: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:52.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:52 smithi149 ceph-mon[67036]: pgmap v226: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:54.840 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: pgmap v227: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:54.840 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.840 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.840 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]: dispatch 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]': finished 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]: dispatch 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.842 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:54 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: pgmap v227: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:10:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]: dispatch 2024-04-15T21:10:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]': finished 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]: dispatch 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:10:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:54 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:10:55.782 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:55 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all ceph-exporter 2024-04-15T21:10:55.782 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:55 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all iscsi 2024-04-15T21:10:55.782 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:55 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all nfs 2024-04-15T21:10:55.783 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:55 smithi072 ceph-mon[78970]: Upgrade: Setting container_image for all nvmeof 2024-04-15T21:10:55.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:55 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all ceph-exporter 2024-04-15T21:10:55.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:55 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all iscsi 2024-04-15T21:10:55.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:55 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all nfs 2024-04-15T21:10:55.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:55 smithi149 ceph-mon[67036]: Upgrade: Setting container_image for all nvmeof 2024-04-15T21:10:56.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:56 smithi149 ceph-mon[67036]: pgmap v228: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:56.888 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:56 smithi072 ceph-mon[78970]: pgmap v228: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:57.904 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:57 smithi149 ceph-mon[67036]: Upgrade: Updating node-exporter.smithi072 (1/2) 2024-04-15T21:10:57.904 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:57 smithi149 ceph-mon[67036]: Deploying daemon node-exporter.smithi072 on smithi072 2024-04-15T21:10:57.915 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:57 smithi072 ceph-mon[78970]: Upgrade: Updating node-exporter.smithi072 (1/2) 2024-04-15T21:10:57.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:57 smithi072 ceph-mon[78970]: Deploying daemon node-exporter.smithi072 on smithi072 2024-04-15T21:10:58.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:58 smithi072 ceph-mon[78970]: pgmap v229: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:10:58.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:58 smithi149 ceph-mon[67036]: pgmap v229: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:00.147 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:00.147 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:59 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:00.147 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:10:59 smithi149 ceph-mon[67036]: pgmap v230: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:00.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:00.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:59 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:00.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:10:59 smithi072 ceph-mon[78970]: pgmap v230: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:01.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:00 smithi072 ceph-mon[78970]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-04-15T21:11:01.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:00 smithi072 ceph-mon[78970]: Deploying daemon node-exporter.smithi149 on smithi149 2024-04-15T21:11:01.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:00 smithi149 ceph-mon[67036]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-04-15T21:11:01.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:00 smithi149 ceph-mon[67036]: Deploying daemon node-exporter.smithi149 on smithi149 2024-04-15T21:11:02.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:01 smithi072 ceph-mon[78970]: pgmap v231: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:02.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:01 smithi149 ceph-mon[67036]: pgmap v231: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:04.152 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:04.152 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:04.152 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:04 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:04.152 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:04 smithi149 ceph-mon[67036]: pgmap v232: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:04 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:04.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:04 smithi072 ceph-mon[78970]: pgmap v232: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:05.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:05.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:06.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:06 smithi072 ceph-mon[78970]: pgmap v233: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:06.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:06.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:06.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:06 smithi149 ceph-mon[67036]: pgmap v233: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:06.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:06.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:07.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:07.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:07 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:07.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:07.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:07 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:08.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:08 smithi149 ceph-mon[67036]: pgmap v234: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:08.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:08.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:08 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:08 smithi072 ceph-mon[78970]: pgmap v234: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:09.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:08 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:09 smithi072 ceph-mon[78970]: pgmap v235: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:09.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:09 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:09 smithi149 ceph-mon[67036]: pgmap v235: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:09.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:09.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:09 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:12.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:12 smithi072 ceph-mon[78970]: pgmap v236: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:12.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:12 smithi149 ceph-mon[67036]: pgmap v236: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:13.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:13 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:13.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:13 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:14.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:14 smithi072 ceph-mon[78970]: pgmap v237: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:14.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:14 smithi149 ceph-mon[67036]: pgmap v237: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:15.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 -- 172.21.15.72:0/3766781102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c1003f0 msgr2=0x7fdd1c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 --2- 172.21.15.72:0/3766781102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c100860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009910 tx=0x7fdd10009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 -- 172.21.15.72:0/3766781102 shutdown_connections 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 --2- 172.21.15.72:0/3766781102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c100860 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 --2- 172.21.15.72:0/3766781102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 -- 172.21.15.72:0/3766781102 >> 172.21.15.72:0/3766781102 conn(0x7fdd1c0fa7a0 msgr2=0x7fdd1c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 -- 172.21.15.72:0/3766781102 shutdown_connections 2024-04-15T21:11:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.562+0000 7fdd20e79700 1 -- 172.21.15.72:0/3766781102 wait complete. 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 Processor -- start 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 -- start start 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c101d10 con 0x7fdd1c0ff150 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd20e79700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c101e50 con 0x7fdd1c1003f0 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53418/0 (socket says 172.21.15.72:53418) 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 -- 172.21.15.72:0/4087120468 learned_addr learned my addr 172.21.15.72:0/4087120468 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd19d9b700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 -- 172.21.15.72:0/4087120468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c1003f0 msgr2=0x7fdd1c1017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c1017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 -- 172.21.15.72:0/4087120468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100095f0 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd1a59c700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00d8d0 tx=0x7fdd0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.563+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0c009940 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.564+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c010460 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.564+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0c00f5f0 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.564+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c102130 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.564+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c19de20 con 0x7fdd1c0ff150 2024-04-15T21:11:15.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.564+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c068ab0 con 0x7fdd1c0ff150 2024-04-15T21:11:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.565+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdd0c0105d0 con 0x7fdd1c0ff150 2024-04-15T21:11:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.565+0000 7fdd0b7fe700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 0x7fdd04071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.566+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fdd0c08eef0 con 0x7fdd1c0ff150 2024-04-15T21:11:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.566+0000 7fdd19d9b700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 0x7fdd04071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.566+0000 7fdd19d9b700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 0x7fdd04071170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd10006010 tx=0x7fdd1000b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:15.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.570+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdd0c05b730 con 0x7fdd1c0ff150 2024-04-15T21:11:15.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:15 smithi072 ceph-mon[78970]: Upgrade: Updating prometheus.smithi072 2024-04-15T21:11:15.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:15 smithi072 ceph-mon[78970]: Deploying daemon prometheus.smithi072 on smithi072 2024-04-15T21:11:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.794+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd1c19dfb0 con 0x7fdd0406ecc0 2024-04-15T21:11:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.796+0000 7fdd0b7fe700 1 -- 172.21.15.72:0/4087120468 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fdd1c19dfb0 con 0x7fdd0406ecc0 2024-04-15T21:11:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 msgr2=0x7fdd04071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 0x7fdd04071170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd10006010 tx=0x7fdd1000b540 comp rx=0 tx=0).stop 2024-04-15T21:11:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 msgr2=0x7fdd1c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00d8d0 tx=0x7fdd0c00dc90 comp rx=0 tx=0).stop 2024-04-15T21:11:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 shutdown_connections 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fdd0406ecc0 0x7fdd04071170 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd1c0ff150 0x7fdd1c103180 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 --2- 172.21.15.72:0/4087120468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd1c1003f0 0x7fdd1c1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 >> 172.21.15.72:0/4087120468 conn(0x7fdd1c0fa7a0 msgr2=0x7fdd1c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 shutdown_connections 2024-04-15T21:11:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.798+0000 7fdd20e79700 1 -- 172.21.15.72:0/4087120468 wait complete. 2024-04-15T21:11:15.803 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:11:15.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 -- 172.21.15.72:0/935168815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 msgr2=0x7f515c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 --2- 172.21.15.72:0/935168815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c101c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5158009910 tx=0x7f5158009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 -- 172.21.15.72:0/935168815 shutdown_connections 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 --2- 172.21.15.72:0/935168815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f515c1021d0 0x7f515c0fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 --2- 172.21.15.72:0/935168815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c101c90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 -- 172.21.15.72:0/935168815 >> 172.21.15.72:0/935168815 conn(0x7f515c0f9f10 msgr2=0x7f515c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 -- 172.21.15.72:0/935168815 shutdown_connections 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.903+0000 7f5163431700 1 -- 172.21.15.72:0/935168815 wait complete. 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 Processor -- start 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 -- start start 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f515c1021d0 0x7f515c196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c196670 con 0x7f515c101880 2024-04-15T21:11:15.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f5163431700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1967b0 con 0x7f515c1021d0 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f51611cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f51611cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53446/0 (socket says 172.21.15.72:53446) 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.904+0000 7f51611cd700 1 -- 172.21.15.72:0/496477804 learned_addr learned my addr 172.21.15.72:0/496477804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51611cd700 1 -- 172.21.15.72:0/496477804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f515c1021d0 msgr2=0x7f515c196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51611cd700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f515c1021d0 0x7f515c196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51611cd700 1 -- 172.21.15.72:0/496477804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580095f0 con 0x7f515c101880 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51611cd700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5158006010 tx=0x7f515800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515801d070 con 0x7f515c101880 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f515800f460 con 0x7f515c101880 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c19b200 con 0x7f515c101880 2024-04-15T21:11:15.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5158017630 con 0x7f515c101880 2024-04-15T21:11:15.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.905+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c19b6f0 con 0x7f515c101880 2024-04-15T21:11:15.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.906+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c108d40 con 0x7f515c101880 2024-04-15T21:11:15.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.906+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f515800f5d0 con 0x7f515c101880 2024-04-15T21:11:15.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.907+0000 7f51527fc700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 0x7f5148071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:15.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.907+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f5158090380 con 0x7f515c101880 2024-04-15T21:11:15.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.907+0000 7f51609cc700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 0x7f5148071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:15.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.907+0000 7f51609cc700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 0x7f5148071170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f514c005950 tx=0x7f514c0058e0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:15.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:15.912+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f515805cbc0 con 0x7f515c101880 2024-04-15T21:11:15.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:15 smithi149 ceph-mon[67036]: Upgrade: Updating prometheus.smithi072 2024-04-15T21:11:15.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:15 smithi149 ceph-mon[67036]: Deploying daemon prometheus.smithi072 on smithi072 2024-04-15T21:11:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.140+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f515c105f70 con 0x7f514806ecc0 2024-04-15T21:11:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.141+0000 7f51527fc700 1 -- 172.21.15.72:0/496477804 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f515c105f70 con 0x7f514806ecc0 2024-04-15T21:11:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 msgr2=0x7f5148071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 0x7f5148071170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f514c005950 tx=0x7f514c0058e0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 msgr2=0x7f515c195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5158006010 tx=0x7f515800be20 comp rx=0 tx=0).stop 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 shutdown_connections 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f514806ecc0 0x7f5148071170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f515c101880 0x7f515c195b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 --2- 172.21.15.72:0/496477804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f515c1021d0 0x7f515c196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 >> 172.21.15.72:0/496477804 conn(0x7f515c0f9f10 msgr2=0x7f515c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 shutdown_connections 2024-04-15T21:11:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.144+0000 7f5163431700 1 -- 172.21.15.72:0/496477804 wait complete. 2024-04-15T21:11:16.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 -- 172.21.15.72:0/1021895168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380103680 msgr2=0x7f1380105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 --2- 172.21.15.72:0/1021895168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380103680 0x7f1380105a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f1374009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 -- 172.21.15.72:0/1021895168 shutdown_connections 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 --2- 172.21.15.72:0/1021895168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380103680 0x7f1380105a60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 --2- 172.21.15.72:0/1021895168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380100d60 0x7f1380103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 -- 172.21.15.72:0/1021895168 >> 172.21.15.72:0/1021895168 conn(0x7f13800fa780 msgr2=0x7f13800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 -- 172.21.15.72:0/1021895168 shutdown_connections 2024-04-15T21:11:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.249+0000 7f1387d20700 1 -- 172.21.15.72:0/1021895168 wait complete. 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 Processor -- start 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 -- start start 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380103680 0x7f13800fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ff250 con 0x7f1380100d60 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ff390 con 0x7f1380103680 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53460/0 (socket says 172.21.15.72:53460) 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 -- 172.21.15.72:0/332810506 learned_addr learned my addr 172.21.15.72:0/332810506 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f13852bb700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380103680 0x7f13800fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 -- 172.21.15.72:0/332810506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380103680 msgr2=0x7f13800fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380103680 0x7f13800fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 -- 172.21.15.72:0/332810506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740095f0 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1385abc700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1378007e90 tx=0x7f137800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137800dda0 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f137800f040 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13800ff670 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.250+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1378012610 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.251+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138019db40 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.252+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138018fbe0 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.252+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1378012880 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.252+0000 7f137effd700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 0x7f1368071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.253+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f137808e770 con 0x7f1380100d60 2024-04-15T21:11:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.253+0000 7f13852bb700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 0x7f1368071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.253+0000 7f13852bb700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 0x7f1368071170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1374006010 tx=0x7f137400b540 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.257+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f137805b030 con 0x7f1380100d60 2024-04-15T21:11:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.477+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1380061190 con 0x7f136806ecc0 2024-04-15T21:11:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.488+0000 7f137effd700 1 -- 172.21.15.72:0/332810506 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1380061190 con 0x7f136806ecc0 2024-04-15T21:11:16.484 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (15m) 8s ago 17m 26.0M - 0.25.0 c8568f914cd2 eef9167de76b 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (41s) 8s ago 17m 7944k - 19.0.0-3084-g87dbfb63 a452a57266c7 b709183b7e33 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (35s) 11s ago 16m 7549k - 19.0.0-3084-g87dbfb63 a452a57266c7 dcd81a36431f 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (5m) 8s ago 17m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (5m) 11s ago 16m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (15m) 8s ago 17m 83.2M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (103s) 8s ago 11m 14.0M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (2m) 8s ago 11m 88.7M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (55s) 11s ago 11m 12.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 23acf6b85560 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (81s) 11s ago 11m 14.3M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (7m) 8s ago 18m 513M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:11:16.485 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (7m) 11s ago 16m 453M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (6m) 8s ago 19m 54.1M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (6m) 11s ago 16m 44.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (18s) 8s ago 17m 5507k - 1.5.0 0da6a335fe13 e8d6864d11cb 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (13s) 11s ago 16m 3590k - 1.5.0 0da6a335fe13 0654749c9fb6 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 8s ago 15m 100M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 8s ago 14m 105M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 8s ago 14m 95.4M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (3m) 11s ago 14m 100M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (2m) 11s ago 13m 97.3M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (2m) 11s ago 13m 87.7M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:11:16.486 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (7m) 8s ago 16m 84.9M - 2.43.0 a07b618ecd1d 852a0473bd7c 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 msgr2=0x7f1368071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 0x7f1368071170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1374006010 tx=0x7f137400b540 comp rx=0 tx=0).stop 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 msgr2=0x7f13801006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1378007e90 tx=0x7f137800d3b0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 shutdown_connections 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f136806ecc0 0x7f1368071170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1380100d60 0x7f13801006c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 --2- 172.21.15.72:0/332810506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1380103680 0x7f13800fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 >> 172.21.15.72:0/332810506 conn(0x7f13800fa780 msgr2=0x7f13800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 shutdown_connections 2024-04-15T21:11:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.491+0000 7f1387d20700 1 -- 172.21.15.72:0/332810506 wait complete. 2024-04-15T21:11:16.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 -- 172.21.15.72:0/563477001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85881003d0 msgr2=0x7f8588100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 --2- 172.21.15.72:0/563477001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85881003d0 0x7f8588100840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f857c009910 tx=0x7f857c009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:16.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 -- 172.21.15.72:0/563477001 shutdown_connections 2024-04-15T21:11:16.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 --2- 172.21.15.72:0/563477001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85881003d0 0x7f8588100840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 --2- 172.21.15.72:0/563477001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85880ff130 0x7f85880ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 -- 172.21.15.72:0/563477001 >> 172.21.15.72:0/563477001 conn(0x7f85880fa780 msgr2=0x7f85880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 -- 172.21.15.72:0/563477001 shutdown_connections 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.596+0000 7f8590783700 1 -- 172.21.15.72:0/563477001 wait complete. 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 Processor -- start 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 -- start start 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 0x7f8588195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85881965c0 con 0x7f85880ff130 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f8590783700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588196700 con 0x7f85881003d0 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53482/0 (socket says 172.21.15.72:53482) 2024-04-15T21:11:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 -- 172.21.15.72:0/288816662 learned_addr learned my addr 172.21.15.72:0/288816662 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858dd1e700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 0x7f8588195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 -- 172.21.15.72:0/288816662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 msgr2=0x7f8588195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 0x7f8588195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 -- 172.21.15.72:0/288816662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0095f0 con 0x7f85880ff130 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858dd1e700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 0x7f8588195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f858e51f700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85800060b0 tx=0x7f858000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858000dda0 con 0x7f85880ff130 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.597+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f858000f040 con 0x7f85880ff130 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.598+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858819b1b0 con 0x7f85880ff130 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.598+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580014790 con 0x7f85880ff130 2024-04-15T21:11:16.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.598+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858819b700 con 0x7f85880ff130 2024-04-15T21:11:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.599+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8588107c10 con 0x7f85880ff130 2024-04-15T21:11:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.599+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f85800148f0 con 0x7f85880ff130 2024-04-15T21:11:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.599+0000 7f85877fe700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 0x7f8570071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.600+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f858008e910 con 0x7f85880ff130 2024-04-15T21:11:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.600+0000 7f858dd1e700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 0x7f8570071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:16.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.600+0000 7f858dd1e700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 0x7f8570071170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f857c005b40 tx=0x7f857c005ab0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:16.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.604+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f858005b280 con 0x7f85880ff130 2024-04-15T21:11:16.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:16 smithi072 ceph-mon[78970]: pgmap v238: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:16.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.903+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f858819bdf0 con 0x7f85880ff130 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.903+0000 7f85877fe700 1 -- 172.21.15.72:0/288816662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f858005ae10 con 0x7f85880ff130 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 14 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:11:16.900 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 msgr2=0x7f8570071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 0x7f8570071170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f857c005b40 tx=0x7f857c005ab0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 msgr2=0x7f8588195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85800060b0 tx=0x7f858000d3b0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 shutdown_connections 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f857006ecc0 0x7f8570071170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85880ff130 0x7f8588195a60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 --2- 172.21.15.72:0/288816662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85881003d0 0x7f8588195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:16.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 >> 172.21.15.72:0/288816662 conn(0x7f85880fa780 msgr2=0x7f8588068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:16.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 shutdown_connections 2024-04-15T21:11:16.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:16.906+0000 7f8590783700 1 -- 172.21.15.72:0/288816662 wait complete. 2024-04-15T21:11:16.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:16 smithi149 ceph-mon[67036]: pgmap v238: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3538304910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 msgr2=0x7fab980ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3538304910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab980ff560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009910 tx=0x7fab8c009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3538304910 shutdown_connections 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3538304910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 0x7fab98100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3538304910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab980ff560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3538304910 >> 172.21.15.72:0/3538304910 conn(0x7fab980fa7a0 msgr2=0x7fab980fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3538304910 shutdown_connections 2024-04-15T21:11:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.011+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3538304910 wait complete. 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 Processor -- start 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 -- start start 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 0x7fab98195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab981957e0 con 0x7fab980ff150 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9ee1f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98195950 con 0x7fab981003f0 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9cbbb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9cbbb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53502/0 (socket says 172.21.15.72:53502) 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab9cbbb700 1 -- 172.21.15.72:0/3058687458 learned_addr learned my addr 172.21.15.72:0/3058687458 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.012+0000 7fab97fff700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 0x7fab98195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9cbbb700 1 -- 172.21.15.72:0/3058687458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 msgr2=0x7fab98195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9cbbb700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 0x7fab98195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9cbbb700 1 -- 172.21.15.72:0/3058687458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0095f0 con 0x7fab980ff150 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9cbbb700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005090 tx=0x7fab8c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8c01d070 con 0x7fab980ff150 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9819a340 con 0x7fab980ff150 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab8c00f460 con 0x7fab980ff150 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8c021640 con 0x7fab980ff150 2024-04-15T21:11:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.013+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9819a830 con 0x7fab980ff150 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.014+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab98068ab0 con 0x7fab980ff150 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.015+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fab8c00f5d0 con 0x7fab980ff150 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.015+0000 7fab95ffb700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 0x7fab88071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.015+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fab8c090320 con 0x7fab980ff150 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.015+0000 7fab97fff700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 0x7fab88071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.016+0000 7fab97fff700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 0x7fab88071170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab8400ac50 tx=0x7fab8400a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.020+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fab8c059030 con 0x7fab980ff150 2024-04-15T21:11:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.273+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab9819ab40 con 0x7fab980ff150 2024-04-15T21:11:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.273+0000 7fab95ffb700 1 -- 172.21.15.72:0/3058687458 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1935 (secure 0 0 0) 0x7fab8c05c6f0 con 0x7fab980ff150 2024-04-15T21:11:17.269 INFO:teuthology.orchestra.run.smithi072.stdout:e29 2024-04-15T21:11:17.269 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:11:17.269 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 29 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T21:10:23.323049+0000 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:11:17.270 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 84 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34402} 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:11:17.271 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 34402 members: 34402 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 msgr2=0x7fab88071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 0x7fab88071170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab8400ac50 tx=0x7fab8400a380 comp rx=0 tx=0).stop 2024-04-15T21:11:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 msgr2=0x7fab98194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005090 tx=0x7fab8c00bd70 comp rx=0 tx=0).stop 2024-04-15T21:11:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 shutdown_connections 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fab8806ecc0 0x7fab88071170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab980ff150 0x7fab98194d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 --2- 172.21.15.72:0/3058687458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab981003f0 0x7fab98195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 >> 172.21.15.72:0/3058687458 conn(0x7fab980fa7a0 msgr2=0x7fab981036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 shutdown_connections 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.276+0000 7fab9ee1f700 1 -- 172.21.15.72:0/3058687458 wait complete. 2024-04-15T21:11:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-04-15T21:11:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 -- 172.21.15.72:0/2845379324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 msgr2=0x7f23a00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/2845379324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a00ff560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2394009910 tx=0x7f2394009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 -- 172.21.15.72:0/2845379324 shutdown_connections 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/2845379324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 0x7f23a0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/2845379324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a00ff560 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 -- 172.21.15.72:0/2845379324 >> 172.21.15.72:0/2845379324 conn(0x7f23a00fa7a0 msgr2=0x7f23a00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 -- 172.21.15.72:0/2845379324 shutdown_connections 2024-04-15T21:11:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.382+0000 7f23a7cbf700 1 -- 172.21.15.72:0/2845379324 wait complete. 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 Processor -- start 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 -- start start 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 0x7f23a0196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0196970 con 0x7f23a00ff150 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a7cbf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0196ab0 con 0x7f23a01003f0 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53524/0 (socket says 172.21.15.72:53524) 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 -- 172.21.15.72:0/1741269893 learned_addr learned my addr 172.21.15.72:0/1741269893 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a525a700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 0x7f23a0196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 -- 172.21.15.72:0/1741269893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 msgr2=0x7f23a0196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 0x7f23a0196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 -- 172.21.15.72:0/1741269893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940095f0 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.383+0000 7f23a5a5b700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f239400b5c0 tx=0x7f239400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.384+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239401d070 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.384+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f239400f460 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.384+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a019b500 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.384+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2394021640 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.384+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a019b9f0 con 0x7f23a00ff150 2024-04-15T21:11:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.385+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a0068ab0 con 0x7f23a00ff150 2024-04-15T21:11:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.385+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f239400fa60 con 0x7f23a00ff150 2024-04-15T21:11:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.386+0000 7f2392ffd700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 0x7f238c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.386+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f2394090170 con 0x7f23a00ff150 2024-04-15T21:11:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.386+0000 7f23a525a700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 0x7f238c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.386+0000 7f23a525a700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 0x7f238c071170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f239c005950 tx=0x7f239c00b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.390+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f239405c9b0 con 0x7f23a00ff150 2024-04-15T21:11:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.616+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a00694e0 con 0x7f238c06ecc0 2024-04-15T21:11:17.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:17 smithi072 ceph-mon[78970]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:17 smithi072 ceph-mon[78970]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:17 smithi072 ceph-mon[78970]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:17 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/288816662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:17.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:17 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3058687458' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:11:17.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.617+0000 7f2392ffd700 1 -- 172.21.15.72:0/1741269893 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f23a00694e0 con 0x7f238c06ecc0 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "mon", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-04-15T21:11:17.672 INFO:teuthology.orchestra.run.smithi072.stdout: "mds" 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 msgr2=0x7f238c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 0x7f238c071170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f239c005950 tx=0x7f239c00b410 comp rx=0 tx=0).stop 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 msgr2=0x7f23a0195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f239400b5c0 tx=0x7f239400bd70 comp rx=0 tx=0).stop 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 shutdown_connections 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f238c06ecc0 0x7f238c071170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a00ff150 0x7f23a0195e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 --2- 172.21.15.72:0/1741269893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23a01003f0 0x7f23a0196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 >> 172.21.15.72:0/1741269893 conn(0x7f23a00fa7a0 msgr2=0x7f23a0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 shutdown_connections 2024-04-15T21:11:17.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.619+0000 7f23a7cbf700 1 -- 172.21.15.72:0/1741269893 wait complete. 2024-04-15T21:11:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.726+0000 7f1014821700 1 -- 172.21.15.72:0/3651237915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 msgr2=0x7f10101007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.726+0000 7f1014821700 1 --2- 172.21.15.72:0/3651237915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f10101007a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009910 tx=0x7f0ff8009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 -- 172.21.15.72:0/3651237915 shutdown_connections 2024-04-15T21:11:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 --2- 172.21.15.72:0/3651237915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f10101007a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 --2- 172.21.15.72:0/3651237915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 0x7f10100ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 -- 172.21.15.72:0/3651237915 >> 172.21.15.72:0/3651237915 conn(0x7f10100fa700 msgr2=0x7f10100fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 -- 172.21.15.72:0/3651237915 shutdown_connections 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 -- 172.21.15.72:0/3651237915 wait complete. 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 Processor -- start 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.727+0000 7f1014821700 1 -- start start 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f1014821700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 0x7f10101949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f1014821700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f1014821700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010195500 con 0x7f1010100350 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f1014821700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010195640 con 0x7f10100ff150 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53546/0 (socket says 172.21.15.72:53546) 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 -- 172.21.15.72:0/4048133574 learned_addr learned my addr 172.21.15.72:0/4048133574 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100e59c700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 0x7f10101949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 -- 172.21.15.72:0/4048133574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 msgr2=0x7f10101949a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 0x7f10101949a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 -- 172.21.15.72:0/4048133574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80095f0 con 0x7f1010100350 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f100dd9b700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff801d070 con 0x7f1010100350 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ff800f460 con 0x7f1010100350 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101019a090 con 0x7f1010100350 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.728+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff8017630 con 0x7f1010100350 2024-04-15T21:11:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.729+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101019a580 con 0x7f1010100350 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.730+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1010107ca0 con 0x7f1010100350 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.730+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ff8003a60 con 0x7f1010100350 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.731+0000 7f10077fe700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 0x7f0ffc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.731+0000 7f100e59c700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 0x7f0ffc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.731+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f0ff80902e0 con 0x7f1010100350 2024-04-15T21:11:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.731+0000 7f100e59c700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 0x7f0ffc071170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10101001b0 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:17.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:17.735+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0ff805cba0 con 0x7f1010100350 2024-04-15T21:11:17.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:17 smithi149 ceph-mon[67036]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:17 smithi149 ceph-mon[67036]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:17 smithi149 ceph-mon[67036]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:17.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:17 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/288816662' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:17.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:17 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3058687458' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:11:18.037 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:11:18.038 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:11:18.038 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:11:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.041+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1010107e60 con 0x7f1010100350 2024-04-15T21:11:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.042+0000 7f10077fe700 1 -- 172.21.15.72:0/4048133574 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0ff805c730 con 0x7f1010100350 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 msgr2=0x7f0ffc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 0x7f0ffc071170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10101001b0 tx=0x7f1000009040 comp rx=0 tx=0).stop 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 msgr2=0x7f1010194ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8006010 tx=0x7f0ff800be20 comp rx=0 tx=0).stop 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 shutdown_connections 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ffc06ecc0 0x7f0ffc071170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10100ff150 0x7f10101949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 --2- 172.21.15.72:0/4048133574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1010100350 0x7f1010194ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 >> 172.21.15.72:0/4048133574 conn(0x7f10100fa700 msgr2=0x7f1010103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 shutdown_connections 2024-04-15T21:11:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:18.044+0000 7f1014821700 1 -- 172.21.15.72:0/4048133574 wait complete. 2024-04-15T21:11:18.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:18 smithi072 ceph-mon[78970]: pgmap v239: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:18.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:18 smithi072 ceph-mon[78970]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:18.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:18 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/4048133574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:11:18.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:18 smithi149 ceph-mon[67036]: pgmap v239: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:18.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:18 smithi149 ceph-mon[67036]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:18.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:18 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/4048133574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:11:20.852 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:20 smithi072 ceph-mon[78970]: pgmap v240: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:20.852 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:20.852 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:20.853 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:20.853 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:20.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:20 smithi149 ceph-mon[67036]: pgmap v240: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:20.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:20.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:20.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:20.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:22.560 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:22 smithi072 ceph-mon[78970]: pgmap v241: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:22.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:22 smithi149 ceph-mon[67036]: pgmap v241: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:24.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:24 smithi072 ceph-mon[78970]: pgmap v242: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:24.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:24.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:24 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:24.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:24 smithi149 ceph-mon[67036]: pgmap v242: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:24.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:24.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:24 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:26.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:26 smithi072 ceph-mon[78970]: pgmap v243: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:26.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:26.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:26 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:26.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:26 smithi149 ceph-mon[67036]: pgmap v243: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:26.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:26.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:26 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:28.877 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:28 smithi072 ceph-mon[78970]: pgmap v244: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:28.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:28 smithi149 ceph-mon[67036]: pgmap v244: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:30.416 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: pgmap v245: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.418 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:30 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: pgmap v245: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:30.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:30 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:32.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:32 smithi072 ceph-mon[78970]: Upgrade: Updating alertmanager.smithi072 2024-04-15T21:11:32.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:32 smithi072 ceph-mon[78970]: Deploying daemon alertmanager.smithi072 on smithi072 2024-04-15T21:11:32.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:32 smithi072 ceph-mon[78970]: pgmap v246: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:32.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:32 smithi149 ceph-mon[67036]: Upgrade: Updating alertmanager.smithi072 2024-04-15T21:11:32.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:32 smithi149 ceph-mon[67036]: Deploying daemon alertmanager.smithi072 on smithi072 2024-04-15T21:11:32.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:32 smithi149 ceph-mon[67036]: pgmap v246: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:34.616 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:34 smithi072 ceph-mon[78970]: pgmap v247: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:34.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:34 smithi149 ceph-mon[67036]: pgmap v247: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:35.620 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:35.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:36.484 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:36 smithi072 ceph-mon[78970]: pgmap v248: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:36.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:36 smithi149 ceph-mon[67036]: pgmap v248: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:38.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:38 smithi072 ceph-mon[78970]: pgmap v249: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:38.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:38.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:38.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:38 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:38.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:38 smithi149 ceph-mon[67036]: pgmap v249: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:38.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:38.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:38.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:38 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:40.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:40 smithi072 ceph-mon[78970]: pgmap v250: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:40.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:40 smithi149 ceph-mon[67036]: pgmap v250: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:43.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:42 smithi072 ceph-mon[78970]: pgmap v251: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:43.225 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:43.225 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:42 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:43.226 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:42 smithi149 ceph-mon[67036]: pgmap v251: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:43.226 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:43.226 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:42 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:44.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:44.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:43 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:44.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:43 smithi072 ceph-mon[78970]: pgmap v252: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:44.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:43 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:44.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:43 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:44.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:43 smithi149 ceph-mon[67036]: pgmap v252: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:46.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:46 smithi072 ceph-mon[78970]: pgmap v253: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:46.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:46 smithi149 ceph-mon[67036]: pgmap v253: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:47.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:47.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:47.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:47 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:47.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:47 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 -- 172.21.15.72:0/45196042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c01003d0 msgr2=0x7fb0c0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/45196042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c01003d0 0x7fb0c0100840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009910 tx=0x7fb0b4009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 -- 172.21.15.72:0/45196042 shutdown_connections 2024-04-15T21:11:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/45196042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c01003d0 0x7fb0c0100840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/45196042 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c00ff130 0x7fb0c00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 -- 172.21.15.72:0/45196042 >> 172.21.15.72:0/45196042 conn(0x7fb0c00fa780 msgr2=0x7fb0c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 -- 172.21.15.72:0/45196042 shutdown_connections 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.154+0000 7fb0c4d17700 1 -- 172.21.15.72:0/45196042 wait complete. 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 Processor -- start 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 -- start start 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 0x7fb0c019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c019ace0 con 0x7fb0c00ff130 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0c4d17700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c019ae50 con 0x7fb0c01003d0 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39684/0 (socket says 172.21.15.72:39684) 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.155+0000 7fb0be59c700 1 -- 172.21.15.72:0/641830774 learned_addr learned my addr 172.21.15.72:0/641830774 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0bdd9b700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 0x7fb0c019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0be59c700 1 -- 172.21.15.72:0/641830774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 msgr2=0x7fb0c019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0be59c700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 0x7fb0c019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0be59c700 1 -- 172.21.15.72:0/641830774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40095f0 con 0x7fb0c00ff130 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0bdd9b700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 0x7fb0c019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0be59c700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c930 tx=0x7fb0b000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b0007ad0 con 0x7fb0c00ff130 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0b0007c30 con 0x7fb0c00ff130 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c019b130 con 0x7fb0c00ff130 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b0018630 con 0x7fb0c00ff130 2024-04-15T21:11:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.156+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c019b680 con 0x7fb0c00ff130 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.157+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c0107c10 con 0x7fb0c00ff130 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.158+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb0b000f450 con 0x7fb0c00ff130 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.158+0000 7fb0af7fe700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 0x7fb0a8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.158+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb0b008f100 con 0x7fb0c00ff130 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.158+0000 7fb0bdd9b700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 0x7fb0a8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.159+0000 7fb0bdd9b700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 0x7fb0a8071170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0069620 tx=0x7fb0b4005ab0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.163+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb0b005b940 con 0x7fb0c00ff130 2024-04-15T21:11:48.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.395+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0c0104d20 con 0x7fb0a806ecc0 2024-04-15T21:11:48.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.406+0000 7fb0af7fe700 1 -- 172.21.15.72:0/641830774 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fb0c0104d20 con 0x7fb0a806ecc0 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 msgr2=0x7fb0a8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 0x7fb0a8071170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0069620 tx=0x7fb0b4005ab0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 msgr2=0x7fb0c00690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c930 tx=0x7fb0b000ccf0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 shutdown_connections 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb0a806ecc0 0x7fb0a8071170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c00ff130 0x7fb0c00690c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 --2- 172.21.15.72:0/641830774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c01003d0 0x7fb0c019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 >> 172.21.15.72:0/641830774 conn(0x7fb0c00fa780 msgr2=0x7fb0c0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 shutdown_connections 2024-04-15T21:11:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.409+0000 7fb0c4d17700 1 -- 172.21.15.72:0/641830774 wait complete. 2024-04-15T21:11:48.415 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:11:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 -- 172.21.15.72:0/1064778034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 msgr2=0x7f05ac0ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 --2- 172.21.15.72:0/1064778034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac0ff310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009910 tx=0x7f05a0009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 -- 172.21.15.72:0/1064778034 shutdown_connections 2024-04-15T21:11:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 --2- 172.21.15.72:0/1064778034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac0ff310 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 --2- 172.21.15.72:0/1064778034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 0x7f05ac0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 -- 172.21.15.72:0/1064778034 >> 172.21.15.72:0/1064778034 conn(0x7f05ac0f9f10 msgr2=0x7f05ac0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:48.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 -- 172.21.15.72:0/1064778034 shutdown_connections 2024-04-15T21:11:48.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.520+0000 7f05b0f31700 1 -- 172.21.15.72:0/1064778034 wait complete. 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.521+0000 7f05b0f31700 1 Processor -- start 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.521+0000 7f05b0f31700 1 -- start start 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.521+0000 7f05b0f31700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 0x7f05ac197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.521+0000 7f05b0f31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05b0f31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac198870 con 0x7f05ac0fee50 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05b0f31700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac19d280 con 0x7f05ac0fe500 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39708/0 (socket says 172.21.15.72:39708) 2024-04-15T21:11:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 -- 172.21.15.72:0/4156569277 learned_addr learned my addr 172.21.15.72:0/4156569277 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05aa59c700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 0x7f05ac197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 -- 172.21.15.72:0/4156569277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 msgr2=0x7f05ac197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 0x7f05ac197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 -- 172.21.15.72:0/4156569277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00095f0 con 0x7f05ac0fee50 2024-04-15T21:11:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.522+0000 7f05a9d9b700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05a000bd70 tx=0x7f05a000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.525+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a001d070 con 0x7f05ac0fee50 2024-04-15T21:11:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.525+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05a0005dc0 con 0x7f05ac0fee50 2024-04-15T21:11:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.525+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac19d420 con 0x7f05ac0fee50 2024-04-15T21:11:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.525+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a0021410 con 0x7f05ac0fee50 2024-04-15T21:11:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.525+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac19d8e0 con 0x7f05ac0fee50 2024-04-15T21:11:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.526+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac10af00 con 0x7f05ac0fee50 2024-04-15T21:11:48.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.527+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f05a000f7b0 con 0x7f05ac0fee50 2024-04-15T21:11:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.527+0000 7f059b7fe700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 0x7f0594071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.528+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f05a0090100 con 0x7f05ac0fee50 2024-04-15T21:11:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.528+0000 7f05aa59c700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 0x7f0594071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.528+0000 7f05aa59c700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 0x7f0594071170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05ac1991f0 tx=0x7f059c00b410 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.532+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f05a0058e10 con 0x7f05ac0fee50 2024-04-15T21:11:48.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:48 smithi072 ceph-mon[78970]: pgmap v254: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.765+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05ac1090c0 con 0x7f059406ecc0 2024-04-15T21:11:48.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.766+0000 7f059b7fe700 1 -- 172.21.15.72:0/4156569277 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f05ac1090c0 con 0x7f059406ecc0 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 msgr2=0x7f0594071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 0x7f0594071170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05ac1991f0 tx=0x7f059c00b410 comp rx=0 tx=0).stop 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 msgr2=0x7f05ac198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05a000bd70 tx=0x7f05a000bda0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 shutdown_connections 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f059406ecc0 0x7f0594071170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ac0fe500 0x7f05ac197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 --2- 172.21.15.72:0/4156569277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ac0fee50 0x7f05ac198250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 >> 172.21.15.72:0/4156569277 conn(0x7f05ac0f9f10 msgr2=0x7f05ac1079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:48.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 shutdown_connections 2024-04-15T21:11:48.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.769+0000 7f05b0f31700 1 -- 172.21.15.72:0/4156569277 wait complete. 2024-04-15T21:11:48.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 -- 172.21.15.72:0/2531097498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4100240 msgr2=0x7f2fa4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 --2- 172.21.15.72:0/2531097498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4100240 0x7f2fa4100650 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009910 tx=0x7f2fa0009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 -- 172.21.15.72:0/2531097498 shutdown_connections 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 --2- 172.21.15.72:0/2531097498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4101440 0x7f2fa4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 --2- 172.21.15.72:0/2531097498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4100240 0x7f2fa4100650 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 -- 172.21.15.72:0/2531097498 >> 172.21.15.72:0/2531097498 conn(0x7f2fa40fb7f0 msgr2=0x7f2fa40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 -- 172.21.15.72:0/2531097498 shutdown_connections 2024-04-15T21:11:48.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.880+0000 7f2fab982700 1 -- 172.21.15.72:0/2531097498 wait complete. 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.881+0000 7f2fab982700 1 Processor -- start 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.881+0000 7f2fab982700 1 -- start start 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.881+0000 7f2fab982700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4100240 0x7f2fa4195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.881+0000 7f2fab982700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fab982700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa41966c0 con 0x7f2fa4101440 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fab982700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4196800 con 0x7f2fa4100240 2024-04-15T21:11:48.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39722/0 (socket says 172.21.15.72:39722) 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 -- 172.21.15.72:0/1991317034 learned_addr learned my addr 172.21.15.72:0/1991317034 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa971e700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4100240 0x7f2fa4195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 -- 172.21.15.72:0/1991317034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4100240 msgr2=0x7f2fa4195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4100240 0x7f2fa4195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 -- 172.21.15.72:0/1991317034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00095f0 con 0x7f2fa4101440 2024-04-15T21:11:48.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fa8f1d700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b4b0 tx=0x7f2f9400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f94011800 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f94011e10 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa419b2b0 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9400f2e0 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.882+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa419b800 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.883+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4108e10 con 0x7f2fa4101440 2024-04-15T21:11:48.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.884+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2f94010380 con 0x7f2fa4101440 2024-04-15T21:11:48.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.884+0000 7f2f9a7fc700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 0x7f2f90071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:48.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.884+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f2f9408e9c0 con 0x7f2fa4101440 2024-04-15T21:11:48.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.884+0000 7f2fa971e700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 0x7f2f90071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:48.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.885+0000 7f2fa971e700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 0x7f2f90071170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006010 tx=0x7f2fa0005280 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:48.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:48.889+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2f9405b280 con 0x7f2fa4101440 2024-04-15T21:11:48.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:48 smithi149 ceph-mon[67036]: pgmap v254: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.108+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa419bf50 con 0x7f2f9006ecc0 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.119+0000 7f2f9a7fc700 1 -- 172.21.15.72:0/1991317034 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f2fa419bf50 con 0x7f2f9006ecc0 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (12s) 7s ago 18m 16.0M - 0.25.0 c8568f914cd2 e1abb1d15468 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (73s) 7s ago 18m 7990k - 19.0.0-3084-g87dbfb63 a452a57266c7 b709183b7e33 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (68s) 43s ago 17m 7549k - 19.0.0-3084-g87dbfb63 a452a57266c7 dcd81a36431f 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (6m) 7s ago 18m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (6m) 43s ago 17m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:11:49.115 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (16m) 7s ago 17m 85.7M - 9.4.7 954c08fa6188 f52b18b9d197 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (2m) 7s ago 12m 14.4M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (2m) 7s ago 12m 88.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (88s) 43s ago 12m 12.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 23acf6b85560 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (114s) 43s ago 12m 14.3M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (8m) 7s ago 19m 515M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (7m) 43s ago 16m 453M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (7m) 7s ago 19m 56.3M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (6m) 43s ago 16m 44.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (50s) 7s ago 18m 9.97M - 1.5.0 0da6a335fe13 e8d6864d11cb 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (46s) 43s ago 16m 3590k - 1.5.0 0da6a335fe13 0654749c9fb6 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 7s ago 16m 100M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 7s ago 15m 105M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 7s ago 14m 95.5M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:11:49.116 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (4m) 43s ago 14m 100M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (3m) 43s ago 14m 97.3M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (2m) 43s ago 13m 87.7M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (29s) 7s ago 17m 64.4M - 2.43.0 a07b618ecd1d 759f14010407 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 msgr2=0x7f2f90071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 0x7f2f90071170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006010 tx=0x7f2fa0005280 comp rx=0 tx=0).stop 2024-04-15T21:11:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 msgr2=0x7f2fa41960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b4b0 tx=0x7f2f9400b7c0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 shutdown_connections 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2f9006ecc0 0x7f2f90071170 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fa4100240 0x7f2fa4195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 --2- 172.21.15.72:0/1991317034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fa4101440 0x7f2fa41960a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.121+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 >> 172.21.15.72:0/1991317034 conn(0x7f2fa40fb7f0 msgr2=0x7f2fa4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.122+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 shutdown_connections 2024-04-15T21:11:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.122+0000 7f2fab982700 1 -- 172.21.15.72:0/1991317034 wait complete. 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 -- 172.21.15.72:0/863978735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 msgr2=0x7f2ca4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/863978735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4101890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009910 tx=0x7f2c94009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 -- 172.21.15.72:0/863978735 shutdown_connections 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/863978735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4101890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/863978735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 0x7f2ca4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 -- 172.21.15.72:0/863978735 >> 172.21.15.72:0/863978735 conn(0x7f2ca40fb7f0 msgr2=0x7f2ca40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 -- 172.21.15.72:0/863978735 shutdown_connections 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.225+0000 7f2cab3f4700 1 -- 172.21.15.72:0/863978735 wait complete. 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 Processor -- start 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 -- start start 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 0x7f2ca4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4073680 con 0x7f2ca4101440 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2cab3f4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40737c0 con 0x7f2ca4100240 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39746/0 (socket says 172.21.15.72:39746) 2024-04-15T21:11:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 -- 172.21.15.72:0/3498002478 learned_addr learned my addr 172.21.15.72:0/3498002478 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca9190700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 0x7f2ca4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 -- 172.21.15.72:0/3498002478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 msgr2=0x7f2ca4074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 0x7f2ca4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 -- 172.21.15.72:0/3498002478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940095f0 con 0x7f2ca4101440 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.226+0000 7f2ca898f700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006010 tx=0x7f2c9400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c9401d070 con 0x7f2ca4101440 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c9400f460 con 0x7f2ca4101440 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c94021640 con 0x7f2ca4101440 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca4073a40 con 0x7f2ca4101440 2024-04-15T21:11:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca4073ee0 con 0x7f2ca4101440 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.227+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4108d90 con 0x7f2ca4101440 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.228+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2c9400fab0 con 0x7f2ca4101440 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.229+0000 7f2c9a7fc700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 0x7f2c90071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.229+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f2c94090280 con 0x7f2ca4101440 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.229+0000 7f2ca9190700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 0x7f2c90071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.229+0000 7f2ca9190700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 0x7f2c90071170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ca41012a0 tx=0x7f2ca0005cf0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.233+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2c9405cb40 con 0x7f2ca4101440 2024-04-15T21:11:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.532+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ca419e1d0 con 0x7f2ca4101440 2024-04-15T21:11:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.532+0000 7f2c9a7fc700 1 -- 172.21.15.72:0/3498002478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f2c9405c6d0 con 0x7f2ca4101440 2024-04-15T21:11:49.528 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:11:49.528 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:11:49.528 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 14 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:11:49.529 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:11:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 msgr2=0x7f2c90071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 0x7f2c90071170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ca41012a0 tx=0x7f2ca0005cf0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 msgr2=0x7f2ca4073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c94006010 tx=0x7f2c9400be20 comp rx=0 tx=0).stop 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 shutdown_connections 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f2c9006ecc0 0x7f2c90071170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ca4100240 0x7f2ca4074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 --2- 172.21.15.72:0/3498002478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ca4101440 0x7f2ca4073140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 >> 172.21.15.72:0/3498002478 conn(0x7f2ca40fb7f0 msgr2=0x7f2ca4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 shutdown_connections 2024-04-15T21:11:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.534+0000 7f2cab3f4700 1 -- 172.21.15.72:0/3498002478 wait complete. 2024-04-15T21:11:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.639+0000 7f60e71e0700 1 -- 172.21.15.72:0/1511337101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 msgr2=0x7f60e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 --2- 172.21.15.72:0/1511337101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0103120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009910 tx=0x7f60d4009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- 172.21.15.72:0/1511337101 shutdown_connections 2024-04-15T21:11:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 --2- 172.21.15.72:0/1511337101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 0x7f60e0105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 --2- 172.21.15.72:0/1511337101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0103120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- 172.21.15.72:0/1511337101 >> 172.21.15.72:0/1511337101 conn(0x7f60e00fa700 msgr2=0x7f60e00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- 172.21.15.72:0/1511337101 shutdown_connections 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- 172.21.15.72:0/1511337101 wait complete. 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 Processor -- start 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- start start 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 0x7f60e0195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0196500 con 0x7f60e0100d40 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.640+0000 7f60e71e0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0196640 con 0x7f60e0103660 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39760/0 (socket says 172.21.15.72:39760) 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 -- 172.21.15.72:0/2939724537 learned_addr learned my addr 172.21.15.72:0/2939724537 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60dffff700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 0x7f60e0195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 -- 172.21.15.72:0/2939724537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 msgr2=0x7f60e0195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 0x7f60e0195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 -- 172.21.15.72:0/2939724537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40095f0 con 0x7f60e0100d40 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e4f7c700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005b40 tx=0x7f60d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d401d070 con 0x7f60e0100d40 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60d4022470 con 0x7f60e0100d40 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e019b0a0 con 0x7f60e0100d40 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d400f690 con 0x7f60e0100d40 2024-04-15T21:11:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.641+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e019b560 con 0x7f60e0100d40 2024-04-15T21:11:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.642+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e018fc70 con 0x7f60e0100d40 2024-04-15T21:11:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.643+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f60d4022a10 con 0x7f60e0100d40 2024-04-15T21:11:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.643+0000 7f60ddffb700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 0x7f60d0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:49.640 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:49 smithi072 ceph-mon[78970]: Upgrade: Updating grafana.smithi072 2024-04-15T21:11:49.641 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:49 smithi072 ceph-mon[78970]: Deploying daemon grafana.smithi072 on smithi072 2024-04-15T21:11:49.641 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:49 smithi072 ceph-mon[78970]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.644+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f60d4090500 con 0x7f60e0100d40 2024-04-15T21:11:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.644+0000 7f60dffff700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 0x7f60d0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.644+0000 7f60dffff700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 0x7f60d0071170 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00ac50 tx=0x7f60cc00a380 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.648+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f60d405cdf0 con 0x7f60e0100d40 2024-04-15T21:11:49.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.902+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f60e002cc30 con 0x7f60e0100d40 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.903+0000 7f60ddffb700 1 -- 172.21.15.72:0/2939724537 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1935 (secure 0 0 0) 0x7f60d405c980 con 0x7f60e0100d40 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stdout:e29 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:11:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 29 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T21:10:23.323049+0000 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:11:49.900 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 84 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34402} 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 34402 members: 34402 2024-04-15T21:11:49.901 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:49.902 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 msgr2=0x7f60d0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 0x7f60d0071170 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00ac50 tx=0x7f60cc00a380 comp rx=0 tx=0).stop 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 msgr2=0x7f60e0195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005b40 tx=0x7f60d400bd70 comp rx=0 tx=0).stop 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 shutdown_connections 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f60d006ecc0 0x7f60d0071170 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60e0100d40 0x7f60e0195a30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.905+0000 7f60e71e0700 1 --2- 172.21.15.72:0/2939724537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60e0103660 0x7f60e0195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.906+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 >> 172.21.15.72:0/2939724537 conn(0x7f60e00fa700 msgr2=0x7f60e00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.906+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 shutdown_connections 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:49.906+0000 7f60e71e0700 1 -- 172.21.15.72:0/2939724537 wait complete. 2024-04-15T21:11:49.903 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-04-15T21:11:49.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:49 smithi149 ceph-mon[67036]: Upgrade: Updating grafana.smithi072 2024-04-15T21:11:49.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:49 smithi149 ceph-mon[67036]: Deploying daemon grafana.smithi072 on smithi072 2024-04-15T21:11:49.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:49 smithi149 ceph-mon[67036]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 -- 172.21.15.72:0/3117651952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f4102210 msgr2=0x7f25f40fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 --2- 172.21.15.72:0/3117651952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f4102210 0x7f25f40fe340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009910 tx=0x7f25dc009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 -- 172.21.15.72:0/3117651952 shutdown_connections 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 --2- 172.21.15.72:0/3117651952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f4102210 0x7f25f40fe340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 --2- 172.21.15.72:0/3117651952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f41018c0 0x7f25f4101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 -- 172.21.15.72:0/3117651952 >> 172.21.15.72:0/3117651952 conn(0x7f25f40f9f10 msgr2=0x7f25f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 -- 172.21.15.72:0/3117651952 shutdown_connections 2024-04-15T21:11:50.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 -- 172.21.15.72:0/3117651952 wait complete. 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.022+0000 7f25f9acb700 1 Processor -- start 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f9acb700 1 -- start start 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f9acb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f9acb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f4102210 0x7f25f4196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f9acb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4196660 con 0x7f25f41018c0 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f9acb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f41967a0 con 0x7f25f4102210 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39778/0 (socket says 172.21.15.72:39778) 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 -- 172.21.15.72:0/2621981921 learned_addr learned my addr 172.21.15.72:0/2621981921 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f2ffd700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f4102210 0x7f25f4196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 -- 172.21.15.72:0/2621981921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f4102210 msgr2=0x7f25f4196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f4102210 0x7f25f4196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 -- 172.21.15.72:0/2621981921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0095f0 con 0x7f25f41018c0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f37fe700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f25e40060b0 tx=0x7f25e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.023+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e400dda0 con 0x7f25f41018c0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.024+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f419b250 con 0x7f25f41018c0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.024+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f25e400f040 con 0x7f25f41018c0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.024+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e4014790 con 0x7f25f41018c0 2024-04-15T21:11:50.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.024+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f419b7a0 con 0x7f25f41018c0 2024-04-15T21:11:50.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.025+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4108d30 con 0x7f25f41018c0 2024-04-15T21:11:50.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.025+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f25e40148f0 con 0x7f25f41018c0 2024-04-15T21:11:50.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.026+0000 7f25f0ff9700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 0x7f25e0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.026+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f25e408e980 con 0x7f25f41018c0 2024-04-15T21:11:50.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.026+0000 7f25f2ffd700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 0x7f25e0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.026+0000 7f25f2ffd700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 0x7f25e0071170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0059d0 tx=0x7f25dc005960 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:50.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.030+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f25e405b270 con 0x7f25f41018c0 2024-04-15T21:11:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.277+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25f4105fb0 con 0x7f25e006ecc0 2024-04-15T21:11:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.279+0000 7f25f0ff9700 1 -- 172.21.15.72:0/2621981921 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f25f4105fb0 con 0x7f25e006ecc0 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mon", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mds" 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-15T21:11:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-04-15T21:11:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading grafana daemons", 2024-04-15T21:11:50.276 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:11:50.276 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:11:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 msgr2=0x7f25e0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 0x7f25e0071170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0059d0 tx=0x7f25dc005960 comp rx=0 tx=0).stop 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 msgr2=0x7f25f4195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f25e40060b0 tx=0x7f25e400d3b0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 shutdown_connections 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f25e006ecc0 0x7f25e0071170 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f41018c0 0x7f25f4195b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 --2- 172.21.15.72:0/2621981921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25f4102210 0x7f25f4196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 >> 172.21.15.72:0/2621981921 conn(0x7f25f40f9f10 msgr2=0x7f25f4104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 shutdown_connections 2024-04-15T21:11:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.281+0000 7f25f9acb700 1 -- 172.21.15.72:0/2621981921 wait complete. 2024-04-15T21:11:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 -- 172.21.15.72:0/502126722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 msgr2=0x7f4d20100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 --2- 172.21.15.72:0/502126722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20100650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009910 tx=0x7f4d10009c20 comp rx=0 tx=0).stop 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 -- 172.21.15.72:0/502126722 shutdown_connections 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 --2- 172.21.15.72:0/502126722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 0x7f4d20101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 --2- 172.21.15.72:0/502126722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20100650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 -- 172.21.15.72:0/502126722 >> 172.21.15.72:0/502126722 conn(0x7f4d200fb7f0 msgr2=0x7f4d200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 -- 172.21.15.72:0/502126722 shutdown_connections 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.396+0000 7f4d25032700 1 -- 172.21.15.72:0/502126722 wait complete. 2024-04-15T21:11:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 Processor -- start 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 -- start start 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 0x7f4d20195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20196610 con 0x7f4d20100240 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d25032700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20196750 con 0x7f4d20101440 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.397+0000 7f4d1ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39804/0 (socket says 172.21.15.72:39804) 2024-04-15T21:11:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 -- 172.21.15.72:0/1726449209 learned_addr learned my addr 172.21.15.72:0/1726449209 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1e59c700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 0x7f4d20195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 -- 172.21.15.72:0/1726449209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 msgr2=0x7f4d20195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 0x7f4d20195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 -- 172.21.15.72:0/1726449209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100095f0 con 0x7f4d20100240 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d1ed9d700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000bda0 tx=0x7f4d1000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1001d070 con 0x7f4d20100240 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2019b1a0 con 0x7f4d20100240 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d10004c50 con 0x7f4d20100240 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1000f690 con 0x7f4d20100240 2024-04-15T21:11:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.398+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2019b690 con 0x7f4d20100240 2024-04-15T21:11:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.400+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d20108d90 con 0x7f4d20100240 2024-04-15T21:11:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.400+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4d100229b0 con 0x7f4d20100240 2024-04-15T21:11:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.401+0000 7f4d07fff700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 0x7f4d08071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:11:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.401+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4d10090630 con 0x7f4d20100240 2024-04-15T21:11:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.401+0000 7f4d1e59c700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 0x7f4d08071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:11:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.401+0000 7f4d1e59c700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 0x7f4d08071170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005fd0 tx=0x7f4d1400a560 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:11:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.406+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4d1005cef0 con 0x7f4d20100240 2024-04-15T21:11:50.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.720+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4d20108f50 con 0x7f4d20100240 2024-04-15T21:11:50.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.720+0000 7f4d07fff700 1 -- 172.21.15.72:0/1726449209 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4d1005ca80 con 0x7f4d20100240 2024-04-15T21:11:50.716 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:11:50.716 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:11:50.716 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:11:50.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 msgr2=0x7f4d08071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 0x7f4d08071170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005fd0 tx=0x7f4d1400a560 comp rx=0 tx=0).stop 2024-04-15T21:11:50.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 msgr2=0x7f4d20195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000bda0 tx=0x7f4d1000be80 comp rx=0 tx=0).stop 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 shutdown_connections 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4d0806ecc0 0x7f4d08071170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d20100240 0x7f4d20195ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 --2- 172.21.15.72:0/1726449209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d20101440 0x7f4d20195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 >> 172.21.15.72:0/1726449209 conn(0x7f4d200fb7f0 msgr2=0x7f4d20104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 shutdown_connections 2024-04-15T21:11:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:11:50.722+0000 7f4d25032700 1 -- 172.21.15.72:0/1726449209 wait complete. 2024-04-15T21:11:50.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:50.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:50.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: pgmap v255: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:50.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3498002478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:50.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2939724537' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:11:50.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:50.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:50.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:50.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: pgmap v255: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:50.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3498002478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:11:50.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2939724537' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:11:50.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:11:51.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:51 smithi072 ceph-mon[78970]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:51.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:51 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1726449209' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:11:51.943 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:51 smithi149 ceph-mon[67036]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:11:51.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:51 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1726449209' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:11:52.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:52 smithi072 ceph-mon[78970]: pgmap v256: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:52.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:52 smithi149 ceph-mon[67036]: pgmap v256: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:54.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:54 smithi072 ceph-mon[78970]: pgmap v257: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:54.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:54 smithi149 ceph-mon[67036]: pgmap v257: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:56.666 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:56 smithi072 ceph-mon[78970]: pgmap v258: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:56.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:56 smithi149 ceph-mon[67036]: pgmap v258: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:58.642 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:11:58 smithi072 ceph-mon[78970]: pgmap v259: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:11:58.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:11:58 smithi149 ceph-mon[67036]: pgmap v259: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:00.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:00 smithi072 ceph-mon[78970]: pgmap v260: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:00.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:00.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:00.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:00 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:00 smithi149 ceph-mon[67036]: pgmap v260: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:00.944 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:00.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:00.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:00 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:02.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:02 smithi072 ceph-mon[78970]: pgmap v261: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:02.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:02 smithi149 ceph-mon[67036]: pgmap v261: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:04.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:04 smithi072 ceph-mon[78970]: pgmap v262: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:04.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:04 smithi149 ceph-mon[67036]: pgmap v262: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:05.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:05.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:05.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:05.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:05.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:05.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:07.092 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:06 smithi149 ceph-mon[67036]: pgmap v263: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:07.092 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:07.093 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:06 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:07.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:06 smithi072 ceph-mon[78970]: pgmap v263: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:07.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:07.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:06 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:09.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:08 smithi072 ceph-mon[78970]: pgmap v264: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:09.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:08 smithi149 ceph-mon[67036]: pgmap v264: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:11.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:10 smithi072 ceph-mon[78970]: pgmap v265: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:11.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:10 smithi149 ceph-mon[67036]: pgmap v265: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:13.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:12 smithi072 ceph-mon[78970]: pgmap v266: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:13.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:12 smithi149 ceph-mon[67036]: pgmap v266: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:15.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: pgmap v267: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:15.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:15.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-15T21:12:15.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.122 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.123 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-15T21:12:15.124 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-15T21:12:15.124 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:14 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: pgmap v267: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T21:12:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-15T21:12:15.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-15T21:12:15.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-15T21:12:15.200 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:14 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: Upgrade: Finalizing container_image settings 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: Upgrade: Complete! 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:15.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:15.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: Upgrade: Finalizing container_image settings 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: Upgrade: Complete! 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:16.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:16.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:12:16.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:12:16.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:12:16.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:16.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:12:16.916 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:16 smithi072 ceph-mon[78970]: pgmap v268: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:17.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:16 smithi149 ceph-mon[67036]: pgmap v268: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:19.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:18 smithi072 ceph-mon[78970]: pgmap v269: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:19.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:18 smithi149 ceph-mon[67036]: pgmap v269: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:20.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:20 smithi072 ceph-mon[78970]: pgmap v270: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 -- 172.21.15.72:0/1544588254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0ff130 msgr2=0x7f92ac0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1544588254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0ff130 0x7f92ac0ff540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009910 tx=0x7f92a0009c20 comp rx=0 tx=0).stop 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 -- 172.21.15.72:0/1544588254 shutdown_connections 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1544588254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac1003d0 0x7f92ac100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1544588254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac0ff130 0x7f92ac0ff540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 -- 172.21.15.72:0/1544588254 >> 172.21.15.72:0/1544588254 conn(0x7f92ac0fa780 msgr2=0x7f92ac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 -- 172.21.15.72:0/1544588254 shutdown_connections 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.843+0000 7f92b3b12700 1 -- 172.21.15.72:0/1544588254 wait complete. 2024-04-15T21:12:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 Processor -- start 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 -- start start 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 0x7f92ac103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac101cf0 con 0x7f92ac1003d0 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.844+0000 7f92b3b12700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac101e30 con 0x7f92ac0ff130 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55980/0 (socket says 172.21.15.72:55980) 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 -- 172.21.15.72:0/1741873760 learned_addr learned my addr 172.21.15.72:0/1741873760 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b18ae700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 0x7f92ac103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 -- 172.21.15.72:0/1741873760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 msgr2=0x7f92ac103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 0x7f92ac103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 -- 172.21.15.72:0/1741873760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00095f0 con 0x7f92ac1003d0 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b18ae700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 0x7f92ac103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:12:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b10ad700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d8d0 tx=0x7f92a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a8009940 con 0x7f92ac1003d0 2024-04-15T21:12:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac102110 con 0x7f92ac1003d0 2024-04-15T21:12:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92a8010460 con 0x7f92ac1003d0 2024-04-15T21:12:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92a800f5f0 con 0x7f92ac1003d0 2024-04-15T21:12:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.845+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac19db00 con 0x7f92ac1003d0 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.846+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac107c10 con 0x7f92ac1003d0 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.847+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92a80105d0 con 0x7f92ac1003d0 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.847+0000 7f929effd700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 0x7f9298071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.848+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f92a808ef20 con 0x7f92ac1003d0 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.848+0000 7f92b18ae700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 0x7f9298071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.848+0000 7f92b18ae700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 0x7f9298071170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005b40 tx=0x7f92a0005ad0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:20.852+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92a805b760 con 0x7f92ac1003d0 2024-04-15T21:12:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.072+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92ac068c50 con 0x7f929806ecc0 2024-04-15T21:12:21.068 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:21.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.073+0000 7f929effd700 1 -- 172.21.15.72:0/1741873760 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f92ac068c50 con 0x7f929806ecc0 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 msgr2=0x7f9298071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 0x7f9298071170 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005b40 tx=0x7f92a0005ad0 comp rx=0 tx=0).stop 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 msgr2=0x7f92ac1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d8d0 tx=0x7f92a800dc90 comp rx=0 tx=0).stop 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 shutdown_connections 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f929806ecc0 0x7f9298071170 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92ac0ff130 0x7f92ac103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 --2- 172.21.15.72:0/1741873760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac1003d0 0x7f92ac1017b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.075+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 >> 172.21.15.72:0/1741873760 conn(0x7f92ac0fa780 msgr2=0x7f92ac068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.076+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 shutdown_connections 2024-04-15T21:12:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:21.076+0000 7f92b3b12700 1 -- 172.21.15.72:0/1741873760 wait complete. 2024-04-15T21:12:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:20 smithi149 ceph-mon[67036]: pgmap v270: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:21.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph orch ps' 2024-04-15T21:12:22.081 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:23.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:22 smithi072 ceph-mon[78970]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:23.167 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:22 smithi072 ceph-mon[78970]: pgmap v271: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:23.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:22 smithi149 ceph-mon[67036]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:23.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:22 smithi149 ceph-mon[67036]: pgmap v271: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- 172.21.15.72:0/2271667776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de8104130 msgr2=0x7f5de8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 --2- 172.21.15.72:0/2271667776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de8104130 0x7f5de8104500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009910 tx=0x7f5de4009c20 comp rx=0 tx=0).stop 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- 172.21.15.72:0/2271667776 shutdown_connections 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 --2- 172.21.15.72:0/2271667776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de80ffbd0 0x7f5de8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 --2- 172.21.15.72:0/2271667776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de8104130 0x7f5de8104500 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- 172.21.15.72:0/2271667776 >> 172.21.15.72:0/2271667776 conn(0x7f5de8075130 msgr2=0x7f5de8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- 172.21.15.72:0/2271667776 shutdown_connections 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- 172.21.15.72:0/2271667776 wait complete. 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 Processor -- start 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.779+0000 7f5df051f700 1 -- start start 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:23.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de8104130 0x7f5de81971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8197810 con 0x7f5de80ffbd0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8197950 con 0x7f5de8104130 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51032/0 (socket says 172.21.15.72:51032) 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 -- 172.21.15.72:0/3254119166 learned_addr learned my addr 172.21.15.72:0/3254119166 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dedaba700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de8104130 0x7f5de81971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 -- 172.21.15.72:0/3254119166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de8104130 msgr2=0x7f5de81971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de8104130 0x7f5de81971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 -- 172.21.15.72:0/3254119166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40095f0 con 0x7f5de80ffbd0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5dee2bb700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5de4000c00 tx=0x7f5de4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de401d070 con 0x7f5de80ffbd0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5de40052a0 con 0x7f5de80ffbd0 2024-04-15T21:12:23.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de819fd20 con 0x7f5de80ffbd0 2024-04-15T21:12:23.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de4022470 con 0x7f5de80ffbd0 2024-04-15T21:12:23.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.780+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de81a0130 con 0x7f5de80ffbd0 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.781+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de81076a0 con 0x7f5de80ffbd0 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.782+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5de4003680 con 0x7f5de80ffbd0 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.782+0000 7f5ddf7fe700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 0x7f5dd4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.782+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f5de40901f0 con 0x7f5de80ffbd0 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.782+0000 7f5dedaba700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 0x7f5dd4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:23.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.783+0000 7f5dedaba700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 0x7f5dd4071170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5de8068df0 tx=0x7f5dd8009260 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:23.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.787+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5de4058f80 con 0x7f5de80ffbd0 2024-04-15T21:12:23.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:23.996+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5de8061190 con 0x7f5dd406ecc0 2024-04-15T21:12:24.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.007+0000 7f5ddf7fe700 1 -- 172.21.15.72:0/3254119166 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f5de8061190 con 0x7f5dd406ecc0 2024-04-15T21:12:24.004 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (47s) 19s ago 18m 16.0M - 0.25.0 c8568f914cd2 e1abb1d15468 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (108s) 19s ago 18m 8014k - 19.0.0-3084-g87dbfb63 a452a57266c7 b709183b7e33 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (103s) 78s ago 17m 7549k - 19.0.0-3084-g87dbfb63 a452a57266c7 dcd81a36431f 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (6m) 19s ago 18m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (6m) 78s ago 17m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (24s) 19s ago 18m 54.2M - 9.4.12 2bacad6d85d8 34052ec1ac09 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (2m) 19s ago 12m 14.5M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (3m) 19s ago 12m 88.5M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (2m) 78s ago 12m 12.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 23acf6b85560 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (2m) 78s ago 12m 14.3M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (9m) 19s ago 20m 522M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (8m) 78s ago 17m 453M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (7m) 19s ago 20m 56.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:12:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (7m) 78s ago 17m 44.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (85s) 19s ago 18m 9873k - 1.5.0 0da6a335fe13 e8d6864d11cb 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (81s) 78s ago 17m 3590k - 1.5.0 0da6a335fe13 0654749c9fb6 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 19s ago 16m 100M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 19s ago 16m 105M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 19s ago 15m 95.6M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (4m) 78s ago 15m 100M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (4m) 78s ago 14m 97.3M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (3m) 78s ago 14m 87.7M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:12:24.006 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (64s) 19s ago 17m 64.7M - 2.43.0 a07b618ecd1d 759f14010407 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 msgr2=0x7f5dd4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 0x7f5dd4071170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5de8068df0 tx=0x7f5dd8009260 comp rx=0 tx=0).stop 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 msgr2=0x7f5de8196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5de4000c00 tx=0x7f5de4005f00 comp rx=0 tx=0).stop 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 shutdown_connections 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f5dd406ecc0 0x7f5dd4071170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5de80ffbd0 0x7f5de8196cb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 --2- 172.21.15.72:0/3254119166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5de8104130 0x7f5de81971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 >> 172.21.15.72:0/3254119166 conn(0x7f5de8075130 msgr2=0x7f5de80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 shutdown_connections 2024-04-15T21:12:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:24.009+0000 7f5df051f700 1 -- 172.21.15.72:0/3254119166 wait complete. 2024-04-15T21:12:24.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph orch upgrade status' 2024-04-15T21:12:24.826 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:24.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:24 smithi072 ceph-mon[78970]: pgmap v272: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:25.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:24 smithi149 ceph-mon[67036]: pgmap v272: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:25.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:25 smithi072 ceph-mon[78970]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:26.096 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:25 smithi149 ceph-mon[67036]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.472+0000 7f3b11e6d700 1 -- 172.21.15.72:0/768238316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 msgr2=0x7f3b0c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.472+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/768238316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c103d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009910 tx=0x7f3b00009c20 comp rx=0 tx=0).stop 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 -- 172.21.15.72:0/768238316 shutdown_connections 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/768238316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c103d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/768238316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 -- 172.21.15.72:0/768238316 >> 172.21.15.72:0/768238316 conn(0x7f3b0c0fac60 msgr2=0x7f3b0c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 -- 172.21.15.72:0/768238316 shutdown_connections 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 -- 172.21.15.72:0/768238316 wait complete. 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 Processor -- start 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.473+0000 7f3b11e6d700 1 -- start start 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c196c40 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c19a9d0 con 0x7f3b0c0ff3c0 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51052/0 (socket says 172.21.15.72:51052) 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 -- 172.21.15.72:0/2628439691 learned_addr learned my addr 172.21.15.72:0/2628439691 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0b7fe700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 -- 172.21.15.72:0/2628439691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 msgr2=0x7f3b0c196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 -- 172.21.15.72:0/2628439691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000095f0 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0b7fe700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b0affd700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000bda0 tx=0x7f3b0000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0001d070 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b00004fb0 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c19ac50 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0000f480 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.474+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c19b140 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.475+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c04f2a0 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.476+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3b00022870 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.476+0000 7f3b08ff9700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 0x7f3af4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.477+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3b00090490 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.477+0000 7f3b0b7fe700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 0x7f3af4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:26.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.477+0000 7f3b0b7fe700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 0x7f3af4071170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0099d0 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.481+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3b00059250 con 0x7f3b0c0ffd60 2024-04-15T21:12:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.704+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b0c19b490 con 0x7f3af406ecc0 2024-04-15T21:12:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.705+0000 7f3b08ff9700 1 -- 172.21.15.72:0/2628439691 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3b0c19b490 con 0x7f3af406ecc0 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": null, 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": false, 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "", 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": null, 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-04-15T21:12:26.702 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 msgr2=0x7f3af4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 0x7f3af4071170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0099d0 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 msgr2=0x7f3b0c196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000bda0 tx=0x7f3b0000be80 comp rx=0 tx=0).stop 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 shutdown_connections 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f3af406ecc0 0x7f3af4071170 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b0c0ff3c0 0x7f3b0c196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 --2- 172.21.15.72:0/2628439691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b0c0ffd60 0x7f3b0c196560 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.707+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 >> 172.21.15.72:0/2628439691 conn(0x7f3b0c0fac60 msgr2=0x7f3b0c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.708+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 shutdown_connections 2024-04-15T21:12:26.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:26.708+0000 7f3b11e6d700 1 -- 172.21.15.72:0/2628439691 wait complete. 2024-04-15T21:12:27.023 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:26 smithi072 ceph-mon[78970]: pgmap v273: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:27.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:26 smithi149 ceph-mon[67036]: pgmap v273: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:27.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph health detail' 2024-04-15T21:12:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:28.026 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:27 smithi072 ceph-mon[78970]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:28.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:27 smithi149 ceph-mon[67036]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:12:28.891 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:28 smithi072 ceph-mon[78970]: pgmap v274: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 -- 172.21.15.72:0/1214186488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ffd60 msgr2=0x7fadd4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 --2- 172.21.15.72:0/1214186488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ffd60 0x7fadd4103d30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009910 tx=0x7fadc4009c20 comp rx=0 tx=0).stop 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 -- 172.21.15.72:0/1214186488 shutdown_connections 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 --2- 172.21.15.72:0/1214186488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ffd60 0x7fadd4103d30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 --2- 172.21.15.72:0/1214186488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ff3c0 0x7fadd40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 -- 172.21.15.72:0/1214186488 >> 172.21.15.72:0/1214186488 conn(0x7fadd40fac80 msgr2=0x7fadd40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 -- 172.21.15.72:0/1214186488 shutdown_connections 2024-04-15T21:12:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.115+0000 7faddaf61700 1 -- 172.21.15.72:0/1214186488 wait complete. 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 Processor -- start 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 -- start start 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 0x7fadd4196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4196ae0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7faddaf61700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd419a870 con 0x7fadd40ffd60 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7fadd8cfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7fadd8cfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51074/0 (socket says 172.21.15.72:51074) 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7fadd8cfd700 1 -- 172.21.15.72:0/436540225 learned_addr learned my addr 172.21.15.72:0/436540225 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.116+0000 7fadcbfff700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 0x7fadd4196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadd8cfd700 1 -- 172.21.15.72:0/436540225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 msgr2=0x7fadd4196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadd8cfd700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 0x7fadd4196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadd8cfd700 1 -- 172.21.15.72:0/436540225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc40095f0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadcbfff700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 0x7fadd4196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadd8cfd700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d900 tx=0x7fadd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadd00041f0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadd0004cf0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd419ab50 con 0x7fadd40ff3c0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadd000b750 con 0x7fadd40ff3c0 2024-04-15T21:12:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.117+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd419b0a0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.118+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd404f2a0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.119+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fadd0004350 con 0x7fadd40ff3c0 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.119+0000 7fadc9ffb700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 0x7fadbc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.119+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fadd008f0b0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.119+0000 7fadcbfff700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 0x7fadbc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.120+0000 7fadcbfff700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 0x7fadbc071170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fadd41974e0 tx=0x7fadc401a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:29.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.124+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fadd0057dc0 con 0x7fadd40ff3c0 2024-04-15T21:12:29.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:28 smithi149 ceph-mon[67036]: pgmap v274: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:29.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.412+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fadd4197220 con 0x7fadd40ff3c0 2024-04-15T21:12:29.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.412+0000 7fadc9ffb700 1 -- 172.21.15.72:0/436540225 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fadd4197220 con 0x7fadd40ff3c0 2024-04-15T21:12:29.409 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-15T21:12:29.409 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-15T21:12:29.409 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 msgr2=0x7fadbc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 0x7fadbc071170 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fadd41974e0 tx=0x7fadc401a040 comp rx=0 tx=0).stop 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 msgr2=0x7fadd4195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d900 tx=0x7fadd000dcc0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 shutdown_connections 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fadbc06ecc0 0x7fadbc071170 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadd40ff3c0 0x7fadd4195ec0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 --2- 172.21.15.72:0/436540225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadd40ffd60 0x7fadd4196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:29.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.414+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 >> 172.21.15.72:0/436540225 conn(0x7fadd40fac80 msgr2=0x7fadd40fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:29.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.415+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 shutdown_connections 2024-04-15T21:12:29.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:29.415+0000 7faddaf61700 1 -- 172.21.15.72:0/436540225 wait complete. 2024-04-15T21:12:29.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:29 smithi072 ceph-mon[78970]: pgmap v275: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:29.993 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:29 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/436540225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:12:30.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph versions' 2024-04-15T21:12:30.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:29 smithi149 ceph-mon[67036]: pgmap v275: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:30.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:29 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/436540225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-15T21:12:30.227 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 -- 172.21.15.72:0/2392768004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd941004e0 msgr2=0x7fcd941008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 --2- 172.21.15.72:0/2392768004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd941004e0 0x7fcd941008b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009910 tx=0x7fcd84009c20 comp rx=0 tx=0).stop 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 -- 172.21.15.72:0/2392768004 shutdown_connections 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 --2- 172.21.15.72:0/2392768004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd94100e80 0x7fcd94104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 --2- 172.21.15.72:0/2392768004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd941004e0 0x7fcd941008b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 -- 172.21.15.72:0/2392768004 >> 172.21.15.72:0/2392768004 conn(0x7fcd940fbda0 msgr2=0x7fcd940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 -- 172.21.15.72:0/2392768004 shutdown_connections 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.835+0000 7fcd989fe700 1 -- 172.21.15.72:0/2392768004 wait complete. 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 Processor -- start 2024-04-15T21:12:31.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 -- start start 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd941004e0 0x7fcd94073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94073ad0 con 0x7fcd94100e80 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd989fe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94073c10 con 0x7fcd941004e0 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58334/0 (socket says 172.21.15.72:58334) 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 -- 172.21.15.72:0/668188035 learned_addr learned my addr 172.21.15.72:0/668188035 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:12:31.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd9259c700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd941004e0 0x7fcd94073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 -- 172.21.15.72:0/668188035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd941004e0 msgr2=0x7fcd94073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd941004e0 0x7fcd94073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 -- 172.21.15.72:0/668188035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840095f0 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.836+0000 7fcd91d9b700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d900 tx=0x7fcd8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.837+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd88009900 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.837+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd88010460 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.837+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd941a20c0 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.837+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8800f5f0 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.837+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd941a24d0 con 0x7fcd94100e80 2024-04-15T21:12:31.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.838+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd941087f0 con 0x7fcd94100e80 2024-04-15T21:12:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.839+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcd880105d0 con 0x7fcd94100e80 2024-04-15T21:12:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.839+0000 7fcd837fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 0x7fcd7c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:12:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.839+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fcd8808eb60 con 0x7fcd94100e80 2024-04-15T21:12:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.840+0000 7fcd9259c700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 0x7fcd7c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:12:31.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.840+0000 7fcd9259c700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 0x7fcd7c071170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd84006010 tx=0x7fcd8401a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:12:31.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:31.844+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcd88057870 con 0x7fcd94100e80 2024-04-15T21:12:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.135+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd9404f2a0 con 0x7fcd94100e80 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.135+0000 7fcd837fe700 1 -- 172.21.15.72:0/668188035 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fcd8805af30 con 0x7fcd94100e80 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:12:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 14 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:12:32.133 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:12:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 msgr2=0x7fcd7c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 0x7fcd7c071170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd84006010 tx=0x7fcd8401a040 comp rx=0 tx=0).stop 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 msgr2=0x7fcd94073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d900 tx=0x7fcd8800dcc0 comp rx=0 tx=0).stop 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 shutdown_connections 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcd7c06ecc0 0x7fcd7c071170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd941004e0 0x7fcd94073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 --2- 172.21.15.72:0/668188035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd94100e80 0x7fcd94073590 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 >> 172.21.15.72:0/668188035 conn(0x7fcd940fbda0 msgr2=0x7fcd940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 shutdown_connections 2024-04-15T21:12:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:12:32.138+0000 7fcd989fe700 1 -- 172.21.15.72:0/668188035 wait complete. 2024-04-15T21:12:32.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:32 smithi072 ceph-mon[78970]: pgmap v276: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:32.417 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:32 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/668188035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:32.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:32 smithi149 ceph-mon[67036]: pgmap v276: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:32.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:32 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/668188035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:12:32.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-15T21:12:32.949 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:34.610 INFO:teuthology.orchestra.run.smithi072.stdout:wait for servicemap items w/ changing names to refresh 2024-04-15T21:12:34.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:34 smithi072 ceph-mon[78970]: pgmap v277: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:34.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:34 smithi149 ceph-mon[67036]: pgmap v277: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:35.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'sleep 60' 2024-04-15T21:12:35.522 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:12:35.645 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:35.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:36.627 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:36 smithi072 ceph-mon[78970]: pgmap v278: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:36.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:36 smithi149 ceph-mon[67036]: pgmap v278: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:38.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:38 smithi072 ceph-mon[78970]: pgmap v279: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:38.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:38 smithi149 ceph-mon[67036]: pgmap v279: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:40.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:40 smithi072 ceph-mon[78970]: pgmap v280: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:40.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:40 smithi149 ceph-mon[67036]: pgmap v280: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:42.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:42 smithi072 ceph-mon[78970]: pgmap v281: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:42.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:42 smithi149 ceph-mon[67036]: pgmap v281: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:44.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:44 smithi072 ceph-mon[78970]: pgmap v282: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:44.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:44 smithi149 ceph-mon[67036]: pgmap v282: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:46.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:46 smithi072 ceph-mon[78970]: pgmap v283: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:46.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:46 smithi149 ceph-mon[67036]: pgmap v283: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:48.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:48 smithi072 ceph-mon[78970]: pgmap v284: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:48.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:48 smithi149 ceph-mon[67036]: pgmap v284: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:50.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:50 smithi072 ceph-mon[78970]: pgmap v285: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:50.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:50.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:50 smithi149 ceph-mon[67036]: pgmap v285: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:50.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:12:52.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:52 smithi072 ceph-mon[78970]: pgmap v286: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:52.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:52 smithi149 ceph-mon[67036]: pgmap v286: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:54.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:54 smithi072 ceph-mon[78970]: pgmap v287: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:54.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:54 smithi149 ceph-mon[67036]: pgmap v287: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:56.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:56 smithi072 ceph-mon[78970]: pgmap v288: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:56.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:56 smithi149 ceph-mon[67036]: pgmap v288: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:58.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:12:58 smithi149 ceph-mon[67036]: pgmap v289: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:12:58.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:12:58 smithi072 ceph-mon[78970]: pgmap v289: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:00.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:00 smithi149 ceph-mon[67036]: pgmap v290: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:00.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:00 smithi072 ceph-mon[78970]: pgmap v290: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:02.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:02 smithi149 ceph-mon[67036]: pgmap v291: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:02.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:02 smithi072 ceph-mon[78970]: pgmap v291: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:04.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:04 smithi149 ceph-mon[67036]: pgmap v292: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:04.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:04 smithi072 ceph-mon[78970]: pgmap v292: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:05.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:05.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:06.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:06 smithi149 ceph-mon[67036]: pgmap v293: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:06.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:06 smithi072 ceph-mon[78970]: pgmap v293: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:08.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:08 smithi149 ceph-mon[67036]: pgmap v294: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:08.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:08 smithi072 ceph-mon[78970]: pgmap v294: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:10.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:10 smithi149 ceph-mon[67036]: pgmap v295: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:10.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:10 smithi072 ceph-mon[78970]: pgmap v295: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:12.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:12 smithi072 ceph-mon[78970]: pgmap v296: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:12.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:12 smithi149 ceph-mon[67036]: pgmap v296: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:14.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:14 smithi072 ceph-mon[78970]: pgmap v297: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:14.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:14 smithi149 ceph-mon[67036]: pgmap v297: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:15.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:15 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:13:15.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:15 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:13:16.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:16 smithi072 ceph-mon[78970]: pgmap v298: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:13:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:13:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:13:16.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:16 smithi149 ceph-mon[67036]: pgmap v298: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:16.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:13:16.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:13:16.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:13:18.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:18 smithi072 ceph-mon[78970]: pgmap v299: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:18.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:18 smithi149 ceph-mon[67036]: pgmap v299: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:20.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:20 smithi072 ceph-mon[78970]: pgmap v300: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:20.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:20.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:20 smithi149 ceph-mon[67036]: pgmap v300: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:20.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:22.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:22 smithi072 ceph-mon[78970]: pgmap v301: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:22.833 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:22 smithi149 ceph-mon[67036]: pgmap v301: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:24.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:24 smithi072 ceph-mon[78970]: pgmap v302: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:24.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:24 smithi149 ceph-mon[67036]: pgmap v302: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:26.748 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:26 smithi149 ceph-mon[67036]: pgmap v303: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:26.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:26 smithi072 ceph-mon[78970]: pgmap v303: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:28.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:28 smithi072 ceph-mon[78970]: pgmap v304: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:28.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:28 smithi149 ceph-mon[67036]: pgmap v304: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:30.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:30 smithi072 ceph-mon[78970]: pgmap v305: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:30.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:30 smithi149 ceph-mon[67036]: pgmap v305: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:32.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:32 smithi072 ceph-mon[78970]: pgmap v306: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:32.932 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:32 smithi149 ceph-mon[67036]: pgmap v306: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:34.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:34 smithi072 ceph-mon[78970]: pgmap v307: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:34.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:34 smithi149 ceph-mon[67036]: pgmap v307: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:35.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:35.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:36.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:36 smithi072 ceph-mon[78970]: pgmap v308: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:36.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:36 smithi149 ceph-mon[67036]: pgmap v308: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:37.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph orch ps' 2024-04-15T21:13:37.886 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:13:38.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:38 smithi072 ceph-mon[78970]: pgmap v309: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:38.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:38 smithi149 ceph-mon[67036]: pgmap v309: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- 172.21.15.72:0/197512636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101420 msgr2=0x7f1a601017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/197512636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101420 0x7f1a601017f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009910 tx=0x7f1a54009c20 comp rx=0 tx=0).stop 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- 172.21.15.72:0/197512636 shutdown_connections 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/197512636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101d30 0x7f1a6010a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/197512636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101420 0x7f1a601017f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- 172.21.15.72:0/197512636 >> 172.21.15.72:0/197512636 conn(0x7f1a600fac80 msgr2=0x7f1a600fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- 172.21.15.72:0/197512636 shutdown_connections 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- 172.21.15.72:0/197512636 wait complete. 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 Processor -- start 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- start start 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101420 0x7f1a600ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600ffb00 con 0x7f1a60101d30 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.534+0000 7f1a66cd5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600ffc40 con 0x7f1a60101420 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60988/0 (socket says 172.21.15.72:60988) 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 -- 172.21.15.72:0/2543358747 learned_addr learned my addr 172.21.15.72:0/2543358747 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a64a71700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101420 0x7f1a600ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 -- 172.21.15.72:0/2543358747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101420 msgr2=0x7f1a600ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101420 0x7f1a600ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 -- 172.21.15.72:0/2543358747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540095f0 con 0x7f1a60101d30 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5ffff700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00d8d0 tx=0x7f1a4c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c0098a0 con 0x7f1a60101d30 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a4c010460 con 0x7f1a60101d30 2024-04-15T21:13:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c00f5f0 con 0x7f1a60101d30 2024-04-15T21:13:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a601a2040 con 0x7f1a60101d30 2024-04-15T21:13:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.535+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a601a2450 con 0x7f1a60101d30 2024-04-15T21:13:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.536+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a60107900 con 0x7f1a60101d30 2024-04-15T21:13:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.537+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1a4c009a00 con 0x7f1a60101d30 2024-04-15T21:13:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.537+0000 7f1a5dffb700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 0x7f1a50071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.537+0000 7f1a64a71700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 0x7f1a50071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.537+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f1a4c08edd0 con 0x7f1a60101d30 2024-04-15T21:13:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.538+0000 7f1a64a71700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 0x7f1a50071170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400b5c0 tx=0x7f1a5401a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.542+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1a4c057ae0 con 0x7f1a60101d30 2024-04-15T21:13:39.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.751+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 --> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a60061190 con 0x7f1a5006ecc0 2024-04-15T21:13:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.762+0000 7f1a5dffb700 1 -- 172.21.15.72:0/2543358747 <== mgr.34100 v2:172.21.15.72:6800/992888162 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1a60061190 con 0x7f1a5006ecc0 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (2m) 95s ago 19m 16.0M - 0.25.0 c8568f914cd2 e1abb1d15468 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (3m) 95s ago 20m 8014k - 19.0.0-3084-g87dbfb63 a452a57266c7 b709183b7e33 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi149 smithi149 running (2m) 2m ago 18m 7549k - 19.0.0-3084-g87dbfb63 a452a57266c7 dcd81a36431f 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (8m) 95s ago 20m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 4a961fe39df4 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi149 smithi149 running (7m) 2m ago 18m 6665k - 19.0.0-3084-g87dbfb63 a452a57266c7 3fecf87215aa 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (100s) 95s ago 19m 54.2M - 9.4.12 2bacad6d85d8 34052ec1ac09 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.pbknte smithi072 running (4m) 95s ago 14m 14.5M - 19.0.0-3084-g87dbfb63 a452a57266c7 f6d313d325e1 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.zkrubp smithi072 running (4m) 95s ago 14m 88.5M - 19.0.0-3084-g87dbfb63 a452a57266c7 10bee94d3ad2 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.jwobda smithi149 running (3m) 2m ago 14m 12.8M - 19.0.0-3084-g87dbfb63 a452a57266c7 23acf6b85560 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi149.mflbpn smithi149 running (3m) 2m ago 14m 14.3M - 19.0.0-3084-g87dbfb63 a452a57266c7 2143ceddc939 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.wfjmmp smithi072 *:8443,9283,8765 running (10m) 95s ago 21m 522M - 19.0.0-3084-g87dbfb63 a452a57266c7 1cd9647ee280 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi149.qgbaiy smithi149 *:8443,9283,8765 running (9m) 2m ago 18m 453M - 19.0.0-3084-g87dbfb63 a452a57266c7 66402079b4b9 2024-04-15T21:13:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 95s ago 21m 56.5M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 f527ad822106 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi149 smithi149 running (8m) 2m ago 18m 44.4M 2048M 19.0.0-3084-g87dbfb63 a452a57266c7 66d6da20f3a8 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (2m) 95s ago 20m 9873k - 1.5.0 0da6a335fe13 e8d6864d11cb 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi149 smithi149 *:9100 running (2m) 2m ago 18m 3590k - 1.5.0 0da6a335fe13 0654749c9fb6 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 95s ago 17m 100M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 dc0a45b20f7b 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 95s ago 17m 105M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 1dae31080e91 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 95s ago 16m 95.6M 1216M 19.0.0-3084-g87dbfb63 a452a57266c7 2512963e56db 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi149 running (5m) 2m ago 16m 100M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 2166c959f069 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi149 running (5m) 2m ago 16m 97.3M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 8023b75068f1 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi149 running (4m) 2m ago 15m 87.7M 4096M 19.0.0-3084-g87dbfb63 a452a57266c7 de7059593537 2024-04-15T21:13:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (2m) 95s ago 19m 64.7M - 2.43.0 a07b618ecd1d 759f14010407 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 msgr2=0x7f1a50071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 0x7f1a50071170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400b5c0 tx=0x7f1a5401a040 comp rx=0 tx=0).stop 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 msgr2=0x7f1a600ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00d8d0 tx=0x7f1a4c00dbe0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 shutdown_connections 2024-04-15T21:13:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5006ecc0 0x7f1a50071170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a60101420 0x7f1a600ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 --2- 172.21.15.72:0/2543358747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a60101d30 0x7f1a600ff5c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 >> 172.21.15.72:0/2543358747 conn(0x7f1a600fac80 msgr2=0x7f1a60104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 shutdown_connections 2024-04-15T21:13:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:39.764+0000 7f1a66cd5700 1 -- 172.21.15.72:0/2543358747 wait complete. 2024-04-15T21:13:40.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph versions' 2024-04-15T21:13:40.638 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:13:40.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:40 smithi072 ceph-mon[78970]: pgmap v310: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:40.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:40 smithi072 ceph-mon[78970]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:13:40.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:40 smithi149 ceph-mon[67036]: pgmap v310: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:40.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:40 smithi149 ceph-mon[67036]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 -- 172.21.15.72:0/1183591676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ff3c0 msgr2=0x7f99cc0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 --2- 172.21.15.72:0/1183591676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc0ff790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009910 tx=0x7f99bc009c20 comp rx=0 tx=0).stop 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 -- 172.21.15.72:0/1183591676 shutdown_connections 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 --2- 172.21.15.72:0/1183591676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ffd60 0x7f99cc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 --2- 172.21.15.72:0/1183591676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc0ff790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 -- 172.21.15.72:0/1183591676 >> 172.21.15.72:0/1183591676 conn(0x7f99cc0fac80 msgr2=0x7f99cc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 -- 172.21.15.72:0/1183591676 shutdown_connections 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.265+0000 7f99d23f8700 1 -- 172.21.15.72:0/1183591676 wait complete. 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 Processor -- start 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 -- start start 2024-04-15T21:13:42.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc196a80 con 0x7f99cc0ffd60 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99d23f8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc19a810 con 0x7f99cc0ff3c0 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58748/0 (socket says 172.21.15.72:58748) 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.266+0000 7f99cb7fe700 1 -- 172.21.15.72:0/911657093 learned_addr learned my addr 172.21.15.72:0/911657093 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99cbfff700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99cb7fe700 1 -- 172.21.15.72:0/911657093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ff3c0 msgr2=0x7f99cc195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99cb7fe700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99cb7fe700 1 -- 172.21.15.72:0/911657093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0095f0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99cb7fe700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c8f0 tx=0x7f99c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c0007a50 con 0x7f99cc0ffd60 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99c0007bb0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc19aaf0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c0018630 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.267+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc19b040 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.268+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc04f2a0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.269+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f99c0007d20 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.269+0000 7f99c97fa700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 0x7f99b4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.269+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f99c008ef70 con 0x7f99cc0ffd60 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.269+0000 7f99cbfff700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 0x7f99b4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.270+0000 7f99cbfff700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 0x7f99b4071170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b5c0 tx=0x7f99bc01a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.274+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f99c0057c00 con 0x7f99cc0ffd60 2024-04-15T21:13:42.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.568+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f99cc1971c0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.568+0000 7f99c97fa700 1 -- 172.21.15.72:0/911657093 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f99c005b2c0 con 0x7f99cc0ffd60 2024-04-15T21:13:42.565 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 2 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 6 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 4 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-04-15T21:13:42.566 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)": 14 2024-04-15T21:13:42.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-15T21:13:42.567 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-15T21:13:42.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.571+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 msgr2=0x7f99b4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:42.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.571+0000 7f99d23f8700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 0x7f99b4071170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b5c0 tx=0x7f99bc01a040 comp rx=0 tx=0).stop 2024-04-15T21:13:42.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.571+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 msgr2=0x7f99cc1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.571+0000 7f99d23f8700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c8f0 tx=0x7f99c000ccb0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 shutdown_connections 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f99b406ecc0 0x7f99b4071170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99cc0ff3c0 0x7f99cc195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 --2- 172.21.15.72:0/911657093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99cc0ffd60 0x7f99cc1963a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 >> 172.21.15.72:0/911657093 conn(0x7f99cc0fac80 msgr2=0x7f99cc103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 shutdown_connections 2024-04-15T21:13:42.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:42.572+0000 7f99d23f8700 1 -- 172.21.15.72:0/911657093 wait complete. 2024-04-15T21:13:42.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:42 smithi072 ceph-mon[78970]: pgmap v311: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:42.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:42 smithi149 ceph-mon[67036]: pgmap v311: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:43.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-15T21:13:43.428 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:13:43.790 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:43 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/911657093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:43.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:43 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/911657093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:44.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:44 smithi072 ceph-mon[78970]: pgmap v312: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:44.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:44 smithi149 ceph-mon[67036]: pgmap v312: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 -- 172.21.15.72:0/2942354060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 msgr2=0x7ff4f8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2942354060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8104500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009910 tx=0x7ff4e8009c20 comp rx=0 tx=0).stop 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 -- 172.21.15.72:0/2942354060 shutdown_connections 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2942354060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 0x7ff4f8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2942354060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8104500 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 -- 172.21.15.72:0/2942354060 >> 172.21.15.72:0/2942354060 conn(0x7ff4f8075130 msgr2=0x7ff4f8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:45.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 -- 172.21.15.72:0/2942354060 shutdown_connections 2024-04-15T21:13:45.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.045+0000 7ff4fe564700 1 -- 172.21.15.72:0/2942354060 wait complete. 2024-04-15T21:13:45.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 Processor -- start 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 -- start start 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 0x7ff4f81981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8198df0 con 0x7ff4f8104130 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4fe564700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f819cb80 con 0x7ff4f80ffbd0 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58772/0 (socket says 172.21.15.72:58772) 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 -- 172.21.15.72:0/2639100376 learned_addr learned my addr 172.21.15.72:0/2639100376 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f7fff700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 0x7ff4f81981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 -- 172.21.15.72:0/2639100376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 msgr2=0x7ff4f81981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 0x7ff4f81981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.046+0000 7ff4f77fe700 1 -- 172.21.15.72:0/2639100376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80095f0 con 0x7ff4f8104130 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4f77fe700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b4b0 tx=0x7ff4ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:45.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec011800 con 0x7ff4f8104130 2024-04-15T21:13:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f819ce60 con 0x7ff4f8104130 2024-04-15T21:13:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec011e20 con 0x7ff4f8104130 2024-04-15T21:13:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec00f2e0 con 0x7ff4f8104130 2024-04-15T21:13:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.047+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f819d3b0 con 0x7ff4f8104130 2024-04-15T21:13:45.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.048+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f804f2a0 con 0x7ff4f8104130 2024-04-15T21:13:45.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.048+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff4ec010380 con 0x7ff4f8104130 2024-04-15T21:13:45.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.049+0000 7ff4f57fa700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 0x7ff4e0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:45.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.049+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff4ec08eae0 con 0x7ff4f8104130 2024-04-15T21:13:45.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.049+0000 7ff4f7fff700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 0x7ff4e0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:45.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.049+0000 7ff4f7fff700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 0x7ff4e0071170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800b5c0 tx=0x7ff4e801a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:45.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.054+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff4ec0577f0 con 0x7ff4f8104130 2024-04-15T21:13:45.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.341+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4f819d630 con 0x7ff4f8104130 2024-04-15T21:13:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.342+0000 7ff4f57fa700 1 -- 172.21.15.72:0/2639100376 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ff4ec05aeb0 con 0x7ff4f8104130 2024-04-15T21:13:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 msgr2=0x7ff4e0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 0x7ff4e0071170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800b5c0 tx=0x7ff4e801a040 comp rx=0 tx=0).stop 2024-04-15T21:13:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 msgr2=0x7ff4f8198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b4b0 tx=0x7ff4ec00b870 comp rx=0 tx=0).stop 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 shutdown_connections 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff4e006ecc0 0x7ff4e0071170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4f80ffbd0 0x7ff4f81981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 --2- 172.21.15.72:0/2639100376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f8104130 0x7ff4f8198710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 >> 172.21.15.72:0/2639100376 conn(0x7ff4f8075130 msgr2=0x7ff4f8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 shutdown_connections 2024-04-15T21:13:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:45.344+0000 7ff4fe564700 1 -- 172.21.15.72:0/2639100376 wait complete. 2024-04-15T21:13:45.351 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-04-15T21:13:45.655 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:45 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2639100376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:45.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:45 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2639100376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:45.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -e sha1=87dbfb632e974cb2c28d17423071d2d833b53b29 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-15T21:13:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:13:46.608 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:46 smithi072 ceph-mon[78970]: pgmap v313: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:46.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:46 smithi149 ceph-mon[67036]: pgmap v313: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 -- 172.21.15.72:0/3534818665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 msgr2=0x7fe5cc103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/3534818665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc103c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009910 tx=0x7fe5c8009c20 comp rx=0 tx=0).stop 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 -- 172.21.15.72:0/3534818665 shutdown_connections 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/3534818665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 0x7fe5cc0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/3534818665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc103c80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 -- 172.21.15.72:0/3534818665 >> 172.21.15.72:0/3534818665 conn(0x7fe5cc0748b0 msgr2=0x7fe5cc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 -- 172.21.15.72:0/3534818665 shutdown_connections 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 -- 172.21.15.72:0/3534818665 wait complete. 2024-04-15T21:13:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.780+0000 7fe5d3aed700 1 Processor -- start 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d3aed700 1 -- start start 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d3aed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 0x7fe5cc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d3aed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d3aed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc19b6a0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d3aed700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc194b50 con 0x7fe5cc0ff350 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58790/0 (socket says 172.21.15.72:58790) 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 -- 172.21.15.72:0/2524692156 learned_addr learned my addr 172.21.15.72:0/2524692156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1889700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 0x7fe5cc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 -- 172.21.15.72:0/2524692156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 msgr2=0x7fe5cc19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 0x7fe5cc19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 -- 172.21.15.72:0/2524692156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80095f0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5d1088700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00d8d0 tx=0x7fe5bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.781+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5bc0098a0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.782+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc194e30 con 0x7fe5cc1038b0 2024-04-15T21:13:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.782+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5bc010460 con 0x7fe5cc1038b0 2024-04-15T21:13:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.782+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5bc00f5f0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.782+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc195380 con 0x7fe5cc1038b0 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.782+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5cc04f2a0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.783+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe5bc009a00 con 0x7fe5cc1038b0 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.783+0000 7fe5c2ffd700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 0x7fe5b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.784+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe5bc08edd0 con 0x7fe5cc1038b0 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.784+0000 7fe5d1889700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 0x7fe5b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.784+0000 7fe5d1889700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 0x7fe5b8071170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8000c00 tx=0x7fe5c801a040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:47.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:47.788+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe5bc05b610 con 0x7fe5cc1038b0 2024-04-15T21:13:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.080+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5cc1955a0 con 0x7fe5cc1038b0 2024-04-15T21:13:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.081+0000 7fe5c2ffd700 1 -- 172.21.15.72:0/2524692156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe5bc05b1a0 con 0x7fe5cc1038b0 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 msgr2=0x7fe5b8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 0x7fe5b8071170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8000c00 tx=0x7fe5c801a040 comp rx=0 tx=0).stop 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 msgr2=0x7fe5cc19b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00d8d0 tx=0x7fe5bc00dbe0 comp rx=0 tx=0).stop 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 shutdown_connections 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe5b806ecc0 0x7fe5b8071170 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5cc0ff350 0x7fe5cc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 --2- 172.21.15.72:0/2524692156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5cc1038b0 0x7fe5cc19b010 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.083+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 >> 172.21.15.72:0/2524692156 conn(0x7fe5cc0748b0 msgr2=0x7fe5cc0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.084+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 shutdown_connections 2024-04-15T21:13:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:48.084+0000 7fe5d3aed700 1 -- 172.21.15.72:0/2524692156 wait complete. 2024-04-15T21:13:48.091 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-3084-g87dbfb63 (87dbfb632e974cb2c28d17423071d2d833b53b29) squid (dev)" 2024-04-15T21:13:48.809 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:48 smithi072 ceph-mon[78970]: pgmap v314: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:48.809 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:48 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2524692156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:48.833 DEBUG:teuthology.parallel:result is None 2024-04-15T21:13:48.833 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-15T21:13:48.844 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T21:13:48.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-15T21:13:48.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:48 smithi149 ceph-mon[67036]: pgmap v314: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:48.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:48 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2524692156' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-15T21:13:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/mon.smithi072/config 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 -- 172.21.15.72:0/2035698469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 msgr2=0x7f4404100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 --2- 172.21.15.72:0/2035698469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f4404100040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009910 tx=0x7f43ec009c20 comp rx=0 tx=0).stop 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 -- 172.21.15.72:0/2035698469 shutdown_connections 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 --2- 172.21.15.72:0/2035698469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f4404100040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 --2- 172.21.15.72:0/2035698469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 0x7f4404104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 -- 172.21.15.72:0/2035698469 >> 172.21.15.72:0/2035698469 conn(0x7f4404075130 msgr2=0x7f4404075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 -- 172.21.15.72:0/2035698469 shutdown_connections 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.638+0000 7f440a446700 1 -- 172.21.15.72:0/2035698469 wait complete. 2024-04-15T21:13:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 Processor -- start 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 -- start start 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 0x7f440410b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440410b790 con 0x7f44040ffbd0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f440a446700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440410b8d0 con 0x7f4404104130 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58806/0 (socket says 172.21.15.72:58806) 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 -- 172.21.15.72:0/2205570790 learned_addr learned my addr 172.21.15.72:0/2205570790 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 0x7f440410b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 -- 172.21.15.72:0/2205570790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 msgr2=0x7f440410b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 0x7f440410b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 -- 172.21.15.72:0/2205570790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0095f0 con 0x7f44040ffbd0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4403fff700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c930 tx=0x7f43f400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.639+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43f4007ad0 con 0x7f44040ffbd0 2024-04-15T21:13:50.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.640+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44041a2000 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.640+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43f4007c30 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.640+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43f4018610 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.640+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44041a2360 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.641+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440404f2a0 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.641+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f43f400f450 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.641+0000 7f4401ffb700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 0x7f43f0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.641+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f43f408f150 con 0x7f44040ffbd0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.642+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 0x7f43f0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.642+0000 7f43fbfff700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 0x7f43f0071170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00b5c0 tx=0x7f43ec005960 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.646+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f43f4057e60 con 0x7f44040ffbd0 2024-04-15T21:13:50.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:50 smithi072 ceph-mon[78970]: pgmap v315: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:50.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.897+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f44041a25b0 con 0x7f44040ffbd0 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.898+0000 7f4401ffb700 1 -- 172.21.15.72:0/2205570790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1935 (secure 0 0 0) 0x7f43f405b520 con 0x7f44040ffbd0 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:e29 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-04-15T21:13:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 29 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-04-15T20:59:24.729135+0000 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-04-15T21:10:23.323049+0000 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 84 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-15T21:13:50.896 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34402} 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:qdb_cluster leader: 34402 members: 34402 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.zkrubp{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.72:6826/4258405382,v1:172.21.15.72:6827/4258405382] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:50.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:50.898 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-04-15T21:13:50.898 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:50.898 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.pbknte{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/601346787,v1:172.21.15.72:6829/601346787] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:13:50.898 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.mflbpn{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/308089751,v1:172.21.15.149:6825/308089751] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:13:50.898 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi149.jwobda{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/2802070337,v1:172.21.15.149:6827/2802070337] compat {c=[1],r=[1],i=[1fff]}] 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 msgr2=0x7f43f0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 0x7f43f0071170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00b5c0 tx=0x7f43ec005960 comp rx=0 tx=0).stop 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 msgr2=0x7f440410ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c930 tx=0x7f43f400ccf0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 shutdown_connections 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f43f006ecc0 0x7f43f0071170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44040ffbd0 0x7f440410ad10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 --2- 172.21.15.72:0/2205570790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4404104130 0x7f440410b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 >> 172.21.15.72:0/2205570790 conn(0x7f4404075130 msgr2=0x7f44040feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 shutdown_connections 2024-04-15T21:13:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:50.900+0000 7f440a446700 1 -- 172.21.15.72:0/2205570790 wait complete. 2024-04-15T21:13:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-04-15T21:13:50.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:50 smithi149 ceph-mon[67036]: pgmap v315: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:50.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:13:51.480 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-15T21:13:51.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/1064390586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4101360 msgr2=0x7fcfc4109850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/1064390586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4101360 0x7fcfc4109850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40098b0 tx=0x7fcfb402bcd0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/1064390586 shutdown_connections 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/1064390586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4101360 0x7fcfc4109850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/1064390586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc4100a50 0x7fcfc4100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/1064390586 >> 172.21.15.72:0/1064390586 conn(0x7fcfc40fa280 msgr2=0x7fcfc40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/1064390586 shutdown_connections 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.606+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/1064390586 wait complete. 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 Processor -- start 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 -- start start 2024-04-15T21:13:51.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc4101360 0x7fcfc41959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4196060 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfcb8c4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4199e30 con 0x7fcfc4101360 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60568/0 (socket says 172.21.15.72:60568) 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 -- 172.21.15.72:0/2501130359 learned_addr learned my addr 172.21.15.72:0/2501130359 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 -- 172.21.15.72:0/2501130359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc4101360 msgr2=0x7fcfc41959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc4101360 0x7fcfc41959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 -- 172.21.15.72:0/2501130359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009560 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.607+0000 7fcfc9660640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d6f0 tx=0x7fcfc000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.608+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc0009a30 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.608+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfc00054e0 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.608+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc419a110 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.608+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc0010460 con 0x7fcfc4100a50 2024-04-15T21:13:51.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.608+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc419a670 con 0x7fcfc4100a50 2024-04-15T21:13:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.609+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc404e000 con 0x7fcfc4100a50 2024-04-15T21:13:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.609+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcfc0009b90 con 0x7fcfc4100a50 2024-04-15T21:13:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.609+0000 7fcfba7fc640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 0x7fcfb00711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.610+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fcfc008e9f0 con 0x7fcfc4100a50 2024-04-15T21:13:51.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.610+0000 7fcfc8e5f640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 0x7fcfb00711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:51.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.610+0000 7fcfc8e5f640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 0x7fcfb00711a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4036040 tx=0x7fcfb4000bc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.614+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcfc0057780 con 0x7fcfc4100a50 2024-04-15T21:13:51.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:51 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2205570790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:13:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.796+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfc4196880 con 0x7fcfc4100a50 2024-04-15T21:13:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.797+0000 7fcfba7fc640 1 -- 172.21.15.72:0/2501130359 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16902 (secure 0 0 0) 0x7fcfc0017090 con 0x7fcfc4100a50 2024-04-15T21:13:51.794 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:51.794 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":84,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T21:10:11.893595+0000","last_up_change":"2024-04-15T21:09:01.856967+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-15T20:59:23.666009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-15T20:59:23.962027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6803","nonce":2753721995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6805","nonce":2753721995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6809","nonce":2753721995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6807","nonce":2753721995}]},"public_addr":"172.21.15.72:6803/2753721995","cluster_addr":"172.21.15.72:6805/2753721995","heartbeat_back_addr":"172.21.15.72:6809/2753721995","heartbeat_front_addr":"172.21.15.72:6807/2753721995","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6811","nonce":2300338279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6813","nonce":2300338279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6817","nonce":2300338279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6815","nonce":2300338279}]},"public_addr":"172.21.15.72:6811/2300338279","cluster_addr":"172.21.15.72:6813/2300338279","heartbeat_back_addr":"172.21.15.72:6817/2300338279","heartbeat_front_addr":"172.21.15.72:6815/2300338279","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6819","nonce":3535754997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6821","nonce":3535754997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6825","nonce":3535754997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6823","nonce":3535754997}]},"public_addr":"172.21.15.72:6819/3535754997","cluster_addr":"172.21.15.72:6821/3535754997","heartbeat_back_addr":"172.21.15.72:6825/3535754997","heartbeat_front_addr":"172.21.15.72:6823/3535754997","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6801","nonce":1868623626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6803","nonce":1868623626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6807","nonce":1868623626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6805","nonce":1868623626}]},"public_addr":"172.21.15.149:6801/1868623626","cluster_addr":"172.21.15.149:6803/1868623626","heartbeat_back_addr":"172.21.15.149:6807/1868623626","heartbeat_front_addr":"172.21.15.149:6805/1868623626","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6809","nonce":2131908761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6811","nonce":2131908761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6815","nonce":2131908761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6813","nonce":2131908761}]},"public_addr":"172.21.15.149:6809/2131908761","cluster_addr":"172.21.15.149:6811/2131908761","heartbeat_back_addr":"172.21.15.149:6815/2131908761","heartbeat_front_addr":"172.21.15.149:6813/2131908761","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6817","nonce":185623514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6819","nonce":185623514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6823","nonce":185623514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6821","nonce":185623514}]},"public_addr":"172.21.15.149:6817/185623514","cluster_addr":"172.21.15.149:6819/185623514","heartbeat_back_addr":"172.21.15.149:6823/185623514","heartbeat_front_addr":"172.21.15.149:6821/185623514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6827/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.149:6825/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.149:6824/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.72:0/116112383":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6800/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.149:0/672367954":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/3638227790":"2024-04-16T21:03:31.688419+0000","172.21.15.149:6828/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/3176148571":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6827/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/633056761":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.149:0/3616555058":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/2634029415":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/2719950832":"2024-04-16T21:04:34.946072+0000","172.21.15.149:0/322745756":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.149:0/1474646985":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6826/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/2673769498":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.149:6826/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.72:0/3235340110":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2285147601":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.149:6829/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/1305982743":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/2896202514":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/3948936780":"2024-04-16T21:04:34.946072+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 msgr2=0x7fcfb00711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 0x7fcfb00711a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4036040 tx=0x7fcfb4000bc0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 msgr2=0x7fcfc4195490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d6f0 tx=0x7fcfc000dbb0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 shutdown_connections 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fcfb006ecf0 0x7fcfb00711a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfc4101360 0x7fcfc41959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 --2- 172.21.15.72:0/2501130359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc4100a50 0x7fcfc4195490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 >> 172.21.15.72:0/2501130359 conn(0x7fcfc40fa280 msgr2=0x7fcfc4104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 shutdown_connections 2024-04-15T21:13:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.799+0000 7fcfcb8c4640 1 -- 172.21.15.72:0/2501130359 wait complete. 2024-04-15T21:13:51.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T20:56:58.477159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-15T20:59:23.666009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-15T20:59:23.962027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T21:13:51.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T21:13:51.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 -- 172.21.15.72:0/3591894581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 msgr2=0x7f68ec104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 --2- 172.21.15.72:0/3591894581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec104990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009880 tx=0x7f68e802bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 -- 172.21.15.72:0/3591894581 shutdown_connections 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 --2- 172.21.15.72:0/3591894581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 0x7f68ec0fea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 --2- 172.21.15.72:0/3591894581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec104990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 -- 172.21.15.72:0/3591894581 >> 172.21.15.72:0/3591894581 conn(0x7f68ec0fa070 msgr2=0x7f68ec0fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.917+0000 7f68f3d67640 1 -- 172.21.15.72:0/3591894581 shutdown_connections 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 -- 172.21.15.72:0/3591894581 wait complete. 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 Processor -- start 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 -- start start 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 0x7f68ec194320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec194ef0 con 0x7f68ec1045c0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f3d67640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec198cc0 con 0x7f68ec0fe590 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f1302640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f1302640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60578/0 (socket says 172.21.15.72:60578) 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.918+0000 7f68f1302640 1 -- 172.21.15.72:0/214394059 learned_addr learned my addr 172.21.15.72:0/214394059 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f1b03640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 0x7f68ec194320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f1302640 1 -- 172.21.15.72:0/214394059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 msgr2=0x7f68ec194320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f1302640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 0x7f68ec194320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f1302640 1 -- 172.21.15.72:0/214394059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009560 con 0x7f68ec1045c0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f1302640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00b420 tx=0x7f68dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc011800 con 0x7f68ec1045c0 2024-04-15T21:13:51.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68dc011e20 con 0x7f68ec1045c0 2024-04-15T21:13:51.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec198fa0 con 0x7f68ec1045c0 2024-04-15T21:13:51.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc00f2e0 con 0x7f68ec1045c0 2024-04-15T21:13:51.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.919+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec199500 con 0x7f68ec1045c0 2024-04-15T21:13:51.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.920+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec04e000 con 0x7f68ec1045c0 2024-04-15T21:13:51.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.920+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f68dc010380 con 0x7f68ec1045c0 2024-04-15T21:13:51.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.921+0000 7f68e2ffd640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 0x7f68d80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:51.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.921+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f68dc08e880 con 0x7f68ec1045c0 2024-04-15T21:13:51.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.921+0000 7f68f1b03640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 0x7f68d80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:51.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.921+0000 7f68f1b03640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 0x7f68d80710e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68e8036040 tx=0x7f68e8005fd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:51.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:51.925+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f68dc057590 con 0x7f68ec1045c0 2024-04-15T21:13:51.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:51 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2205570790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-15T21:13:52.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.105+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68ec10b7b0 con 0x7f68ec1045c0 2024-04-15T21:13:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.105+0000 7f68e2ffd640 1 -- 172.21.15.72:0/214394059 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68dc055e60 con 0x7f68ec1045c0 2024-04-15T21:13:52.103 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.107+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 msgr2=0x7f68d80710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.107+0000 7f68f3d67640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 0x7f68d80710e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68e8036040 tx=0x7f68e8005fd0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.107+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 msgr2=0x7f68ec194860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.107+0000 7f68f3d67640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00b420 tx=0x7f68dc00b8e0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 shutdown_connections 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f68d806ec30 0x7f68d80710e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec1045c0 0x7f68ec194860 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 --2- 172.21.15.72:0/214394059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec0fe590 0x7f68ec194320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 >> 172.21.15.72:0/214394059 conn(0x7f68ec0fa070 msgr2=0x7f68ec0fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 shutdown_connections 2024-04-15T21:13:52.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.108+0000 7f68f3d67640 1 -- 172.21.15.72:0/214394059 wait complete. 2024-04-15T21:13:52.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-15T21:13:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- 172.21.15.72:0/1237167638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1550105680 msgr2=0x7f1550105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 --2- 172.21.15.72:0/1237167638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1550105680 0x7f1550105a50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f154c009880 tx=0x7f154c02bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- 172.21.15.72:0/1237167638 shutdown_connections 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 --2- 172.21.15.72:0/1237167638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15500ff670 0x7f15500ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 --2- 172.21.15.72:0/1237167638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1550105680 0x7f1550105a50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- 172.21.15.72:0/1237167638 >> 172.21.15.72:0/1237167638 conn(0x7f15500fb190 msgr2=0x7f15500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- 172.21.15.72:0/1237167638 shutdown_connections 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- 172.21.15.72:0/1237167638 wait complete. 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 Processor -- start 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 -- start start 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.225+0000 7f15587ca640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15587ca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1550105680 0x7f1550195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15587ca640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550195ed0 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15587ca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1550199ca0 con 0x7f1550105680 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60586/0 (socket says 172.21.15.72:60586) 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 -- 172.21.15.72:0/1390418685 learned_addr learned my addr 172.21.15.72:0/1390418685 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1555d65640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1550105680 0x7f1550195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 -- 172.21.15.72:0/1390418685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1550105680 msgr2=0x7f1550195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1550105680 0x7f1550195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 -- 172.21.15.72:0/1390418685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c009560 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f1556566640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f154c02c220 tx=0x7f154c02c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154c004520 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f154c003ab0 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154c034440 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1550199f20 con 0x7f15500ff670 2024-04-15T21:13:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.226+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155019a4a0 con 0x7f15500ff670 2024-04-15T21:13:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.227+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155004e000 con 0x7f15500ff670 2024-04-15T21:13:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.228+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f154c003c20 con 0x7f15500ff670 2024-04-15T21:13:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.228+0000 7f15477fe640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 0x7f153c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.228+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f154c0b11f0 con 0x7f15500ff670 2024-04-15T21:13:52.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.228+0000 7f1555d65640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 0x7f153c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.229+0000 7f1555d65640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 0x7f153c0710e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1550196910 tx=0x7f154000b390 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.233+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f154c079fb0 con 0x7f15500ff670 2024-04-15T21:13:52.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.411+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1550196650 con 0x7f15500ff670 2024-04-15T21:13:52.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.411+0000 7f15477fe640 1 -- 172.21.15.72:0/1390418685 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f154c07d670 con 0x7f15500ff670 2024-04-15T21:13:52.409 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:13:52.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 msgr2=0x7f153c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 0x7f153c0710e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1550196910 tx=0x7f154000b390 comp rx=0 tx=0).stop 2024-04-15T21:13:52.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 msgr2=0x7f1550195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f154c02c220 tx=0x7f154c02c7a0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 shutdown_connections 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f153c06ec30 0x7f153c0710e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1550105680 0x7f1550195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 --2- 172.21.15.72:0/1390418685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15500ff670 0x7f1550195300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.413+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 >> 172.21.15.72:0/1390418685 conn(0x7f15500fb190 msgr2=0x7f15500fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.414+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 shutdown_connections 2024-04-15T21:13:52.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.414+0000 7f15587ca640 1 -- 172.21.15.72:0/1390418685 wait complete. 2024-04-15T21:13:52.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 -- 172.21.15.72:0/2520974720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 msgr2=0x7f93900feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2520974720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f93900feac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9380009880 tx=0x7f938002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 -- 172.21.15.72:0/2520974720 shutdown_connections 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2520974720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f9390109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2520974720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f93900feac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 -- 172.21.15.72:0/2520974720 >> 172.21.15.72:0/2520974720 conn(0x7f9390073d20 msgr2=0x7f9390074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 -- 172.21.15.72:0/2520974720 shutdown_connections 2024-04-15T21:13:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.532+0000 7f9395dd5640 1 -- 172.21.15.72:0/2520974720 wait complete. 2024-04-15T21:13:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 Processor -- start 2024-04-15T21:13:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 -- start start 2024-04-15T21:13:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f93901958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390195f40 con 0x7f93900fe6f0 2024-04-15T21:13:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f9395dd5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390199d10 con 0x7f93900ff000 2024-04-15T21:13:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60610/0 (socket says 172.21.15.72:60610) 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 -- 172.21.15.72:0/2136919008 learned_addr learned my addr 172.21.15.72:0/2136919008 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938effd640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f93901958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 -- 172.21.15.72:0/2136919008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 msgr2=0x7f93901958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f93901958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.533+0000 7f938f7fe640 1 -- 172.21.15.72:0/2136919008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380009560 con 0x7f93900fe6f0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f938effd640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f93901958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f938f7fe640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f938002c220 tx=0x7f9380004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93800037c0 con 0x7f93900fe6f0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9390199f90 con 0x7f93900fe6f0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9380003de0 con 0x7f93900fe6f0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9380034440 con 0x7f93900fe6f0 2024-04-15T21:13:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.534+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939019a510 con 0x7f93900fe6f0 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.535+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939004e000 con 0x7f93900fe6f0 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.535+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9380005060 con 0x7f93900fe6f0 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.536+0000 7f938cff9640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 0x7f93780710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.536+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f93800b1430 con 0x7f93900fe6f0 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.536+0000 7f938effd640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 0x7f93780710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.536+0000 7f938effd640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 0x7f93780710e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9384006fd0 tx=0x7f9384008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.541+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f938007a140 con 0x7f93900fe6f0 2024-04-15T21:13:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.734+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f93901070e0 con 0x7f93900fe6f0 2024-04-15T21:13:52.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.735+0000 7f938cff9640 1 -- 172.21.15.72:0/2136919008 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f938007d800 con 0x7f93900fe6f0 2024-04-15T21:13:52.732 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 msgr2=0x7f93780710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 0x7f93780710e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9384006fd0 tx=0x7f9384008040 comp rx=0 tx=0).stop 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 msgr2=0x7f9390195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f938002c220 tx=0x7f9380004270 comp rx=0 tx=0).stop 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 shutdown_connections 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f937806ec30 0x7f93780710e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93900ff000 0x7f93901958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 --2- 172.21.15.72:0/2136919008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93900fe6f0 0x7f9390195370 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 >> 172.21.15.72:0/2136919008 conn(0x7f9390073d20 msgr2=0x7f93901042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 shutdown_connections 2024-04-15T21:13:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.737+0000 7f9395dd5640 1 -- 172.21.15.72:0/2136919008 wait complete. 2024-04-15T21:13:52.744 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:52 smithi072 ceph-mon[78970]: pgmap v316: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:52.744 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:52 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2501130359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:13:52.745 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:52 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/214394059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:13:52.745 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:52 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1390418685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:13:52.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.852+0000 7f5767989640 1 -- 172.21.15.72:0/2909433634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 msgr2=0x7f5760100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.852+0000 7f5767989640 1 --2- 172.21.15.72:0/2909433634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f5760100c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f57540098b0 tx=0x7f575402bd60 comp rx=0 tx=0).stop 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- 172.21.15.72:0/2909433634 shutdown_connections 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 --2- 172.21.15.72:0/2909433634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 --2- 172.21.15.72:0/2909433634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f5760100c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- 172.21.15.72:0/2909433634 >> 172.21.15.72:0/2909433634 conn(0x7f5760075270 msgr2=0x7f5760075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- 172.21.15.72:0/2909433634 shutdown_connections 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- 172.21.15.72:0/2909433634 wait complete. 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 Processor -- start 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- start start 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760195ea0 con 0x7f5760100850 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.853+0000 7f5767989640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760199c20 con 0x7f5760101160 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60628/0 (socket says 172.21.15.72:60628) 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 -- 172.21.15.72:0/288619934 learned_addr learned my addr 172.21.15.72:0/288619934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5764f24640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 -- 172.21.15.72:0/288619934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 msgr2=0x7f5760195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 -- 172.21.15.72:0/288619934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009560 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5764f24640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5765725640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5754009880 tx=0x7f575402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57540035f0 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5754003c10 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5760199ea0 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5754005690 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.854+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576019a400 con 0x7f5760100850 2024-04-15T21:13:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.855+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576004e000 con 0x7f5760100850 2024-04-15T21:13:52.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.856+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5754004ed0 con 0x7f5760100850 2024-04-15T21:13:52.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.856+0000 7f57527fc640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 0x7f574c071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:52.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.856+0000 7f5764f24640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 0x7f574c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:52.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.857+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f57540b1ad0 con 0x7f5760100850 2024-04-15T21:13:52.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.857+0000 7f5764f24640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 0x7f574c071140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5760196890 tx=0x7f575c0094d0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:52.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:52.861+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f575407a7e0 con 0x7f5760100850 2024-04-15T21:13:52.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:52 smithi149 ceph-mon[67036]: pgmap v316: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:52.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:52 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2501130359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:13:52.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:52 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/214394059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:13:52.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:52 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1390418685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:13:53.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.077+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5760106cc0 con 0x7f5760100850 2024-04-15T21:13:53.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.077+0000 7f57527fc640 1 -- 172.21.15.72:0/288619934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5207 (secure 0 0 0) 0x7f575407dea0 con 0x7f5760100850 2024-04-15T21:13:53.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:53.075 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2802070337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2802070337},{"type":"v1","addr":"172.21.15.149:6827","nonce":2802070337}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:10:23.323049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":0,"incarnation":26,"state":"up:active","state_seq":20,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34402,"qdb_cluster":[34402]},"id":1}]} 2024-04-15T21:13:53.075 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 msgr2=0x7f574c071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 0x7f574c071140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5760196890 tx=0x7f575c0094d0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 msgr2=0x7f57601952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5754009880 tx=0x7f575402c8d0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 shutdown_connections 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f574c06ec90 0x7f574c071140 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5760101160 0x7f5760195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 --2- 172.21.15.72:0/288619934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5760100850 0x7f57601952d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.079+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 >> 172.21.15.72:0/288619934 conn(0x7f5760075270 msgr2=0x7f5760103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.080+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 shutdown_connections 2024-04-15T21:13:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.080+0000 7f5767989640 1 -- 172.21.15.72:0/288619934 wait complete. 2024-04-15T21:13:53.088 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-04-15T21:13:53.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- 172.21.15.72:0/1728992859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b740fe5b0 msgr2=0x7f4b740fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1728992859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b740fe5b0 0x7f4b740fea20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009880 tx=0x7f4b5c02bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- 172.21.15.72:0/1728992859 shutdown_connections 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1728992859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b740fe5b0 0x7f4b740fea20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1728992859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74104590 0x7f4b74104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- 172.21.15.72:0/1728992859 >> 172.21.15.72:0/1728992859 conn(0x7f4b740743d0 msgr2=0x7f4b740747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- 172.21.15.72:0/1728992859 shutdown_connections 2024-04-15T21:13:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- 172.21.15.72:0/1728992859 wait complete. 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 Processor -- start 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.196+0000 7f4b79b41640 1 -- start start 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b79b41640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b740fe5b0 0x7f4b74196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b79b41640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b79b41640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74196c20 con 0x7f4b74104590 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b79b41640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74196d90 con 0x7f4b740fe5b0 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60646/0 (socket says 172.21.15.72:60646) 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 -- 172.21.15.72:0/1067640307 learned_addr learned my addr 172.21.15.72:0/1067640307 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b737fe640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b740fe5b0 0x7f4b74196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 -- 172.21.15.72:0/1067640307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b740fe5b0 msgr2=0x7f4b74196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b740fe5b0 0x7f4b74196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 -- 172.21.15.72:0/1067640307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c009560 con 0x7f4b74104590 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b6bfff640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009230 tx=0x7f4b5c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b5c0035f0 con 0x7f4b74104590 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b5c003c10 con 0x7f4b74104590 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7419f180 con 0x7f4b74104590 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.197+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b5c005670 con 0x7f4b74104590 2024-04-15T21:13:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.198+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7419f620 con 0x7f4b74104590 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.199+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7404e000 con 0x7f4b74104590 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.199+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4b5c004dd0 con 0x7f4b74104590 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.199+0000 7f4b717fa640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 0x7f4b60071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.200+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4b5c0b1260 con 0x7f4b74104590 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.200+0000 7f4b737fe640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 0x7f4b60071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.200+0000 7f4b737fe640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 0x7f4b60071090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005fd0 tx=0x7f4b6400b390 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.204+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4b5c07a020 con 0x7f4b74104590 2024-04-15T21:13:53.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.419+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f4b74196f50 con 0x7f4b74104590 2024-04-15T21:13:53.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.419+0000 7f4b717fa640 1 -- 172.21.15.72:0/1067640307 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v29) v1 ==== 107+0+4081 (secure 0 0 0) 0x7f4b5c07d6e0 con 0x7f4b74104590 2024-04-15T21:13:53.417 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:53.417 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.72:6829/4081954875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":4081954875},{"type":"v1","addr":"172.21.15.72:6829","nonce":4081954875}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T20:59:43.360239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi149.mflbpn","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6825/2041346775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2041346775},{"type":"v1","addr":"172.21.15.149:6825","nonce":2041346775}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:53.417 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.421+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 msgr2=0x7f4b60071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.421+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 0x7f4b60071090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005fd0 tx=0x7f4b6400b390 comp rx=0 tx=0).stop 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.421+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 msgr2=0x7f4b74196650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.421+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009230 tx=0x7f4b5c004040 comp rx=0 tx=0).stop 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 shutdown_connections 2024-04-15T21:13:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4b6006ebe0 0x7f4b60071090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b74104590 0x7f4b74196650 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 --2- 172.21.15.72:0/1067640307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b740fe5b0 0x7f4b74196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 >> 172.21.15.72:0/1067640307 conn(0x7f4b740743d0 msgr2=0x7f4b740fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 shutdown_connections 2024-04-15T21:13:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.422+0000 7f4b79b41640 1 -- 172.21.15.72:0/1067640307 wait complete. 2024-04-15T21:13:53.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1692849684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 msgr2=0x7f74f4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1692849684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f4105a60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009880 tx=0x7f74f002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1692849684 shutdown_connections 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1692849684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1692849684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f4105a60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1692849684 >> 172.21.15.72:0/1692849684 conn(0x7f74f40743d0 msgr2=0x7f74f40747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1692849684 shutdown_connections 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.539+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1692849684 wait complete. 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 Processor -- start 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 -- start start 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40fe640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40ff150 con 0x7f74f4105690 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74fc0bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40ff290 con 0x7f74f4067350 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74f9658640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74f9658640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60660/0 (socket says 172.21.15.72:60660) 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74f9658640 1 -- 172.21.15.72:0/1277584500 learned_addr learned my addr 172.21.15.72:0/1277584500 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.540+0000 7f74f9e59640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74f9658640 1 -- 172.21.15.72:0/1277584500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 msgr2=0x7f74f40fe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74f9658640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40fe640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74f9658640 1 -- 172.21.15.72:0/1277584500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0009560 con 0x7f74f4105690 2024-04-15T21:13:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74f9e59640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74f9658640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b420 tx=0x7f74e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4011800 con 0x7f74f4105690 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74e4011e20 con 0x7f74f4105690 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e400f2e0 con 0x7f74f4105690 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f41a1590 con 0x7f74f4105690 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.541+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f41a19b0 con 0x7f74f4105690 2024-04-15T21:13:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.542+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f404e000 con 0x7f74f4105690 2024-04-15T21:13:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.542+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f74e4010380 con 0x7f74f4105690 2024-04-15T21:13:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.543+0000 7f74eaffd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 0x7f74e00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.543+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f74e408e850 con 0x7f74f4105690 2024-04-15T21:13:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.543+0000 7f74f9e59640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 0x7f74e00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.543+0000 7f74f9e59640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 0x7f74e00710e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000c00 tx=0x7f74f002cf90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.548+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f74e4057560 con 0x7f74f4105690 2024-04-15T21:13:53.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.765+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f74f4107aa0 con 0x7f74f4105690 2024-04-15T21:13:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.765+0000 7f74eaffd640 1 -- 172.21.15.72:0/1277584500 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v29) v1 ==== 107+0+4928 (secure 0 0 0) 0x7f74e405ac20 con 0x7f74f4105690 2024-04-15T21:13:53.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:53.763 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.72:6829/4081954875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":4081954875},{"type":"v1","addr":"172.21.15.72:6829","nonce":4081954875}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T20:59:43.360239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi149.mflbpn","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6825/2041346775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2041346775},{"type":"v1","addr":"172.21.15.149:6825","nonce":2041346775}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.767+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 msgr2=0x7f74e00710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.767+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 0x7f74e00710e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000c00 tx=0x7f74f002cf90 comp rx=0 tx=0).stop 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.767+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 msgr2=0x7f74f40feb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.767+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b420 tx=0x7f74e400b8e0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 shutdown_connections 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f74e006ec30 0x7f74e00710e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f4105690 0x7f74f40feb80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 --2- 172.21.15.72:0/1277584500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f4067350 0x7f74f40fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 >> 172.21.15.72:0/1277584500 conn(0x7f74f40743d0 msgr2=0x7f74f40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 shutdown_connections 2024-04-15T21:13:53.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.768+0000 7f74fc0bd640 1 -- 172.21.15.72:0/1277584500 wait complete. 2024-04-15T21:13:53.775 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:53 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2136919008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:13:53.775 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:53 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/288619934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T21:13:53.775 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:53 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1067640307' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-15T21:13:53.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-15T21:13:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- 172.21.15.72:0/2897532392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840fe5b0 msgr2=0x7f27840fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 --2- 172.21.15.72:0/2897532392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840fe5b0 0x7f27840fea20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f276c009880 tx=0x7f276c02bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- 172.21.15.72:0/2897532392 shutdown_connections 2024-04-15T21:13:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 --2- 172.21.15.72:0/2897532392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840fe5b0 0x7f27840fea20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 --2- 172.21.15.72:0/2897532392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2784104590 0x7f2784104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- 172.21.15.72:0/2897532392 >> 172.21.15.72:0/2897532392 conn(0x7f27840743d0 msgr2=0x7f27840747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- 172.21.15.72:0/2897532392 shutdown_connections 2024-04-15T21:13:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- 172.21.15.72:0/2897532392 wait complete. 2024-04-15T21:13:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 Processor -- start 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.884+0000 7f2789550640 1 -- start start 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 0x7f27841952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784195eb0 con 0x7f2784104590 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784199c80 con 0x7f27840fe5b0 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60682/0 (socket says 172.21.15.72:60682) 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 -- 172.21.15.72:0/775003984 learned_addr learned my addr 172.21.15.72:0/775003984 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2782ffd640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 0x7f27841952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 -- 172.21.15.72:0/775003984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 msgr2=0x7f27841952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 0x7f27841952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 -- 172.21.15.72:0/775003984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c009560 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2782ffd640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 0x7f27841952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f27827fc640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276c0035f0 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784199f00 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f276c003c10 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276c005670 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.885+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278419a480 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.886+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278404e000 con 0x7f2784104590 2024-04-15T21:13:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.887+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f276c004dd0 con 0x7f2784104590 2024-04-15T21:13:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.887+0000 7f277bfff640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 0x7f2770071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.887+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f276c0b1310 con 0x7f2784104590 2024-04-15T21:13:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.887+0000 7f2782ffd640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 0x7f2770071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.888+0000 7f2782ffd640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 0x7f2770071090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2774005fd0 tx=0x7f2774009520 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:53.892+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f276c07a020 con 0x7f2784104590 2024-04-15T21:13:53.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:53 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2136919008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:13:53.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:53 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/288619934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-15T21:13:53.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:53 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1067640307' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-15T21:13:54.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.110+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f278410b820 con 0x7f2784104590 2024-04-15T21:13:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.111+0000 7f277bfff640 1 -- 172.21.15.72:0/775003984 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v29) v1 ==== 107+0+4149 (secure 0 0 0) 0x7f276c07d6e0 con 0x7f2784104590 2024-04-15T21:13:54.108 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:54.108 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T20:59:43.360239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi149.mflbpn","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6825/2041346775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2041346775},{"type":"v1","addr":"172.21.15.149:6825","nonce":2041346775}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-04-15T21:13:54.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 msgr2=0x7f2770071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 0x7f2770071090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2774005fd0 tx=0x7f2774009520 comp rx=0 tx=0).stop 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 msgr2=0x7f2784195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004040 comp rx=0 tx=0).stop 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 shutdown_connections 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f277006ebe0 0x7f2770071090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2784104590 0x7f2784195820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 --2- 172.21.15.72:0/775003984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27840fe5b0 0x7f27841952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 >> 172.21.15.72:0/775003984 conn(0x7f27840743d0 msgr2=0x7f2784067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 shutdown_connections 2024-04-15T21:13:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.113+0000 7f2789550640 1 -- 172.21.15.72:0/775003984 wait complete. 2024-04-15T21:13:54.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- 172.21.15.72:0/2110434981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 msgr2=0x7f98340ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 --2- 172.21.15.72:0/2110434981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f98340ffae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9828009880 tx=0x7f982802bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- 172.21.15.72:0/2110434981 shutdown_connections 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 --2- 172.21.15.72:0/2110434981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f98340ffae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 --2- 172.21.15.72:0/2110434981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 0x7f9834105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- 172.21.15.72:0/2110434981 >> 172.21.15.72:0/2110434981 conn(0x7f98340fb190 msgr2=0x7f98340fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- 172.21.15.72:0/2110434981 shutdown_connections 2024-04-15T21:13:54.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- 172.21.15.72:0/2110434981 wait complete. 2024-04-15T21:13:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 Processor -- start 2024-04-15T21:13:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- start start 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 0x7f9834195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834195f20 con 0x7f98340ff670 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.230+0000 7f983c139640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834199cf0 con 0x7f9834105680 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60696/0 (socket says 172.21.15.72:60696) 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 -- 172.21.15.72:0/3126938044 learned_addr learned my addr 172.21.15.72:0/3126938044 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 -- 172.21.15.72:0/3126938044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 msgr2=0x7f9834195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f98396d4640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 0x7f9834195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 0x7f9834195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 -- 172.21.15.72:0/3126938044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009560 con 0x7f98340ff670 2024-04-15T21:13:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9839ed5640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d8d0 tx=0x7f982c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c009a30 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9834199fd0 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f982c009b90 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c00f680 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.231+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983419a530 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.232+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983404e000 con 0x7f98340ff670 2024-04-15T21:13:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.233+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f982c009d00 con 0x7f98340ff670 2024-04-15T21:13:54.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.233+0000 7f9832ffd640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 0x7f981c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.233+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f982c08ed70 con 0x7f98340ff670 2024-04-15T21:13:54.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.233+0000 7f98396d4640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 0x7f981c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.233+0000 7f98396d4640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 0x7f981c0710e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9828036040 tx=0x7f9828005fd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.238+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f982c057a80 con 0x7f98340ff670 2024-04-15T21:13:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.452+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f98341966a0 con 0x7f98340ff670 2024-04-15T21:13:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.452+0000 7f9832ffd640 1 -- 172.21.15.72:0/3126938044 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v29) v1 ==== 107+0+4993 (secure 0 0 0) 0x7f982c05b140 con 0x7f98340ff670 2024-04-15T21:13:54.449 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:54.450 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T20:59:43.360239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi149.mflbpn","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.149:6825/2041346775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2041346775},{"type":"v1","addr":"172.21.15.149:6825","nonce":2041346775}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 msgr2=0x7f981c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 0x7f981c0710e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9828036040 tx=0x7f9828005fd0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 msgr2=0x7f9834195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d8d0 tx=0x7f982c00dd90 comp rx=0 tx=0).stop 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 shutdown_connections 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f981c06ec30 0x7f981c0710e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834105680 0x7f9834195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 --2- 172.21.15.72:0/3126938044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98340ff670 0x7f9834195350 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.454+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 >> 172.21.15.72:0/3126938044 conn(0x7f98340fb190 msgr2=0x7f98340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.455+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 shutdown_connections 2024-04-15T21:13:54.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.455+0000 7f983c139640 1 -- 172.21.15.72:0/3126938044 wait complete. 2024-04-15T21:13:54.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/1736258355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb0104770 msgr2=0x7f4fb0104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/1736258355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb0104770 0x7f4fb0104b40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009880 tx=0x7f4fa402bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/1736258355 shutdown_connections 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/1736258355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb00fe760 0x7f4fb00febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/1736258355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb0104770 0x7f4fb0104b40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/1736258355 >> 172.21.15.72:0/1736258355 conn(0x7f4fb00fa260 msgr2=0x7f4fb00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/1736258355 shutdown_connections 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.571+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/1736258355 wait complete. 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 Processor -- start 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 -- start start 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb0104770 0x7f4fb0195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01960c0 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb6e2f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0199e90 con 0x7f4fb0104770 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60708/0 (socket says 172.21.15.72:60708) 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 -- 172.21.15.72:0/2213076320 learned_addr learned my addr 172.21.15.72:0/2213076320 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 -- 172.21.15.72:0/2213076320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb0104770 msgr2=0x7f4fb0195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb0104770 0x7f4fb0195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 -- 172.21.15.72:0/2213076320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009560 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.572+0000 7f4fb4bcb640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fa402c220 tx=0x7f4fa402c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.573+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa4004520 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.573+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb019a110 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.573+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fa4003ab0 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.573+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa4034440 con 0x7f4fb00fe760 2024-04-15T21:13:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.573+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb019a690 con 0x7f4fb00fe760 2024-04-15T21:13:54.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.574+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb004e000 con 0x7f4fb00fe760 2024-04-15T21:13:54.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.574+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4fa4003c20 con 0x7f4fb00fe760 2024-04-15T21:13:54.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.575+0000 7f4fadffb640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 0x7f4fa00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.575+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4fa40b12a0 con 0x7f4fb00fe760 2024-04-15T21:13:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.575+0000 7f4faffff640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 0x7f4fa00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.575+0000 7f4faffff640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 0x7f4fa00710e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c005fd0 tx=0x7f4f9c005850 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.579+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4fa4079fb0 con 0x7f4fb00fe760 2024-04-15T21:13:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.795+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f4fb0066860 con 0x7f4fb00fe760 2024-04-15T21:13:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.796+0000 7f4fadffb640 1 -- 172.21.15.72:0/2213076320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v29) v1 ==== 107+0+4200 (secure 0 0 0) 0x7f4fa407d670 con 0x7f4fb00fe760 2024-04-15T21:13:54.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:54.793 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:47.947014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 msgr2=0x7f4fa00710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 0x7f4fa00710e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c005fd0 tx=0x7f4f9c005850 comp rx=0 tx=0).stop 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 msgr2=0x7f4fb01954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fa402c220 tx=0x7f4fa402c7a0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 shutdown_connections 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f4fa006ec30 0x7f4fa00710e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb0104770 0x7f4fb0195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 --2- 172.21.15.72:0/2213076320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fb00fe760 0x7f4fb01954f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 >> 172.21.15.72:0/2213076320 conn(0x7f4fb00fa260 msgr2=0x7f4fb0068400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 shutdown_connections 2024-04-15T21:13:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.798+0000 7f4fb6e2f640 1 -- 172.21.15.72:0/2213076320 wait complete. 2024-04-15T21:13:54.805 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:54 smithi072 ceph-mon[78970]: pgmap v317: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:54.805 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:54 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1277584500' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-15T21:13:54.805 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:54 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/775003984' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-15T21:13:54.805 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:54 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3126938044' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-15T21:13:54.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- 172.21.15.72:0/3751812608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 msgr2=0x7f138c105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 --2- 172.21.15.72:0/3751812608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c105a60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1384009880 tx=0x7f138402bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- 172.21.15.72:0/3751812608 shutdown_connections 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 --2- 172.21.15.72:0/3751812608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 0x7f138c0677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 --2- 172.21.15.72:0/3751812608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c105a60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- 172.21.15.72:0/3751812608 >> 172.21.15.72:0/3751812608 conn(0x7f138c0743d0 msgr2=0x7f138c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- 172.21.15.72:0/3751812608 shutdown_connections 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- 172.21.15.72:0/3751812608 wait complete. 2024-04-15T21:13:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 Processor -- start 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- start start 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 0x7f138c1953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c195fa0 con 0x7f138c105690 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.914+0000 7f1393f9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c199d70 con 0x7f138c067350 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60724/0 (socket says 172.21.15.72:60724) 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 -- 172.21.15.72:0/941425305 learned_addr learned my addr 172.21.15.72:0/941425305 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:54.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391d38640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 0x7f138c1953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 -- 172.21.15.72:0/941425305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 msgr2=0x7f138c1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 0x7f138c1953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 -- 172.21.15.72:0/941425305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384009560 con 0x7f138c105690 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1391537640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f138000ba50 tx=0x7f138000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138000cb30 con 0x7f138c105690 2024-04-15T21:13:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c19a050 con 0x7f138c105690 2024-04-15T21:13:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138000cc90 con 0x7f138c105690 2024-04-15T21:13:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1380007740 con 0x7f138c105690 2024-04-15T21:13:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.915+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c19a630 con 0x7f138c105690 2024-04-15T21:13:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.916+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c04e000 con 0x7f138c105690 2024-04-15T21:13:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.917+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1380014b90 con 0x7f138c105690 2024-04-15T21:13:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.917+0000 7f138affd640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 0x7f13740710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.917+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f138008e860 con 0x7f138c105690 2024-04-15T21:13:54.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.917+0000 7f1391d38640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 0x7f13740710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.917+0000 7f1391d38640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 0x7f13740710e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1384006010 tx=0x7f138402cf90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:54.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:54.922+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1380057620 con 0x7f138c105690 2024-04-15T21:13:54.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:54 smithi149 ceph-mon[67036]: pgmap v317: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:54 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1277584500' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-15T21:13:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:54 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/775003984' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-15T21:13:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:54 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3126938044' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-15T21:13:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.139+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f138c107aa0 con 0x7f138c105690 2024-04-15T21:13:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.139+0000 7f138affd640 1 -- 172.21.15.72:0/941425305 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v29) v1 ==== 107+0+4211 (secure 0 0 0) 0x7f138005ace0 con 0x7f138c105690 2024-04-15T21:13:55.136 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:55.137 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:47.954398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24261":{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":0,"incarnation":20,"state":"up:replay","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 msgr2=0x7f13740710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 0x7f13740710e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1384006010 tx=0x7f138402cf90 comp rx=0 tx=0).stop 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 msgr2=0x7f138c195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f138000ba50 tx=0x7f138000bf10 comp rx=0 tx=0).stop 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 shutdown_connections 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f137406ec30 0x7f13740710e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c105690 0x7f138c195910 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 --2- 172.21.15.72:0/941425305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f138c067350 0x7f138c1953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 >> 172.21.15.72:0/941425305 conn(0x7f138c0743d0 msgr2=0x7f138c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 shutdown_connections 2024-04-15T21:13:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.141+0000 7f1393f9c640 1 -- 172.21.15.72:0/941425305 wait complete. 2024-04-15T21:13:55.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-15T21:13:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 -- 172.21.15.72:0/3929579848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc0fe5b0 msgr2=0x7fa1bc0fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/3929579848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc0fe5b0 0x7fa1bc0fea20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009880 tx=0x7fa1a402bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 -- 172.21.15.72:0/3929579848 shutdown_connections 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/3929579848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc0fe5b0 0x7fa1bc0fea20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/3929579848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 -- 172.21.15.72:0/3929579848 >> 172.21.15.72:0/3929579848 conn(0x7fa1bc0fa090 msgr2=0x7fa1bc0fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 -- 172.21.15.72:0/3929579848 shutdown_connections 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.257+0000 7fa1c09d2640 1 -- 172.21.15.72:0/3929579848 wait complete. 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 Processor -- start 2024-04-15T21:13:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 -- start start 2024-04-15T21:13:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1bc0fe5b0 0x7fa1bc194200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc194dd0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1c09d2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc198ba0 con 0x7fa1bc0fe5b0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60750/0 (socket says 172.21.15.72:60750) 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 -- 172.21.15.72:0/453527346 learned_addr learned my addr 172.21.15.72:0/453527346 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 -- 172.21.15.72:0/453527346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1bc0fe5b0 msgr2=0x7fa1bc194200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1bc0fe5b0 0x7fa1bc194200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 -- 172.21.15.72:0/453527346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009560 con 0x7fa1bc1045e0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.258+0000 7fa1b3fff640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009230 tx=0x7fa1a4005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.259+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a40044a0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.259+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc198e20 con 0x7fa1bc1045e0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.259+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1a4003ab0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.259+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a40055f0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.259+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc199320 con 0x7fa1bc1045e0 2024-04-15T21:13:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.260+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc04e000 con 0x7fa1bc1045e0 2024-04-15T21:13:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.260+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa1a4004e60 con 0x7fa1bc1045e0 2024-04-15T21:13:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.260+0000 7fa1b37fe640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 0x7fa1a80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.261+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa1a40b12f0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.261+0000 7fa1ba59c640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 0x7fa1a80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.261+0000 7fa1ba59c640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 0x7fa1a80710e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0058c0 tx=0x7fa1ac005850 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.265+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa1a407a000 con 0x7fa1bc1045e0 2024-04-15T21:13:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.509+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fa1bc195550 con 0x7fa1bc1045e0 2024-04-15T21:13:55.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.510+0000 7fa1b37fe640 1 -- 172.21.15.72:0/453527346 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v29) v1 ==== 107+0+5058 (secure 0 0 0) 0x7fa1a407d6c0 con 0x7fa1bc1045e0 2024-04-15T21:13:55.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:47.954398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24261":{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":0,"incarnation":20,"state":"up:replay","state_seq":2,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 21 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 msgr2=0x7fa1a80710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 0x7fa1a80710e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0058c0 tx=0x7fa1ac005850 comp rx=0 tx=0).stop 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 msgr2=0x7fa1bc194740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009230 tx=0x7fa1a4005e50 comp rx=0 tx=0).stop 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 shutdown_connections 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa1a806ec30 0x7fa1a80710e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1bc1045e0 0x7fa1bc194740 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 --2- 172.21.15.72:0/453527346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1bc0fe5b0 0x7fa1bc194200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 >> 172.21.15.72:0/453527346 conn(0x7fa1bc0fa090 msgr2=0x7fa1bc0fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 shutdown_connections 2024-04-15T21:13:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.512+0000 7fa1c09d2640 1 -- 172.21.15.72:0/453527346 wait complete. 2024-04-15T21:13:55.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 -- 172.21.15.72:0/1324681283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e00fe590 msgr2=0x7f77e00fea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1324681283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e00fe590 0x7f77e00fea00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009880 tx=0x7f77d002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 -- 172.21.15.72:0/1324681283 shutdown_connections 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1324681283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e00fe590 0x7f77e00fea00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1324681283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77e01045c0 0x7f77e0104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 -- 172.21.15.72:0/1324681283 >> 172.21.15.72:0/1324681283 conn(0x7f77e00fa030 msgr2=0x7f77e00fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 -- 172.21.15.72:0/1324681283 shutdown_connections 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.629+0000 7f77e76e0640 1 -- 172.21.15.72:0/1324681283 wait complete. 2024-04-15T21:13:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 Processor -- start 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 -- start start 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77e00fe590 0x7f77e01952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0195de0 con 0x7f77e01045c0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e76e0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0195f50 con 0x7f77e00fe590 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60772/0 (socket says 172.21.15.72:60772) 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 -- 172.21.15.72:0/1914137367 learned_addr learned my addr 172.21.15.72:0/1914137367 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 -- 172.21.15.72:0/1914137367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77e00fe590 msgr2=0x7f77e01952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77e00fe590 0x7f77e01952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 -- 172.21.15.72:0/1914137367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009560 con 0x7f77e01045c0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.630+0000 7f77e4c7b640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009230 tx=0x7f77d0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.631+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d00035f0 con 0x7f77e01045c0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.631+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e0199d80 con 0x7f77e01045c0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.631+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77d0003c10 con 0x7f77e01045c0 2024-04-15T21:13:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.631+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d0034440 con 0x7f77e01045c0 2024-04-15T21:13:55.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.631+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e019a300 con 0x7f77e01045c0 2024-04-15T21:13:55.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.632+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e004e000 con 0x7f77e01045c0 2024-04-15T21:13:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.632+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f77d0004fd0 con 0x7f77e01045c0 2024-04-15T21:13:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.632+0000 7f77d67fc640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 0x7f77cc0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.633+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f77d00b1380 con 0x7f77e01045c0 2024-04-15T21:13:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.633+0000 7f77e547c640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 0x7f77cc0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.633+0000 7f77e547c640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 0x7f77cc0710e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00a990 tx=0x7f77dc005c70 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.637+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f77d007a090 con 0x7f77e01045c0 2024-04-15T21:13:55.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.854+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f77e01965f0 con 0x7f77e01045c0 2024-04-15T21:13:55.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.855+0000 7f77d67fc640 1 -- 172.21.15.72:0/1914137367 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v29) v1 ==== 107+0+5063 (secure 0 0 0) 0x7f77d007d750 con 0x7f77e01045c0 2024-04-15T21:13:55.852 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:55.852 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:57.532499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24261":{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":156,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:55.852 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2024-04-15T21:13:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 msgr2=0x7f77cc0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 0x7f77cc0710e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00a990 tx=0x7f77dc005c70 comp rx=0 tx=0).stop 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 msgr2=0x7f77e01957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009230 tx=0x7f77d0004040 comp rx=0 tx=0).stop 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 shutdown_connections 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f77cc06ec30 0x7f77cc0710e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e01045c0 0x7f77e01957e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 --2- 172.21.15.72:0/1914137367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77e00fe590 0x7f77e01952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 >> 172.21.15.72:0/1914137367 conn(0x7f77e00fa030 msgr2=0x7f77e00683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 shutdown_connections 2024-04-15T21:13:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.857+0000 7f77e76e0640 1 -- 172.21.15.72:0/1914137367 wait complete. 2024-04-15T21:13:55.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:55 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2213076320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-15T21:13:55.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:55 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/941425305' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-15T21:13:55.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:55 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/453527346' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-15T21:13:55.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-15T21:13:55.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:55 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2213076320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-15T21:13:55.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:55 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/941425305' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-15T21:13:55.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:55 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/453527346' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 -- 172.21.15.72:0/263558846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380fe6e0 msgr2=0x7ff8380feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/263558846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380fe6e0 0x7ff8380feab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009880 tx=0x7ff82c02bd10 comp rx=0 tx=0).stop 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 -- 172.21.15.72:0/263558846 shutdown_connections 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/263558846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8380feff0 0x7ff838109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/263558846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380fe6e0 0x7ff8380feab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 -- 172.21.15.72:0/263558846 >> 172.21.15.72:0/263558846 conn(0x7ff838074cf0 msgr2=0x7ff8380750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 -- 172.21.15.72:0/263558846 shutdown_connections 2024-04-15T21:13:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.972+0000 7ff83f5c0640 1 -- 172.21.15.72:0/263558846 wait complete. 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 Processor -- start 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 -- start start 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8380fe6e0 0x7ff838195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838195f60 con 0x7ff8380feff0 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83f5c0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838199d30 con 0x7ff8380fe6e0 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60788/0 (socket says 172.21.15.72:60788) 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 -- 172.21.15.72:0/2037389138 learned_addr learned my addr 172.21.15.72:0/2037389138 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 -- 172.21.15.72:0/2037389138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8380fe6e0 msgr2=0x7ff838195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8380fe6e0 0x7ff838195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 -- 172.21.15.72:0/2037389138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009560 con 0x7ff8380feff0 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.973+0000 7ff83cb5b640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff83400b3d0 tx=0x7ff83400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.974+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff834011800 con 0x7ff8380feff0 2024-04-15T21:13:55.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.974+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff834011e20 con 0x7ff8380feff0 2024-04-15T21:13:55.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.974+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83819a010 con 0x7ff8380feff0 2024-04-15T21:13:55.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.974+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff83400f510 con 0x7ff8380feff0 2024-04-15T21:13:55.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.974+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83819a5f0 con 0x7ff8380feff0 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.975+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83804e000 con 0x7ff8380feff0 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.975+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff834010380 con 0x7ff8380feff0 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.976+0000 7ff82a7fc640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 0x7ff8240710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.976+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff83408ec50 con 0x7ff8380feff0 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.976+0000 7ff83d35c640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 0x7ff8240710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:55.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.976+0000 7ff83d35c640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 0x7ff8240710e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036040 tx=0x7ff82c000bc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:55.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:55.980+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff834057960 con 0x7ff8380feff0 2024-04-15T21:13:56.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.195+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7ff8381070d0 con 0x7ff8380feff0 2024-04-15T21:13:56.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.196+0000 7ff82a7fc640 1 -- 172.21.15.72:0/2037389138 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v29) v1 ==== 107+0+5060 (secure 0 0 0) 0x7ff83405b020 con 0x7ff8380feff0 2024-04-15T21:13:56.194 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:56.194 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:57.566420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24261":{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":157,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 msgr2=0x7ff8240710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 0x7ff8240710e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036040 tx=0x7ff82c000bc0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 msgr2=0x7ff8381958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff83400b3d0 tx=0x7ff83400b890 comp rx=0 tx=0).stop 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 shutdown_connections 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff82406ec30 0x7ff8240710e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8380feff0 0x7ff8381958d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 --2- 172.21.15.72:0/2037389138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8380fe6e0 0x7ff838195390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 >> 172.21.15.72:0/2037389138 conn(0x7ff838074cf0 msgr2=0x7ff8381042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 shutdown_connections 2024-04-15T21:13:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.198+0000 7ff83f5c0640 1 -- 172.21.15.72:0/2037389138 wait complete. 2024-04-15T21:13:56.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-15T21:13:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 -- 172.21.15.72:0/214119164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e80fe7f0 msgr2=0x7fe4e80fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 --2- 172.21.15.72:0/214119164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e80fe7f0 0x7fe4e80fec60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009880 tx=0x7fe4d002bd10 comp rx=0 tx=0).stop 2024-04-15T21:13:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 -- 172.21.15.72:0/214119164 shutdown_connections 2024-04-15T21:13:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 --2- 172.21.15.72:0/214119164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e80fe7f0 0x7fe4e80fec60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 --2- 172.21.15.72:0/214119164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4e8104800 0x7fe4e8104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 -- 172.21.15.72:0/214119164 >> 172.21.15.72:0/214119164 conn(0x7fe4e80fa2f0 msgr2=0x7fe4e80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 -- 172.21.15.72:0/214119164 shutdown_connections 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.313+0000 7fe4ed916640 1 -- 172.21.15.72:0/214119164 wait complete. 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 Processor -- start 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 -- start start 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4e80fe7f0 0x7fe4e819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e819e200 con 0x7fe4e8104800 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4ed916640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81976c0 con 0x7fe4e80fe7f0 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60804/0 (socket says 172.21.15.72:60804) 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 -- 172.21.15.72:0/743669164 learned_addr learned my addr 172.21.15.72:0/743669164 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 -- 172.21.15.72:0/743669164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4e80fe7f0 msgr2=0x7fe4e819d630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4e80fe7f0 0x7fe4e819d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.314+0000 7fe4dffff640 1 -- 172.21.15.72:0/743669164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0009560 con 0x7fe4e8104800 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4dffff640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009230 tx=0x7fe4d0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d00035f0 con 0x7fe4e8104800 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e8197910 con 0x7fe4e8104800 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d0003c10 con 0x7fe4e8104800 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d00344e0 con 0x7fe4e8104800 2024-04-15T21:13:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.315+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e8197e70 con 0x7fe4e8104800 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.316+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e804e000 con 0x7fe4e8104800 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.316+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe4d0004f60 con 0x7fe4e8104800 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.317+0000 7fe4ec914640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 0x7fe4d40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.317+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe4d00b1b90 con 0x7fe4e8104800 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.317+0000 7fe4e6ffd640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 0x7fe4d40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.317+0000 7fe4e6ffd640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 0x7fe4d40710e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80ff930 tx=0x7fe4d8006bd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.321+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe4d007a8a0 con 0x7fe4e8104800 2024-04-15T21:13:56.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.536+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fe4e810ba60 con 0x7fe4e8104800 2024-04-15T21:13:56.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.537+0000 7fe4ec914640 1 -- 172.21.15.72:0/743669164 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v29) v1 ==== 107+0+5069 (secure 0 0 0) 0x7fe4d007a020 con 0x7fe4e8104800 2024-04-15T21:13:56.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:56.535 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:09:59.570537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24261":{"gid":24261,"name":"cephfs.smithi149.jwobda","rank":0,"incarnation":20,"state":"up:active","state_seq":158,"addr":"172.21.15.149:6827/725234987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":725234987},{"type":"v1","addr":"172.21.15.149:6827","nonce":725234987}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24261,"qdb_cluster":[24261]},"id":1}]} 2024-04-15T21:13:56.535 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2024-04-15T21:13:56.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 msgr2=0x7fe4d40710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 0x7fe4d40710e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80ff930 tx=0x7fe4d8006bd0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 msgr2=0x7fe4e819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009230 tx=0x7fe4d0004040 comp rx=0 tx=0).stop 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 shutdown_connections 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fe4d406ec30 0x7fe4d40710e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8104800 0x7fe4e819db70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 --2- 172.21.15.72:0/743669164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4e80fe7f0 0x7fe4e819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 >> 172.21.15.72:0/743669164 conn(0x7fe4e80fa2f0 msgr2=0x7fe4e80684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 shutdown_connections 2024-04-15T21:13:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.539+0000 7fe4ed916640 1 -- 172.21.15.72:0/743669164 wait complete. 2024-04-15T21:13:56.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-15T21:13:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 -- 172.21.15.72:0/2184032783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 msgr2=0x7f8024104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 --2- 172.21.15.72:0/2184032783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024104960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8020009880 tx=0x7f802002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 -- 172.21.15.72:0/2184032783 shutdown_connections 2024-04-15T21:13:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 --2- 172.21.15.72:0/2184032783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f80240fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 --2- 172.21.15.72:0/2184032783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024104960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 -- 172.21.15.72:0/2184032783 >> 172.21.15.72:0/2184032783 conn(0x7f80240743d0 msgr2=0x7f80240747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 -- 172.21.15.72:0/2184032783 shutdown_connections 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 -- 172.21.15.72:0/2184032783 wait complete. 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.655+0000 7f802c792640 1 Processor -- start 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 -- start start 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f8024195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024195ef0 con 0x7f8024104590 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024199cc0 con 0x7f80240fe5b0 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60822/0 (socket says 172.21.15.72:60822) 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 -- 172.21.15.72:0/3518410389 learned_addr learned my addr 172.21.15.72:0/3518410389 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802a52e640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f8024195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 -- 172.21.15.72:0/3518410389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 msgr2=0x7f8024195320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f8024195320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 -- 172.21.15.72:0/3518410389 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020009560 con 0x7f8024104590 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802a52e640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f8024195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f8029d2d640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f801400d6f0 tx=0x7f801400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8014009a30 con 0x7f8024104590 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80140054e0 con 0x7f8024104590 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8024199fa0 con 0x7f8024104590 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8014010460 con 0x7f8024104590 2024-04-15T21:13:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.656+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802419a500 con 0x7f8024104590 2024-04-15T21:13:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.657+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802404e000 con 0x7f8024104590 2024-04-15T21:13:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.658+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8014009b90 con 0x7f8024104590 2024-04-15T21:13:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.658+0000 7f801b7fe640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 0x7f80100710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.658+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f801408e9f0 con 0x7f8024104590 2024-04-15T21:13:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.658+0000 7f802a52e640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 0x7f80100710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.659+0000 7f802a52e640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 0x7f80100710e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8020000c00 tx=0x7f802002cb40 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:56.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.663+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8014057780 con 0x7f8024104590 2024-04-15T21:13:56.847 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:56 smithi149 ceph-mon[67036]: pgmap v318: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:56.847 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:56 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1914137367' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-15T21:13:56.847 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:56 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2037389138' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-15T21:13:56.847 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:56 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/743669164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-15T21:13:56.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.881+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f8024196670 con 0x7f8024104590 2024-04-15T21:13:56.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.882+0000 7f801b7fe640 1 -- 172.21.15.72:0/3518410389 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v29) v1 ==== 107+0+4268 (secure 0 0 0) 0x7f8014017090 con 0x7f8024104590 2024-04-15T21:13:56.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:56.880 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:10:11.893849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:56.880 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-04-15T21:13:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 msgr2=0x7f80100710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 0x7f80100710e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8020000c00 tx=0x7f802002cb40 comp rx=0 tx=0).stop 2024-04-15T21:13:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 msgr2=0x7f8024195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f801400d6f0 tx=0x7f801400dbb0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 shutdown_connections 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f801006ec30 0x7f80100710e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8024104590 0x7f8024195860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 --2- 172.21.15.72:0/3518410389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80240fe5b0 0x7f8024195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 >> 172.21.15.72:0/3518410389 conn(0x7f80240743d0 msgr2=0x7f8024067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 shutdown_connections 2024-04-15T21:13:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.884+0000 7f802c792640 1 -- 172.21.15.72:0/3518410389 wait complete. 2024-04-15T21:13:56.892 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:56 smithi072 ceph-mon[78970]: pgmap v318: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:56.892 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:56 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1914137367' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-15T21:13:56.892 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:56 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2037389138' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-15T21:13:56.892 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:56 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/743669164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-15T21:13:56.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-15T21:13:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 -- 172.21.15.72:0/3829435550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 msgr2=0x7fa6640fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 --2- 172.21.15.72:0/3829435550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6640fec60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa654009880 tx=0x7fa65402bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 -- 172.21.15.72:0/3829435550 shutdown_connections 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 --2- 172.21.15.72:0/3829435550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6640fec60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 --2- 172.21.15.72:0/3829435550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 0x7fa664104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 -- 172.21.15.72:0/3829435550 >> 172.21.15.72:0/3829435550 conn(0x7fa6640fa2f0 msgr2=0x7fa6640fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 -- 172.21.15.72:0/3829435550 shutdown_connections 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:56.999+0000 7fa66c578640 1 -- 172.21.15.72:0/3829435550 wait complete. 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 Processor -- start 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 -- start start 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 0x7fa6641969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664196fb0 con 0x7fa6640fe7f0 2024-04-15T21:13:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66c578640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664197120 con 0x7fa664104800 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60836/0 (socket says 172.21.15.72:60836) 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 -- 172.21.15.72:0/2778042882 learned_addr learned my addr 172.21.15.72:0/2778042882 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 -- 172.21.15.72:0/2778042882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 msgr2=0x7fa6641969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa669b13640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 0x7fa6641969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 0x7fa6641969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 -- 172.21.15.72:0/2778042882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009560 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.000+0000 7fa66a314640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa66000b3d0 tx=0x7fa66000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.001+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa660011800 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.001+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa660011e20 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.001+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66000f510 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.001+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66419f510 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.001+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66419fa10 con 0x7fa6640fe7f0 2024-04-15T21:13:57.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.002+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66404e000 con 0x7fa6640fe7f0 2024-04-15T21:13:57.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.002+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa660010380 con 0x7fa6640fe7f0 2024-04-15T21:13:57.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.002+0000 7fa65b7fe640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 0x7fa6500710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.003+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa66008eb10 con 0x7fa6640fe7f0 2024-04-15T21:13:57.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.003+0000 7fa669b13640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 0x7fa6500710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.003+0000 7fa669b13640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 0x7fa6500710e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa654036040 tx=0x7fa654005fd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.007+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa6600578a0 con 0x7fa6640fe7f0 2024-04-15T21:13:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.224+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fa664066860 con 0x7fa6640fe7f0 2024-04-15T21:13:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.224+0000 7fa65b7fe640 1 -- 172.21.15.72:0/2778042882 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v29) v1 ==== 107+0+4347 (secure 0 0 0) 0x7fa660057070 con 0x7fa6640fe7f0 2024-04-15T21:13:57.223 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:57.223 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:10:11.898325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 msgr2=0x7fa6500710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 0x7fa6500710e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa654036040 tx=0x7fa654005fd0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 msgr2=0x7fa6641964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa66000b3d0 tx=0x7fa66000b890 comp rx=0 tx=0).stop 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 shutdown_connections 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fa65006ec30 0x7fa6500710e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa664104800 0x7fa6641969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 --2- 172.21.15.72:0/2778042882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6640fe7f0 0x7fa6641964a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 >> 172.21.15.72:0/2778042882 conn(0x7fa6640fa2f0 msgr2=0x7fa6640fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 shutdown_connections 2024-04-15T21:13:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.226+0000 7fa66c578640 1 -- 172.21.15.72:0/2778042882 wait complete. 2024-04-15T21:13:57.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 -- 172.21.15.72:0/3434854867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 msgr2=0x7f72b80feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 --2- 172.21.15.72:0/3434854867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b80feab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009880 tx=0x7f72ac02bd30 comp rx=0 tx=0).stop 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 -- 172.21.15.72:0/3434854867 shutdown_connections 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 --2- 172.21.15.72:0/3434854867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72b80feff0 0x7f72b8109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 --2- 172.21.15.72:0/3434854867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b80feab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 -- 172.21.15.72:0/3434854867 >> 172.21.15.72:0/3434854867 conn(0x7f72b8074cf0 msgr2=0x7f72b80750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 -- 172.21.15.72:0/3434854867 shutdown_connections 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.342+0000 7f72bf77e640 1 -- 172.21.15.72:0/3434854867 wait complete. 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 Processor -- start 2024-04-15T21:13:57.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 -- start start 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72b80feff0 0x7f72b8195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8195e00 con 0x7f72b80fe6e0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bf77e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8199bd0 con 0x7f72b80feff0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60856/0 (socket says 172.21.15.72:60856) 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 -- 172.21.15.72:0/2541494820 learned_addr learned my addr 172.21.15.72:0/2541494820 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 -- 172.21.15.72:0/2541494820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72b80feff0 msgr2=0x7f72b8195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72b80feff0 0x7f72b8195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 -- 172.21.15.72:0/2541494820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac009560 con 0x7f72b80fe6e0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72bd51a640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009230 tx=0x7f72ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.343+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ac0037c0 con 0x7f72b80fe6e0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.344+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72ac005d50 con 0x7f72b80fe6e0 2024-04-15T21:13:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.344+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8199e50 con 0x7f72b80fe6e0 2024-04-15T21:13:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.344+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ac034440 con 0x7f72b80fe6e0 2024-04-15T21:13:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.344+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b819a430 con 0x7f72b80fe6e0 2024-04-15T21:13:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.345+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b804e000 con 0x7f72b80fe6e0 2024-04-15T21:13:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.345+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f72ac004f60 con 0x7f72b80fe6e0 2024-04-15T21:13:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.345+0000 7f72aa7fc640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 0x7f72a40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.346+0000 7f72bcd19640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 0x7f72a40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.346+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f72ac0b12c0 con 0x7f72b80fe6e0 2024-04-15T21:13:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.346+0000 7f72bcd19640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 0x7f72a40710e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72b4005fd0 tx=0x7f72b4005850 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.350+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f72ac079fd0 con 0x7f72b80fe6e0 2024-04-15T21:13:57.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.568+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f72b81070d0 con 0x7f72b80fe6e0 2024-04-15T21:13:57.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.568+0000 7f72aa7fc640 1 -- 172.21.15.72:0/2541494820 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v29) v1 ==== 107+0+4351 (secure 0 0 0) 0x7f72ac09ce60 con 0x7f72b80fe6e0 2024-04-15T21:13:57.567 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:57.567 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:10:20.992918+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:57.567 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 msgr2=0x7f72a40710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 0x7f72a40710e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72b4005fd0 tx=0x7f72b4005850 comp rx=0 tx=0).stop 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 msgr2=0x7f72b8195230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009230 tx=0x7f72ac004270 comp rx=0 tx=0).stop 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 shutdown_connections 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f72a406ec30 0x7f72a40710e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72b80feff0 0x7f72b8195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 --2- 172.21.15.72:0/2541494820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72b80fe6e0 0x7f72b8195230 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 >> 172.21.15.72:0/2541494820 conn(0x7f72b8074cf0 msgr2=0x7f72b81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 shutdown_connections 2024-04-15T21:13:57.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.571+0000 7f72bf77e640 1 -- 172.21.15.72:0/2541494820 wait complete. 2024-04-15T21:13:57.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-15T21:13:57.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 -- 172.21.15.72:0/1705753264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0fe810 msgr2=0x7fb11c0febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1705753264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0fe810 0x7fb11c0febe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb110009880 tx=0x7fb11002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 -- 172.21.15.72:0/1705753264 shutdown_connections 2024-04-15T21:13:57.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1705753264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb11c0ff120 0x7fb11c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1705753264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0fe810 0x7fb11c0febe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 -- 172.21.15.72:0/1705753264 >> 172.21.15.72:0/1705753264 conn(0x7fb11c0fa270 msgr2=0x7fb11c0fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 -- 172.21.15.72:0/1705753264 shutdown_connections 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.692+0000 7fb122eb4640 1 -- 172.21.15.72:0/1705753264 wait complete. 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 Processor -- start 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 -- start start 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb11c0fe810 0x7fb11c1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c19ba70 con 0x7fb11c0ff120 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb122eb4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c19bbb0 con 0x7fb11c0fe810 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60868/0 (socket says 172.21.15.72:60868) 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 -- 172.21.15.72:0/1523272952 learned_addr learned my addr 172.21.15.72:0/1523272952 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 -- 172.21.15.72:0/1523272952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb11c0fe810 msgr2=0x7fb11c1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb11c0fe810 0x7fb11c1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 -- 172.21.15.72:0/1523272952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110009560 con 0x7fb11c0ff120 2024-04-15T21:13:57.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.693+0000 7fb11bfff640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb10800b420 tx=0x7fb10800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.694+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb108011800 con 0x7fb11c0ff120 2024-04-15T21:13:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.694+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11c19be90 con 0x7fb11c0ff120 2024-04-15T21:13:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.694+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb108011e20 con 0x7fb11c0ff120 2024-04-15T21:13:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.694+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10800f2e0 con 0x7fb11c0ff120 2024-04-15T21:13:57.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.694+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c19c3f0 con 0x7fb11c0ff120 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.695+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c04e000 con 0x7fb11c0ff120 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.695+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb108010380 con 0x7fb11c0ff120 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.695+0000 7fb119ffb640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 0x7fb10c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.696+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb10808e880 con 0x7fb11c0ff120 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.696+0000 7fb120c50640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 0x7fb10c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:57.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.696+0000 7fb120c50640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 0x7fb10c0710e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb110036040 tx=0x7fb110000bc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:57.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.700+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb108057590 con 0x7fb11c0ff120 2024-04-15T21:13:57.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:57 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3518410389' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-15T21:13:57.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:57 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2778042882' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-15T21:13:57.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.929+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb11c19cfa0 con 0x7fb11c0ff120 2024-04-15T21:13:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.930+0000 7fb119ffb640 1 -- 172.21.15.72:0/1523272952 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v29) v1 ==== 107+0+5198 (secure 0 0 0) 0x7fb108055e60 con 0x7fb11c0ff120 2024-04-15T21:13:57.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:57.928 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi072.pbknte","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/601346787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":601346787},{"type":"v1","addr":"172.21.15.72:6829","nonce":601346787}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44277,"name":"cephfs.smithi149.mflbpn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/308089751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":308089751},{"type":"v1","addr":"172.21.15.149:6825","nonce":308089751}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi149.jwobda","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/2802070337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":2802070337},{"type":"v1","addr":"172.21.15.149:6827","nonce":2802070337}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T20:59:24.729135+0000","modified":"2024-04-15T21:10:21.315385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi072.zkrubp","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.72:6827/4258405382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4258405382},{"type":"v1","addr":"172.21.15.72:6827","nonce":4258405382}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-15T21:13:57.929 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 28 2024-04-15T21:13:57.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 msgr2=0x7fb10c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 0x7fb10c0710e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb110036040 tx=0x7fb110000bc0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 msgr2=0x7fb11c1a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb10800b420 tx=0x7fb10800b8e0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 shutdown_connections 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7fb10c06ec30 0x7fb10c0710e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb11c0ff120 0x7fb11c1a1fd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 --2- 172.21.15.72:0/1523272952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb11c0fe810 0x7fb11c1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 >> 172.21.15.72:0/1523272952 conn(0x7fb11c0fa270 msgr2=0x7fb11c10fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 shutdown_connections 2024-04-15T21:13:57.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:57.932+0000 7fb122eb4640 1 -- 172.21.15.72:0/1523272952 wait complete. 2024-04-15T21:13:57.941 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-15T21:13:57.952 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-15T21:13:57.952 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T21:13:57.952 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T21:13:57.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:57 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3518410389' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-15T21:13:57.953 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:57 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2778042882' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-15T21:13:57.970 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T21:13:57.970 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T21:13:58.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 -- 172.21.15.72:0/169379051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 msgr2=0x7f0af80fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/169379051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af80fec30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009880 tx=0x7f0ae002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 -- 172.21.15.72:0/169379051 shutdown_connections 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/169379051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af80fec30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/169379051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.171+0000 7f0afc9d5640 1 -- 172.21.15.72:0/169379051 >> 172.21.15.72:0/169379051 conn(0x7f0af80fa2a0 msgr2=0x7f0af80fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.172+0000 7f0afc9d5640 1 -- 172.21.15.72:0/169379051 shutdown_connections 2024-04-15T21:13:58.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.172+0000 7f0afc9d5640 1 -- 172.21.15.72:0/169379051 wait complete. 2024-04-15T21:13:58.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.172+0000 7f0afc9d5640 1 Processor -- start 2024-04-15T21:13:58.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.172+0000 7f0afc9d5640 1 -- start start 2024-04-15T21:13:58.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8196e90 con 0x7f0af80fe7c0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8196fd0 con 0x7f0af81047d0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60894/0 (socket says 172.21.15.72:60894) 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 -- 172.21.15.72:0/3539780292 learned_addr learned my addr 172.21.15.72:0/3539780292 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0aedd9b640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 -- 172.21.15.72:0/3539780292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 msgr2=0x7f0af8196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 -- 172.21.15.72:0/3539780292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0009560 con 0x7f0af80fe7c0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0aedd9b640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0af659c640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800d8d0 tx=0x7f0ae800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8009a30 con 0x7f0af80fe7c0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af819f3a0 con 0x7f0af80fe7c0 2024-04-15T21:13:58.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ae8009b90 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae800f680 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.173+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af819f870 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.174+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af804e000 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.175+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ae8009d00 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.175+0000 7f0aeffff640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 0x7f0ae40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.175+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f0ae808ed70 con 0x7f0af80fe7c0 2024-04-15T21:13:58.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.175+0000 7f0aedd9b640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 0x7f0ae40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.176+0000 7f0aedd9b640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 0x7f0ae40711a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0af8068c80 tx=0x7f0ae002cb40 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.180+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0ae8057a80 con 0x7f0af80fe7c0 2024-04-15T21:13:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.360+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af8066860 con 0x7f0af80fe7c0 2024-04-15T21:13:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.361+0000 7f0aeffff640 1 -- 172.21.15.72:0/3539780292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16902 (secure 0 0 0) 0x7f0ae805b140 con 0x7f0af80fe7c0 2024-04-15T21:13:58.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":84,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T21:10:11.893595+0000","last_up_change":"2024-04-15T21:09:01.856967+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-15T20:59:23.666009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-15T20:59:23.962027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6803","nonce":2753721995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6805","nonce":2753721995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6809","nonce":2753721995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6807","nonce":2753721995}]},"public_addr":"172.21.15.72:6803/2753721995","cluster_addr":"172.21.15.72:6805/2753721995","heartbeat_back_addr":"172.21.15.72:6809/2753721995","heartbeat_front_addr":"172.21.15.72:6807/2753721995","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6811","nonce":2300338279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6813","nonce":2300338279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6817","nonce":2300338279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6815","nonce":2300338279}]},"public_addr":"172.21.15.72:6811/2300338279","cluster_addr":"172.21.15.72:6813/2300338279","heartbeat_back_addr":"172.21.15.72:6817/2300338279","heartbeat_front_addr":"172.21.15.72:6815/2300338279","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6819","nonce":3535754997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6821","nonce":3535754997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6825","nonce":3535754997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6823","nonce":3535754997}]},"public_addr":"172.21.15.72:6819/3535754997","cluster_addr":"172.21.15.72:6821/3535754997","heartbeat_back_addr":"172.21.15.72:6825/3535754997","heartbeat_front_addr":"172.21.15.72:6823/3535754997","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6801","nonce":1868623626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6803","nonce":1868623626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6807","nonce":1868623626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6805","nonce":1868623626}]},"public_addr":"172.21.15.149:6801/1868623626","cluster_addr":"172.21.15.149:6803/1868623626","heartbeat_back_addr":"172.21.15.149:6807/1868623626","heartbeat_front_addr":"172.21.15.149:6805/1868623626","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6809","nonce":2131908761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6811","nonce":2131908761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6815","nonce":2131908761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6813","nonce":2131908761}]},"public_addr":"172.21.15.149:6809/2131908761","cluster_addr":"172.21.15.149:6811/2131908761","heartbeat_back_addr":"172.21.15.149:6815/2131908761","heartbeat_front_addr":"172.21.15.149:6813/2131908761","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6817","nonce":185623514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6819","nonce":185623514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6823","nonce":185623514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6821","nonce":185623514}]},"public_addr":"172.21.15.149:6817/185623514","cluster_addr":"172.21.15.149:6819/185623514","heartbeat_back_addr":"172.21.15.149:6823/185623514","heartbeat_front_addr":"172.21.15.149:6821/185623514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6827/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.149:6825/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.149:6824/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.72:0/116112383":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6800/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.149:0/672367954":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/3638227790":"2024-04-16T21:03:31.688419+0000","172.21.15.149:6828/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/3176148571":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6827/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/633056761":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.149:0/3616555058":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/2634029415":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/2719950832":"2024-04-16T21:04:34.946072+0000","172.21.15.149:0/322745756":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.149:0/1474646985":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6826/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/2673769498":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.149:6826/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.72:0/3235340110":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2285147601":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.149:6829/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/1305982743":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/2896202514":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/3948936780":"2024-04-16T21:04:34.946072+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T21:13:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 msgr2=0x7f0ae40711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 0x7f0ae40711a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0af8068c80 tx=0x7f0ae002cb40 comp rx=0 tx=0).stop 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 msgr2=0x7f0af8196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800d8d0 tx=0x7f0ae800dd90 comp rx=0 tx=0).stop 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 shutdown_connections 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f0ae406ecf0 0x7f0ae40711a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0af81047d0 0x7f0af8196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 --2- 172.21.15.72:0/3539780292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af80fe7c0 0x7f0af8196330 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 >> 172.21.15.72:0/3539780292 conn(0x7f0af80fa2a0 msgr2=0x7f0af80fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 shutdown_connections 2024-04-15T21:13:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.363+0000 7f0afc9d5640 1 -- 172.21.15.72:0/3539780292 wait complete. 2024-04-15T21:13:58.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T20:56:58.477159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-15T20:59:23.666009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-15T20:59:23.962027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T21:13:58.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T21:13:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- 172.21.15.72:0/3989624900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95600fe5b0 msgr2=0x7f95600fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 --2- 172.21.15.72:0/3989624900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95600fe5b0 0x7f95600fea20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9550009880 tx=0x7f955002bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- 172.21.15.72:0/3989624900 shutdown_connections 2024-04-15T21:13:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 --2- 172.21.15.72:0/3989624900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95600fe5b0 0x7f95600fea20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 --2- 172.21.15.72:0/3989624900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9560104590 0x7f9560104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- 172.21.15.72:0/3989624900 >> 172.21.15.72:0/3989624900 conn(0x7f95600743d0 msgr2=0x7f95600747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- 172.21.15.72:0/3989624900 shutdown_connections 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- 172.21.15.72:0/3989624900 wait complete. 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 Processor -- start 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 -- start start 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600fe5b0 0x7f9560194330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.485+0000 7f95674e0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95674e0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560194f00 con 0x7f9560104590 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95674e0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560198cd0 con 0x7f95600fe5b0 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60918/0 (socket says 172.21.15.72:60918) 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 -- 172.21.15.72:0/627695140 learned_addr learned my addr 172.21.15.72:0/627695140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:58.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f956527c640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600fe5b0 0x7f9560194330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 -- 172.21.15.72:0/627695140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600fe5b0 msgr2=0x7f9560194330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600fe5b0 0x7f9560194330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 -- 172.21.15.72:0/627695140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9550009560 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f9564a7b640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9550009230 tx=0x7f9550004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95500035f0 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9550003c10 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9560198f50 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9550034440 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.486+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9560199450 con 0x7f9560104590 2024-04-15T21:13:58.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.487+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956004e000 con 0x7f9560104590 2024-04-15T21:13:58.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.488+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9550004fd0 con 0x7f9560104590 2024-04-15T21:13:58.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.488+0000 7f95567fc640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 0x7f954c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.488+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f95500b1380 con 0x7f9560104590 2024-04-15T21:13:58.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.488+0000 7f956527c640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 0x7f954c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.489+0000 7f956527c640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 0x7f954c0710e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f955c007dc0 tx=0x7f955c0072f0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.494+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f955007a090 con 0x7f9560104590 2024-04-15T21:13:58.667 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:58 smithi072 ceph-mon[78970]: pgmap v319: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:58.668 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:58 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2541494820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-15T21:13:58.668 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:58 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1523272952' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-15T21:13:58.668 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:58 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3539780292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:13:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.672+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f956010b780 con 0x7f9560104590 2024-04-15T21:13:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.672+0000 7f95567fc640 1 -- 172.21.15.72:0/627695140 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f955007d750 con 0x7f9560104590 2024-04-15T21:13:58.670 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 msgr2=0x7f954c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 0x7f954c0710e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f955c007dc0 tx=0x7f955c0072f0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 msgr2=0x7f9560194870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9550009230 tx=0x7f9550004040 comp rx=0 tx=0).stop 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 shutdown_connections 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f954c06ec30 0x7f954c0710e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9560104590 0x7f9560194870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 --2- 172.21.15.72:0/627695140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95600fe5b0 0x7f9560194330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.674+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 >> 172.21.15.72:0/627695140 conn(0x7f95600743d0 msgr2=0x7f95600fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.675+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 shutdown_connections 2024-04-15T21:13:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.675+0000 7f95674e0640 1 -- 172.21.15.72:0/627695140 wait complete. 2024-04-15T21:13:58.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- 172.21.15.72:0/983818055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1008b0 msgr2=0x7f53cc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 --2- 172.21.15.72:0/983818055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1008b0 0x7f53cc100c80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f53c00098b0 tx=0x7f53c002bcd0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- 172.21.15.72:0/983818055 shutdown_connections 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 --2- 172.21.15.72:0/983818055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1011c0 0x7f53cc1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 --2- 172.21.15.72:0/983818055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1008b0 0x7f53cc100c80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- 172.21.15.72:0/983818055 >> 172.21.15.72:0/983818055 conn(0x7f53cc0fa060 msgr2=0x7f53cc0fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- 172.21.15.72:0/983818055 shutdown_connections 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- 172.21.15.72:0/983818055 wait complete. 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 Processor -- start 2024-04-15T21:13:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.792+0000 7f53d2a81640 1 -- start start 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d2a81640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 0x7f53cc1952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d2a81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d2a81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc195ec0 con 0x7f53cc1011c0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d2a81640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc199c90 con 0x7f53cc1008b0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60938/0 (socket says 172.21.15.72:60938) 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 -- 172.21.15.72:0/616445920 learned_addr learned my addr 172.21.15.72:0/616445920 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d081d640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 0x7f53cc1952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 -- 172.21.15.72:0/616445920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 msgr2=0x7f53cc1952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 0x7f53cc1952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 -- 172.21.15.72:0/616445920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009560 con 0x7f53cc1011c0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d081d640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 0x7f53cc1952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53cbfff640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53b800d8d0 tx=0x7f53b800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b8009c00 con 0x7f53cc1011c0 2024-04-15T21:13:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc199f70 con 0x7f53cc1011c0 2024-04-15T21:13:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53b8009d60 con 0x7f53cc1011c0 2024-04-15T21:13:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.793+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b80049d0 con 0x7f53cc1011c0 2024-04-15T21:13:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.794+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc19a4d0 con 0x7f53cc1011c0 2024-04-15T21:13:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.795+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc04e000 con 0x7f53cc1011c0 2024-04-15T21:13:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.795+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f53b8004c90 con 0x7f53cc1011c0 2024-04-15T21:13:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.795+0000 7f53c9ffb640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 0x7f53bc0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.796+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f53b808ec30 con 0x7f53cc1011c0 2024-04-15T21:13:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.796+0000 7f53d081d640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 0x7f53bc0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.796+0000 7f53d081d640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 0x7f53bc0710e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53c0006010 tx=0x7f53c0005a20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.801+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f53b8057940 con 0x7f53cc1011c0 2024-04-15T21:13:58.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:58 smithi149 ceph-mon[67036]: pgmap v319: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:13:58.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:58 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2541494820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-15T21:13:58.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:58 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1523272952' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-15T21:13:58.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:58 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3539780292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:13:58.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.979+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f53cc106d20 con 0x7f53cc1011c0 2024-04-15T21:13:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.980+0000 7f53c9ffb640 1 -- 172.21.15.72:0/616445920 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f53b805b000 con 0x7f53cc1011c0 2024-04-15T21:13:58.978 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:13:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 msgr2=0x7f53bc0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 0x7f53bc0710e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53c0006010 tx=0x7f53c0005a20 comp rx=0 tx=0).stop 2024-04-15T21:13:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 msgr2=0x7f53cc195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53b800d8d0 tx=0x7f53b800dd90 comp rx=0 tx=0).stop 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 shutdown_connections 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f53bc06ec30 0x7f53bc0710e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53cc1011c0 0x7f53cc195830 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 --2- 172.21.15.72:0/616445920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53cc1008b0 0x7f53cc1952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 >> 172.21.15.72:0/616445920 conn(0x7f53cc0fa060 msgr2=0x7f53cc103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 shutdown_connections 2024-04-15T21:13:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:58.982+0000 7f53d2a81640 1 -- 172.21.15.72:0/616445920 wait complete. 2024-04-15T21:13:58.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 -- 172.21.15.72:0/730787075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 msgr2=0x7ff968100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 --2- 172.21.15.72:0/730787075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff968100e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff958009880 tx=0x7ff95802bd90 comp rx=0 tx=0).stop 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 -- 172.21.15.72:0/730787075 shutdown_connections 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 --2- 172.21.15.72:0/730787075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9681013a0 0x7ff968109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 --2- 172.21.15.72:0/730787075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff968100e60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 -- 172.21.15.72:0/730787075 >> 172.21.15.72:0/730787075 conn(0x7ff9680fa260 msgr2=0x7ff9680fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 -- 172.21.15.72:0/730787075 shutdown_connections 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 -- 172.21.15.72:0/730787075 wait complete. 2024-04-15T21:13:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.100+0000 7ff96de8e640 1 Processor -- start 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff96de8e640 1 -- start start 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff96de8e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff96de8e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9681013a0 0x7ff9680fec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff96de8e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681006e0 con 0x7ff968100a90 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff96de8e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680ff190 con 0x7ff9681013a0 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60946/0 (socket says 172.21.15.72:60946) 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 -- 172.21.15.72:0/1086058915 learned_addr learned my addr 172.21.15.72:0/1086058915 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 -- 172.21.15.72:0/1086058915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9681013a0 msgr2=0x7ff9680fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9681013a0 0x7ff9680fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 -- 172.21.15.72:0/1086058915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009560 con 0x7ff968100a90 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.101+0000 7ff9677fe640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff958009230 tx=0x7ff958004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.102+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9580037c0 con 0x7ff968100a90 2024-04-15T21:13:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.102+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff958004aa0 con 0x7ff968100a90 2024-04-15T21:13:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.102+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9680ff410 con 0x7ff968100a90 2024-04-15T21:13:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.102+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff95803e680 con 0x7ff968100a90 2024-04-15T21:13:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.102+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9681a19c0 con 0x7ff968100a90 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.103+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96804e000 con 0x7ff968100a90 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.103+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff958004dd0 con 0x7ff968100a90 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.104+0000 7ff964ff9640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 0x7ff9500710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.104+0000 7ff966ffd640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 0x7ff9500710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.104+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff9580b1bb0 con 0x7ff968100a90 2024-04-15T21:13:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.104+0000 7ff966ffd640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 0x7ff9500710e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9680ffe80 tx=0x7ff95c005c70 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.108+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff95807a8c0 con 0x7ff968100a90 2024-04-15T21:13:59.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.287+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff9680ffbc0 con 0x7ff968100a90 2024-04-15T21:13:59.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.287+0000 7ff964ff9640 1 -- 172.21.15.72:0/1086058915 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff95807df80 con 0x7ff968100a90 2024-04-15T21:13:59.285 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:13:59.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 msgr2=0x7ff9500710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 0x7ff9500710e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9680ffe80 tx=0x7ff95c005c70 comp rx=0 tx=0).stop 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 msgr2=0x7ff9680fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff958009230 tx=0x7ff958004270 comp rx=0 tx=0).stop 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 shutdown_connections 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff95006ec30 0x7ff9500710e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9681013a0 0x7ff9680fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 --2- 172.21.15.72:0/1086058915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff968100a90 0x7ff9680fe6e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 >> 172.21.15.72:0/1086058915 conn(0x7ff9680fa260 msgr2=0x7ff968104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 shutdown_connections 2024-04-15T21:13:59.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.289+0000 7ff96de8e640 1 -- 172.21.15.72:0/1086058915 wait complete. 2024-04-15T21:13:59.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T21:13:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/951454662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 msgr2=0x7f8bc40feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/951454662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc40feab0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00098b0 tx=0x7f8bc002bcd0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/951454662 shutdown_connections 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/951454662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc40feff0 0x7f8bc4109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/951454662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc40feab0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/951454662 >> 172.21.15.72:0/951454662 conn(0x7f8bc4074d60 msgr2=0x7f8bc4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/951454662 shutdown_connections 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.407+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/951454662 wait complete. 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 Processor -- start 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 -- start start 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc40feff0 0x7f8bc4195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4195ea0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bcb9eb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4199c70 con 0x7f8bc40feff0 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60968/0 (socket says 172.21.15.72:60968) 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 -- 172.21.15.72:0/1934548848 learned_addr learned my addr 172.21.15.72:0/1934548848 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 -- 172.21.15.72:0/1934548848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc40feff0 msgr2=0x7f8bc4195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc40feff0 0x7f8bc4195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.408+0000 7f8bc9787640 1 -- 172.21.15.72:0/1934548848 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009560 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bc9787640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009880 tx=0x7f8bc0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0004520 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc4199ef0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bc0003ab0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0005620 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.409+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc419a450 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.410+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc404e000 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.410+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8bc0004dd0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.411+0000 7f8bba7fc640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 0x7f8bb0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.411+0000 7f8bc8f86640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 0x7f8bb0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.411+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f8bc00b1ad0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.411+0000 7f8bc8f86640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 0x7f8bb0071140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005fd0 tx=0x7f8bb4005850 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.416+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8bc007a7e0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.606+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8bc41966f0 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.606+0000 7f8bba7fc640 1 -- 172.21.15.72:0/1934548848 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2552 (secure 0 0 0) 0x7f8bc0043a10 con 0x7f8bc40fe6e0 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6827/725234987 2024-04-16T21:10:11.893559+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6825/2041346775 2024-04-16T21:09:47.947003+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6824/2041346775 2024-04-16T21:09:47.947003+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/116112383 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2725585914 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3853111144 2024-04-16T20:53:11.112428+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/672367954 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/3638227790 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6828/2367773940 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3176148571 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.604 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6827/3675018183 2024-04-16T20:59:40.349311+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/633056761 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1790774082 2024-04-16T20:52:38.020009+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/3616555058 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2165968680 2024-04-16T20:52:38.020009+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3608699399 2024-04-16T20:54:34.152176+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1845266177 2024-04-16T20:53:11.112428+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3853111144 2024-04-16T20:53:11.112428+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2725585914 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2634029415 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/38200281 2024-04-16T20:53:11.112428+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2719950832 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/322745756 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1391457205 2024-04-16T20:52:38.020009+0000 2024-04-15T21:13:59.605 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3608699399 2024-04-16T20:54:34.152176+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/1474646985 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/4209054147 2024-04-16T20:54:34.152176+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6826/3675018183 2024-04-16T20:59:40.349311+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2673769498 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3446136011 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3446136011 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/4212675791 2024-04-16T20:52:38.020009+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6826/725234987 2024-04-16T21:10:11.893559+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3235340110 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/4212675791 2024-04-16T20:52:38.020009+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2285147601 2024-04-16T21:02:36.125766+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1705002257 2024-04-16T20:54:34.152176+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1498620363 2024-04-16T20:53:11.112428+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6829/2367773940 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.606 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/1305982743 2024-04-16T21:03:31.688419+0000 2024-04-15T21:13:59.607 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1279663585 2024-04-16T20:54:34.152176+0000 2024-04-15T21:13:59.607 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2896202514 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.607 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3948936780 2024-04-16T21:04:34.946072+0000 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:listed 43 entries 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 msgr2=0x7f8bb0071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 0x7f8bb0071140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005fd0 tx=0x7f8bb4005850 comp rx=0 tx=0).stop 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 msgr2=0x7f8bc41952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009880 tx=0x7f8bc0005e70 comp rx=0 tx=0).stop 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 shutdown_connections 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f8bb006ec90 0x7f8bb0071140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc40feff0 0x7f8bc4195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 --2- 172.21.15.72:0/1934548848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc40fe6e0 0x7f8bc41952d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 >> 172.21.15.72:0/1934548848 conn(0x7f8bc4074d60 msgr2=0x7f8bc41042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 shutdown_connections 2024-04-15T21:13:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.608+0000 7f8bcb9eb640 1 -- 172.21.15.72:0/1934548848 wait complete. 2024-04-15T21:13:59.617 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-15T21:13:59.617 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T21:13:59.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 -- 172.21.15.72:0/3351375592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 msgr2=0x7f82540fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 --2- 172.21.15.72:0/3351375592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82540fea10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8244009880 tx=0x7f824402bce0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 -- 172.21.15.72:0/3351375592 shutdown_connections 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 --2- 172.21.15.72:0/3351375592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82540fea10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 --2- 172.21.15.72:0/3351375592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 0x7f82541049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 -- 172.21.15.72:0/3351375592 >> 172.21.15.72:0/3351375592 conn(0x7f8254075270 msgr2=0x7f8254075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 -- 172.21.15.72:0/3351375592 shutdown_connections 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.780+0000 7f825c377640 1 -- 172.21.15.72:0/3351375592 wait complete. 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 Processor -- start 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 -- start start 2024-04-15T21:13:59.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 0x7f8254195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254195d20 con 0x7f82540fe5a0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825c377640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254195e90 con 0x7f82541045d0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825a113640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825a113640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60986/0 (socket says 172.21.15.72:60986) 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f825a113640 1 -- 172.21.15.72:0/1980981426 learned_addr learned my addr 172.21.15.72:0/1980981426 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.781+0000 7f8259912640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 0x7f8254195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825a113640 1 -- 172.21.15.72:0/1980981426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 msgr2=0x7f8254195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825a113640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 0x7f8254195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825a113640 1 -- 172.21.15.72:0/1980981426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244009560 con 0x7f82540fe5a0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825a113640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f825000cc60 tx=0x7f825000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f825000f450 con 0x7f82540fe5a0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f825000fa70 con 0x7f82540fe5a0 2024-04-15T21:13:59.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8254199d20 con 0x7f82540fe5a0 2024-04-15T21:13:59.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8250018b80 con 0x7f82540fe5a0 2024-04-15T21:13:59.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.782+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825419a300 con 0x7f82540fe5a0 2024-04-15T21:13:59.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.783+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825404e000 con 0x7f82540fe5a0 2024-04-15T21:13:59.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.783+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8250018d00 con 0x7f82540fe5a0 2024-04-15T21:13:59.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.784+0000 7f824b7fe640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 0x7f82400711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:13:59.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.784+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f825008f490 con 0x7f82540fe5a0 2024-04-15T21:13:59.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.784+0000 7f8259912640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 0x7f82400711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:13:59.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.784+0000 7f8259912640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 0x7f82400711a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82541967f0 tx=0x7f8244000bc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:13:59.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.788+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f82500581a0 con 0x7f82540fe5a0 2024-04-15T21:13:59.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:59 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/627695140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:59 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/616445920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:13:59 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1086058915' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:59 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/627695140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:59 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/616445920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:13:59 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1086058915' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:13:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.968+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825419a580 con 0x7f82540fe5a0 2024-04-15T21:13:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.969+0000 7f824b7fe640 1 -- 172.21.15.72:0/1980981426 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16902 (secure 0 0 0) 0x7f825005b860 con 0x7f82540fe5a0 2024-04-15T21:13:59.966 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-15T21:13:59.967 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":84,"fsid":"e60a5b86-fb69-11ee-bc8f-c7b262605968","created":"2024-04-15T20:52:07.240333+0000","modified":"2024-04-15T21:10:11.893595+0000","last_up_change":"2024-04-15T21:09:01.856967+0000","last_in_change":"2024-04-15T20:57:51.488063+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T20:56:58.477159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-15T20:59:23.666009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-15T20:59:23.962027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39a59c56-c54d-403d-8359-88c2416aab70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6803","nonce":2753721995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6805","nonce":2753721995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6809","nonce":2753721995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2753721995},{"type":"v1","addr":"172.21.15.72:6807","nonce":2753721995}]},"public_addr":"172.21.15.72:6803/2753721995","cluster_addr":"172.21.15.72:6805/2753721995","heartbeat_back_addr":"172.21.15.72:6809/2753721995","heartbeat_front_addr":"172.21.15.72:6807/2753721995","state":["exists","up"]},{"osd":1,"uuid":"c8f40340-9769-4140-bfb2-eb4deb6efb5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6811","nonce":2300338279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6813","nonce":2300338279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6817","nonce":2300338279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2300338279},{"type":"v1","addr":"172.21.15.72:6815","nonce":2300338279}]},"public_addr":"172.21.15.72:6811/2300338279","cluster_addr":"172.21.15.72:6813/2300338279","heartbeat_back_addr":"172.21.15.72:6817/2300338279","heartbeat_front_addr":"172.21.15.72:6815/2300338279","state":["exists","up"]},{"osd":2,"uuid":"e5817373-e470-4ead-b9ef-2fa3c589decf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6819","nonce":3535754997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6821","nonce":3535754997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6825","nonce":3535754997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3535754997},{"type":"v1","addr":"172.21.15.72:6823","nonce":3535754997}]},"public_addr":"172.21.15.72:6819/3535754997","cluster_addr":"172.21.15.72:6821/3535754997","heartbeat_back_addr":"172.21.15.72:6825/3535754997","heartbeat_front_addr":"172.21.15.72:6823/3535754997","state":["exists","up"]},{"osd":3,"uuid":"8352909c-79a0-4f91-b710-9d1faf18fb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6801","nonce":1868623626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6803","nonce":1868623626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6807","nonce":1868623626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1868623626},{"type":"v1","addr":"172.21.15.149:6805","nonce":1868623626}]},"public_addr":"172.21.15.149:6801/1868623626","cluster_addr":"172.21.15.149:6803/1868623626","heartbeat_back_addr":"172.21.15.149:6807/1868623626","heartbeat_front_addr":"172.21.15.149:6805/1868623626","state":["exists","up"]},{"osd":4,"uuid":"4544ec9f-b3e9-4b15-9f82-b8b8f99089b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6809","nonce":2131908761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6811","nonce":2131908761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6815","nonce":2131908761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2131908761},{"type":"v1","addr":"172.21.15.149:6813","nonce":2131908761}]},"public_addr":"172.21.15.149:6809/2131908761","cluster_addr":"172.21.15.149:6811/2131908761","heartbeat_back_addr":"172.21.15.149:6815/2131908761","heartbeat_front_addr":"172.21.15.149:6813/2131908761","state":["exists","up"]},{"osd":5,"uuid":"618aadbb-c524-42e5-9e80-62a254a5f1d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6817","nonce":185623514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6819","nonce":185623514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6823","nonce":185623514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":185623514},{"type":"v1","addr":"172.21.15.149:6821","nonce":185623514}]},"public_addr":"172.21.15.149:6817/185623514","cluster_addr":"172.21.15.149:6819/185623514","heartbeat_back_addr":"172.21.15.149:6823/185623514","heartbeat_front_addr":"172.21.15.149:6821/185623514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:55:53.155319+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:22.519575+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:56:54.711658+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:17.535794+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:57:42.742336+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T20:58:08.866179+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6827/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.149:6825/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.149:6824/2041346775":"2024-04-16T21:09:47.947003+0000","172.21.15.72:0/116112383":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6800/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.149:0/672367954":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/3638227790":"2024-04-16T21:03:31.688419+0000","172.21.15.149:6828/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/3176148571":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6827/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/633056761":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/1790774082":"2024-04-16T20:52:38.020009+0000","172.21.15.149:0/3616555058":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/2165968680":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6800/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1845266177":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6800/3853111144":"2024-04-16T20:53:11.112428+0000","172.21.15.72:6801/2725585914":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/2634029415":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/38200281":"2024-04-16T20:53:11.112428+0000","172.21.15.72:0/2719950832":"2024-04-16T21:04:34.946072+0000","172.21.15.149:0/322745756":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1391457205":"2024-04-16T20:52:38.020009+0000","172.21.15.72:6801/3608699399":"2024-04-16T20:54:34.152176+0000","172.21.15.149:0/1474646985":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/4209054147":"2024-04-16T20:54:34.152176+0000","172.21.15.72:6826/3675018183":"2024-04-16T20:59:40.349311+0000","172.21.15.72:0/2673769498":"2024-04-16T21:04:34.946072+0000","172.21.15.72:6801/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/3446136011":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6800/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.149:6826/725234987":"2024-04-16T21:10:11.893559+0000","172.21.15.72:0/3235340110":"2024-04-16T21:02:36.125766+0000","172.21.15.72:6801/4212675791":"2024-04-16T20:52:38.020009+0000","172.21.15.72:0/2285147601":"2024-04-16T21:02:36.125766+0000","172.21.15.72:0/1705002257":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/1498620363":"2024-04-16T20:53:11.112428+0000","172.21.15.149:6829/2367773940":"2024-04-16T21:03:31.688419+0000","172.21.15.149:0/1305982743":"2024-04-16T21:03:31.688419+0000","172.21.15.72:0/1279663585":"2024-04-16T20:54:34.152176+0000","172.21.15.72:0/2896202514":"2024-04-16T21:04:34.946072+0000","172.21.15.72:0/3948936780":"2024-04-16T21:04:34.946072+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T21:13:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 msgr2=0x7f82400711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 0x7f82400711a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82541967f0 tx=0x7f8244000bc0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 msgr2=0x7f82541951e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f825000cc60 tx=0x7f825000a620 comp rx=0 tx=0).stop 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 shutdown_connections 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f824006ecf0 0x7f82400711a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82541045d0 0x7f8254195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 --2- 172.21.15.72:0/1980981426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82540fe5a0 0x7f82541951e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 >> 172.21.15.72:0/1980981426 conn(0x7f8254075270 msgr2=0x7f82540fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 shutdown_connections 2024-04-15T21:13:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:13:59.971+0000 7f825c377640 1 -- 172.21.15.72:0/1980981426 wait complete. 2024-04-15T21:13:59.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T20:56:58.477159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-15T20:59:23.666009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-15T20:59:23.962027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T21:13:59.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T21:14:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 -- 172.21.15.72:0/1567496884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4101140 msgr2=0x7f75a4109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 --2- 172.21.15.72:0/1567496884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4101140 0x7f75a4109630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75980098b0 tx=0x7f759802bd60 comp rx=0 tx=0).stop 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 -- 172.21.15.72:0/1567496884 shutdown_connections 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 --2- 172.21.15.72:0/1567496884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4101140 0x7f75a4109630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 --2- 172.21.15.72:0/1567496884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4100830 0x7f75a4100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 -- 172.21.15.72:0/1567496884 >> 172.21.15.72:0/1567496884 conn(0x7f75a40fa060 msgr2=0x7f75a40fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 -- 172.21.15.72:0/1567496884 shutdown_connections 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.092+0000 7f75a9d50640 1 -- 172.21.15.72:0/1567496884 wait complete. 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 Processor -- start 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 -- start start 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 0x7f75a4195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4195f10 con 0x7f75a4100830 2024-04-15T21:14:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a9d50640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4199ce0 con 0x7f75a4101140 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32776/0 (socket says 172.21.15.72:32776) 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.093+0000 7f75a37fe640 1 -- 172.21.15.72:0/3737589620 learned_addr learned my addr 172.21.15.72:0/3737589620 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a2ffd640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 0x7f75a4195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a37fe640 1 -- 172.21.15.72:0/3737589620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 msgr2=0x7f75a4195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a37fe640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 0x7f75a4195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a37fe640 1 -- 172.21.15.72:0/3737589620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009560 con 0x7f75a4100830 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a2ffd640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 0x7f75a4195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a37fe640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f759400d8d0 tx=0x7f759400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7594009c00 con 0x7f75a4100830 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a4199fc0 con 0x7f75a4100830 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7594009d60 con 0x7f75a4100830 2024-04-15T21:14:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75940049d0 con 0x7f75a4100830 2024-04-15T21:14:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.094+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a419a4f0 con 0x7f75a4100830 2024-04-15T21:14:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.095+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a404e000 con 0x7f75a4100830 2024-04-15T21:14:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.096+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7594004c90 con 0x7f75a4100830 2024-04-15T21:14:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.096+0000 7f75a0ff9640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 0x7f758c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.096+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f759408ec30 con 0x7f75a4100830 2024-04-15T21:14:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.096+0000 7f75a2ffd640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 0x7f758c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.097+0000 7f75a2ffd640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 0x7f758c0710e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7598006010 tx=0x7f759802cbc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.101+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7594057940 con 0x7f75a4100830 2024-04-15T21:14:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.279+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75a410c840 con 0x7f75a4100830 2024-04-15T21:14:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.279+0000 7f75a0ff9640 1 -- 172.21.15.72:0/3737589620 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f759405b000 con 0x7f75a4100830 2024-04-15T21:14:00.276 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 msgr2=0x7f758c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 0x7f758c0710e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7598006010 tx=0x7f759802cbc0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 msgr2=0x7f75a4195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f759400d8d0 tx=0x7f759400dd90 comp rx=0 tx=0).stop 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 shutdown_connections 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f758c06ec30 0x7f758c0710e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75a4101140 0x7f75a4195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 --2- 172.21.15.72:0/3737589620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75a4100830 0x7f75a4195340 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 >> 172.21.15.72:0/3737589620 conn(0x7f75a40fa060 msgr2=0x7f75a4103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 shutdown_connections 2024-04-15T21:14:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.281+0000 7f75a9d50640 1 -- 172.21.15.72:0/3737589620 wait complete. 2024-04-15T21:14:00.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-15T21:14:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 -- 172.21.15.72:0/2265392943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 msgr2=0x7f1a6c0ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/2265392943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c0ffce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009880 tx=0x7f1a6002bce0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 -- 172.21.15.72:0/2265392943 shutdown_connections 2024-04-15T21:14:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/2265392943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c0ffce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/2265392943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a6c105880 0x7f1a6c105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 -- 172.21.15.72:0/2265392943 >> 172.21.15.72:0/2265392943 conn(0x7f1a6c0fb370 msgr2=0x7f1a6c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 -- 172.21.15.72:0/2265392943 shutdown_connections 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.399+0000 7f1a72a5c640 1 -- 172.21.15.72:0/2265392943 wait complete. 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 Processor -- start 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 -- start start 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a6c105880 0x7f1a6c195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c196050 con 0x7f1a6c0ff870 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a72a5c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c1961c0 con 0x7f1a6c105880 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32784/0 (socket says 172.21.15.72:32784) 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 -- 172.21.15.72:0/1940520290 learned_addr learned my addr 172.21.15.72:0/1940520290 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 -- 172.21.15.72:0/1940520290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a6c105880 msgr2=0x7f1a6c195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a6c105880 0x7f1a6c195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 -- 172.21.15.72:0/1940520290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009560 con 0x7f1a6c0ff870 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.400+0000 7f1a6bfff640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c8f0 tx=0x7f1a5c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.401+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c0041f0 con 0x7f1a6c0ff870 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.401+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a5c007e10 con 0x7f1a6c0ff870 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.401+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c19a050 con 0x7f1a6c0ff870 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.401+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c00f450 con 0x7f1a6c0ff870 2024-04-15T21:14:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.401+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c19a630 con 0x7f1a6c0ff870 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.402+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c04e000 con 0x7f1a6c0ff870 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.402+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1a5c007950 con 0x7f1a6c0ff870 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.403+0000 7f1a697fa640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 0x7f1a540710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.403+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f1a5c013070 con 0x7f1a6c0ff870 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.403+0000 7f1a6b7fe640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 0x7f1a540710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.403+0000 7f1a6b7fe640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 0x7f1a540710e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1a60036040 tx=0x7f1a60000bc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.407+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1a5c057d10 con 0x7f1a6c0ff870 2024-04-15T21:14:00.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.584+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1a6c066860 con 0x7f1a6c0ff870 2024-04-15T21:14:00.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.584+0000 7f1a697fa640 1 -- 172.21.15.72:0/1940520290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1a5c05b3d0 con 0x7f1a6c0ff870 2024-04-15T21:14:00.581 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:14:00.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 msgr2=0x7f1a540710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 0x7f1a540710e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1a60036040 tx=0x7f1a60000bc0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 msgr2=0x7f1a6c195510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c8f0 tx=0x7f1a5c00cdb0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 shutdown_connections 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f1a5406ec30 0x7f1a540710e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a6c105880 0x7f1a6c195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 --2- 172.21.15.72:0/1940520290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0ff870 0x7f1a6c195510 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 >> 172.21.15.72:0/1940520290 conn(0x7f1a6c0fb370 msgr2=0x7f1a6c0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 shutdown_connections 2024-04-15T21:14:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.586+0000 7f1a72a5c640 1 -- 172.21.15.72:0/1940520290 wait complete. 2024-04-15T21:14:00.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- 172.21.15.72:0/292883506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9480fe580 msgr2=0x7ff9480fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 --2- 172.21.15.72:0/292883506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9480fe580 0x7ff9480fe9f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff938009880 tx=0x7ff93802bce0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- 172.21.15.72:0/292883506 shutdown_connections 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 --2- 172.21.15.72:0/292883506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9480fe580 0x7ff9480fe9f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 --2- 172.21.15.72:0/292883506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9481045b0 0x7ff948104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- 172.21.15.72:0/292883506 >> 172.21.15.72:0/292883506 conn(0x7ff9480fa060 msgr2=0x7ff9480fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- 172.21.15.72:0/292883506 shutdown_connections 2024-04-15T21:14:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- 172.21.15.72:0/292883506 wait complete. 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 Processor -- start 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.703+0000 7ff950171640 1 -- start start 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480fe580 0x7ff948195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948195e60 con 0x7ff9481045b0 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948199c30 con 0x7ff9480fe580 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32792/0 (socket says 172.21.15.72:32792) 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 -- 172.21.15.72:0/2349071716 learned_addr learned my addr 172.21.15.72:0/2349071716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 -- 172.21.15.72:0/2349071716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480fe580 msgr2=0x7ff948195290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94df0d640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480fe580 0x7ff948195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480fe580 0x7ff948195290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 -- 172.21.15.72:0/2349071716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009560 con 0x7ff9481045b0 2024-04-15T21:14:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff94d70c640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff938009230 tx=0x7ff938004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9380035f0 con 0x7ff9481045b0 2024-04-15T21:14:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff938003c10 con 0x7ff9481045b0 2024-04-15T21:14:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948199eb0 con 0x7ff9481045b0 2024-04-15T21:14:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff938005670 con 0x7ff9481045b0 2024-04-15T21:14:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.704+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94819a430 con 0x7ff9481045b0 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.705+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94804e000 con 0x7ff9481045b0 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.706+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff938004dd0 con 0x7ff9481045b0 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.706+0000 7ff93effd640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 0x7ff934071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.706+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff9380b1310 con 0x7ff9481045b0 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.706+0000 7ff94df0d640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 0x7ff934071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.707+0000 7ff94df0d640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 0x7ff934071090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff944005fd0 tx=0x7ff944005850 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.711+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff93807a020 con 0x7ff9481045b0 2024-04-15T21:14:00.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.888+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff9481965e0 con 0x7ff9481045b0 2024-04-15T21:14:00.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.888+0000 7ff93effd640 1 -- 172.21.15.72:0/2349071716 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff93807d6e0 con 0x7ff9481045b0 2024-04-15T21:14:00.886 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 msgr2=0x7ff934071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 0x7ff934071090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff944005fd0 tx=0x7ff944005850 comp rx=0 tx=0).stop 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 msgr2=0x7ff9481957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff938009230 tx=0x7ff938004040 comp rx=0 tx=0).stop 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 shutdown_connections 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7ff93406ebe0 0x7ff934071090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9481045b0 0x7ff9481957d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 --2- 172.21.15.72:0/2349071716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9480fe580 0x7ff948195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 >> 172.21.15.72:0/2349071716 conn(0x7ff9480fa060 msgr2=0x7ff9480683e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 shutdown_connections 2024-04-15T21:14:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:00.890+0000 7ff950171640 1 -- 172.21.15.72:0/2349071716 wait complete. 2024-04-15T21:14:00.897 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:00 smithi072 ceph-mon[78970]: pgmap v320: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:00.897 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:00 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1934548848' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-15T21:14:00.897 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:00 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1980981426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:14:00.898 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:00 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3737589620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:14:00.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T21:14:00.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:00 smithi149 ceph-mon[67036]: pgmap v320: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:00.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:00 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1934548848' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-15T21:14:00.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:00 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1980981426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-15T21:14:00.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:00 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3737589620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 -- 172.21.15.72:0/1181419779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 msgr2=0x7f67600ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 --2- 172.21.15.72:0/1181419779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67600ffcb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6748009880 tx=0x7f674802bce0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 -- 172.21.15.72:0/1181419779 shutdown_connections 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 --2- 172.21.15.72:0/1181419779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67600ffcb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 --2- 172.21.15.72:0/1181419779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 -- 172.21.15.72:0/1181419779 >> 172.21.15.72:0/1181419779 conn(0x7f67600fb320 msgr2=0x7f67600fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 -- 172.21.15.72:0/1181419779 shutdown_connections 2024-04-15T21:14:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.006+0000 7f6764a21640 1 -- 172.21.15.72:0/1181419779 wait complete. 2024-04-15T21:14:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 Processor -- start 2024-04-15T21:14:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 -- start start 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760195fa0 con 0x7f67600ff840 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f6764a21640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760199d70 con 0x7f6760105850 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f675e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.007+0000 7f675e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32812/0 (socket says 172.21.15.72:32812) 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675e59c640 1 -- 172.21.15.72:0/3900670014 learned_addr learned my addr 172.21.15.72:0/3900670014 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675dd9b640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675e59c640 1 -- 172.21.15.72:0/3900670014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 msgr2=0x7f6760195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675e59c640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675e59c640 1 -- 172.21.15.72:0/3900670014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009560 con 0x7f67600ff840 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675dd9b640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f675e59c640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f675800ea20 tx=0x7f675800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675800cdb0 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676019a050 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6758003e30 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67580116a0 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.008+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676019a630 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.009+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676004e000 con 0x7f67600ff840 2024-04-15T21:14:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.009+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6758003970 con 0x7f67600ff840 2024-04-15T21:14:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.010+0000 7f67577fe640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 0x7f674c0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T21:14:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.010+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f675808f430 con 0x7f67600ff840 2024-04-15T21:14:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.010+0000 7f675dd9b640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 0x7f674c0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T21:14:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.010+0000 7f675dd9b640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 0x7f674c0711a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6748005ec0 tx=0x7f6748005fd0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T21:14:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.014+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6758058140 con 0x7f67600ff840 2024-04-15T21:14:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.206+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6760066860 con 0x7f67600ff840 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.206+0000 7f67577fe640 1 -- 172.21.15.72:0/3900670014 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2552 (secure 0 0 0) 0x7f675805b800 con 0x7f67600ff840 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6827/725234987 2024-04-16T21:10:11.893559+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6825/2041346775 2024-04-16T21:09:47.947003+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6824/2041346775 2024-04-16T21:09:47.947003+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/116112383 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2725585914 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3853111144 2024-04-16T20:53:11.112428+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/672367954 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.204 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/3638227790 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6828/2367773940 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3176148571 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6827/3675018183 2024-04-16T20:59:40.349311+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/633056761 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1790774082 2024-04-16T20:52:38.020009+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/3616555058 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2165968680 2024-04-16T20:52:38.020009+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3608699399 2024-04-16T20:54:34.152176+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1845266177 2024-04-16T20:53:11.112428+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3853111144 2024-04-16T20:53:11.112428+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2725585914 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2634029415 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/38200281 2024-04-16T20:53:11.112428+0000 2024-04-15T21:14:01.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2719950832 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/322745756 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1391457205 2024-04-16T20:52:38.020009+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3608699399 2024-04-16T20:54:34.152176+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/1474646985 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/4209054147 2024-04-16T20:54:34.152176+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6826/3675018183 2024-04-16T20:59:40.349311+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2673769498 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3446136011 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3446136011 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/4212675791 2024-04-16T20:52:38.020009+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6826/725234987 2024-04-16T21:10:11.893559+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3235340110 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/4212675791 2024-04-16T20:52:38.020009+0000 2024-04-15T21:14:01.206 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2285147601 2024-04-16T21:02:36.125766+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1705002257 2024-04-16T20:54:34.152176+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1498620363 2024-04-16T20:53:11.112428+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:6829/2367773940 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.149:0/1305982743 2024-04-16T21:03:31.688419+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1279663585 2024-04-16T20:54:34.152176+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2896202514 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3948936780 2024-04-16T21:04:34.946072+0000 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:listed 43 entries 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 msgr2=0x7f674c0711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 0x7f674c0711a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6748005ec0 tx=0x7f6748005fd0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 msgr2=0x7f67601953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f675800ea20 tx=0x7f675800eee0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 shutdown_connections 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:6800/992888162,v1:172.21.15.72:6801/992888162] conn(0x7f674c06ecf0 0x7f674c0711a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6760105850 0x7f6760195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 --2- 172.21.15.72:0/3900670014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67600ff840 0x7f67601953d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T21:14:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 >> 172.21.15.72:0/3900670014 conn(0x7f67600fb320 msgr2=0x7f67600fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T21:14:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 shutdown_connections 2024-04-15T21:14:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-15T21:14:01.209+0000 7f6764a21640 1 -- 172.21.15.72:0/3900670014 wait complete. 2024-04-15T21:14:01.217 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-04-15T21:14:01.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T21:14:01.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-15T21:14:01.246 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T21:14:01.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:01 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/1940520290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:14:01.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:01 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/2349071716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:14:01.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:01 smithi072 ceph-mon[78970]: from='client.? 172.21.15.72:0/3900670014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-15T21:14:01.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:01 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/1940520290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-15T21:14:01.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:01 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/2349071716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-15T21:14:01.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:01 smithi149 ceph-mon[67036]: from='client.? 172.21.15.72:0/3900670014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-15T21:14:02.668 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:02 smithi072 ceph-mon[78970]: pgmap v321: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:02 smithi149 ceph-mon[67036]: pgmap v321: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:04.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:04 smithi072 ceph-mon[78970]: pgmap v322: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:04.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:04 smithi149 ceph-mon[67036]: pgmap v322: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:05.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:05.945 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:06.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:06 smithi072 ceph-mon[78970]: pgmap v323: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:06.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:06 smithi149 ceph-mon[67036]: pgmap v323: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:08.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:08 smithi072 ceph-mon[78970]: pgmap v324: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:08.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:08 smithi149 ceph-mon[67036]: pgmap v324: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:10.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:10 smithi072 ceph-mon[78970]: pgmap v325: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:10.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:10 smithi149 ceph-mon[67036]: pgmap v325: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:12.889 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:12 smithi072 ceph-mon[78970]: pgmap v326: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:12.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:12 smithi149 ceph-mon[67036]: pgmap v326: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:14.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:14 smithi072 ceph-mon[78970]: pgmap v327: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:14.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:14 smithi149 ceph-mon[67036]: pgmap v327: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:16 smithi072 ceph-mon[78970]: pgmap v328: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:14:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:16.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:16 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:16.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:16 smithi149 ceph-mon[67036]: pgmap v328: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:16.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:14:16.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:16.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:16 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:17.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:17 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:14:17.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:17 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:14:17.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:17 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:17.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:17 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:14:17.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:17 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:14:17.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:17 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:14:18.696 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:18 smithi149 ceph-mon[67036]: pgmap v329: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:18.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:18 smithi072 ceph-mon[78970]: pgmap v329: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:20.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:20 smithi072 ceph-mon[78970]: pgmap v330: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:20.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:20.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:20 smithi149 ceph-mon[67036]: pgmap v330: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:20.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:22.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:22 smithi072 ceph-mon[78970]: pgmap v331: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:22.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:22 smithi149 ceph-mon[67036]: pgmap v331: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:24.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:24 smithi072 ceph-mon[78970]: pgmap v332: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:24.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:24 smithi149 ceph-mon[67036]: pgmap v332: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:26.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:26 smithi072 ceph-mon[78970]: pgmap v333: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:26.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:26 smithi149 ceph-mon[67036]: pgmap v333: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:28.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:28 smithi072 ceph-mon[78970]: pgmap v334: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:28.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:28 smithi149 ceph-mon[67036]: pgmap v334: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:30.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:30 smithi072 ceph-mon[78970]: pgmap v335: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:30.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:30 smithi149 ceph-mon[67036]: pgmap v335: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:32.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:32 smithi072 ceph-mon[78970]: pgmap v336: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:32.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:32 smithi149 ceph-mon[67036]: pgmap v336: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:34.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:34 smithi072 ceph-mon[78970]: pgmap v337: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:34.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:34 smithi149 ceph-mon[67036]: pgmap v337: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:35.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:35.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:36.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:36 smithi072 ceph-mon[78970]: pgmap v338: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:36.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:36 smithi149 ceph-mon[67036]: pgmap v338: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:38.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:38 smithi072 ceph-mon[78970]: pgmap v339: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:38.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:38 smithi149 ceph-mon[67036]: pgmap v339: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:40.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:40 smithi072 ceph-mon[78970]: pgmap v340: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:40.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:40 smithi149 ceph-mon[67036]: pgmap v340: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:42.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:42 smithi072 ceph-mon[78970]: pgmap v341: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:42.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:42 smithi149 ceph-mon[67036]: pgmap v341: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:44.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:44 smithi072 ceph-mon[78970]: pgmap v342: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:44.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:44 smithi149 ceph-mon[67036]: pgmap v342: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:46.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:46 smithi072 ceph-mon[78970]: pgmap v343: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:46.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:46 smithi149 ceph-mon[67036]: pgmap v343: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:48.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:48 smithi072 ceph-mon[78970]: pgmap v344: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:48.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:48 smithi149 ceph-mon[67036]: pgmap v344: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:50.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:50 smithi072 ceph-mon[78970]: pgmap v345: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:50.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:50.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:50 smithi149 ceph-mon[67036]: pgmap v345: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:50.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:14:52.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:52 smithi072 ceph-mon[78970]: pgmap v346: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:52.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:52 smithi149 ceph-mon[67036]: pgmap v346: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:54.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:54 smithi072 ceph-mon[78970]: pgmap v347: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:54.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:54 smithi149 ceph-mon[67036]: pgmap v347: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:56.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:56 smithi072 ceph-mon[78970]: pgmap v348: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:56.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:56 smithi149 ceph-mon[67036]: pgmap v348: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:58.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:14:58 smithi149 ceph-mon[67036]: pgmap v349: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:14:59.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:14:58 smithi072 ceph-mon[78970]: pgmap v349: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:00.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:00 smithi149 ceph-mon[67036]: pgmap v350: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:01.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:00 smithi072 ceph-mon[78970]: pgmap v350: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:02.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:02 smithi149 ceph-mon[67036]: pgmap v351: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:03.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:02 smithi072 ceph-mon[78970]: pgmap v351: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:04.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:04 smithi149 ceph-mon[67036]: pgmap v352: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:05.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:04 smithi072 ceph-mon[78970]: pgmap v352: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:05.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:06.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:06.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:06 smithi149 ceph-mon[67036]: pgmap v353: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:07.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:06 smithi072 ceph-mon[78970]: pgmap v353: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:08.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:08 smithi072 ceph-mon[78970]: pgmap v354: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:08.946 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:08 smithi149 ceph-mon[67036]: pgmap v354: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:10.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:10 smithi149 ceph-mon[67036]: pgmap v355: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:11.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:10 smithi072 ceph-mon[78970]: pgmap v355: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:13.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:12 smithi072 ceph-mon[78970]: pgmap v356: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:13.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:12 smithi149 ceph-mon[67036]: pgmap v356: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:15.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:14 smithi072 ceph-mon[78970]: pgmap v357: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:15.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:14 smithi149 ceph-mon[67036]: pgmap v357: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:17.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:16 smithi072 ceph-mon[78970]: pgmap v358: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:17.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:16 smithi149 ceph-mon[67036]: pgmap v358: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:18.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:17 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:15:18.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:17 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:15:18.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: pgmap v359: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:18.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:15:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:15:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:15:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: pgmap v359: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:15:18.982 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:15:21.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:20 smithi072 ceph-mon[78970]: pgmap v360: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:21.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:20 smithi149 ceph-mon[67036]: pgmap v360: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:23.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:22 smithi072 ceph-mon[78970]: pgmap v361: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:23.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:22 smithi149 ceph-mon[67036]: pgmap v361: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:25.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:24 smithi072 ceph-mon[78970]: pgmap v362: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:25.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:24 smithi149 ceph-mon[67036]: pgmap v362: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:26.999 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:26 smithi149 ceph-mon[67036]: pgmap v363: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:27.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:26 smithi072 ceph-mon[78970]: pgmap v363: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:29.076 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:28 smithi149 ceph-mon[67036]: pgmap v364: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:29.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:28 smithi072 ceph-mon[78970]: pgmap v364: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:31.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:30 smithi072 ceph-mon[78970]: pgmap v365: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:31.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:30 smithi149 ceph-mon[67036]: pgmap v365: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:33.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:32 smithi072 ceph-mon[78970]: pgmap v366: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:33.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:32 smithi149 ceph-mon[67036]: pgmap v366: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:35.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:34 smithi072 ceph-mon[78970]: pgmap v367: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:35.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:34 smithi149 ceph-mon[67036]: pgmap v367: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:36.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:36.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:37.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:36 smithi072 ceph-mon[78970]: pgmap v368: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:37.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:36 smithi149 ceph-mon[67036]: pgmap v368: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:39.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:38 smithi072 ceph-mon[78970]: pgmap v369: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:39.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:38 smithi149 ceph-mon[67036]: pgmap v369: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:41.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:40 smithi072 ceph-mon[78970]: pgmap v370: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:41.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:40 smithi149 ceph-mon[67036]: pgmap v370: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:43.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:42 smithi072 ceph-mon[78970]: pgmap v371: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:43.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:42 smithi149 ceph-mon[67036]: pgmap v371: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:45.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:44 smithi072 ceph-mon[78970]: pgmap v372: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:45.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:44 smithi149 ceph-mon[67036]: pgmap v372: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:47.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:46 smithi072 ceph-mon[78970]: pgmap v373: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:47.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:46 smithi149 ceph-mon[67036]: pgmap v373: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:49.168 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:48 smithi072 ceph-mon[78970]: pgmap v374: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:49.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:48 smithi149 ceph-mon[67036]: pgmap v374: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:51.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:50 smithi072 ceph-mon[78970]: pgmap v375: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:51.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:51.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:50 smithi149 ceph-mon[67036]: pgmap v375: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:51.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:15:53.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:52 smithi072 ceph-mon[78970]: pgmap v376: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:53.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:52 smithi149 ceph-mon[67036]: pgmap v376: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:55.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:54 smithi072 ceph-mon[78970]: pgmap v377: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:55.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:54 smithi149 ceph-mon[67036]: pgmap v377: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:57.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:56 smithi072 ceph-mon[78970]: pgmap v378: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:57.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:56 smithi149 ceph-mon[67036]: pgmap v378: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:59.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:15:58 smithi072 ceph-mon[78970]: pgmap v379: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:15:59.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:15:58 smithi149 ceph-mon[67036]: pgmap v379: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:01.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:00 smithi072 ceph-mon[78970]: pgmap v380: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:01.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:00 smithi149 ceph-mon[67036]: pgmap v380: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:03.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:02 smithi072 ceph-mon[78970]: pgmap v381: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:03.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:02 smithi149 ceph-mon[67036]: pgmap v381: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:05.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:04 smithi072 ceph-mon[78970]: pgmap v382: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:05.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:04 smithi149 ceph-mon[67036]: pgmap v382: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:06.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:06.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:07.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:06 smithi072 ceph-mon[78970]: pgmap v383: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:07.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:06 smithi149 ceph-mon[67036]: pgmap v383: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:09.119 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:08 smithi072 ceph-mon[78970]: pgmap v384: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:09.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:08 smithi149 ceph-mon[67036]: pgmap v384: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:11.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:10 smithi072 ceph-mon[78970]: pgmap v385: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:11.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:10 smithi149 ceph-mon[67036]: pgmap v385: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:13.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:12 smithi072 ceph-mon[78970]: pgmap v386: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:13.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:12 smithi149 ceph-mon[67036]: pgmap v386: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:15.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:14 smithi072 ceph-mon[78970]: pgmap v387: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:15.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:14 smithi149 ceph-mon[67036]: pgmap v387: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:17.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:16 smithi072 ceph-mon[78970]: pgmap v388: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:17.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:16 smithi149 ceph-mon[67036]: pgmap v388: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:19.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:18 smithi072 ceph-mon[78970]: pgmap v389: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:19.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:18 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:16:19.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:18 smithi149 ceph-mon[67036]: pgmap v389: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:19.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:18 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:16:19.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:16:19.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:16:19.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:16:20.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:16:20.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:16:20.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:16:21.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:20 smithi072 ceph-mon[78970]: pgmap v390: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:21.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:20 smithi149 ceph-mon[67036]: pgmap v390: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:22.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:21 smithi072 ceph-mon[78970]: pgmap v391: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:22.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:21 smithi149 ceph-mon[67036]: pgmap v391: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:24.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:24 smithi072 ceph-mon[78970]: pgmap v392: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:24.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:24 smithi149 ceph-mon[67036]: pgmap v392: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:26.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:26 smithi149 ceph-mon[67036]: pgmap v393: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:26.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:26 smithi072 ceph-mon[78970]: pgmap v393: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:28.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:28 smithi149 ceph-mon[67036]: pgmap v394: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:28.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:28 smithi072 ceph-mon[78970]: pgmap v394: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:30.697 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:30 smithi149 ceph-mon[67036]: pgmap v395: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:30.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:30 smithi072 ceph-mon[78970]: pgmap v395: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:32.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:32 smithi072 ceph-mon[78970]: pgmap v396: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:32.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:32 smithi149 ceph-mon[67036]: pgmap v396: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:34.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:34 smithi072 ceph-mon[78970]: pgmap v397: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:34.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:34 smithi149 ceph-mon[67036]: pgmap v397: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:35.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:35.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:36.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:36 smithi072 ceph-mon[78970]: pgmap v398: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:36.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:36 smithi149 ceph-mon[67036]: pgmap v398: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:38.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:38 smithi072 ceph-mon[78970]: pgmap v399: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:38.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:38 smithi149 ceph-mon[67036]: pgmap v399: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:40.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:40 smithi072 ceph-mon[78970]: pgmap v400: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:40.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:40 smithi149 ceph-mon[67036]: pgmap v400: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:42.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:42 smithi072 ceph-mon[78970]: pgmap v401: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:42.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:42 smithi149 ceph-mon[67036]: pgmap v401: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:44.815 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:44 smithi149 ceph-mon[67036]: pgmap v402: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:44.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:44 smithi072 ceph-mon[78970]: pgmap v402: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:46.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:46 smithi072 ceph-mon[78970]: pgmap v403: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:46.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:46 smithi149 ceph-mon[67036]: pgmap v403: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:48.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:48 smithi072 ceph-mon[78970]: pgmap v404: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:48.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:48 smithi149 ceph-mon[67036]: pgmap v404: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:50.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:50 smithi072 ceph-mon[78970]: pgmap v405: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:50.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:50.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:50 smithi149 ceph-mon[67036]: pgmap v405: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:50.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:16:52.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:52 smithi072 ceph-mon[78970]: pgmap v406: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:52.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:52 smithi149 ceph-mon[67036]: pgmap v406: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:54.914 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:54 smithi149 ceph-mon[67036]: pgmap v407: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:54.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:54 smithi072 ceph-mon[78970]: pgmap v407: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:56.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:56 smithi072 ceph-mon[78970]: pgmap v408: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:56.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:56 smithi149 ceph-mon[67036]: pgmap v408: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:58.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:16:58 smithi072 ceph-mon[78970]: pgmap v409: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:16:58.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:16:58 smithi149 ceph-mon[67036]: pgmap v409: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:00.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:00 smithi072 ceph-mon[78970]: pgmap v410: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:00.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:00 smithi149 ceph-mon[67036]: pgmap v410: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:02.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:02 smithi072 ceph-mon[78970]: pgmap v411: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:02.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:02 smithi149 ceph-mon[67036]: pgmap v411: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:04.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:04 smithi072 ceph-mon[78970]: pgmap v412: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:04.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:04 smithi149 ceph-mon[67036]: pgmap v412: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:05.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:05.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:06.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:06 smithi072 ceph-mon[78970]: pgmap v413: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:06.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:06 smithi149 ceph-mon[67036]: pgmap v413: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:08.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:08 smithi072 ceph-mon[78970]: pgmap v414: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:08.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:08 smithi149 ceph-mon[67036]: pgmap v414: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:10.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:10 smithi072 ceph-mon[78970]: pgmap v415: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:10.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:10 smithi149 ceph-mon[67036]: pgmap v415: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:12.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:12 smithi072 ceph-mon[78970]: pgmap v416: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:12.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:12 smithi149 ceph-mon[67036]: pgmap v416: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:14.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:14 smithi072 ceph-mon[78970]: pgmap v417: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:14.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:14 smithi149 ceph-mon[67036]: pgmap v417: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:16.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:16 smithi072 ceph-mon[78970]: pgmap v418: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:16.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:16 smithi149 ceph-mon[67036]: pgmap v418: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:18.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:18 smithi072 ceph-mon[78970]: pgmap v419: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:18.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:18 smithi149 ceph-mon[67036]: pgmap v419: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:19.669 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:19 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:17:19.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:19 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:17:20.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:20 smithi072 ceph-mon[78970]: pgmap v420: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:20.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:20.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:17:20.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:17:20.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:17:20.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:20 smithi149 ceph-mon[67036]: pgmap v420: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:20.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:20.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:17:20.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:17:20.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:17:22.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:22 smithi072 ceph-mon[78970]: pgmap v421: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:22.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:22 smithi149 ceph-mon[67036]: pgmap v421: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:24.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:24 smithi072 ceph-mon[78970]: pgmap v422: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:24.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:24 smithi149 ceph-mon[67036]: pgmap v422: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:26.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:26 smithi072 ceph-mon[78970]: pgmap v423: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:26.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:26 smithi149 ceph-mon[67036]: pgmap v423: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:28.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:28 smithi072 ceph-mon[78970]: pgmap v424: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:28.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:28 smithi149 ceph-mon[67036]: pgmap v424: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:30.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:30 smithi072 ceph-mon[78970]: pgmap v425: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:30.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:30 smithi149 ceph-mon[67036]: pgmap v425: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:32.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:32 smithi072 ceph-mon[78970]: pgmap v426: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:32.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:32 smithi149 ceph-mon[67036]: pgmap v426: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:34.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:34 smithi072 ceph-mon[78970]: pgmap v427: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:34.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:34 smithi149 ceph-mon[67036]: pgmap v427: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:35.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:35.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:36.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:36 smithi072 ceph-mon[78970]: pgmap v428: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:36.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:36 smithi149 ceph-mon[67036]: pgmap v428: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:38.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:38 smithi072 ceph-mon[78970]: pgmap v429: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:38.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:38 smithi149 ceph-mon[67036]: pgmap v429: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:40.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:40 smithi072 ceph-mon[78970]: pgmap v430: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:40.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:40 smithi149 ceph-mon[67036]: pgmap v430: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:42.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:42 smithi072 ceph-mon[78970]: pgmap v431: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:42.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:42 smithi149 ceph-mon[67036]: pgmap v431: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:44.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:44 smithi072 ceph-mon[78970]: pgmap v432: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:44.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:44 smithi149 ceph-mon[67036]: pgmap v432: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:46.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:46 smithi072 ceph-mon[78970]: pgmap v433: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:46.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:46 smithi149 ceph-mon[67036]: pgmap v433: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:48.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:48 smithi072 ceph-mon[78970]: pgmap v434: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:48.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:48 smithi149 ceph-mon[67036]: pgmap v434: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:50.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:50 smithi072 ceph-mon[78970]: pgmap v435: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:50.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:50.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:50 smithi149 ceph-mon[67036]: pgmap v435: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:50.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:17:52.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:52 smithi072 ceph-mon[78970]: pgmap v436: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:52.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:52 smithi149 ceph-mon[67036]: pgmap v436: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:54.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:54 smithi072 ceph-mon[78970]: pgmap v437: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:54.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:54 smithi149 ceph-mon[67036]: pgmap v437: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:56.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:56 smithi072 ceph-mon[78970]: pgmap v438: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:56.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:56 smithi149 ceph-mon[67036]: pgmap v438: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:58.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:17:58 smithi072 ceph-mon[78970]: pgmap v439: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:17:58.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:17:58 smithi149 ceph-mon[67036]: pgmap v439: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:00.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:00 smithi072 ceph-mon[78970]: pgmap v440: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:00.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:00 smithi149 ceph-mon[67036]: pgmap v440: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:02.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:02 smithi072 ceph-mon[78970]: pgmap v441: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:02.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:02 smithi149 ceph-mon[67036]: pgmap v441: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:04.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:04 smithi072 ceph-mon[78970]: pgmap v442: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:04.947 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:04 smithi149 ceph-mon[67036]: pgmap v442: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:05.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:05 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:06.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:05 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:06.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:06 smithi149 ceph-mon[67036]: pgmap v443: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:07.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:06 smithi072 ceph-mon[78970]: pgmap v443: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:08.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:08 smithi149 ceph-mon[67036]: pgmap v444: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:09.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:08 smithi072 ceph-mon[78970]: pgmap v444: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:10.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:10 smithi149 ceph-mon[67036]: pgmap v445: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:11.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:10 smithi072 ceph-mon[78970]: pgmap v445: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:12.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:12 smithi149 ceph-mon[67036]: pgmap v446: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:13.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:12 smithi072 ceph-mon[78970]: pgmap v446: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:14.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:14 smithi149 ceph-mon[67036]: pgmap v447: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:14.972 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:14 smithi072 ceph-mon[78970]: pgmap v447: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:16.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:16 smithi149 ceph-mon[67036]: pgmap v448: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:17.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:16 smithi072 ceph-mon[78970]: pgmap v448: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:18.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:18 smithi149 ceph-mon[67036]: pgmap v449: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:19.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:18 smithi072 ceph-mon[78970]: pgmap v449: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:20.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:20 smithi072 ceph-mon[78970]: pgmap v450: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:20.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:20.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:20 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:18:20.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:20 smithi149 ceph-mon[67036]: pgmap v450: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:20.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:20.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:20 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-15T21:18:21.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:18:21.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:18:21.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:21 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:18:22.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-15T21:18:22.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-15T21:18:22.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:21 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' 2024-04-15T21:18:22.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:22 smithi149 ceph-mon[67036]: pgmap v451: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:23.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:22 smithi072 ceph-mon[78970]: pgmap v451: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:25.169 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:24 smithi072 ceph-mon[78970]: pgmap v452: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:25.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:24 smithi149 ceph-mon[67036]: pgmap v452: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:27.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:26 smithi072 ceph-mon[78970]: pgmap v453: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:27.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:26 smithi149 ceph-mon[67036]: pgmap v453: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:29.000 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:28 smithi149 ceph-mon[67036]: pgmap v454: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:29.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:28 smithi072 ceph-mon[78970]: pgmap v454: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:30.920 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:30 smithi072 ceph-mon[78970]: pgmap v455: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:31.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:30 smithi149 ceph-mon[67036]: pgmap v455: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:33.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:32 smithi072 ceph-mon[78970]: pgmap v456: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:33.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:32 smithi149 ceph-mon[67036]: pgmap v456: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:35.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:34 smithi072 ceph-mon[78970]: pgmap v457: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:35.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:34 smithi149 ceph-mon[67036]: pgmap v457: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:36.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:35 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:36.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:35 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:37.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:36 smithi072 ceph-mon[78970]: pgmap v458: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:37.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:36 smithi149 ceph-mon[67036]: pgmap v458: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:39.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:38 smithi072 ceph-mon[78970]: pgmap v459: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:39.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:38 smithi149 ceph-mon[67036]: pgmap v459: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:41.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:40 smithi072 ceph-mon[78970]: pgmap v460: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:41.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:40 smithi149 ceph-mon[67036]: pgmap v460: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:43.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:42 smithi072 ceph-mon[78970]: pgmap v461: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:43.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:42 smithi149 ceph-mon[67036]: pgmap v461: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:45.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:44 smithi072 ceph-mon[78970]: pgmap v462: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:45.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:44 smithi149 ceph-mon[67036]: pgmap v462: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:47.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:46 smithi072 ceph-mon[78970]: pgmap v463: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:47.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:46 smithi149 ceph-mon[67036]: pgmap v463: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:49.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:48 smithi072 ceph-mon[78970]: pgmap v464: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:49.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:48 smithi149 ceph-mon[67036]: pgmap v464: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:51.051 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:50 smithi149 ceph-mon[67036]: pgmap v465: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:51.051 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:50 smithi149 ceph-mon[67036]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:51.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:50 smithi072 ceph-mon[78970]: pgmap v465: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:51.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:50 smithi072 ceph-mon[78970]: from='mgr.34100 172.21.15.72:0/713925516' entity='mgr.smithi072.wfjmmp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-15T21:18:53.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:52 smithi072 ceph-mon[78970]: pgmap v466: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:53.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:52 smithi149 ceph-mon[67036]: pgmap v466: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:55.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:54 smithi072 ceph-mon[78970]: pgmap v467: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:55.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:54 smithi149 ceph-mon[67036]: pgmap v467: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:57.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:56 smithi072 ceph-mon[78970]: pgmap v468: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:57.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:56 smithi149 ceph-mon[67036]: pgmap v468: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:59.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:18:58 smithi072 ceph-mon[78970]: pgmap v469: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:18:59.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:18:58 smithi149 ceph-mon[67036]: pgmap v469: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:19:00.321 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-15T21:19:00.321 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-15T21:19:00.324 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-15T21:19:00.335 INFO:tasks.cephadm:Teardown begin 2024-04-15T21:19:00.336 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/cephadm.py", line 2246, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-15T21:19:00.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-15T21:19:00.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-15T21:19:00.411 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-15T21:19:00.412 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-15T21:19:00.432 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-15T21:19:00.470 INFO:tasks.cephadm:Stopping all daemons... 2024-04-15T21:19:00.470 INFO:tasks.cephadm.mon.smithi072:Stopping mon.smithi072... 2024-04-15T21:19:00.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072 2024-04-15T21:19:00.670 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:00 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:01.149 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:00 smithi149 ceph-mon[67036]: pgmap v470: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:19:01.160 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:00 smithi072 ceph-mon[78970]: pgmap v470: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-15T21:19:01.160 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:00 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[78966]: 2024-04-15T21:19:00.798+0000 7f52d4644700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:01.160 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:00 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072[78966]: 2024-04-15T21:19:00.798+0000 7f52d4644700 -1 mon.smithi072@0(leader) e3 *** Got Signal Terminated *** 2024-04-15T21:19:01.160 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:00 smithi072 podman[129533]: 2024-04-15 21:19:00.870946704 +0000 UTC m=+0.200798007 container died f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-15T21:19:01.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 podman[129533]: 2024-04-15 21:19:01.362080721 +0000 UTC m=+0.691932085 container cleanup f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-15T21:19:01.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 bash[129533]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072 2024-04-15T21:19:01.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service' 2024-04-15T21:19:01.812 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 podman[129558]: 2024-04-15 21:19:01.55647042 +0000 UTC m=+0.690395593 container remove f527ad822106447a2879622886a095e75db2a23952b29e815a3cfc349af24756 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi072, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-15T21:19:01.812 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Deactivated successfully. 2024-04-15T21:19:01.812 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 systemd[1]: Stopped Ceph mon.smithi072 for e60a5b86-fb69-11ee-bc8f-c7b262605968. 2024-04-15T21:19:01.812 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Apr 15 21:19:01 smithi072 systemd[1]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi072.service: Consumed 12.308s CPU time. 2024-04-15T21:19:01.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:01.843 INFO:tasks.cephadm.mon.smithi072:Stopped mon.smithi072 2024-04-15T21:19:01.843 INFO:tasks.cephadm.mon.smithi149:Stopping mon.smithi149... 2024-04-15T21:19:01.843 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi149 2024-04-15T21:19:02.130 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:01 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:02.448 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:02 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149[67032]: 2024-04-15T21:19:02.130+0000 7efc5d42b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:02.448 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:02 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149[67032]: 2024-04-15T21:19:02.130+0000 7efc5d42b700 -1 mon.smithi149@1(peon) e3 *** Got Signal Terminated *** 2024-04-15T21:19:02.448 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:02 smithi149 podman[97571]: 2024-04-15 21:19:02.346201781 +0000 UTC m=+0.307180661 container died 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, ceph=True, org.label-schema.vendor=CentOS) 2024-04-15T21:19:02.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:02 smithi149 podman[97571]: 2024-04-15 21:19:02.815100817 +0000 UTC m=+0.776079746 container cleanup 66d6da20f3a87172f7bcde291ac8bfd8a40e458b5bff48f9ee419cbdc6c879da (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS) 2024-04-15T21:19:02.948 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Apr 15 21:19:02 smithi149 bash[97571]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-mon-smithi149 2024-04-15T21:19:03.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@mon.smithi149.service' 2024-04-15T21:19:03.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:03.292 INFO:tasks.cephadm.mon.smithi149:Stopped mon.smithi149 2024-04-15T21:19:03.292 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-15T21:19:03.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.0 2024-04-15T21:19:03.602 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:03 smithi072 systemd[1]: Stopping Ceph osd.0 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:03.920 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:03 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:19:03.602+0000 7f976cebb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:03.920 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:03 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:19:03.602+0000 7f976cebb700 -1 osd.0 84 *** Got signal Terminated *** 2024-04-15T21:19:03.920 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:03 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0[85512]: 2024-04-15T21:19:03.602+0000 7f976cebb700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:09.273 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:09 smithi072 podman[129665]: 2024-04-15 21:19:09.015497385 +0000 UTC m=+5.529153110 container died dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-15T21:19:09.670 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:09 smithi072 podman[129665]: 2024-04-15 21:19:09.373339992 +0000 UTC m=+5.886995708 container cleanup dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-15T21:19:09.670 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:09 smithi072 bash[129665]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0 2024-04-15T21:19:09.998 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:09 smithi072 podman[129682]: 2024-04-15 21:19:09.678004918 +0000 UTC m=+0.656596332 container remove dc0a45b20f7baeb62226b2d70699634ed0aaf2fac728f0057a4bcd6589cf992a (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-04-15T21:19:10.286 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:09 smithi072 podman[129777]: 2024-04-15 21:19:09.902477984 +0000 UTC m=+0.018042844 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:10.286 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:10 smithi072 podman[129777]: 2024-04-15 21:19:10.030149185 +0000 UTC m=+0.145714044 container create 020bddc08371a3db5ce7735f8bb5bcc1287502bd9ebe436168a51b50b80e7572 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-15T21:19:10.579 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:10 smithi072 podman[129777]: 2024-04-15 21:19:10.287500846 +0000 UTC m=+0.403065707 container init 020bddc08371a3db5ce7735f8bb5bcc1287502bd9ebe436168a51b50b80e7572 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS) 2024-04-15T21:19:10.579 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:10 smithi072 podman[129777]: 2024-04-15 21:19:10.291340318 +0000 UTC m=+0.406905179 container start 020bddc08371a3db5ce7735f8bb5bcc1287502bd9ebe436168a51b50b80e7572 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0) 2024-04-15T21:19:10.579 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:10 smithi072 podman[129777]: 2024-04-15 21:19:10.39585359 +0000 UTC m=+0.511418451 container attach 020bddc08371a3db5ce7735f8bb5bcc1287502bd9ebe436168a51b50b80e7572 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-15T21:19:10.920 INFO:journalctl@ceph.osd.0.smithi072.stdout:Apr 15 21:19:10 smithi072 podman[129777]: 2024-04-15 21:19:10.580811089 +0000 UTC m=+0.696375952 container died 020bddc08371a3db5ce7735f8bb5bcc1287502bd9ebe436168a51b50b80e7572 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-15T21:19:11.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.0.service' 2024-04-15T21:19:11.304 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:11.305 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-15T21:19:11.305 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-15T21:19:11.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.1 2024-04-15T21:19:11.537 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:11 smithi072 systemd[1]: Stopping Ceph osd.1 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:11.920 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:11 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:19:11.667+0000 7f4e6e28a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:11.920 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:11 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:19:11.667+0000 7f4e6e28a700 -1 osd.1 84 *** Got signal Terminated *** 2024-04-15T21:19:11.920 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:11 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1[88854]: 2024-04-15T21:19:11.667+0000 7f4e6e28a700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:17.387 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:17 smithi072 podman[129884]: 2024-04-15 21:19:17.104530908 +0000 UTC m=+5.550812751 container died 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, GIT_BRANCH=HEAD) 2024-04-15T21:19:17.670 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:17 smithi072 podman[129884]: 2024-04-15 21:19:17.480365068 +0000 UTC m=+5.926646893 container cleanup 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:19:17.670 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:17 smithi072 bash[129884]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1 2024-04-15T21:19:18.047 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:17 smithi072 podman[129912]: 2024-04-15 21:19:17.725051097 +0000 UTC m=+0.621249144 container remove 1dae31080e912ac4095623ee1dd1d7b1766155fa99508ef29ffa56e25a998182 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:19:18.373 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:17.951524744 +0000 UTC m=+0.018380505 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:18.373 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:18.06021961 +0000 UTC m=+0.127075386 container create bfaf4290896c1b00ed380beeba3d4be54ea265976bc1c97bc96da2a0f54bb0e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-15T21:19:18.374 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:18.28271775 +0000 UTC m=+0.349573496 container init bfaf4290896c1b00ed380beeba3d4be54ea265976bc1c97bc96da2a0f54bb0e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-04-15T21:19:18.374 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:18.286028099 +0000 UTC m=+0.352883842 container start bfaf4290896c1b00ed380beeba3d4be54ea265976bc1c97bc96da2a0f54bb0e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-15T21:19:18.374 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:18.374757564 +0000 UTC m=+0.441613308 container attach bfaf4290896c1b00ed380beeba3d4be54ea265976bc1c97bc96da2a0f54bb0e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, io.buildah.version=1.33.5) 2024-04-15T21:19:18.670 INFO:journalctl@ceph.osd.1.smithi072.stdout:Apr 15 21:19:18 smithi072 podman[130003]: 2024-04-15 21:19:18.584382862 +0000 UTC m=+0.651238608 container died bfaf4290896c1b00ed380beeba3d4be54ea265976bc1c97bc96da2a0f54bb0e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-15T21:19:19.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.1.service' 2024-04-15T21:19:19.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:19.245 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-15T21:19:19.246 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-15T21:19:19.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.2 2024-04-15T21:19:19.595 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:19 smithi072 systemd[1]: Stopping Ceph osd.2 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:19.920 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:19 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:19:19.595+0000 7f0189511700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:19.920 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:19 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:19:19.595+0000 7f0189511700 -1 osd.2 84 *** Got signal Terminated *** 2024-04-15T21:19:19.920 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:19 smithi072 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2[92153]: 2024-04-15T21:19:19.595+0000 7f0189511700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:25.256 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:24 smithi072 podman[130110]: 2024-04-15 21:19:24.973044915 +0000 UTC m=+5.501940266 container died 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:19:25.610 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:25 smithi072 podman[130110]: 2024-04-15 21:19:25.35845046 +0000 UTC m=+5.887345810 container cleanup 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, GIT_CLEAN=True) 2024-04-15T21:19:25.610 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:25 smithi072 bash[130110]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2 2024-04-15T21:19:25.920 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:25 smithi072 podman[130126]: 2024-04-15 21:19:25.611267616 +0000 UTC m=+0.634732593 container remove 2512963e56db0e40233c42146d0deea69ba3e6d68077dfbe974a028fbc06902e (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2) 2024-04-15T21:19:26.268 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:25 smithi072 podman[130219]: 2024-04-15 21:19:25.929822163 +0000 UTC m=+0.110901740 container create bac33793142010c24cd7e0964aa33788387f6eea9ee8713da89b82df78c4f9ca (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:19:26.269 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:25 smithi072 podman[130219]: 2024-04-15 21:19:25.836976975 +0000 UTC m=+0.018056522 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:26.269 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:26 smithi072 podman[130219]: 2024-04-15 21:19:26.161282412 +0000 UTC m=+0.342361949 container init bac33793142010c24cd7e0964aa33788387f6eea9ee8713da89b82df78c4f9ca (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-15T21:19:26.269 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:26 smithi072 podman[130219]: 2024-04-15 21:19:26.165950872 +0000 UTC m=+0.347030408 container start bac33793142010c24cd7e0964aa33788387f6eea9ee8713da89b82df78c4f9ca (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6) 2024-04-15T21:19:26.269 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:26 smithi072 podman[130219]: 2024-04-15 21:19:26.269742157 +0000 UTC m=+0.450821704 container attach bac33793142010c24cd7e0964aa33788387f6eea9ee8713da89b82df78c4f9ca (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409) 2024-04-15T21:19:26.670 INFO:journalctl@ceph.osd.2.smithi072.stdout:Apr 15 21:19:26 smithi072 podman[130219]: 2024-04-15 21:19:26.467385167 +0000 UTC m=+0.648464711 container died bac33793142010c24cd7e0964aa33788387f6eea9ee8713da89b82df78c4f9ca (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-15T21:19:27.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.2.service' 2024-04-15T21:19:27.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:27.093 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-15T21:19:27.093 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-15T21:19:27.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.3 2024-04-15T21:19:27.384 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:27 smithi149 systemd[1]: Stopping Ceph osd.3 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:27.698 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:27 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:19:27.384+0000 7f09e3383700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:27.698 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:27 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:19:27.384+0000 7f09e3383700 -1 osd.3 84 *** Got signal Terminated *** 2024-04-15T21:19:27.698 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:27 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:19:27.384+0000 7f09e3383700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:30.401 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:30 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:30.015+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:31.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:31 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:31.024+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:31.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:30 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:19:30.938+0000 7f09df977700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:04.899462+0000 front 2024-04-15T21:19:04.899493+0000 (oldest deadline 2024-04-15T21:19:30.799377+0000) 2024-04-15T21:19:31.698 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:31 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:31.638+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:32.198 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:31 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3[72306]: 2024-04-15T21:19:31.918+0000 7f09df977700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:04.899462+0000 front 2024-04-15T21:19:04.899493+0000 (oldest deadline 2024-04-15T21:19:30.799377+0000) 2024-04-15T21:19:32.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:32 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:32.061+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:32.948 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:32 smithi149 podman[97692]: 2024-04-15 21:19:32.748438544 +0000 UTC m=+5.461174811 container died 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-15T21:19:32.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:32 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:32.643+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:33.276 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97692]: 2024-04-15 21:19:33.093017489 +0000 UTC m=+5.805753746 container cleanup 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-87dbfb6) 2024-04-15T21:19:33.277 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 bash[97692]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3 2024-04-15T21:19:33.278 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:33 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:33.077+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:33.598 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97711]: 2024-04-15 21:19:33.277496499 +0000 UTC m=+0.528892270 container remove 2166c959f0699a0a39e57016e9b202cd424e55019d492d5e9ec2c3cd6524921d (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:19:33.946 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:33 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:33.598+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:33.946 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97801]: 2024-04-15 21:19:33.613267983 +0000 UTC m=+0.018258602 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:33.946 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97801]: 2024-04-15 21:19:33.711860071 +0000 UTC m=+0.116850717 container create 0b866ee722e88ccb07f0b3dc17085333c8e921d9a9f1bb24e0c0a2b6395d1b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=main-87dbfb6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-15T21:19:33.946 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97801]: 2024-04-15 21:19:33.947563461 +0000 UTC m=+0.352554061 container init 0b866ee722e88ccb07f0b3dc17085333c8e921d9a9f1bb24e0c0a2b6395d1b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS) 2024-04-15T21:19:34.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:34 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:34.049+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:34.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:33 smithi149 podman[97801]: 2024-04-15 21:19:33.951018004 +0000 UTC m=+0.356008607 container start 0b866ee722e88ccb07f0b3dc17085333c8e921d9a9f1bb24e0c0a2b6395d1b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-15T21:19:34.199 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:34 smithi149 podman[97801]: 2024-04-15 21:19:34.0308383 +0000 UTC m=+0.435828909 container attach 0b866ee722e88ccb07f0b3dc17085333c8e921d9a9f1bb24e0c0a2b6395d1b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-15T21:19:34.566 INFO:journalctl@ceph.osd.3.smithi149.stdout:Apr 15 21:19:34 smithi149 podman[97801]: 2024-04-15 21:19:34.246237754 +0000 UTC m=+0.651228360 container died 0b866ee722e88ccb07f0b3dc17085333c8e921d9a9f1bb24e0c0a2b6395d1b40 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-15T21:19:34.842 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:34 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:34.641+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:34.868 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.3.service' 2024-04-15T21:19:34.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:34.913 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-15T21:19:34.913 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-15T21:19:34.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.4 2024-04-15T21:19:35.198 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:35 smithi149 systemd[1]: Stopping Ceph osd.4 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:35.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:35 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:35.054+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:35.657 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:35 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:35.254+0000 7f0c0b37a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:35.658 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:35 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:35.254+0000 7f0c0b37a700 -1 osd.4 84 *** Got signal Terminated *** 2024-04-15T21:19:35.658 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:35 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:35.254+0000 7f0c0b37a700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:35.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:35 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:35.658+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:36.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:36 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:36.007+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:36.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:36 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:36.665+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:37.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:37 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:37.019+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:37.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:37 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:37.617+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:38.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:38 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:38.030+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:38.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:38 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:38.666+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:38.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:38 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:38.666+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:14.715466+0000 front 2024-04-15T21:19:14.715385+0000 (oldest deadline 2024-04-15T21:19:38.115618+0000) 2024-04-15T21:19:39.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:39 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:39.041+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:39.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:39 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:39.041+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:39.948 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:39 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:39.683+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:08.414372+0000 front 2024-04-15T21:19:08.414420+0000 (oldest deadline 2024-04-15T21:19:30.714185+0000) 2024-04-15T21:19:39.949 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:39 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4[75261]: 2024-04-15T21:19:39.683+0000 7f0c03966700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:14.715466+0000 front 2024-04-15T21:19:14.715385+0000 (oldest deadline 2024-04-15T21:19:38.115618+0000) 2024-04-15T21:19:40.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:40 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:40.040+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:40.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:40 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:40.040+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:40.987 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:40 smithi149 podman[97907]: 2024-04-15 21:19:40.720348546 +0000 UTC m=+5.577730662 container died 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-15T21:19:41.371 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[97907]: 2024-04-15 21:19:41.087814858 +0000 UTC m=+5.945197018 container cleanup 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-87dbfb6, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:19:41.371 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 bash[97907]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4 2024-04-15T21:19:41.371 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:41 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:41.028+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:41.372 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:41 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:41.028+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:41.698 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[97924]: 2024-04-15 21:19:41.372424288 +0000 UTC m=+0.647233783 container remove 8023b75068f1ead7c7d845e420b76ca727c4868d052ca975d822f56b5a608afd (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409) 2024-04-15T21:19:41.979 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[98018]: 2024-04-15 21:19:41.614576464 +0000 UTC m=+0.017974038 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:41.980 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[98018]: 2024-04-15 21:19:41.715053057 +0000 UTC m=+0.118450676 container create 481dc49840ccdfd249b7411185b3c2b7617f68ccbfe48cc8ae83fea58472e7e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-15T21:19:41.980 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[98018]: 2024-04-15 21:19:41.925829503 +0000 UTC m=+0.329227059 container init 481dc49840ccdfd249b7411185b3c2b7617f68ccbfe48cc8ae83fea58472e7e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:19:41.980 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:41 smithi149 podman[98018]: 2024-04-15 21:19:41.929191244 +0000 UTC m=+0.332588803 container start 481dc49840ccdfd249b7411185b3c2b7617f68ccbfe48cc8ae83fea58472e7e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, RELEASE=main-87dbfb6, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-15T21:19:42.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:41 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:41.978+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:42.449 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:41 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:41.978+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:42.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:42 smithi149 podman[98018]: 2024-04-15 21:19:42.009005029 +0000 UTC m=+0.412402586 container attach 481dc49840ccdfd249b7411185b3c2b7617f68ccbfe48cc8ae83fea58472e7e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-87dbfb6, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-15T21:19:42.449 INFO:journalctl@ceph.osd.4.smithi149.stdout:Apr 15 21:19:42 smithi149 podman[98018]: 2024-04-15 21:19:42.218424455 +0000 UTC m=+0.621822011 container died 481dc49840ccdfd249b7411185b3c2b7617f68ccbfe48cc8ae83fea58472e7e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-4-deactivate, RELEASE=main-87dbfb6, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=) 2024-04-15T21:19:42.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.4.service' 2024-04-15T21:19:42.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:42.866 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-15T21:19:42.866 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-15T21:19:42.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.5 2024-04-15T21:19:43.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:42 smithi149 systemd[1]: Stopping Ceph osd.5 for e60a5b86-fb69-11ee-bc8f-c7b262605968... 2024-04-15T21:19:43.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:42 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:42.959+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:43.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:42 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:42.959+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:43.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:43.197+0000 7f50b49a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-15T21:19:43.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:43.197+0000 7f50b49a9700 -1 osd.5 84 *** Got signal Terminated *** 2024-04-15T21:19:43.199 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:43.197+0000 7f50b49a9700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-15T21:19:44.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:43.924+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:44.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:43 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:43.924+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:45.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:44 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:44.972+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:45.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:44 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:44.972+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:46.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:45 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:45.973+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:46.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:45 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:45.973+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:47.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:46 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:46.961+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:47.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:46 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:46.961+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:48.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:47.996+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-04-15T21:19:07.100192+0000 front 2024-04-15T21:19:07.100236+0000 (oldest deadline 2024-04-15T21:19:29.300672+0000) 2024-04-15T21:19:48.448 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:47 smithi149 ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5[78228]: 2024-04-15T21:19:47.996+0000 7f50b0f9d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-04-15T21:19:12.702089+0000 front 2024-04-15T21:19:12.702121+0000 (oldest deadline 2024-04-15T21:19:38.601875+0000) 2024-04-15T21:19:48.889 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:48 smithi149 podman[98124]: 2024-04-15 21:19:48.584342464 +0000 UTC m=+5.493627849 container died de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-15T21:19:49.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:48 smithi149 podman[98124]: 2024-04-15 21:19:48.890128014 +0000 UTC m=+5.799413385 container cleanup de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-15T21:19:49.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:48 smithi149 bash[98124]: ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5 2024-04-15T21:19:49.198 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98141]: 2024-04-15 21:19:49.108126078 +0000 UTC m=+0.524422265 container remove de705959353720f2743f51e632f7109b13496cf2ae1851d6ab955f0c58345e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-87dbfb6, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:19:49.698 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98233]: 2024-04-15 21:19:49.336547725 +0000 UTC m=+0.018190169 image pull a452a57266c718c37049de4c2da9a5e566bb7b9c6db62908ada4c8b0e854997b quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f 2024-04-15T21:19:49.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98233]: 2024-04-15 21:19:49.458942939 +0000 UTC m=+0.140585384 container create a24c4a4ff514a2a931e9b518a6f4afd6c6ee90bc06d5c1001b130028710d1e5f (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-87dbfb6) 2024-04-15T21:19:50.014 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98233]: 2024-04-15 21:19:49.719744401 +0000 UTC m=+0.401386845 container init a24c4a4ff514a2a931e9b518a6f4afd6c6ee90bc06d5c1001b130028710d1e5f (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-87dbfb6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-15T21:19:50.015 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98233]: 2024-04-15 21:19:49.723318669 +0000 UTC m=+0.404961119 container start a24c4a4ff514a2a931e9b518a6f4afd6c6ee90bc06d5c1001b130028710d1e5f (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-87dbfb6, ceph=True, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-15T21:19:50.015 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:49 smithi149 podman[98233]: 2024-04-15 21:19:49.819862963 +0000 UTC m=+0.501505430 container attach a24c4a4ff514a2a931e9b518a6f4afd6c6ee90bc06d5c1001b130028710d1e5f (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240409, RELEASE=main-87dbfb6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True) 2024-04-15T21:19:50.305 INFO:journalctl@ceph.osd.5.smithi149.stdout:Apr 15 21:19:50 smithi149 podman[98233]: 2024-04-15 21:19:50.015734535 +0000 UTC m=+0.697376986 container died a24c4a4ff514a2a931e9b518a6f4afd6c6ee90bc06d5c1001b130028710d1e5f (image=quay.ceph.io/ceph-ci/ceph@sha256:386dcbdb0b8a78b880705c56a17f715946e178c298e478ab4b58fddb8072ae6f, name=ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-87dbfb6, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-15T21:19:50.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e60a5b86-fb69-11ee-bc8f-c7b262605968@osd.5.service' 2024-04-15T21:19:50.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-15T21:19:50.636 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-15T21:19:50.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 --force --keep-logs 2024-04-15T21:19:50.798 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:19:55.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[67138]: fuse finished with error 0 and tester_r 0 2024-04-15T21:20:15.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 --force --keep-logs 2024-04-15T21:20:15.307 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:20:30.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-15T21:20:30.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-15T21:20:30.450 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-15T21:20:30.452 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi072/crash 2024-04-15T21:20:30.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash -- . 2024-04-15T21:20:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash: Cannot open: No such file or directory 2024-04-15T21:20:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now 2024-04-15T21:20:30.492 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi149/crash 2024-04-15T21:20:30.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash -- . 2024-04-15T21:20:30.520 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/crash: Cannot open: No such file or directory 2024-04-15T21:20:30.521 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-04-15T21:20:30.521 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-15T21:20:30.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-15T21:20:30.567 INFO:tasks.cephadm:Compressing logs... 2024-04-15T21:20:30.567 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T21:20:30.609 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi072.log 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi072.wfjmmp.log 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi072.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log 2024-04-15T21:20:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.pbknte.log 2024-04-15T21:20:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi072.wfjmmp.log: /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi072.log 2024-04-15T21:20:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.pbknte.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.1.log 2024-04-15T21:20:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi072.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.zkrubp.log 2024-04-15T21:20:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi072.log.gz 2024-04-15T21:20:30.641 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log.gz 2024-04-15T21:20:30.643 INFO:teuthology.orchestra.run.smithi072.stderr: 94.3% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.pbknte.log.gz 2024-04-15T21:20:30.649 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-15T21:20:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.0.log 2024-04-15T21:20:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.zkrubp.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log 2024-04-15T21:20:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log 2024-04-15T21:20:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log: 85.9% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log.gz 2024-04-15T21:20:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.2.log 2024-04-15T21:20:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log: 88.4% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log.gz 2024-04-15T21:20:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log 2024-04-15T21:20:30.660 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-15T21:20:30.660 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.mflbpn.log 2024-04-15T21:20:30.660 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.jwobda.log 2024-04-15T21:20:30.660 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.mflbpn.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi149.qgbaiy.log 2024-04-15T21:20:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.2.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.jwobda.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi149.qgbaiy.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.4.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.5.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.3.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.4.log: /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi149.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi149.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi149.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi149.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-15T21:20:30.664 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log: /var/log/ceph/ceph-client.1.log: 94.3% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-client.ceph-exporter.smithi149.log.gz 2024-04-15T21:20:30.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log: 91.7% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log.gz 2024-04-15T21:20:30.778 INFO:teuthology.orchestra.run.smithi149.stderr: 85.9% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.cephadm.log.gz 2024-04-15T21:20:30.788 INFO:teuthology.orchestra.run.smithi149.stderr: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-15T21:20:30.829 INFO:teuthology.orchestra.run.smithi149.stderr: 88.4% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.log.gz 2024-04-15T21:20:30.839 INFO:teuthology.orchestra.run.smithi149.stderr: 91.9% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-volume.log.gz 2024-04-15T21:20:30.896 INFO:teuthology.orchestra.run.smithi149.stderr: 91.6% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph.audit.log.gz 2024-04-15T21:20:30.932 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi072.wfjmmp.log.gz 2024-04-15T21:20:31.405 INFO:teuthology.orchestra.run.smithi149.stderr: 89.3% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mgr.smithi149.qgbaiy.log.gz 2024-04-15T21:20:31.871 INFO:teuthology.orchestra.run.smithi072.stderr: 90.4% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi072.log.gz 2024-04-15T21:20:32.460 INFO:teuthology.orchestra.run.smithi149.stderr: 92.6% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mon.smithi149.log.gz 2024-04-15T21:20:34.982 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.0.log.gz 2024-04-15T21:20:35.207 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.1.log.gz 2024-04-15T21:20:35.653 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.2.log.gz 2024-04-15T21:20:36.765 INFO:teuthology.orchestra.run.smithi149.stderr: 94.8% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.jwobda.log.gz 2024-04-15T21:20:38.034 INFO:teuthology.orchestra.run.smithi072.stderr: 94.8% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi072.zkrubp.log.gz 2024-04-15T21:20:43.219 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.5.log.gz 2024-04-15T21:20:44.493 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-15T21:20:44.494 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-15T21:20:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m13.872s 2024-04-15T21:20:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m35.446s 2024-04-15T21:20:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m1.237s 2024-04-15T21:20:44.699 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-15T21:20:44.699 INFO:teuthology.orchestra.run.smithi149.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-15T21:20:45.333 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.4.log.gz 2024-04-15T21:20:50.700 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-osd.3.log.gz 2024-04-15T21:22:11.362 INFO:teuthology.orchestra.run.smithi149.stderr: 92.6% -- replaced with /var/log/ceph/e60a5b86-fb69-11ee-bc8f-c7b262605968/ceph-mds.cephfs.smithi149.mflbpn.log.gz 2024-04-15T21:22:11.364 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-04-15T21:22:11.364 INFO:teuthology.orchestra.run.smithi149.stderr:real 1m40.739s 2024-04-15T21:22:11.364 INFO:teuthology.orchestra.run.smithi149.stderr:user 1m53.764s 2024-04-15T21:22:11.364 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m3.912s 2024-04-15T21:22:11.365 INFO:tasks.cephadm:Archiving logs... 2024-04-15T21:22:11.365 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi072/log 2024-04-15T21:22:11.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T21:22:16.308 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi149/log 2024-04-15T21:22:16.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T21:22:34.891 INFO:tasks.cephadm:Removing cluster... 2024-04-15T21:22:34.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 --force 2024-04-15T21:22:35.051 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:22:35.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e60a5b86-fb69-11ee-bc8f-c7b262605968 --force 2024-04-15T21:22:35.522 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: e60a5b86-fb69-11ee-bc8f-c7b262605968 2024-04-15T21:22:35.888 INFO:tasks.cephadm:Removing cephadm ... 2024-04-15T21:22:35.888 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-15T21:22:35.905 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-15T21:22:35.921 INFO:tasks.cephadm:Teardown complete 2024-04-15T21:22:35.921 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T21:22:35.936 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-15T21:22:35.937 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T21:22:35.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T21:22:35.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T21:22:36.039 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T21:22:36.050 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T21:22:36.050 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T21:22:36.053 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T21:22:36.067 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-04-15T21:22:36.068 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +681us[ +685us] +/- 50ms 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -347us[ -343us] +/- 75ms 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -782us[ -782us] +/- 84ms 2024-04-15T21:22:36.072 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T21:22:36.088 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T21:22:36.088 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-04-15T21:22:36.088 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +678us[ +672us] +/- 50ms 2024-04-15T21:22:36.088 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -348us[ -354us] +/- 75ms 2024-04-15T21:22:36.088 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -801us[ -807us] +/- 84ms 2024-04-15T21:22:36.089 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T21:22:36.089 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T21:22:36.100 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T21:22:36.101 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T21:22:36.116 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T21:22:36.206 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T21:22:36.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T21:22:36.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T21:22:36.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T21:22:36.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T21:22:36.384 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T21:22:36.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T21:22:36.436 INFO:teuthology.task.internal:Duration was 2272.198599 seconds 2024-04-15T21:22:36.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T21:22:36.469 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T21:22:36.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T21:22:36.472 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T21:22:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T21:22:36.542 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T21:22:37.002 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T21:22:37.002 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-04-15T21:22:37.002 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T21:22:37.024 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-04-15T21:22:37.024 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T21:22:37.057 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T21:22:37.057 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T21:22:37.067 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T21:22:37.128 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T21:22:37.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T21:22:37.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T21:22:37.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T21:22:37.807 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T21:22:37.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T21:22:37.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T21:22:37.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T21:22:37.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T21:22:37.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T21:22:37.929 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-04-15T21:22:37.941 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-04-15T21:22:37.966 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T21:22:38.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T21:22:38.012 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T21:22:38.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T21:22:38.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T21:22:38.039 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T21:22:38.040 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi072 2024-04-15T21:22:38.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T21:22:38.107 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306/remote/smithi149 2024-04-15T21:22:38.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T21:22:38.151 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T21:22:38.151 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T21:22:38.154 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T21:22:38.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T21:22:38.215 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T21:22:38.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T21:22:38.260 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T21:22:38.260 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T21:22:38.263 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T21:22:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 15 21:22 /home/ubuntu/cephtest 2024-04-15T21:22:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: 550130 4 d--------- 2 ubuntu ubuntu 4096 Apr 15 20:59 /home/ubuntu/cephtest/mnt.0 2024-04-15T21:22:38.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T21:22:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-15T21:22:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-15T21:22:38.277 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_3f7db60e5ba4c4d053b594b7ec58703d2833c55b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-15T21:22:38.278 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T21:22:38.291 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T21:22:38.322 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-15T21:22:38.322 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T21:22:38.350 DEBUG:teuthology.nuke:shortname: smithi072 2024-04-15T21:22:38.350 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T21:22:38.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 20:35:08.029002', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6Hz/i97QUFumPxqikZ7dlk2dpRqoQgKvorGZQJHpuz47+p2nRTz500YphP2Rv4HQE3dZ6SgEHH+wMIL5OKrA4='} 2024-04-15T21:22:38.377 DEBUG:teuthology.nuke:shortname: smithi149 2024-04-15T21:22:38.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T21:22:38.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 20:35:08.030578', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEkPXIFBn/nQd4yinAwGDZ8AxAGWxd9VHtmEqxVsJF5LOugu4wjMmSEpsvMR3IoHSExS97yv+iAX7F6gygp4+y8='} 2024-04-15T21:22:38.427 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-15T21:22:38.428 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T21:22:38.454 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-15T21:22:38.454 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:38.470 INFO:teuthology.orchestra.console.smithi149:Power off 2024-04-15T21:22:38.470 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T21:22:38.479 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-15T21:22:38.492 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-04-15T21:22:38.492 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:38.516 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-04-15T21:22:42.481 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:42.517 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:42.594 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-15T21:22:42.627 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-04-15T21:22:46.598 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:46.628 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:46.708 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-15T21:22:46.738 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-04-15T21:22:46.810 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-15T21:22:50.742 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T21:22:50.852 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-04-15T21:22:50.953 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-04-15T21:22:51.057 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2272.198599100113 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-15T21:22:51.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T21:22:51.148 INFO:teuthology.run:FAIL